Pick Intelligems if price, shipping threshold and offer testing is the point and you want results read as profit per visitor. Pick Shoplift if you test themes and templates inside the Shopify theme customizer and want to apply winners in one click. Pick Variant if you want AI agents to propose and build the tests for your team to approve. Pick Visually if you want a visual editor and personalization on monthly tiers set by order count, and Convert.com if you have a developer and need split URL, multivariate and full-stack tests beyond the storefront.
The five at a glance
Every tool here is sold as A/B testing. They are not substitutes. Two test prices, one tests themes, one writes the tests for you, one is a general experimentation platform with a Shopify app.
 Intelligems |  Shoplift |  Variant |  Visually |  Convert.com | |
|---|---|---|---|---|---|
| Built for | Shopify merchants with or without developers, priced on sitewide order volume | Shopify merchants including Plus, plus agencies running several stores | Consumer and ecommerce brands; the vendor does not state merchant size | Shopify merchants, with listed plans running up to 600 orders | Growth for smaller businesses, Pro for mid-sized enterprises, Enterprise for large enterprises |
| What it tests | Prices, content, offers, shipping rates, checkout and post-purchase | Themes, templates and URLs, with price testing on Advanced | Landing pages, product pages and cart, via AI agents your team approves | Full-funnel tests from first click to checkout, plus merchandising and upsells | A/B, split URL, multivariate, multipage and full-stack, plus personalization |
| Pricing shape | Free plan, then monthly tiers that scale with sitewide order volume; the top plan has a 3-month minimum | Three plans priced by monthly unique visitors, annual or monthly; free trial and a free plan listed | Not published; demo request only | Free plan for dev stores, then monthly tiers by order count | Monthly tiers by tested users, annual Enterprise on request; Shopify app free to install with an account |
| Strongest at | Reading a test as profit per visitor | Theme and template tests set up without custom design or dev work | Turning research into built, on-brand experiments your team only has to approve | Speed to first test; the vendor cites an average of four hours from install | Test types the storefront-only tools do not cover, and a long integrations list |
| Support shape | Unlimited adds live guided onboarding, a storefront audit and roadmap, and a dedicated CSM | Core has email and chat; Pro adds a merchant success manager, Slack channel and quarterly business reviews | Team approves every launch; demo form answered within 24 hours | Chat support on all plans | Onboarding on all plans: snippet install, first project, an A/A test and goals |
| Most common reason teams drop it | Cost relative to what testing returns at their volume, and product duplication cluttering the catalog | Nobody has the capacity to run tests, so the subscription sits idle | Tests coming back inconclusive | Flicker and trouble with redirect tests | Migration to other experimentation platforms |
Intelligems
Intelligems is the one to buy if the variable you care about is price, discount depth, a free shipping threshold or a post-purchase offer. The modules split that way: Smart Content for pages, themes and content, Smart Merchandising for discounts, upsells, bundles and gift with purchase, Smart Shipping for flat, weight and zone rates. Unlimited adds pricing, checkout and post-purchase plus uncapped AI usage. Atlas, the AI layer, suggests tests, helps build them and answers questions about results.
Results report as profit per visitor, which matters when a price test wins on conversion and loses on margin. The listing carries a Built for Shopify badge, a 4.8 rating across 199 reviews, and a free plan before the paid tiers. It connects to Claude, ChatGPT, Gemini, Klaviyo, Slack, Microsoft Clarity, Hotjar, Segment, Snowflake and BigQuery.
Two things push teams off it. Cost is one: at modest testing volume the spend is hard to justify against the rest of the stack. The other is operational. Price testing creates duplicate product records, and merchandising and IT teams notice when several versions of one product appear on the site. Ask how the vendor handles that before you launch a catalog-wide price test. 12th Tribe and 1st Phorm both run Intelligems on their storefronts.
Shoplift
Shoplift works inside the Shopify theme customizer. You change a theme or template, split traffic, read a Bayesian result and apply the winner in one click. Core covers template, theme and URL tests with mobile versus desktop segmentation. Advanced adds price testing, audience segmentation, GA4 integration and exports, subscription testing and API access for use with Claude and ChatGPT. Pro adds a dedicated merchant success manager, twice-monthly strategy sessions, a storefront audit and roadmap, a dedicated Slack channel and a quarterly business review, and is annual only.
The listing shows a 4.9 rating across 134 reviews and a free plan, and the site offers a 14-day trial on any plan. It supports all Shopify themes, though editing options may be limited on legacy Online Store 1.0 themes.
The failure mode is staffing. Theme testing still needs someone to decide what to test, build the variant and call the result. Where no one owns that, the app sits installed and unused, and then it gets cut. If you cannot name the person running tests next quarter, buy the plan with the success manager or do not buy yet.
Variant
Variant sells the missing person. A Research Agent reads shopper behavior and ad context and proposes what to test. A Dev Agent designs and codes the experiment on brand. Your team reviews and approves every change before it launches. Compounding Intelligence stores what each test taught so later recommendations build on it. The targets are landing pages, product pages and cart.
This is the right shape for a team with a testing budget and no build capacity, and it is the only tool here whose agents code the variant for you. Two cautions. Pricing is not published, so you go through a demo; the site says demo requests are answered within 24 hours, and a Data Processing Addendum is available. And agent-generated tests can land inconclusive, same as human-generated ones. Judge it on whether its recommendations beat the ones your merchandising or personalization tools already produce, and run that comparison on a page that gets real traffic.
Visually
Visually.io gives you an AI-powered visual editor, full-funnel tests from first click through checkout, personalization by segment using catalog and behavior data, merchandising with more than a dozen pre-built algorithms, and a Bayesian analytics engine reporting Shopify-native KPIs. The vendor says no code is needed and cites an average of four hours between install and first test. The listing shows a 4.8 rating across 147 reviews.
Pricing is set a different way. The App Store tiers are free for development stores, then three monthly tiers by order count, topping out at up to 600 orders. That is a different buyer from the one on an order-volume-scaled Intelligems plan, so confirm what your volume costs before you compare it to anything else here.
The thing to test for in a trial is rendering. Redirect tests and flicker are where it has given teams trouble, and flicker on a product page is worse than running no test at all. Set up your messiest redirect test on day one, not your cleanest copy test.
Convert.com
Convert Experiences is a general experimentation platform with a Shopify app attached. It covers A/B, split URL, multivariate, multipage and full-stack testing plus personalization. Convert Signals filters session recordings to interactions showing signs of frustration. Convert Intelligence, in beta, runs experimentation tasks from prompts, and an MCP server lets testers drive the platform from their own AI tools with tiered permissions. The integration list runs long, including Adobe Analytics, Amplitude, ContentSquare, FullStory and Google Analytics.
Plans are priced by monthly tested users: Growth, Pro, and an annual Enterprise tier on request. There is a 15-day trial with no card, onboarding on every plan covering snippet install, first project, an A/A test, goals and integrations, and data is stored on servers in Frankfurt. The Shopify app is free to install but requires a Convert.com account.
It fits teams with a developer who sets up tests. Full-stack and split URL work is what you pay for, and if your roadmap is really theme and price tests, a Shopify-native tool is less work. Movement away from Convert tends to go toward other experimentation platforms rather than toward no testing at all.
How to decide
For how we identify apps on a storefront, see how we count.
Questions people ask
Which A/B testing tool should I use if I want to test prices on Shopify?
Intelligems is built around it: Smart Pricing sits on the Unlimited plan alongside shipping, checkout and post-purchase testing, and results report as profit per visitor, so a win on conversion that loses margin shows up. Shoplift also offers price testing, on its Advanced plan. One thing to plan for with price testing: it creates duplicate product records, which your catalog and IT teams will notice.
Do I need a developer to run A/B tests on a Shopify store?
Not for most of these. Shoplift works inside the Shopify theme customizer and is meant to let teams test without custom design or development work. Visually says no code is needed and cites an average of four hours from install to first test. Variant has AI agents design and code experiments for your team to approve. Convert.com is the one where a developer setting up tests is the common pattern, and it is also the one that covers full-stack and multivariate testing.
Why do Shopify brands stop using their A/B testing app?
Three reasons recur. Capacity: nobody owns the test calendar, so the app sits installed and unused until the budget line gets cut. Cost against return: at low test volume the subscription is hard to justify next to the rest of the stack. And technical friction: flicker and failing redirect tests, or duplicate product records piling up from price tests. Check the first one before you check pricing, because it is the one no vendor can fix for you.
