When to use it
- Storewide tests. See whether a theme or template test helped your hero collection, not just the whole store.
- Price tests across many products. Filter to the tested products, then open the per-product breakdown to see which products drove the lift.
- A recurring focus set. Build a “Best sellers” group once and apply it to every test.
How it works
The test still splits visitors randomly between control and variants. A product group only filters which sessions and which products in each order count toward the dashboard numbers.- Apply a group on a test’s Analytics dashboard.
- A session counts when the visitor viewed a group product; each step (product view, add to cart, checkout, purchase) counts when it involved a group product.
- Revenue and profit count only the group’s products in each order, never the whole order.
- Collection, tag, and product type groups stay in sync as your catalog changes in Shopify.
- A Product tab appears in the breakdown table with per-product rows.
The test splits visitors randomly, not products, and visitors choose what they view, so per-product results are noisier than the test-level verdict. Read them as signals of where the lift came from.
Setup
Price tests come with a built-in group of the tested products, marked In this test in the Filters modal. No setup needed.
Create a group
- In ABConvert, open Settings and find the Product Groups card.
- Click Manage Product Groups, then Create group.
- Pick a source: Specific products, Collection, Tag, or Product type. The last three update automatically with your catalog; Specific products is a fixed list.
- Name the group and save it.


Apply it on the Analytics dashboard
- Open the test’s Analytics dashboard and click the Filters icon.
- Under Product group, pick a group. All products means no filter; a price test also shows its built-in group marked In this test here.
- Click Apply. A Filtered to: pill shows the active group, and the selection is saved per test.


Break results down per product
While a group is applied, a Product tab appears in the breakdown table next to Country and Device Type. Each row is one product in the group, so you can compare control and variants product by product.
Common mistakes
- Expecting a group to change who sees the test. It never does. Groups are an analytics filter; targeting and product selection live in the test setup.
- Comparing filtered revenue with the test total. Only group products in qualifying sessions count, so filtered numbers won’t add up to the total. Compare filtered numbers with each other.
- Looking for the Product tab without a group applied. The per-product breakdown only appears while a group is applied.
- Hesitating to edit or delete a group. Your test data isn’t affected. If you delete a group a dashboard is filtered to, open Filters on that test and pick another group or All products.
FAQ
Do product groups change which visitors enter my test?
Do product groups change which visitors enter my test?
No. Randomization, targeting, and traffic split are untouched. A group only filters which sessions and order line items count toward the dashboard numbers.
What is the group with the 'In this test' badge?
What is the group with the 'In this test' badge?
Price tests (and offer tests that target specific products) automatically get a built-in group of exactly the tested products. It only appears in that test’s Filters modal and isn’t listed on the Product Groups page.
What happens when my collection changes?
What happens when my collection changes?
Groups built from a collection, tag, or product type stay in sync automatically. There’s nothing to rebuild.
Why is filtered revenue lower than I expected?
Why is filtered revenue lower than I expected?
Only sessions that viewed a group product count, and revenue is counted per product: an order with one group product and three others contributes only that one line’s revenue.
Can I reuse a group across tests?
Can I reuse a group across tests?
Yes. Groups are store-level: define one in Settings and apply it on any test’s Analytics dashboard.
How reliable are per-product results?
How reliable are per-product results?
Per-product comparisons aren’t randomized the way the test itself is, because visitors choose which products they view. Expect more noise than the test-level verdict and weigh them accordingly. See Statistical Significance.