Skip to main content
A subscription test assigns a provider plan to each eligible test group for the same product. Use it to compare offers such as a standard monthly plan and a discounted monthly plan.
Subscription tests appear when the subscription provider feature is enabled for your ABConvert account. Connect Recharge or SKIO before previewing or launching.

When to use it

  • Compare two existing Recharge or SKIO plans for one product.
  • Create a Recharge plan with a different recurring discount and measure whether it attracts more subscribers.
  • Compare first subscription orders and later renewals by the test group that acquired the customer.

When not to use it

  • To change checkout content, delivery, or payment options, use a checkout test.
  • To test a one-time product price, use a price test. Price tests do not support subscription products.

How it works

The provider owns each plan and its recurring price. ABConvert assigns one plan to each eligible test group on the selected product page. A visitor outside your target audience can still see the product’s other plans.

Set up the test

1

Create a subscription test

Choose Subscription in Create new test. Add a name, hypothesis, primary metric, test groups, and audience targeting.
2

Choose the provider and product

In Subscription Offer, select Recharge or SKIO, then select a product. The product list shows products with plans for that provider. Use Browse all products if the list is incomplete. Every test group uses the same product.
3

Assign a plan to each test group

Select a provider plan for Control and every other test group. The plan list loads after you choose the product. SKIO plans must already exist in SKIO. For Recharge, you can select an existing plan or use Create plan if your API token has write_plans permission. A new Recharge plan sets the recurring price for its subscribers.
4

Check the plans and preview

Keep Show only the assigned subscription plan on so an eligible visitor sees only their test group’s plan. Select Check Recharge plans or Check SKIO plans, then use Preview to inspect each test group on the storefront before launch.
If you create a Recharge plan from the test, plan hiding stays on for the test. Visitors outside the test can still see every plan on the product. After the test ends, the results page lets you keep or remove plans ABConvert created. Existing subscriptions keep their plan.

Read the results

Subscription Metrics uses Shopify first orders with a subscription line. It shows subscription orders, subscription revenue, units, and rates by test group. Renewals are separate: Subscription Lifecycle uses verified Recharge or SKIO events for subscribers, retention, churn, and renewal revenue. See Subscription metrics for the metric definitions. A connected provider or a successful preview does not prove a renewal was received. Check the provider event status and wait for an attributed event before using lifecycle results.

If preview is blocked

Check the message in the test review step. An active test on the same product can block Preview or launch. End or pause the conflicting test only if you intend to change its traffic and results, then retry Preview. Confirm the provider connection and each test group’s plan if the message points to either of those instead.

Common mistakes

  • Expecting SKIO plans to be created in ABConvert. Create them in SKIO before you choose the product and plan in the test.
  • Treating Preview as a renewal check. Preview shows the storefront offer. Verify provider events separately in Recharge or SKIO.

FAQ

Plan hiding applies to eligible visitors assigned to the subscription test. Review the test’s audience targeting if you want more visitors to receive an assigned plan.