How to Set Up a Theme Test

Step 1: Create a New Theme Test

Head to the Experiments tab in your TestSignal sidebar.

Click Create New at the top of the experiments table, then choose Theme Test as your experiment type.Hit Continue to get started.

Step 2: Set Up Your Experiment

Configure the core settings for your test:

Select your success metrics
Set your experiment duration
Set Interval Timer
(Optional) Target specific device types or visitor types
(Optional) Turn on UTM Controls to include or exclude traffic based on UTM rules

Step 3: Add Group & Configure Theme

Create Test Groups

Click Add New Test Group (up to 5 groups supported)
Give each group a name

Select Theme (For each group)

Select the theme for your test group. A preview and name will appear automatically.
Use Edit in Shopify to customize or View in Browser to preview your theme

Click Next → to review your test configuration before launch.

Step 4: Final Review & Launch

Before going live, you’ll land on the Experiment Overview page — a quick snapshot of everything you’ve set up.

Review the Essentials

Double-check that all key details look right:

Experiment duration
Primary success metric
Selected products & variants
Test groups & price adjustments
Traffic split

Name Your Experiment

Give your experiment a clear name so it’s easy to track later. (You can also rename it anytime before launching.)

Add Notification Emails

Experiment start confirmation
Important status updates
Results notifications

Launch Your Test
Once everything looks perfect, click Launch Experiment in the bottom-right corner.
Your Description test is officially live—time to let the data roll in!