Analytics FAQs

Analytics refresh every 30–60 seconds, combining Shopify Web Pixel, server-side events, and TestSignal tracking for high accuracy.

Low data may occur if:

• Your experiment just started
• The targeted products or layouts have low traffic
• The experiment has a narrow audience or filter

• A product was added to cart before the test began (those orders are not counted)

Because they measure different scopes:

• Dashboard: Storewide sessions, orders, and revenue

• Experiment Results: Only sessions exposed to the experiment

• Price, Image, Description Tests: Product sessions

• Theme & Layout Tests: Store sessions

• Shipping Tests: Checkout sessions

Orders are only counted if they occur in a session influenced by the experiment.

Statistical confidence hasn’t been reached yet.
You may need:

• More traffic
• More days of data
• A larger performance difference between groups

Because:

• Shopify measures all site traffic
• TestSignal measures experiment-exposed sessions for experiments

• Dashboard Visitor Insights shows store sessions during the selected range

• Experiments count only qualified sessions (based on test type)

Yes. TestSignal tracks:

• Add to Cart Rate
• Begin Checkout Rate
• Abandoned Cart Rate
• Abandoned Checkout Rate
• Checkout Progression Stages (contact, shipping, payment)

These help diagnose where friction occurs in each variant.

Common reasons:

• No sessions reached that stage
• Data hasn’t synced yet

• The experiment type doesn’t track that stage (e.g., shipping tests don’t use product views)

Not yet — but export functionality is coming soon!

We’re actively working on adding data export so you can download your experiment sessions, orders, and performance metrics for deeper analysis.

All analytics in TestSignal use your store’s Shopify time zone.
This ensures that revenue, sessions, and experiment results align exactly with how your Shopify data is reported.

As more sessions and orders come in, statistical confidence increases. Early results may shift until enough data is collected to lock in a reliable winner.

When you pause or edit a test, traffic patterns may shift. TestSignal preserves all historical data, but results may differ because:

• Some products or variants were added/removed
• Traffic allocation changed
• Price or layout changes influence behavior differently

You can use date filters to view data before or after edits.

Yes. TestSignal tracks performance by device type, allowing you to see which variation performs best on mobile, desktop, or tablet.

The Dashboard shows metrics based on the date selector at the top.
Experiment results use the experiment’s actual running dates, independent of the dashboard range.

No. Analytics start collecting the moment you install TestSignal and enable experiments. Past traffic and orders cannot be imported.

No — TestSignal does not include POS (Point of Sale) orders in analytics. All analytics are based solely on online store sessions and online checkout orders, since experiments only run on your storefront.

No. All revenue metrics exclude tax amounts to maintain consistency with Shopify reporting and profit calculations.