Skip to content
Open fromusers

Compare groups in results

Compare group in Results Studio focuses analysis on one experiment arm or variant assignment created by logic such as randomization groups or compare assets.

If the study has no assignments, the control may be hidden or show a single default group.

  1. Open Results for the study.
  2. Locate the Compare group selector (often near filters on Dashboards or Summary).
  3. Pick an arm (for example Variant A).
  4. Review metrics, charts, and sessions for that arm.
  5. Switch arms and note differences before you write recommendations.
  6. Optionally combine with filters such as device or completion.
SignalWhy
Completion rateOne variant may cause drop-off
Task success / timeUsability differences
Preference / rating meansDirectional product choice
Open text themesQualitative explanation
Recording samplesBehavioral proof

A homepage hero compare-assets test:

  1. Select Variant A; note bounce-like early exits on Summary.
  2. Select Variant B; confirm higher completion.
  3. On Responses, open three recordings per arm.
  4. Export each arm’s Current view for the design review.
  • Unequal sample sizes across arms reduce confidence. Check counts first.
  • Changing logic mid-flight can mix old and new assignments; Pause when redesigning experiments.
  • Compare group is analysis-time slicing; it does not rewrite stored answers.

Common questions

Where does Compare group come from?

It appears when the study uses randomization groups, compare assets, or related experiment setups that assign participants to arms.

Can I see all groups at once?

Use the compare selector and charts that support breakdowns. Start with one arm when validating data quality, then compare.

Do synthetic responses respect groups?

When synthetic data is generated for experiments, use the Real or Synthetic toggle carefully and confirm arm labels before presenting.