Experiment recipes
Copy-paste starting points for common research designs. Adjust page counts and group names to match your study.
Fixed questionnaire (no experiments)
Section titled “Fixed questionnaire (no experiments)”Goal: Everyone sees the same flow.
- No randomisation on sections and pages
- Optional display logic for screener skip or answer-based follow-ups
Counterbalanced question order
Section titled “Counterbalanced question order”Goal: Reduce order bias without hiding content.
- Randomise order at page level (blocks) or section level (pages)
- Keep instructions on a separate page with no randomisation
Shorter survey — random module sampling
Section titled “Shorter survey — random module sampling”Goal: Each person sees some modules, not all; group names not needed in results.
- Split modules into a section
- Present a subset → e.g. 2 of 5 subsections
- Do not enable Randomisation groups
Classic A/B test (one variant per participant)
Section titled “Classic A/B test (one variant per participant)”Goal: Group A vs Group B with named conditions in results.
- Create a section with one page (or subsection) per variant
- Present a subset → 1 of N
- Enable Randomisation groups → map Group A/B to each target
- Add shared post-task questions outside the randomised section
- Keep thank you page outside the section
Multivariate test (3+ conditions)
Section titled “Multivariate test (3+ conditions)”Goal: Three or more between-subjects arms with balanced assignment.
- Same as A/B with N pages and N groups (or N blocks on one page)
- Use weighted randomisation if groups are not equal size
- Test every arm in preview with Follow logic
Prototype comparison (usability test)
Section titled “Prototype comparison (usability test)”Goal: Same task, different prototypes per group.
- Compare assets on task pages with randomisation driver
- Optionally combine with section randomisation if each group has a different task flow
- Define groups in the creation wizard or inline in compare assets
Prolific / custom link routing
Section titled “Prolific / custom link routing”Goal: Condition comes from the URL, not random assignment.
- Create a URL parameter variable (e.g.
?condition=B) - Display logic on each page or section: show when variable equals the right value
- Do not use section subset mode — assignment comes from the link
Mixed: random group + conditional follow-up
Section titled “Mixed: random group + conditional follow-up”Goal: Between-subjects main task, then answer-driven paths.
- Randomisation groups for the main between-subjects block
- Shared later pages with display logic based on answers
- Branching to jump qualified participants to the main block