Section randomization
Section randomization controls which pages or subsections inside a section a participant sees, and in what order.
When to use it
Section titled “When to use it”- Rotate concept modules so each person sees a different order.
- Assign one random scenario out of several.
- Shorten long studies by sampling N modules from a larger set.
| Mode | Behavior |
|---|---|
| All ordered | Show the full pool in authored order |
| All shuffled | Show the full pool in random order |
| Pick one | Show exactly one random item from the pool |
| Pick N | Show N randomly selected items from the pool |
For Pick N, set the count of items each participant should receive.
Targets
Section titled “Targets”| Target | What is randomized |
|---|---|
| Pages | Direct pages in the section |
| Subsections | Child subsections in the section |
Do not mix pages and subsections
Section titled “Do not mix pages and subsections”A section should randomize either pages or subsections, not both at once. If a section contains a mix of direct pages and subsections, randomization for that section is not applied reliably. Restructure so the pool is uniform:
- Put only pages under the section, or
- Put only subsections under the section (with pages inside those subsections).
How to set it up
Section titled “How to set it up”- Open the section settings in the builder.
- Enable section randomization.
- Choose a mode: all ordered, all shuffled, pick one, or pick N.
- Choose the target: pages or subsections.
- Enter pick count when using pick N.
- Remove mixed structure if the builder warns about mixed content.
- Preview paths, then confirm with Live test takes.
Example
Section titled “Example”A usability section contains four concept subsections. Set target to subsections, mode to pick one. Each participant evaluates a single random concept while you still compare concepts across the sample.
Evaluation timing
Section titled “Evaluation timing”Section randomization runs after section display logic and before page display logic. See How rules are evaluated.
Limitations
Section titled “Limitations”- Mixed page and subsection pools are not supported for randomization.
- Hidden pages (via display logic) may further reduce what participants see after the random pool is chosen.
- Analysis should account for missing modules when using pick one or pick N.
- Use all shuffled when every module is required but order bias matters.
- Use pick one or pick N when total length is the constraint.
- For balanced experiment arms (not just order), add randomization groups.
Common questions
Can I randomize pages and subsections in the same section?
No. Choose either pages or subsections as the randomization target. Mixing both in one section disables reliable randomization for that section.
What does pick one do?
Each participant sees exactly one randomly selected page or subsection from the pool, depending on the target you chose.
Is authored order preserved anywhere?
Yes. The all ordered mode keeps your authored sequence while still allowing the section to participate in the broader study path.