Skip to content
Open fromusers

Section randomization

SurveysUsability testsIn-product surveys

Section randomization controls which pages or subsections inside a section a participant sees, and in what order.

  • Rotate concept modules so each person sees a different order.
  • Assign one random scenario out of several.
  • Shorten long studies by sampling N modules from a larger set.
ModeBehavior
All orderedShow the full pool in authored order
All shuffledShow the full pool in random order
Pick oneShow exactly one random item from the pool
Pick NShow N randomly selected items from the pool

For Pick N, set the count of items each participant should receive.

TargetWhat is randomized
PagesDirect pages in the section
SubsectionsChild subsections in the section

A section should randomize either pages or subsections, not both at once. If a section contains a mix of direct pages and subsections, randomization for that section is not applied reliably. Restructure so the pool is uniform:

  • Put only pages under the section, or
  • Put only subsections under the section (with pages inside those subsections).
  1. Open the section settings in the builder.
  2. Enable section randomization.
  3. Choose a mode: all ordered, all shuffled, pick one, or pick N.
  4. Choose the target: pages or subsections.
  5. Enter pick count when using pick N.
  6. Remove mixed structure if the builder warns about mixed content.
  7. Preview paths, then confirm with Live test takes.

A usability section contains four concept subsections. Set target to subsections, mode to pick one. Each participant evaluates a single random concept while you still compare concepts across the sample.

Section randomization runs after section display logic and before page display logic. See How rules are evaluated.

  • Mixed page and subsection pools are not supported for randomization.
  • Hidden pages (via display logic) may further reduce what participants see after the random pool is chosen.
  • Analysis should account for missing modules when using pick one or pick N.
  • Use all shuffled when every module is required but order bias matters.
  • Use pick one or pick N when total length is the constraint.
  • For balanced experiment arms (not just order), add randomization groups.

Common questions

Can I randomize pages and subsections in the same section?

No. Choose either pages or subsections as the randomization target. Mixing both in one section disables reliable randomization for that section.

What does pick one do?

Each participant sees exactly one randomly selected page or subsection from the pool, depending on the target you chose.

Is authored order preserved anywhere?

Yes. The all ordered mode keeps your authored sequence while still allowing the section to participate in the broader study path.