Skip to content
Open fromusers

Block randomization

SurveysUsability testsIn-product surveys

Block randomization controls the order (or subset) of content blocks on a page. Use it when question order itself could bias answers.

  • Rotate rating items so no item always appears first.
  • Show only a sample of statements from a larger battery.
  • Keep a fixed intro block, then shuffle the remaining blocks (by structuring page content accordingly).

For rotating whole pages or subsections, use section randomization instead.

ModePlain-English behavior
NoneKeep the authored order
Shuffle allPresent all blocks in a random order
Pick NShow only N randomly selected blocks

When you choose Pick N, set how many blocks each participant should see.

  1. Open the page in the builder.
  2. Enable block randomization for the page.
  3. Choose None, Shuffle all, or Pick N.
  4. For Pick N, enter the count.
  5. Preview, then verify Live behavior with a few test takes.

A page has eight brand attribute ratings. Set Pick N to 4 so each participant rates a random subset of four attributes. Analysis still compares attributes across the sample.

Block randomization runs after page display and qualification checks, and before question display logic on that page. Details: How rules are evaluated.

  • Applies within one page, not across the whole study.
  • If display logic hides many questions inside selected blocks, participants may see fewer items than N.
  • Do not rely on a fixed on-page order in analysis when shuffle or pick is enabled.
  • Use shuffle when every item must be answered but order should vary.
  • Use pick N when the full battery is too long for every participant.
  • Combine with randomization groups only when you also need experiment arms, not just order control.

Common questions

What is a page block?

A block is a group of content on a page that can be ordered or sampled together when block randomization is enabled.

How is block randomization different from section randomization?

Block randomization works inside a single page. Section randomization works across pages or subsections in a section.

Does preview always shuffle blocks?

Preview may keep authored order so you can review every block. Live sessions apply the configured shuffle or pick behavior.