Skip to main content
Randomization helps reduce order bias by shuffling the order of research objectives for each participant. Different participants see objectives in different orders, ensuring that position in the interview doesn’t skew results.

​
How It Works

  • Research objectives in the same randomization group appear in a random order for each interview
  • Each interview gets a unique shuffle, but the same interview always sees the same order (deterministic)
  • Intro and outro sections always stay in their fixed positions

​
Setting Up Randomization Groups

  1. Click “Reorder & Randomize” on your topic guide
  2. Click “Add Randomization Group” to create a new group
  3. Use the dropdown to add objectives to the group
  4. Objectives in the same colored group will be shuffled together
  5. Click “Save Changes”
Screenshot of the randomization groups sheet with objectives in groups

​
Tips

  • Groups with only 1 objective won’t be randomized (you need at least 2)
  • You can create multiple independent groups that shuffle separately
  • Objectives not in any group maintain their fixed position
  • Use this to reduce primacy/recency bias in your research
Need help? Contact us at [email protected]