Skip to main content
Randomization helps reduce order bias by shuffling the order of research objectives for each participant. Different participants see objectives in different orders, ensuring that position in the interview doesn’t skew results.

​
How It Works

  • Research objectives in the same randomization group appear in a random order for each interview
  • Each interview gets a unique shuffle, but the same interview always sees the same order (deterministic)
  • Intro and outro sections always stay in their fixed positions

​
Setting Up Randomization Groups

  1. Click “Reorder & Randomize” on your topic guide
  2. Click “Add Randomization Group” to create a new group
  3. Use the dropdown to add objectives to the group
  4. Objectives in the same colored group will be shuffled together
  5. Click “Save Changes”
Screenshot of the randomization groups sheet with objectives in groups

​
Distribution & Balancing

Randomization groups control the order of objectives, not which objectives a participant sees. Every participant sees every objective in the group — just in a different order. The order is a purely random shuffle with no balancing algorithm applied. For example, with 3 objectives in a group:
  • Participant 1 might see: A → B → C
  • Participant 2 might see: C → A → B
  • Participant 3 might see: B → C → A
All participants answer the same objectives, just in a different order.
This is different from stimulus randomization (randomized images/videos), which controls which content a participant sees and uses a balanced algorithm to ensure an equal split across participants.

​
Tips

  • Groups with only 1 objective won’t be randomized (you need at least 2)
  • You can create multiple independent groups that shuffle separately
  • Objectives not in any group maintain their fixed position
  • Use this to reduce primacy/recency bias in your research
Need help? Contact us at support@conveo.ai