How to restrict a drag ranking question so that respondents can only choose 3 items

Overview

This article explains how to restrict a drag ranking question in a survey so that respondents can only choose 3 items out of a larger set. It provides step-by-step instructions on using plausibility checks to achieve this limitation.

Information

In survey design, it's sometimes necessary to limit the number of items respondents can rank. This guide focuses on creating a "Top 3 Ranking" out of 5 items using drag ranking and plausibility checks.

When creating a drag ranking, the variables will receive the code that they are given in the ranking. #1 = Code 1, #2 = Code 2, etc. We can use this coding to make sure that participants only create a "Top 3 Ranking". In this example, participants are supposed to create a Top 3 out of 5 items. Naturally, you can make changes to this manual, so it fits your needs. 

1. On the same page that you created the drag ranking, enter "plausibility checks" in the left menu. Here, create a "standard check"

2. Under "definition" select the first variable (of the first item) out of the drag ranking. In my example, it is "v_14 (Dimension 1)".

2. a) To make sure that this variable can't be placed 4th, we have to define "v_14 (Dimension 1) >= 4". Now the plausibility check will be activated when someone tries to put this item in 4th place.

1. Add another standard check and connect the two checks with "OR".

2. Now select the second item and define it the same way ("v_15 (Dimension 2) >= 4")

4. a) Repeat this step with all items of your drag ranking.

FAQ

Can I modify this method for a different number of top choices?

Yes, you can adjust the number in the plausibility check condition. For example, to allow only top 2 choices, you would use "= 3" instead of "= 4".

Will this method work for any number of total items?

Yes, this method can be applied to any number of total items. Just ensure you create a plausibility check for each item in your drag ranking question.