Scored and Dropdown Questions
Two kinds of evaluation question.
- Scored questions — rated from 1 to 5 and weighted; these produce the weighted score. Evaluators see each criterion's weight, for example 25.00%, next to it.
- Dropdown questions — a single-select answer captured for context; these do not affect the weighted score and do not appear in the score summary.
Give every scored criterion a short piece of guidance explaining what a reviewer should look for. Evaluators see that text while scoring, and it is the simplest way to keep reviews consistent between people.
Use a dropdown for the judgement that should not be arithmetically averaged — typically a recommendation such as Strongly recommend, Recommend, Neutral, or Do not recommend.