On the optimal number of scale points in graded paired comparisons

Abstract

In market research, it is common practice to measure individuals’ brand or product preference through graded paired comparisons (GPCs). One important decision concerns the (odd) number of scale points (e.g., five, seven, nine, or eleven) that has to be assigned to either brands or products in each pair. Using data from an experiment with 122 students, we assessed the extent to which GPCs with a higher number of scale points (requiring more cognitive effort) really outperform GPCs with a smaller number of scale points (requiring less cognitive effort). Our data analyses have shown that one may reduce the (odd) number of
scale points from eleven to nine or seven, depending on what minor compromises one is willing to make. The detailed psychometric results presented in this paper are useful to applied researchers as they help them in making well-informed decisions on the number of scale points in a GPC task.