Is satisficing responsible for response order effects in rating scale questions?
Keywords: scale direction, response order effect, rating scales, satisficing, Web survey
AbstractRating scales are used extensively in surveys. A rating scale can descend from the highest to the lowest point or from the positive to the negative pole. A rating scale can also start with the lowest point (or the negative pole) and ascend to the highest point (or the positive pole). Previous research has shown that the direction of the scale, i.e., the order of the response options, has an impact on responses, and that respondents are more likely to select response options close to the starting point of the scale, regardless of whether the scale ascends or descends. This paper advances the literature by examining empirically whether or not the response order effect in rating scale questions is driven by satisficing. Drawing on data from five experiments, we found that scale direction had a significant and extreme impact on response distributions. Although the effect of scale direction was stronger among speeders than non-speeders, the effect was observed across the board among those who were at a high risk of satisficing and those who were not.
How to Cite
Keusch, F., & Yang, T. (2018). Is satisficing responsible for response order effects in rating scale questions?. Survey Research Methods, 12(3), 259-270. https://doi.org/10.18148/srm/2018.v12i3.7263
Copyright for articles published in this journal is retained by the authors, with first publication rights granted to the journal. By virtue of their appearance in this open access journal, users can use, reuse and build upon the material published in the journal but only for non-commercial purposes and with proper attribution.