A Closer Look at Attitude Scales with Positive and Negative Items. Response Latency Perspectives on Measurement Quality
Keywords: Response Latency, Paradata, Reversed Items, Method Effects, Cognition in Surveys
AbstractMeasurement quality in standardized surveys has been a core issue for decades in survey research. For questionnaire designers, it is common to use a mix of positive and negative worded items to measure multi-item-constructs in order to control for response effects like acquiescence bias. The paper shows that paradata such as response latency measurement can be used to identify specific subgroups of respondents with specific types of cognitive response modes. These response modes moderate the occurrence of response effects, systematic and random measurement errors, and thus the reliability and validity of attitudinal measurement models. Therefore, adapting paradata to detect low measurement quality can be used as a tool leading to a better understanding of respondents’ cognitive processes. Data of a German CATI-survey with experimental design and measurement of response latencies are used to analyze data quality of a measurement model of attitudes towards health nutrition with mixed items. Response effects are analyzed through the experimental variation of question order of negative and positive worded items. Structural equation models are estimated in a multiple-group moderator design to test validity and reliability of the latent attitude construct. As a result, the attitude scale shows acceptable values of validity and reliability only under the condition of spontaneous answers where question order effects appear.
How to Cite
Mayerl, J., & Giehl, C. (2018). A Closer Look at Attitude Scales with Positive and Negative Items. Response Latency Perspectives on Measurement Quality. Survey Research Methods, 12(3), 193-209. https://doi.org/10.18148/srm/2018.v12i3.7207
Copyright for articles published in this journal is retained by the authors, with first publication rights granted to the journal. By virtue of their appearance in this open access journal, users can use, reuse and build upon the material published in the journal but only for non-commercial purposes and with proper attribution.