Pseudo-Opinions in Online Surveys: Evidence to Recontextualize the Imputed Meaning Hypothesis

Authors

  • Henrik Andersen Chemnitz University of Technology
  • Jochen Mayerl Chemnitz University of Technology
  • Felix Wolter University of Konstanz
  • Justus Junkermann University of Leipzig

DOI:

https://doi.org/10.18148/srm/2023.v17i2.7943

Keywords:

survey methodology, online surveys, pseudo-opinions, fictitious issues, response latencies

Abstract

Pseudo-opinions and nonattitudes describe when survey respondents give substantive answers to things that they know little to nothing about. They can be seen as a threat to the validity and reliability of survey data as they represent deviations from the ‘true’ answer: “I don’t know”. Two competing hypotheses are often put forth to explain pseudo-opinions. The mental coin-flip hypothesis is associated with satisficing response behavior and states respondents choose an answer at random while the imputed meaning hypothesis is associated more with optimizing and states that respondents attempt to find meaning in the unfamiliar question and answer accordingly. While the imputed meaning hypothesis is currently favored in the literature, we argue it is implausible in online surveys employing ‘professional’ panelists. Namely, the lack of an interviewer should reduce the pressure to look informed, and extrinsic incentives should reduce the respondent’s motivation. Therefore, we believe online surveys are particularly susceptible to a satisficing style of pseudo-opinions. To investigate this, we conduct a large online survey and use response latencies as an indicator of satisficing along with fictitious issues, i.e., questions about nonexistent things. The results of fixed effects probit regression models confirm that the probability for a pseudo-opinion tends to be higher for very fast (satisficing) responses. However, the inclusion of the squared response latency term reveals that pseudo-opinions are predicted by both very fast and very slow average responses. This shows that very fast responses should be scrutinized. Comparatively slow answers indicate respondents trying to put in the effort to give a valid answer. Two experimental conditions reveal instructions to take one’s time and deliberate before answering reduce pseudo-opinions slightly, and the inclusion of an explicit “don’t know” category greatly reduces pseudo-opinions.

Downloads

Additional Files

Published

2023-08-08 — Updated on 2023-08-16

Versions

How to Cite

Andersen, H., Mayerl, J., Wolter, F., & Junkermann, J. (2023). Pseudo-Opinions in Online Surveys: Evidence to Recontextualize the Imputed Meaning Hypothesis. Survey Research Methods, 17(2), 205–217. https://doi.org/10.18148/srm/2023.v17i2.7943 (Original work published August 8, 2023)

Issue

Section

Articles

Similar Articles

1 2 3 4 5 6 7 8 9 10 > >> 

You may also start an advanced similarity search for this article.