Reduction of Measurement Error due to Survey Length: Evaluation of the Split Questionnaire Design Approach

Authors

  • Andy Peytchev University of Michigan
  • Emilia Peytcheva RTI International

DOI:

https://doi.org/10.18148/srm/2017.v11i4.7145

Keywords:

Split Questionnaire Design, Matrix Sampling, Survey Length, Measurement Error, Multiple Imputation

Abstract

Long survey instruments can be taxing to respondents, which may result in greater measurement error. There is little empirical evidence on the relationship between length and measurement error, possibly leading to longer surveys than desirable. At least equally important is the need for methods to reduce survey length while meeting the survey’s objectives. This study tests the ability to reduce measurement error related to survey length through split questionnaire design, in which the survey is modularized and respondents are randomly assigned to receive subsets of the survey modules. The omitted questions are then multiply imputed for all respondents. The imputation variance, however, may overwhelm any benefits to survey estimates from the reduction of survey length. We use an experimental design to further evaluate the effect of survey length on measurement error and to examine the degree to which a split questionnaire design can yield estimates with less measurement error. We found strong evidence for greater measurement error when the questions were asked late in the survey. We also found that a split questionnaire design retained lower measurement error without compromising total error from the additional imputation variance. This is the first study with an experimental design used to evaluate split questionnaire design, demonstrating substantial benefits in reduction of measurement error. Future experimental designs are needed to empirically evaluate the approach’s ability to reduce nonresponse bias.

Author Biographies

Andy Peytchev, University of Michigan

Research Assistant Professor, Survey Research Center, Institute for Social Research

Emilia Peytcheva, RTI International

Research Survey Methodologist, Survey Research Division

Downloads

Additional Files

Published

2017-12-13

How to Cite

Peytchev, A., & Peytcheva, E. (2017). Reduction of Measurement Error due to Survey Length: Evaluation of the Split Questionnaire Design Approach. Survey Research Methods, 11(4), 361–368. https://doi.org/10.18148/srm/2017.v11i4.7145

Issue

Section

Articles

Most read articles by the same author(s)

Similar Articles

<< < 3 4 5 6 7 8 9 10 11 12 > >> 

You may also start an advanced similarity search for this article.