The Utility of GPS data in Assessing Interviewer Travel Behavior and Errors in Level-of-Effort Paradata

  • James Wagner University of Michigan Survey Research Center http://orcid.org/0000-0002-8823-3110
  • Kristen Olson Department of Sociology University of Nebraska-Lincoln
  • Minako Edgar Survey Research Center University of Michigan
Keywords: Paradata, Measurement Erro

Abstract

Surveys are a critical resource for social, economic, and health research. The ability to efficiently collect these data and develop accurate post-survey adjustments depends upon reliable data about effort required to recruit sampled units. Level-of-effort paradata are data generated by interviewers during the process of collecting data in surveys. These data are often used as predictors in nonresponse adjustment models or to guide data collection efforts. However, recent research has found that these data may include measurement errors, which would lead to inaccurate decisions in the field or reduced effectiveness for adjustment purposes (Biemer, et al., 2013; West and Little, 2013). In order to assess whether errors occur in level-of-effort paradata, we introduce a new source of validation data for call records -- Global Positioning System (GPS) data generated by smartphones carried by interviewers. We examine the quality of the GPS data and then use the GPS data to characterize interviewer travel within sampled area segments. We also link the GPS data with the interviewer-reported call records in order to identify potential errors in the call records. Given the lack of a gold standard, we perform a sensitivity analysis under various assumptions to see how this would change our conclusions.

Author Biography

James Wagner, University of Michigan Survey Research Center
I am on the faculty of the Michigan Program in Survey Methdology at the University of Michigan and the Joint Program of Survey Methodology at the University of Michigan and the University of Maryland. I am a Research Associate Professor.
Published
2017-10-20
How to Cite
Wagner, J., Olson, K., & Edgar, M. (2017). The Utility of GPS data in Assessing Interviewer Travel Behavior and Errors in Level-of-Effort Paradata. Survey Research Methods, 11(3), 218-233. https://doi.org/10.18148/srm/2017.v11i3.6794