Work

Causes of Mode Effects: Separating out Interviewer and Stimulus Effects in Comparisons of Face-to-Face and Telephone Surveys

Year: 2006
Type: report
Study design: Clinical Trial
Abstract: Non-technical summaryMany long-established surveys that have so far relied on face-to-face interviewing are facing increasing pressures to reduce data collection costs.As a result, there is rising interest in the use of cheaper data collection methods, such as telephone interviewing, alongside or instead of face-to-face interviews.For established surveys that produce time series or longitudinal data, there is concern that changing the mode of data collection may pose a threat to the continuity of the data produced.In this paper we focus on reasons why respondents may answer a given survey question differently depending on whether they are interviewed faceto-face or over the telephone.The main differences between telephone and face-to-face interviewing are in the physical presence of the interviewer, and the aural versus visual presentation of questions.Previous studies that have examined whether telephone interviewing leads respondent to give different answers than face-to-face interviewing have tended to confound these two differences between the modes, making it difficult for survey designers to identify the causes of differences and how the survey design might be adapted to reduce risks to data comparability.In this paper we use data from an experiment conducted in the context of the European Social Survey to test for mechanisms that may lead respondents to give different answers in telephone and face-to-face interviewing.The experiment included three randomly allocated treatment groups: (1) face-to-face interviewing using showcards to present response categories visually, (2) telephone interviewing, and (3) face-to-face interviewing using the telephone questionnaire, that is without showcards.The results suggest that measurement differences between telephone and face-to-face interviewing with showcards were mainly driven by the physical presence of the interviewer: telephone respondents were more likely to give socially desirable responses than face-to-face interviewers.The question stimulus, that is, whether questions were administered aurally or with the help of showcards, did not affect responses.
Source: IRIS
Language: English
Open Access status: green
OpenAlex ID: W1587027783
Cites: 40
Cited by: 16
Related to: 8