L11: Types of Errors in Probability Survey Research (pdf)
In this lecture series we talk about how to conduct effective probability sample surveys. We discuss the fundamental requirements that must be met if one wants to generalize results with statistical confidence from the few who are surveyed to the many they are selected to represent.
In particular, we cover four main types of error that surveyors need to try to minimize in order to improve the survey estimates:
- Coverage Error occurs when the list from which sample members are drawn does not accurately represent the population on the characteristic(s) one wants to estimate with the survey data
- Sampling Error exists anytime we decide to survey only some, rather than all, members of the sample frame.
- Nonresponse Error occurs when those who do not respond are different from those who do respond in a way that influences the estimate.
- Measurement Error occurs when respondents are unable or unwilling to provide accurate answers, which can be due to poor question design, survey mode effects, interviewer and respondent behavior, or data collection mistakes.
Dillman, D., Smyth, J. D., & Christian, L. M. (2014). Internet, Phone, Mail and Mixed-Mode Surveys: The Tailored Design Method (4th ed.). Hoboken, NJ: Wiley.
- Chapter 1: Sample Surveys in our Electronic World
- Chapter 2: Reducing People's Reluctance to Respond to Surveys
- Chapter 4: The Fundamentals of Writing Questions
- Chapter 5: How to Write Open and Closed Ended Questions