In statistics, survey sampling describes the process of selecting a sample of elements from a target population to conduct a survey. The term "survey" may refer to many different types or techniques of observation. In survey sampling it most often involves a questionnaire used to measure the characteristics and/or attitudes of people. Different ways of contacting members of a sample once they have been selected is the subject of survey data collection. The purpose of sampling is to reduce the cost and/or the amount of work that it would take to survey the entire target population. A survey that measures the entire target population is called a census.
Survey samples can be broadly divided into two types: probability samples and nonprobability samples. Probabilitybased samples implement a sampling plan with specified probabilities (perhaps adapted probabilities specified by an adaptive procedure). Probabilitybased sampling allows designbased inference about the target population. The inferences are based on a known objective probability distribution that was specified in the study protocol. Inferences from probabilitybased surveys may still suffer from many types of bias.
Surveys that are not based on probability sampling have greater difficulty measuring their bias or sampling error. Surveys based on nonprobability samples often fail to represent the people in the target population.^{[1]}
In academic and government survey research, probability sampling is a standard procedure. In the USA, the Office of Management and Budget's "List of Standards for Statistical Surveys" states that federally funded surveys must be performed:
selecting samples using generally accepted statistical methods (e.g., probabilistic methods that can provide estimates of sampling error). Any use of nonprobability sampling methods (e.g., cutoff or modelbased samples) must be justified statistically and be able to measure estimation error.^{[2]}
Besides, random sampling and designbased inference are supplemented by other statistical methods, such as modelassisted sampling and modelbased sampling.^{[3]}^{[4]}
For example, many surveys have substantial amounts of nonresponse. Even though the units are initially chosen with known probabilities, the nonresponse mechanisms are unknown. For surveys with substantial nonresponse, statisticians have proposed statistical models, with which data sets are analyzed.
Probability sampling
In a probability sample (also called "scientific" or "random" sample) each member of the target population has a known and nonzero probability of inclusion in the sample.^{[5]} A survey based on a probability sample can in theory produce statistical measurements of the target population that are:
A probabilitybased survey sample is created by constructing a list of the target population, called the sample frame, a randomized process for selecting units from the sample frame, called a selection procedure, and a method of contacting selected units to and enabling them complete the survey, called a data collection method or mode.^{[8]} For some target populations this process may be easy, for example, sampling the employees of a company by using payroll list. However, in large, disorganized populations simply constructing a suitable sample frame is often a complex and expensive task.
Common methods of conducting a probability sample of the household population in the United States are Area Probability Sampling, Random Digit Dial telephone sampling, and more recently, AddressBased Sampling.^{[9]}
Within probability sampling, there are specialized techniques such as stratified sampling and cluster sampling that improve the precision or efficiency of the sampling process without altering the fundamental principles of probability sampling.
Stratification is the process of dividing members of the population into homogeneous subgroups before sampling. The strata should be mutually exclusive: every element in the population must be assigned to only one stratum. The strata should also be collectively exhaustive: no population element can be excluded. Then methods such as simple random sampling or systematic sampling can be applied within each stratum. This often improves the representativeness of the sample by reducing sampling error.
Bias in probability sampling
Bias in surveys is undesirable, but often unavoidable. The major types of bias that may occur in the sampling process are:

Nonresponse bias: When individuals or households selected in the survey sample cannot or will not complete the survey there is the potential for bias to result from this nonresponse. Nonresponse bias occurs when the observed value deviates from the population parameter due to differences between respondents and nonrespondents.^{[10]}

Coverage bias: Coverage bias can occur when population members do not appear in the sample frame (undercoverage). Coverage bias occurs when the observed value deviates from the population parameter due to differences between covered and noncovered units. Telephone surveys suffer from a well known source of coverage bias because they cannot include households without telephones.

Selection Bias: Selection bias occurs when some units have a differing probability of selection that is unaccounted for by the researcher. For example, some households have multiple phone numbers making them more likely to be selected in a telephone survey than households with only one phone number. This selection bias would be corrected by applying a survey weight equal to [1/(# of phone numbers)] to each household.
Nonprobability sampling
Many surveys are not based on probability samples, but rather on finding a suitable collection of respondents to complete the survey. Some common examples of nonprobability sampling are:^{[11]}

Judgement Samples: A researcher decides which population members to include in the sample based on his or her judgement. The researcher may provide some alternative justification for the representativeness of the sample.

Snowball Samples: Often used when a target population is rare. Members of the target population recruit other members of the population for the survey.

Quota Samples: The sample is designed to include a designated number of people with certain specified characteristics. For example, 100 coffee drinkers. This type of sampling is common in nonprobability market research surveys.

Convenience Samples: The sample is composed of whatever persons can be most easily accessed to fill out the survey.
In nonprobability samples the relationship between the target population and the survey sample is immeasurable and potential bias is unknowable. Sophisticated users of nonprobability survey samples tend to view the survey as an experimental condition, rather than a tool for population measurement, and examine the results for internally consistent relationships.
See also
Notes

^ Weisberg, Herbert F. (2005), The Total Survey Error Approach, University of Chicago Press: Chicago. p.231.

^ http://www.whitehouse.gov/omb/inforeg/statpolicy/standards_stat_surveys.pdf

^ Lohr. Brewer. Swedes

^ Richard Valliant, Alan H. Dorfman, and Richard M. Royall (2000), Finite Population Sampling and Inference: A Prediction Approach, Wiley, New York, p. 19

^ Kish, L. (1965), Survey Sampling, New York: Wiley. p. 20

^ Kish, L. (1965), Survey Sampling, New York: Wiley. p.59

^ http://www.aapor.org/whysamplingworks

^ Groves et al., Survey Methodology, Wiley: New York.

^ Michael W. Link, Michael P. Battaglia, Martin R. Frankel, Larry Osborn, and Ali H. Mokdad, A Comparison of AddressBased Sampling (ABS) Versus RandomDigit Dialing (RDD) for General Population Surveys; Public Opinion Q, Spring 2008; 72: 6  27.

^ http://nces.ed.gov/StatProg/2002/glossary.asp#nonresponse

^ http://www.statpac.com/surveys/sampling.htm
Further reading
The textbook by Groves et alia provides an overview of survey methodology, including recent literature on questionnaire development (informed by cognitive psychology) :

Robert Groves, et alia. Survey methodology (2010) Second edition of the (2004) first edition ISBN 0471483486.
The other books focus on the statistical theory of survey sampling and require some knowledge of basic statistics, as discussed in the following textbooks:
The elementary book by Scheaffer et alia uses quadratic equations from highschool algebra:

Scheaffer, Richard L., William Mendenhal and R. Lyman Ott. Elementary survey sampling, Fifth Edition. Belmont: Duxbury Press, 1996.
More mathematical statistics is required for Lohr, for Särndal et alia, and for Cochran (classic):
The historically important books by Deming and Kish remain valuable for insights for social scientists (particularly about the U.S. census and the Institute for Social Research at the University of Michigan):


Kish, Leslie (1995) Survey Sampling, Wiley, ISBN 0471109495
External links

CRAN Task View Survey Methodology

What is a Survey? Booklet published by National Opinion Research Center and The American Statistical Association

article Organizational Research: Determining Sample Size in Survey ResearchJournal of Information Technology Learning and Performance

Sample Design and Confidence Intervals
This article was sourced from Creative Commons AttributionShareAlike License; additional terms may apply. World Heritage Encyclopedia content is assembled from numerous content providers, Open Access Publishing, and in compliance with The Fair Access to Science and Technology Research Act (FASTR), Wikimedia Foundation, Inc., Public Library of Science, The Encyclopedia of Life, Open Book Publishers (OBP), PubMed, U.S. National Library of Medicine, National Center for Biotechnology Information, U.S. National Library of Medicine, National Institutes of Health (NIH), U.S. Department of Health & Human Services, and USA.gov, which sources content from all federal, state, local, tribal, and territorial government publication portals (.gov, .mil, .edu). Funding for USA.gov and content contributors is made possible from the U.S. Congress, EGovernment Act of 2002.
Crowd sourced content that is contributed to World Heritage Encyclopedia is peer reviewed and edited by our editorial staff to ensure quality scholarly research articles.
By using this site, you agree to the Terms of Use and Privacy Policy. World Heritage Encyclopedia™ is a registered trademark of the World Public Library Association, a nonprofit organization.