- Atlas
- Mathematics
- Survey Sampling
Survey Sampling
Survey sampling is the branch of statistics that decides which members of a population to measure, and then turns what is measured into estimates of the whole.
12 frameworks, from 1900 to today · Statistics · Mathematics
- Representative and Quota Sampling 1900-1948
- Multistage sampling 1930-Present
- Design-Based Inference 1934-Present
- Weighting and Calibration Adjustment 1940-Present
- Replication Variance Estimation 1950-Present
- Random-Digit Dialing 1960-2005
- Model-Based Inference 1970-Present
- Small-Area Estimation 1970-Present
- Total Survey Error 1970-Present
- Model-Assisted Estimation 1980-Present
- Adaptive and Network Sampling 1990-Present
- Non-Probability and Blended-Source Inference 2005-Present
Overview
Survey sampling is the branch of statistics that decides which members of a population to measure, and then turns what is measured into estimates of the whole12. Its central problem is practical and unavoidable: you cannot ask every household in a country how much it spends, test every manufactured part, or interview every voter2. You must choose a part, and the way you choose it determines whether your conclusions about the whole are trustworthy. The field's history is the story of how that choice was made rigorous—how a "representative" sample became a probability sample with calculable error, how the machinery of estimation and variance grew around it, and how the field has kept adapting as the ways of reaching people changed from face-to-face visits to random-digit telephone dialing to web panels.
Representative sampling before probability
For most of the nineteenth and early twentieth centuries, the dominant idea was the representative sample: choose units so that the sample mirrors the population's known composition—so many from each region, income band, or occupation. This was the logic behind the quota sample, in which an interviewer is given targets (say, 200 women and 200 men, spread across age groups) and fills them by whatever means. Quota sampling was cheap and, in the hands of skilled practitioners, often produced plausible results; it underpinned much market research and early opinion polling.
Its weakness was structural. Because the interviewer chooses whom to approach within each quota, the probability that any given person enters the sample is unknown, and so the sampling error cannot be calculated. The most famous demonstration came in 1936, when the Literary Digest poll, drawing on millions of returned ballots from telephone and automobile-registration lists, predicted a landslide for Alf Landon; George Gallup's much smaller quota-based poll predicted Roosevelt correctly. The lesson drawn at the time was about sample selection (the Digest's lists skewed wealthy), but the deeper point—that without known selection probabilities you cannot quantify uncertainty—became the foundation of the modern field.
The probability-sample revolution
The decisive turn was the idea of probability sampling: every unit in the population is given a known, nonzero chance of selection, and the sample is drawn by a random mechanism12. This single requirement makes inference possible, because the statistician can compute how often a given sampling procedure would produce estimates far from the truth1. The intellectual architect was the Polish mathematician Jerzy Neyman, whose 1934 paper argued that the representative method should be replaced by random selection and that the confidence interval—a range that would contain the true value in a stated fraction of repeated samples—was the proper way to express uncertainty. Neyman's argument reframed the whole enterprise: randomness, not resemblance, is what licenses inference.
The institutional home of the new field was the United States Department of Agriculture and, later, the Census Bureau and the Bureau of Labor Statistics. In the 1930s and 1940s, statisticians there confronted large national problems—estimating farm acreage, unemployment, crop yields—and built the tools that became standard. Multistage area sampling was one such tool: rather than listing every household, the sampler divides the country into nested units (counties, then blocks, then dwellings) and samples at each stage, so that a manageable number of field visits yields a sample with known probabilities3. This made national surveys feasible without a complete population list3.
The theoretical synthesis came with Morris Hansen and William Hurwitz, whose work at the U.S. Census Bureau in the 1940s and 1950s formalized the design-based approach. In design-based inference, the population values are treated as fixed, and randomness comes entirely from the sampling design; the estimator's properties are evaluated over repeated samples from that design. Hansen and Hurwitz developed the ratio and regression estimators, the theory of sampling with unequal probabilities, and the variance formulas that go with them. Their 1953 textbook, written with William Madow, became the field's standard reference and taught a generation how to design a survey and estimate its error.
Estimating the variance
A probability sample gives an estimate, but a survey is useless without an honest statement of its precision. The classical variance formulas depend on the design—stratification, clustering, unequal weights—and for complex designs they become unwieldy. The practical solution was replication variance estimation: instead of deriving a formula, split the sample into subsamples (replicates), compute the estimate from each, and use the spread among them to estimate the variance4. The two dominant forms are the jackknife, which repeatedly drops one unit (or one group) and recomputes, and the bootstrap, which resamples from the observed data567. These methods, developed from the mid-twentieth century onward, let survey statisticians estimate uncertainty for almost any estimator under almost any design, including the ratio and regression estimators that had no simple closed-form variance.
Weighting and adjustment
Real samples are never perfectly balanced. Some groups are over- or under-represented, some units fail to respond, and the sampler must correct. Weighting assigns each sampled unit an influence proportional to how many population units it stands for—the inverse of its selection probability—and adjustment modifies those weights to compensate for nonresponse and to align the sample with known population totals (a procedure called post-stratification or calibration). The tension is real: weighting corrects bias but inflates variance, and the field developed a body of theory on how to trade the two. This machinery is what lets a survey of a few thousand people speak, however imperfectly, for a nation.
The total survey error framework
By the mid-twentieth century, practitioners recognized that sampling error was only one of many ways a survey can go wrong. The total survey error framework, articulated most influentially by Robert Groves and colleagues, organized the field's thinking around two families of error: sampling error (from measuring only a part) and nonsampling error (coverage, nonresponse, measurement, and processing error). The framework's value was diagnostic—it forced designers to weigh the errors against each other, since spending more to reduce one (say, a larger sample) might leave another (say, nonresponse bias) untouched. It reframed survey quality as a budget-allocation problem across all sources of error, not a single number.
Telephone, then the internet
The rise of the telephone reshaped sampling practice. Early telephone surveys suffered from coverage bias, since phone ownership was uneven1. Random-digit dialing (RDD), developed in the 1960s and refined through the 1970s and 1980s, solved the listing problem: by generating random telephone numbers within known area-code and exchange prefixes, it reached unlisted households and gave every residential number a known chance of selection. RDD became the workhorse of political polling and social research for decades.
Its decline is one of the field's clearest recent turning points. As households abandoned landlines for mobile phones and increasingly screened calls, RDD's coverage and response rates fell, and the cost of reaching a representative sample rose sharply. The field turned to address-based sampling (drawing from postal address frames) and, increasingly, to online panels and other non-probability sources. This has reopened the oldest question in the field: when selection probabilities are unknown, can weighting and modeling still deliver trustworthy estimates? Much current methodological work—on calibration, on propensity adjustment, on combining probability and non-probability samples—is an attempt to answer it.
Model-based and model-assisted inference
The design-based orthodoxy was never the only option. Model-based inference treats the population values as random draws from a statistical model and bases estimates and their uncertainty on that model rather than on the sampling design. Its appeal is that it can borrow strength across variables and handle small samples where design-based variance is unstable. The risk is model misspecification: if the model is wrong, the inference is wrong, and the design offers no protection.
Model-assisted estimation is the pragmatic middle ground, developed especially from the 1980s onward. It uses a model to improve an estimator—typically a regression or ratio estimator—but calibrates the result so that it remains approximately design-unbiased even if the model is imperfect. The generalized regression (GREG) estimator is the canonical example: it uses auxiliary data (say, known population totals from a census) to sharpen estimates while retaining design-based guarantees. This synthesis—models for efficiency, design for validity—is now standard.
Small-area estimation and adaptive designs
Two further developments extended the field's reach. Small-area estimation addresses the problem of producing estimates for domains (a small county, a demographic subgroup) where the sample is too thin for direct estimation8. The solution is to borrow strength from related areas and auxiliary data through models—often hierarchical or Bayesian—yielding estimates with acceptable precision where direct design-based estimates would be hopeless. This has become essential for official statistics and health and demographic research.
Adaptive and network sampling tackle populations that are rare, hidden, or clustered—people with a rare disease, or members of a social network19. In adaptive designs, the sampling rule changes as data accumulate (for example, sampling more intensively where cases are found). In network or respondent-driven sampling, participants recruit others from their social network, and the resulting referral chains are used to estimate the size and characteristics of the hidden population19. These designs trade the clean probabilities of classical sampling for reach into populations no list can capture, and their theory—how to weight and estimate from such chains—remains an active research frontier.
The field today
Contemporary survey sampling is a plural enterprise. Design-based inference remains the backbone of official statistics and large government surveys, where known selection probabilities and replication-based variance estimation are the norm. Model-assisted methods are routine wherever auxiliary data exist. Model-based and Bayesian approaches dominate small-area estimation and are increasingly used to combine disparate data sources. The rise of non-probability data—web panels, administrative records, and "big data" streams—has pushed the field toward methods that diagnose and correct selection bias through modeling and calibration, and toward total survey error as the organizing framework for weighing every source of error at once. The open questions are the old ones in new dress: how to quantify uncertainty when selection probabilities are unknown, how to integrate probability and non-probability sources without fooling oneself, and how to keep inference honest as the ways of reaching people keep changing.
References
- Survey sampling (introduction, Probability sampling, Non-sampling error in probability sampling, Non-probability sampling), Wikipedia
- Sampling (statistics) (introduction, Sampling frame), Wikipedia
- Multistage sampling, Wikipedia
- Imputation and Variance Estimation Software, Wikipedia
- Resampling (statistics), Wikipedia
- Jackknife resampling, Wikipedia
- Bootstrapping (statistics), Wikipedia
- Small area estimation, Wikipedia
- Snowball sampling, Wikipedia
The frameworks of Survey Sampling
Each framework is a way of working the field has used: when it held, and the question it answers.
- 1900-1948
Representative and Quota Sampling
How should a sample mirror the population?
- 1930-Present
Multistage sampling
How can national samples be drawn without a full list?
- 1934-Present
- 1940-Present
Weighting and Calibration Adjustment
How should weights correct for imbalance and nonresponse?
- 1950-Present
Replication Variance Estimation
How can variance be estimated for complex designs?
- 1960-2005
Random-Digit Dialing
How can telephone households be sampled with known chances?
- 1970-Present
Model-Based Inference
When should inference rest on a statistical model?
- 1970-Present
- 1970-Present
- 1980-Present
Model-Assisted Estimation
How can models improve estimates without biasing them?
- 1990-Present
Adaptive and Network Sampling
How should sampling adapt as data are collected?
- 2005-Present
Non-Probability and Blended-Source Inference
Can non-probability samples yield trustworthy estimates?
How the ideas connect
Each arrow runs from an earlier idea to the later one it shaped. The list below says what passed between them.
Design-Based Inference reacted against Representative and Quota Sampling
Neyman's 1934 paper attacked representative and quota sampling, arguing that random selection with known probabilities, not resemblance to the population, is what licenses inference.
Carried by Jerzy Neyman.
Model-Based Inference reacted against Design-Based Inference
Model-based inference arose as a challenge to design-based orthodoxy, treating population values as random draws from a model rather than fixing them and randomizing only the sample.
Model-Assisted Estimation grew out of Design-Based Inference
Model-assisted estimation grew directly out of design-based inference, using models to improve ratio and regression estimators while calibrating them to remain approximately design-unbiased.
Design-Based Inference influenced by Multistage sampling
Multistage area designs created the complex selection probabilities and clustering that Hansen and Hurwitz's design-based variance theory was built to handle.
Carried by Morris Hansen; William Hurwitz.
Replication Variance Estimation grew out of Design-Based Inference
Replication methods such as the jackknife were developed to estimate variances for the ratio and regression estimators of design-based theory whose closed-form variances were intractable.
Model-Assisted Estimation influenced by Weighting and Calibration Adjustment
Calibration weighting and post-stratification supplied the machinery by which model-assisted estimators such as GREG align model predictions with known population totals.
Non-Probability and Blended-Source Inference influenced by Weighting and Calibration Adjustment
Calibration and propensity weighting developed for probability samples were carried over to non-probability and blended-source inference, where selection probabilities are unknown and must be modeled.
Non-Probability and Blended-Source Inference influenced by Random-Digit Dialing
The decline of random-digit dialing from falling coverage and response pushed the field toward address-based frames, online panels and non-probability sources, reopening the question of inference without known selection probabilities.
Model-Assisted Estimation influenced by Model-Based Inference
Model-assisted estimation took the model-based insight that auxiliary models can improve estimates but disciplined it with design-based calibration to guard against misspecification.
Total Survey Error influenced by Design-Based Inference
Design-based sampling error theory gave total survey error its sampling-error component, against which coverage, nonresponse and measurement errors were then weighed.
Non-Probability and Blended-Source Inference influenced by Total Survey Error
Total survey error thinking framed the shift to blended and non-probability sources as a trade of sampling error for coverage and nonresponse error, guiding how mixed-source estimates are combined and assessed.
Carried by Robert Groves.
Beyond the field
Where Survey Sampling's ideas came from in other fields, and what they led to there: the strongest 12 of 43 links.
Representative and Quota Sampling influenced Survey methodology in Marketing Research
Representative and quota sampling techniques developed in polling and government statistics, culminating in the work of statisticians on probability sampling, supplied the core sampling logic that survey methodology adopted. The failure of quota sampling in the 1948 US election polls pushed survey methodology toward probability-based representative sampling.
Carried by Representative and Quota Sampling.
Design-Based Inference influenced Survey research and quantitative modeling in Sociology
Design-based inference, developed in survey sampling by Neyman and later Hansen-Hurwitz, supplied the probability-sampling logic that sociological survey research adopted. The shift from quota to probability sampling in the 1940s carried this into the field.
Carried by Jerzy Neyman; Morris Hansen.
Design-Based Inference influenced Sampling design in Forest Inventory And Biometrics
Forest sampling design was built directly on the design-based inference framework of survey sampling, especially Neyman's 1934 stratified random sampling results. Forest inventory adopted probability sampling with known inclusion probabilities and unbiased estimators from that tradition.
Carried by Jerzy Neyman.
Model-Based Inference reacted against Design-based and randomization inference in Statistical Inference
Model-based inference in survey sampling grew out of the design-based randomization framework of Neyman and later authors, which it generalised by replacing the fixed design with an explicit statistical model while keeping design-based inference as a special case.
Carried by Jerzy Neyman; Richard Royall; Carl-Erik Särndal.
Model-Based Inference grew out of Frequentist Inference in Statistical Inference
Model-based survey inference is a branch of frequentist inference, applying its likelihood and repeated-sampling reasoning to survey populations under superpopulation models.
Small-Area Estimation led to Computational and Bayesian Small-Area Estimation in Global Health Metrics And Evaluation
Computational and Bayesian small-area estimation is a direct extension of survey-sampling small-area estimation, adding Bayesian hierarchical models and computation to the same problem of estimating for small domains.
Small-Area Estimation influenced by Empirical Bayes in Statistical Inference
Empirical Bayes methods, especially the Fay-Herriot approach, are the core technique of small-area estimation, borrowing strength across areas by estimating prior distributions from the data.
Carried by Herbert Robbins; Robert Fay; Roger Herriot.
Total Survey Error grew out of Survey methodology in Marketing Research
Total survey error is a framework within survey methodology, systematising its accumulated catalogue of sampling and non-sampling errors into a single mean-squared-error decomposition.
Carried by Robert Groves.
Representative and Quota Sampling replaced by Survey research and quantitative modeling in Sociology
Representative and quota sampling was the earlier practice that probability-based survey research replaced in the 1940s, retaining quota methods only as a limiting case. The adoption of probability sampling by academic survey organizations marks the transition.
Carried by Jerzy Neyman.
Multistage sampling influenced by Sanitary and Social Survey Investigation in Urban Social History
The nineteenth-century sanitary and social survey investigations, such as Booth's and Rowntree's poverty surveys, established the practice of surveying households area by area. Multistage sampling formalised this area-based, nested selection of districts, then blocks, then households.
Carried by Charles Booth; Seebohm Rowntree.
Multistage sampling influenced Sampling design in Forest Inventory And Biometrics
Multistage sampling theory, developed for social and agricultural surveys, supplied the nested sampling structure used in forest inventories where stands, plots and subplots are selected in stages. Forest sampling design took over this multistage estimator framework.
Design-Based Inference influenced Resampling in Statistical Computing
Design-based inference in survey sampling supplied the idea of treating the observed sample as fixed and randomizing over selection, which the bootstrap adapted to estimate variance. Resampling took its inferential stance from the design-based tradition.

Survey Sampling is a planet in Nousfarer
Its city has a tower for each of these 12 frameworks. Land, walk in, and climb one concept at a time.
Land on Survey SamplingRelated fields
Fields its ideas are linked to
- Statistical Inference 15 links
- Forest Inventory And Biometrics 4 links
- Sociology 4 links
- Marketing Research 3 links
- Statistical Computing 3 links
- Causal Inference 2 links
- Panel Data Methods 1 link
- Education 1 link
- Educational Assessment 1 link
- Public Health Informatics 1 link
- Compensation And Rewards 1 link
- Global Health Metrics And Evaluation 1 link
More in Statistics
- Bayesian Statistics
- Causal Inference
- Experimental Design
- Multivariate Statistics
- Nonparametric Statistics
- Regression Analysis
- Spatial Statistics
- Statistical Computing
- Statistical Inference
- Statistical Learning
- Statistics
- Survival Analysis
- Time Series Analysis
See where Survey Sampling sits on the Map of Human Knowledge