- Atlas
- Medicine & Health
- Public Health Program Evaluation
Public Health Program Evaluation
Public health program evaluation is the systematic work of finding out whether an organized effort to improve population health actually did what it promised, and why.
14 frameworks, from 1840 to today · Public Health · Medicine & Health
- Program Statistics and Vital Statistics Reporting 1840-1960
- Objectives-Based Evaluation 1930-1980
- Experimental and Quasi-Experimental Design 1948-Present
- Randomized Controlled Trial Evaluation 1948-Present
- Countenance Model 1967-1990
- Formative and Summative Evaluation 1967-Present
- Logic model 1970-Present
- CIPP evaluation model 1971-Present
- Goal-Free Evaluation 1972-2000
- Community Trial 1978-Present
- Utilization-Focused Evaluation 1978-Present
- Evidence-Based Public Health and Systematic Review 1993-Present
- Implementation research 1995-Present
- Realist Evaluation 1997-Present
Overview
Public health program evaluation is the systematic work of finding out whether an organized effort to improve population health actually did what it promised, and why1. Its practitioners ask three linked questions: Did the program reach the people it meant to reach1? Did it change anything1? And was the change worth what it cost1? The field matters because public health runs on collective action—vaccination campaigns, tobacco taxes, school meal standards, sanitation drives—and money spent on a program that does not work is money not spent on one that does. Evaluation is how the field learns from its own interventions rather than assuming good intentions produce good outcomes.
Counting the Population: Vital Statistics and the First Evaluations
The oldest strand is measurement. Before anyone could evaluate a program, someone had to know how many people were born, who died, and of what. In England, the Bills of Mortality were published weekly from the early seventeenth century, and John Graunt's Natural and Political Observations (1662) used them to estimate death rates and describe patterns of mortality. In the nineteenth century, William Farr, as compiler of abstracts in the General Register Office from 1839, built England's system of vital statistics into a tool for comparing death rates across districts and occupations. This was evaluation in embryo: a program or a condition could be judged by whether the numbers moved.
The sanitary movement made the link explicit. When John Snow investigated the Broad Street pump in 1854, he was not only explaining a cholera outbreak but testing a claim about how cholera spread—and the removal of the pump handle was an intervention whose effect could be read in the falling case counts. The idea that a public health action could be assessed by its consequences, counted before and after, is the ancestor of everything that follows.
The Randomized Controlled Trial and the Problem of Causation
The central difficulty of evaluation is that populations change for many reasons at once. A vaccination campaign that coincides with a mild season will look effective whether or not it was. The randomized controlled trial (RCT)—in which participants are assigned by chance to receive an intervention or not—solves this by making the groups comparable on everything except the intervention. The first widely recognized RCT in medicine is usually dated to the 1948 streptomycin trial for tuberculosis, run by the British Medical Research Council under Austin Bradford Hill. In public health, the classic early example is the field trial of the Salk polio vaccine in 1954, which randomized schoolchildren across the United States and showed the vaccine protected against paralytic polio.
The RCT gave evaluation a gold standard, but it also created a tension that has shaped the field ever since. Many public health programs cannot be randomized: a city cannot be randomly assigned to fluoridate its water without political and ethical complications, and a national tobacco policy cannot be withheld from a control group. This pushed evaluators toward quasi-experimental designs—studies that compare groups or periods without random assignment, using techniques such as before-and-after comparisons, matched comparison areas, interrupted time series, and regression discontinuity. Donald Campbell and Julian Stanley's Experimental and Quasi-Experimental Designs for Research (1963) became the standard reference, teaching a generation that credible causal claims could be built from carefully chosen comparison groups even when randomization was impossible. The community trial, in which whole communities rather than individuals are the unit of assignment, extended the logic to population-level interventions; the Stanford Five-City Project and the Minnesota Heart Health Program in the 1970s and 1980s were ambitious attempts to test community-wide cardiovascular prevention, and their mixed results taught the field how hard it is to detect the effect of a diffuse program.
Evaluation Comes of Age: Models and Debates
Through the 1960s and 1970s, evaluation grew into a profession with its own theories. In the United States, the Great Society programs of the 1960s—Head Start, Model Cities, community health centers—created a demand for evaluation and a federal expectation that programs would be judged. Out of this ferment came competing models.
Ralph Tyler's objectives-based approach, developed earlier in education, held that evaluation should measure whether stated objectives were met. Robert Stake's Countenance Model (1967) complicated this by distinguishing what was intended from what actually happened, and by looking at antecedents, transactions, and outcomes rather than outcomes alone. Daniel Stufflebeam's CIPP model (context, input, process, product) proposed that evaluation should examine the setting, the resources, the implementation, and the results—not just the final outcome12. Michael Scriven drew the distinction between formative evaluation, which feeds back during a program's development to improve it, and summative evaluation, which judges a finished program's worth3. Scriven also argued for goal-free evaluation: an evaluator who does not know the program's stated goals is less likely to miss unintended effects, whether good or bad.
These models were not merely academic. They reflected a real dispute about what evaluation was for. Was it a service to program managers, helping them improve? Or a service to funders and the public, helping them decide? Carol Weiss's work on how evaluation is actually used—her 1970s research showed that findings often influence decisions indirectly, by changing how people think about a problem, rather than by directly triggering a decision—reframed the question. Michael Quinn Patton's utilization-focused evaluation (1978 onward) built on this: evaluation should be designed from the start around the specific decisions its intended users will face, with those users involved in shaping the questions. The approach claimed that evaluations failed less often because of bad methods than because nobody used them.
Realist Evaluation and the Question of Mechanism
By the 1990s, a further dissatisfaction had set in. RCTs and quasi-experiments could show whether a program worked on average, but not why, for whom, or under what conditions. A program that succeeded in one city might fail in another, and the trial design offered no account of the difference. Realist evaluation, associated with Ray Pawson and Nick Tilley's Realistic Evaluation (1997), proposed that evaluation should identify the underlying mechanism—the process by which the program produces its effect—and the contexts in which that mechanism operates. The formula "$\text{mechanism} + \text{context} = \text{outcome}$" became its shorthand. A realist evaluator asks not "does this work?" but "how does this work, for whom, in what circumstances?" This was a direct challenge to the dominance of the experimental model and drew heavily on public health and social program experience.
Implementation Science and the Fidelity Problem
A parallel development asked a different question: even when a program is known to work, why does it so often fail when taken to scale? Implementation science emerged in the 1990s and 2000s to study the gap between evidence and practice. Its central concept is implementation fidelity—the degree to which a program is delivered as designed—and its central finding is that many programs fail not because the idea was wrong but because the delivery was incomplete, underfunded, or adapted beyond recognition. The field produced frameworks for understanding implementation (such as the Consolidated Framework for Implementation Research, published in 2009) and measures of fidelity, and it pushed evaluators to study process as carefully as outcomes. The logic model, a diagram tracing a program's inputs through activities and outputs to outcomes, became a standard tool for making a program's theory of change explicit and testable; the results chain is a close relative used in international development.
Evidence-Based Public Health and the Systematic Review
The final major strand is the movement toward synthesizing evidence. The Cochrane Collaboration, founded in 1993, and the Campbell Collaboration, founded in 2000, built systems for systematic reviews—structured, transparent summaries of all the studies on a question, often combined statistically in meta-analysis. The GRADE approach, developed in the 2000s, gave a common language for rating the certainty of evidence. Evidence-based public health, articulated in the 1990s and 2000s, argued that program decisions should rest on the best available research evidence, combined with local data and community values. This changed what evaluators were expected to produce: not just a verdict on one program, but a contribution to a cumulative evidence base that could guide future programs.
The Present
Today the field is plural. Experimental and quasi-experimental designs remain central, but they sit alongside realist, theory-based, and utilization-focused approaches, and mixed-methods designs that combine them are common. Implementation science has become a field in its own right, with its own journals and frameworks. Systematic reviews and evidence grading are routine. The open questions are real: how to evaluate complex, multi-component interventions whose effects are diffuse and long-delayed; how to weigh local context against generalizable evidence; how to involve communities in defining what counts as success; and how to evaluate programs in low- and middle-income settings where the experimental infrastructure is thin. The field's history is a record of successive attempts to answer a single stubborn question—how do we know whether we made a difference?—and each generation's answer has been more demanding than the last.
References
- Program evaluation (introduction, Assessing implementation, Assessing the impact (effectiveness), Conducting an evaluation, Assessing efficiency, History of the CIPP model), Wikipedia
- CIPP evaluation model, Wikipedia
- Formative assessment (Origin of the term), Wikipedia
The frameworks of Public Health Program Evaluation
Each framework is a way of working the field has used: when it held, and the question it answers.
- 1840-1960
Program Statistics and Vital Statistics Reporting
How many people are born, die, and of what?
- 1930-1980
- 1948-Present
Experimental and Quasi-Experimental Design
Can we infer cause without random assignment?
- 1948-Present
Randomized Controlled Trial Evaluation
Does the intervention cause the outcome?
- 1967-1990
Countenance Model
How do intentions compare with what actually happened?
- 1967-Present
Formative and Summative Evaluation
Is evaluation for improving or for judging?
- 1970-Present
- 1971-Present
CIPP evaluation model
What should be examined: context, inputs, process, results?
- 1972-2000
- 1978-Present
- 1978-Present
Utilization-Focused Evaluation
Will the intended users actually use the findings?
- 1993-Present
Evidence-Based Public Health and Systematic Review
What does all the evidence together say?
- 1995-Present
- 1997-Present
Realist Evaluation
How does a program work, for whom, in what circumstances?
How the ideas connect
Each arrow runs from an earlier idea to the later one it shaped. The list below says what passed between them.
Countenance Model reacted against Objectives-Based Evaluation
Stake's Countenance Model defined itself against the narrow objectives-based approach by insisting that evaluation compare intended and actual antecedents, transactions and outcomes rather than only check stated objectives.
Carried by Robert Stake; Countenance Model (1967).
Goal-Free Evaluation reacted against Objectives-Based Evaluation
Scriven's goal-free evaluation attacked the objectives-based premise that a program should be judged against its own stated goals, arguing that withholding the goals lets the evaluator detect unintended effects.
Carried by Michael Scriven.
Community Trial grew out of Experimental and Quasi-Experimental Design
The community trial extended quasi-experimental comparison logic to whole communities as the unit of assignment, using matched comparison sites and before-after series when individual randomization was impossible.
Carried by Stanford Five-City Project; Minnesota Heart Health Program.
Realist Evaluation reacted against Experimental and Quasi-Experimental Design
Realist evaluation defined itself against the experimental and quasi-experimental model's question of whether a program works on average, asking instead how, for whom and in what circumstances a mechanism operates.
Carried by Ray Pawson; Nick Tilley; Realistic Evaluation (1997).
Community Trial influenced by Randomized Controlled Trial Evaluation
Community trials carried the RCT's causal logic to population-level interventions, assigning or comparing whole communities because individuals could not be randomized to a city-wide program.
Carried by Stanford Five-City Project; Minnesota Heart Health Program.
Evidence-Based Public Health and Systematic Review influenced by Randomized Controlled Trial Evaluation
Systematic review and evidence-based public health took the RCT as the privileged source of evidence, building transparent methods to find, appraise and pool trials into a cumulative evidence base.
Carried by Cochrane Collaboration; GRADE.
Realist Evaluation reacted against Randomized Controlled Trial Evaluation
Pawson and Tilley's realist evaluation attacked the RCT's average treatment effect as uninformative about mechanism and context, replacing 'does it work?' with 'how does it work, for whom, in what circumstances?'
Carried by Ray Pawson; Nick Tilley; Realistic Evaluation (1997).
Utilization-Focused Evaluation influenced by Formative and Summative Evaluation
Patton's utilization-focused evaluation built on Scriven's formative-summative distinction and on research showing evaluation is used indirectly, designing evaluation around the decisions of intended users.
Carried by Michael Quinn Patton; Carol Weiss.
Evidence-Based Public Health and Systematic Review influenced by Experimental and Quasi-Experimental Design
Systematic reviews and GRADE extended the quasi-experimental design tradition by grading the certainty of non-randomized studies alongside trials when synthesizing evidence for program decisions.
Carried by GRADE.
Beyond the field
Where Public Health Program Evaluation's ideas came from in other fields, and what they led to there: the strongest 12 of 95 links.
Program Statistics and Vital Statistics Reporting grew out of Political Arithmetic and Vital Statistics in Biostatistics
Political arithmetic, the numerical study of births and deaths begun by Graunt and Petty, supplied the rate calculations and population reasoning that civil registration and program statistics later institutionalised.
Carried by John Graunt; William Petty.
Experimental and Quasi-Experimental Design influenced by Randomized controlled trial in Experimental Design
The randomized controlled trial as an experimental design supplied the assignment and comparison procedures that experimental and quasi-experimental evaluation formalised for programs.
Carried by Donald T. Campbell; Julian C. Stanley.
Experimental and Quasi-Experimental Design influenced by Randomized Experimental Design in Causal Inference
Randomized experimental design, developed in agricultural and clinical statistics, supplied the random assignment and comparison-group logic that experimental and quasi-experimental evaluation adopted.
Carried by Ronald A. Fisher.
Experimental and Quasi-Experimental Design influenced Quasi-experiment in Health Policy Evaluation
Campbell and Stanley's experimental and quasi-experimental design codified the quasi-experiment as a named design, which the health policy quasi-experiment framework then adopted.
Carried by Donald T. Campbell; Julian C. Stanley; Experimental and Quasi-Experimental Designs for Research (1963).
Randomized Controlled Trial Evaluation influenced External Validity and Scale-Up Evaluation in Impact Evaluation
The randomized controlled trial tradition in public health, codified from the 1948 streptomycin trial onward, supplied the randomization and comparison design that randomized impact evaluation in development adopted in the 2000s.
Carried by Austin Bradford Hill.
Randomized Controlled Trial Evaluation influenced Quantitative Intervention and Theory-Testing Research in Nursing Research Methods
Nursing's quantitative intervention research took the randomized controlled trial design, with randomization, control groups and statistical testing, from the clinical-trial movement that began with the 1948 streptomycin trial.
Randomized Controlled Trial Evaluation influenced Complex Interventions Evaluation in Health Promotion
The randomised controlled trial, established in mid-twentieth-century clinical and public health evaluation, is the core design complex-intervention evaluation adapted, adding clustering and process evaluation to handle multi-component interventions.
Carried by Austin Bradford Hill; Streptomycin trial (1948).
Randomized Controlled Trial Evaluation influenced Randomized Impact Evaluation in Microfinance
Randomized impact evaluation in microfinance adopted the randomized controlled trial method developed in public-health program evaluation. Development economists imported the RCT design to test microcredit and other interventions.
Randomized Controlled Trial Evaluation influenced Randomized Controlled Trials in Development in Human Capital Development
The randomized controlled trial was developed in mid-twentieth-century medicine, above all the streptomycin trial for tuberculosis in 1948, with randomization, control arms and pre-specified outcomes. Development economists adopted this design wholesale for field experiments on poverty programmes.
Carried by Medical Research Council; Streptomycin trial (1948).
CIPP evaluation model grew out of Program Evaluation in Health Policy Evaluation
Stufflebeam's CIPP model was developed within the field of program evaluation as a decision-oriented alternative to objectives-based evaluation, and it is a branch of that broader tradition. It grew directly out of the evaluation practice and debates of the 1960s and 1970s.
Carried by Daniel Stufflebeam.
Goal-Free Evaluation reacted against Objectives-based evaluation in Educational Assessment
Scriven's goal-free evaluation was defined explicitly against objectives-based evaluation, arguing that judging against stated goals blinds evaluators to unintended effects. The approach arose as a rejection of that dominant model.
Carried by Michael Scriven.
Community Trial influenced by Randomized Controlled Trial in Epidemiological Methods
Community trials apply the randomized controlled trial design, assigning whole communities rather than individuals to intervention and comparison conditions. The design and its randomization logic were taken directly from the RCT tradition.

Public Health Program Evaluation is a planet in Nousfarer
Its city has a tower for each of these 14 frameworks. Land, walk in, and climb one concept at a time.
Land on Public Health Program EvaluationRelated fields
Fields its ideas are linked to
- Health Policy Evaluation 13 links
- Impact Evaluation 10 links
- Health Promotion 8 links
- Implementation And Dissemination Research 7 links
- Educational Assessment 6 links
- Global Health Metrics And Evaluation 5 links
- Social Insurance And Redistribution 3 links
- Public Art Theory 2 links
- Quality Improvement 2 links
- Epidemiological Methods 2 links
- Public Health 2 links
- Nursing Research Methods 2 links
More in Public Health
- Biostatistics
- Environmental Health
- Health Behavior Theory
- Health Equity
- Health Policy
- Health Promotion
- Occupational Health
- Public Health
See where Public Health Program Evaluation sits on the Map of Human Knowledge