2027 Public Health PhD Research: Evaluating a Synthetic Control for a Policy Study

Imed Bouchrika, PhD

by Imed Bouchrika, PhD

Co-Founder and Chief Data Scientist

What is synthetic control research in public health policy evaluation?

A synthetic control is a comparison assembled from a weighted combination of places or other units that did not receive the policy being studied. The weights are selected using information from before the policy, often including earlier values of the outcome. The researcher then compares the treated unit's observed outcome after implementation with its synthetic counterpart's outcome. That counterpart represents an estimate of what might have happened without the policy - not an observed fact.

Consider an illustrative study of a state tobacco-tax change and smoking-related hospitalizations. The treated unit is the state; potential donors are states without comparable changes during the study period; the outcome is a consistently defined hospitalization rate. The difference between the treated and synthetic series after the tax change is the estimated effect for that state and period. It does not automatically identify the effect in other states, explain the mechanism, or establish that the tax alone caused every observed change.

The design is most useful when a policy affects a limited number of identifiable units, comparable untreated units exist, and repeated outcome measurements cover meaningful periods before and after implementation. A large contemporaneous national policy, changing hospital coding, or widespread cross-border effects can undermine that comparison. If the goal is to learn policy evaluation without pursuing independent scholarship, public health graduate degrees and salary pathways offer context for comparing a research-oriented master's program with doctoral study.

Table of contents

How does a public health PhD prepare researchers for policy studies?

A research-focused PhD should develop the ability to formulate a policy question, defend a causal design, obtain and govern data, carry out reproducible analysis, and explain limitations to academic and policy audiences. A dissertation offers sustained practice in those tasks under faculty and committee supervision. It is not a substitute for policy-specific expertise: the student must understand implementation dates, affected populations, concurrent initiatives, and how the outcome is recorded.

For a proposed synthetic-control dissertation, advisor fit is more specific than a shared interest in "health policy." Ask whether prospective supervisors can advise on comparative causal methods, the policy setting, and the available data. Confirm who would review code and design choices, whether committee members have complementary expertise, and what happens if a supervisor or dataset becomes unavailable. Data access may depend on an agency agreement rather than university admission; clarify publication rights and approval requirements before treating a dataset as a dissertation commitment.

A PhD makes sense when you want to lead a broader program of research and can identify multiple feasible questions if one policy evaluation fails. If your objective is a single workplace analysis, a methods-intensive MS, targeted causal-inference coursework, or supervised collaboration may be a more direct route. Funding affects that choice: use comparing tuition for public health research degrees as a starting point, then obtain each program's actual funding and supervision terms.

       

What methods are used to evaluate synthetic control validity and bias?

The central question is whether the weighted donors provide a credible estimate of the treated unit's untreated outcome path. A good visual match before implementation helps, but it cannot prove that unobserved post-policy changes would have been the same. The researcher needs to examine the design as well as the fitted model.

The following checks address different ways the comparison could fail; none is a stand-alone test of causality.

  • Donor eligibility and interference: Document other policies, exposure to the treated policy, and reasons a donor's trend may have changed. Exclude affected units on substantive grounds rather than because their results are inconvenient.
  • Pre-policy fit and overlap: Plot treated and synthetic trends, report a pre-policy prediction-error measure, and examine whether donors can plausibly reproduce the treated unit. A short or unusually smooth pre-period can make fit misleading.
  • Placebo analyses: Apply the procedure to untreated units or plausible false intervention dates. Large apparent effects elsewhere weaken an exceptional-effect claim; comparisons need care when units differ greatly in pre-policy fit.
  • Sensitivity analyses: Reassess results after removing influential donors, changing a defensible pre-period, or using alternative outcome definitions and specifications. Disclose choices made after seeing the result.
  • Data and timing checks: Investigate missing observations, changing denominators or reporting rules, anticipation before the official start date, and other events occurring near implementation.

Placebo patterns and other uncertainty summaries require interpretation in light of the donor pool; they are not automatically equivalent to randomized-trial confidence intervals. If donors cannot approximate the treated unit before the policy, a comparative interrupted time-series design or a narrower descriptive analysis may be more honest than forcing a synthetic-control result.

Researchers who need introductory evaluation training before doctoral-level work can compare finding online MPH programs that fit your profile, while checking the actual depth of each program's causal-methods coursework.

What job outlook and certifications apply to public health researchers?

Employment projections are published for occupations, not for synthetic-control researchers or public health PhD graduates as a group. Use the current US Bureau of Labor Statistics projection for a relevant occupation - such as epidemiologist or statistician - only after checking that its duties resemble the roles you want. A favorable occupation-wide outlook does not establish demand for a particular method, institution, or applicant.

There is no general professional certification required to use synthetic control. Credentials such as Certified in Public Health may be relevant to some broader roles, but they do not validate causal-inference competence; clinical or regulated positions have separate requirements. Employers are more likely to evaluate whether you can explain assumptions, document reproducible work, protect data, and communicate uncertainty.

If your target is an entry-level public health position rather than leading independent research, a PhD may be unnecessary. A public health BS program selection guide is more relevant to evaluating an undergraduate starting point; supervised projects and the requirements of specific job postings should guide the next step.

Other Things You Should Know About Public Health

Can a state policy study use counties as its comparison units?

Possibly, but counties within the treated state may all be exposed. The comparison units must reflect how the policy operates, and the analysis must account for shared state-level influences rather than treating counties as independent replications of one policy decision.

Can a synthetic control show whether a policy helped a particular community?

Only if appropriate subgroup outcomes and comparison data are available. An effect estimated for an entire state does not automatically describe effects by race, income, geography, or another population characteristic.

Can I publish code from an analysis using restricted health records?

Often you can share approved analysis code, but not restricted records or information that could reveal them. Check the data-use agreement and institutional rules before releasing code, derived data, or small-cell results.

What if the policy ends during the study period?

Treat the end of the policy as a change in exposure, not as an ordinary continuation of the original intervention. Define the periods and research question explicitly; effects may persist, reverse, or be obscured by later changes.