2027 Public Health PhD Research: Designing a Realist Evaluation Across Multiple Sites

Imed Bouchrika, PhD

by Imed Bouchrika, PhD

Co-Founder and Chief Data Scientist

What is a realist evaluation in public health research?

A realist evaluation examines how a program generates outcomes through mechanisms that operate under particular conditions. Its working unit is often a context-mechanism-outcome configuration, or CMO. Context includes features such as staffing, policy, community trust, and service access. A mechanism is the response or reasoning that program resources trigger - for example, whether a trusted referral makes a participant feel that seeking care is worthwhile. An outcome is the resulting change the evaluation investigates. The referral itself is an activity, not necessarily the mechanism.

Suppose a hypothetical community screening initiative has higher follow-up in some locations than others. A provisional theory might be that a personal referral prompts follow-up when patients trust the referring worker and can reach the clinic. Interviews, implementation records, and follow-up data could challenge or refine that theory. This is an illustrative design, not a finding or proof that the referral caused the difference.

Realist evaluation is especially useful when the research question concerns how an intervention travels across settings. If the primary question is an average effect under a specified comparison, a conventional impact design may be a better centerpiece; the approaches can also complement one another.

An MPH or research-oriented MS may provide a route into evaluation work, while a PhD is most relevant when the goal is an original, sustained scholarly contribution. Readers weighing that preparation can compare MPH and related public health graduate pathways.

How does a multisite realist evaluation work in public health?

The design begins with a program theory: a set of testable explanations of how the intervention is expected to work for different people and settings. Sites are then selected for informative variation, not merely convenience. For example, a researcher might compare locations with different staffing models or referral pathways while documenting differences in populations served. Variation helps test explanations, but poorly documented variation makes interpretation harder.

The following table shows what a cross-site comparison should distinguish. Each column answers a different question; an observed outcome alone cannot reveal the mechanism behind it.

Evidence categoryIllustrative screening-program questionInterpretive caution
ContextAre clinic access, staffing, and community relationships different?Do not treat a site label as an explanation.
Program resourceWho offers referrals, and how are they delivered?Delivery may differ from the written protocol.
Candidate mechanismDoes the referral prompt confidence, reassurance, or concern?Infer reasoning from appropriate evidence, not outcomes alone.
OutcomeWho completes follow-up, and over what interval?Check definitions, missing records, and who enters the denominator.

A feasible dissertation follows a sequence that leaves room for the theory to change:

  1. Specify the population, intervention, outcome, time window, initial CMOs, and plausible rival explanations.
  2. Secure partner agreements and confirm what each site can provide before finalizing sampling or measures.
  3. Collect complementary evidence, such as documents, interviews, observations, and appropriately accessible routine data; document differences in how each source was produced.
  4. Analyze cases within each site first, then compare where a proposed mechanism appears to operate, fail, or take a different form.
  5. Refine the theory with disconfirming cases and report what the evidence cannot establish.

Comparable outcome definitions matter, but forcing identical interview questions or delivery practices onto unlike settings can hide meaningful context. A prospective doctoral researcher who mainly wants to help implement or monitor a program may need supervised evaluation experience rather than a dissertation; public health BS programs and career preparation describe an earlier-stage route into that work.

What are the median weekly earnings for workers without a HS diploma?

What does a public health PhD prepare graduates to do?

A public health PhD develops the ability to formulate research questions, select defensible methods, manage research ethics, analyze evidence, publish findings, and build an independent line of inquiry. For multisite realist work, that means explaining not only what happened at participating sites but also how confidently the evidence supports a transferable explanation - not a promise that another site will achieve the same result.

A practice-focused DrPH may be a better fit for someone whose chief objective is to lead improvement within an organization. A PhD is generally the stronger fit for an applicant who wants to develop and test theory, produce a dissertation, and compete for research-intensive roles. Neither degree substitutes for partner relationships or experience conducting interviews and interpreting program data.

If the immediate goal is advancement in practice rather than independent research, review MPH compensation and career advancement before assuming another doctorate is necessary.

What should you look for in a multisite realist evaluation PhD program?

The strongest fit is a program where the proposed question can survive contact with its supervision, funding, and partner arrangements. Look for faculty who can critique theory-driven evaluation, committee members who cover the needed qualitative and quantitative methods, and a realistic route to the sites. A well-known department without available mentorship or accessible data may be a weaker choice than a less prominent program with both.

Before accepting an offer, put these questions to the prospective advisor and doctoral director:

  • Who can supervise realist evaluation, and who will advise on cross-site sampling, qualitative rigor, and outcome measurement?
  • Which partner permissions, data-use agreements, community approvals, and institutional review determinations are needed before recruitment or record access?
  • What happens to supervision, funding, and dissertation scope if an advisor leaves or a site withdraws?
  • Who controls publication review, site identification, and authorship, and how are disagreements with partners handled?
  • Which milestones and funding conditions apply if approvals or fieldwork take longer than planned?

Compare the answers in writing alongside each offer's funding terms and dissertation policies. Doctoral public health study costs and career directions can provide a broader comparison, but for this project the deciding evidence is whether a feasible research design and durable mentoring arrangement exist.

Other Things You Should Know About Public Health

Can a dissertation site remain anonymous?

Sometimes, but anonymity is difficult when a site's location, program, or distinctive characteristics make it recognizable. Agree on disclosure and publication review terms early, and do not promise anonymity that the dissertation cannot protect.

What if a partner site withdraws during the study?

Follow the agreement and applicable review requirements, then consult the advisor about whether the remaining sites can still test the research questions. A contingency plan should address recruitment, permitted use of previously collected data, and changes to dissertation scope.

Can existing program records replace participant interviews?

Records may document delivery and outcomes, but they seldom establish participants' reasoning by themselves. Whether interviews are necessary depends on the proposed mechanisms and what other ethically accessible evidence can test them.

Can community partners coauthor publications from the evaluation?

Yes, when their contributions meet the relevant journal's authorship criteria and all authors can take the required responsibility for the work. Discuss contributions, review timelines, confidentiality, and disagreements before drafting.