Opens in a new tab

Ex ante modelling of interventions

Before you roll out an intervention, estimate the change you can expect and how uncertain it is

What it is

Before a health, nutrition, behavioural or policy intervention is rolled out, we estimate the potential effect it could have on the indicator that matters. We integrate the available sources of information: national surveys, situation reports, data held by your research group or company, and the scientific literature.

The impact is projected counterfactually: what could be expected with the intervention against what could be expected without it, in the same population. This gives an estimate of the incremental change associated with the intervention under explicit assumptions, without mistaking it for the underlying trend.

Objectives

  • Quantify the potential effect of an intervention on an indicator before it is rolled out.
  • Integrate the available sources of information, such as surveys, reports, your own data and the literature, as starting evidence for the estimate, rather than relying on a single source.
  • Estimate the counterfactual scenario: the expected difference with the intervention versus without it, separated from the underlying trend.
  • Put bounds on the uncertainty of the estimate, rather than delivering a single figure with no margin.
Key points

Integrating the available sources

  • We combine whatever sources the case allows: national surveys, situation or behaviour reports, the client's own data and effect sizes from the literature.
  • Each source enters the estimate with a weight and a role that match its quality, how recent it is and how close it is to the target population.
  • When there is more than one independent source, they are checked against each other as evidence triangulation: convergence supports the estimate, and divergence shows which assumptions need revisiting.

Indicator models tailored to the data

  • We choose the model according to the nature of the indicator (continuous, binary, count or time-to-event) and the structure of the data.
  • For continuous indicators with non-linear relationships, flexible models (e.g. generalised additive models) rather than imposed linearity.
  • Where the indicator allows it, we model the full magnitude of the change, not just whether a threshold is crossed: an improvement that does not change the classification can still be a relevant effect.

From input to effect, no shortcuts

  • The effect of an intervention depends on more than its nominal coverage: adherence, compliance and actual utilisation matter too.
  • We model the losses between what is planned, what is rolled out and what actually reaches the target population.
  • The estimated impact reflects realistic implementation conditions, not an optimistic assumption of full coverage.

Counterfactual estimation with uncertainty

  • Expected scenario with the intervention versus expected scenario without it, in the same population and under explicit assumptions.
  • Quantification of the potential change in the target indicator, separated from the underlying trend.
  • Explicit analysis of the uncertainty around the estimate, using Monte Carlo simulation or other uncertainty propagation approaches when the case requires it.

What it is for

  • Estimate the change you can expect before committing resources, instead of choosing an intervention on intuition or an expected impact alone.
  • Make the case for a funding application or a roll-out decision with an estimate built on the available evidence, explicit assumptions and quantified uncertainty.
  • Compare scenarios of coverage, adoption or target population, identifying which assumptions weigh most on the result and where more information is worth obtaining before implementation.
Why choose this service

Committing a programme budget without first estimating its effect is deciding blind

The decision to roll out an intervention is often made on an expected impact that nobody has quantified. You know what you want to achieve, but not how much you can reasonably expect, or with what margin of uncertainty. Modelling the effect before implementation, integrating the available sources and projecting a counterfactual, turns that expectation into an estimate you can defend.

The sources you have, integrated with judgement

You rarely start from a single clean dataset. The usual situation is a national survey, a situation report, some data of your own or scattered literature. We integrate whatever the case offers as starting evidence, weighting each source by its quality, how recent it is and how close it is to your population. When there is more than one independent source, we check them against each other as triangulation: convergence supports the estimate, divergence shows which assumptions need revisiting.

We model the magnitude, not just the threshold

Where the indicator allows it, we model not only whether a threshold is crossed but the full magnitude of the change. An intervention can improve an indicator without changing how an individual or an area is classified. If you only count threshold crossings, that progress stays invisible.

From roll-out to effect, no shortcuts

What is planned is not always what arrives. Actual coverage, adherence, compliance and utilisation all stand between the intervention and the expected effect. We build those losses in, so that the estimated impact reflects realistic implementation conditions, not an optimistic assumption of full coverage.

The projected counterfactual, made explicit

Potential impact is not just what we expect to happen with the intervention: it is the difference from what could be expected without it, in the same population and before roll-out. We project that counterfactual scenario explicitly and bound its uncertainty, so that the figure you present to a funder is an expected incremental effect under clear assumptions, not simply the underlying trend carrying on.

Our process

What working with us looks like

We apply our D²I (Data to Insights) methodology to every service. A structured, iterative and transparent process that turns complex data into actionable knowledge.

01

Kick-off and problem definition

We meet with you to understand the clinical problem, the data available and the objectives of the project. We agree on deliverables, timelines and communication channels, and we sign whatever confidentiality agreements you need to protect your data.

02

Data review and preparation

We assess the quality of your data, identify inconsistencies and limitations, and structure the data for analysis. If critical information is missing, we tell you before going any further. We document every cleaning decision so that the process is traceable and reproducible. In ex ante modelling, this includes gathering and harmonising the available sources, such as surveys, reports, your own data and the literature, and assessing their quality and how close they are to the target population. We also define the assumptions on coverage, adherence, compliance or utilisation that link the planned intervention to the expected effect.

03

Analysis and modelling

We apply the statistical methodology that fits your questions. We work iteratively: we share preliminary results with you, discuss the findings and adjust the approach where needed. We do not work in the dark until the final delivery. For this service, we estimate the potential effect on the indicator by integrating the available sources as starting evidence, project the scenario with the intervention against the scenario without it, and bound the uncertainty of the result. When there is more than one independent source, we check them against each other as evidence triangulation.

04

Communicating results

We turn the findings into the format you need: a technical report, tables and figures for publication, an interactive dashboard or an executive presentation. We always include the clinical interpretation, not just the figures.

05

Impact review session

30 days after delivery we meet with you again for a 60-minute strategy session. By then you have had time to present the results internally, the real implementation questions have come up and you can assess the impact of the work with some perspective. We answer your questions, adjust interpretations where necessary and agree together on the way forward.

This is our general process. If you want to understand how we apply it technically to each type of analysis, see our full D²I methodology.

Have a data project on your hands?

Tell us about your case and we will work out together how to approach it.

Book a session
FAQs

Frequently asked questions

What is ex ante modelling, and how does it differ from evaluating an intervention that has already been implemented?

Ex ante modelling of interventions estimates the potential effect of an intervention on an indicator before it is rolled out, whereas ex post evaluation analyses what happened once it was implemented and, if the design allows, estimates its observed effect. It applies when the decision to launch a health, nutrition, behavioural or policy intervention has not yet been made and you want to anticipate what change to expect. The difference lies in the timing and in the nature of the question. Ex ante modelling projects a scenario before resources are committed, integrating the available sources of information to estimate the effect the intervention could have. Ex post evaluation analyses data already collected on an intervention that has already taken place. They are sister services and complement each other: one informs the decision to roll out, the other evaluates the roll-out once it has happened. If the question is "what can we expect if we do this?", it is ex ante modelling; if it is "what effect did our intervention have?", it is ex post evaluation.

I don't have complete data of my own, just a national survey and some literature. Can it still be modelled?

Yes: the core of the service is integrating whatever sources the case allows, such as national surveys, situation or behaviour reports, your own data and the scientific literature, as starting evidence for the estimate. It applies precisely to the usual situation, in which you rarely start from a single clean and complete dataset. Each source is brought in with a role that matches its quality, how recent it is and how close it is to the target population, so that the estimate makes use of what is available without treating all sources as equivalent. Extensive data of your own are not essential: a well-used national survey and effect sizes from the literature can support a modelled estimate with its assumptions made explicit. What determines the scope is not the number of sources but their quality and how close they are to the question. The less information you start from, the more weight the assumptions carry and the greater the uncertainty, and the result reflects that.

Is this the same as checking two independent sources against each other to validate the estimate?

Not necessarily: checking two independent sources against each other is an option used when the case allows it, not the structure of the service. It applies when there is more than one independent source on the same effect. In that situation, the sources are checked against each other as evidence triangulation: convergence makes the estimate more plausible, and divergence shows which assumptions need revisiting. But many cases arrive with a single usable source, or with several that are not independent, and that does not prevent modelling: the estimate is still built from what is available, with the assumptions and the uncertainty made explicit. Triangulation is a valuable tool when there is material for it, not a requirement without which the work cannot go ahead. What defines the service is estimating the potential effect by integrating whatever there is. Checking independent sources against each other reinforces the estimate when the case offers it; it is not a condition of entry.

What does it mean that the estimate is "counterfactual"? Isn't it enough to project what will happen with the intervention?

It is not enough: potential impact is not what is expected to happen with the intervention, but the difference from what could be expected without it, in the same population. This applies to all ex ante modelling, because projecting only the scenario with the intervention conflates its effect with the underlying trend that was already under way. Counterfactual estimation compares the expected scenario with the intervention against the expected scenario without it, under explicit assumptions, and so estimates the incremental change associated with the intervention under those assumptions. If an indicator was already improving on its own, attributing all of that improvement to the intervention overstates its effect; the counterfactual guards against that. One honest limit is worth stating: this counterfactual is a projection under assumptions, not the causal certainty of an experiment. Its credibility depends on how reasonable those assumptions are, and they are stated explicitly. What you receive is an expected incremental effect, separated from the underlying trend, not a promise of what will certainly happen.

Do you take into account that actual coverage may fall short of 100% in practice?

Yes: the effect of an intervention depends not only on its nominal coverage but also on adherence, compliance and actual utilisation, and all of that is modelled. It applies to any intervention where what is planned is not what finally reaches the target population, which is the case for many interventions in practice. The losses between what is planned, what is rolled out and what actually reaches people and is used are modelled, so that the estimated impact reflects realistic implementation conditions rather than an optimistic assumption of full coverage. An estimate that assumes everyone receives and makes full use of the intervention produces an inflated figure that reality will not match. Building in those losses, which form the cascade between the planned intervention and the real effect, is what makes the estimate defensible to whoever will have to answer for the result. Estimating the effect under realistic coverage is not pessimism; it is honesty about how interventions work.

How do you express uncertainty? Do I get a single number or a range?

An estimate with its uncertainty, not a single number with no margin: bounding the uncertainty of the estimate is a central part of the service. This applies to all ex ante modelling, because a point estimate with no margin conveys false precision about something that, by definition, has not happened yet. Uncertainty is analysed explicitly, using Monte Carlo simulation or other uncertainty propagation approaches when the case requires it, so that the result shows a range of effects consistent with the assumptions and sources available, not just the central value. This also reveals which assumptions weigh most on the result and where more information is worth obtaining before implementation. An effect presented as an exact figure hides precisely what a funder or a decision-maker needs to know: how much it can vary and what it depends on. Delivering the uncertainty with clear bounds is what turns the estimate into an honest basis for a decision rather than a numerical promise.

Does ex ante modelling include generating synthetic populations or simulating scenarios?

Ex ante modelling of interventions is a high-level service that can draw on tools such as synthetic population generation, scenario simulation, time series analysis or stratification, but none of them is a required part of the service: they are brought in when the case calls for them. This is worth clarifying because it is sometimes assumed that ex ante modelling always means simulating many scenarios or generating a synthetic population, and that is not so. One case may be resolved with a single national survey and a point estimate under one scenario, with no need for a synthetic population or a battery of scenarios; another, more complex case may well require those tools. The choice depends on the case in hand, not on a fixed package of techniques. Several of these tools are also services in their own right and can be commissioned separately when that is the main need. What defines ex ante modelling is the question, the effect of the intervention on the indicator before roll-out, not a closed set of methods.

Does ex ante modelling prove that the intervention will work?

No: ex ante modelling of interventions estimates what can be expected under explicit assumptions. It does not prove that the intervention will work, nor does it replace evaluating the intervention once it has been implemented. This limit is worth understanding before using the estimate to decide, because it is an informed projection, not a certainty. The estimate is built on the available evidence and a set of stated assumptions. Its value lies in turning an expected impact into a defensible estimate, with its uncertainty, so that the decision rests on more than intuition. But the actual effect only becomes known once it can be observed after roll-out, which is the task of ex post evaluation. The client decides on and rolls out the intervention and commits the resources; the service estimates, models and quantifies the potential effect that informs that decision. What you receive is an estimate that helps you decide better before committing resources, not an assurance of the outcome.

Shall we talk?

Tell us what you are working on and we will give you a straight answer on how we can help.