Opens in a new tab

Scenario simulation and policy evaluation

What happens under each configuration of an intervention, estimated before it is implemented

What it is

We build a parameterised simulation engine that estimates the impact of different configurations of a policy or intervention before it is implemented, on a realistic population baseline. The engine works through the decision space, defined by variants, intensities and coverage levels, and returns, for each combination, its estimated effect on the indicators that matter to the decision.

It lets you compare scenarios across several indicators at once, such as economic, health or diffusion indicators, and at the geographic scale at which the decision is made, not only in aggregate.

Objectives

  • Estimate the impact of a policy before implementing it, avoiding the cost of testing it in the field.
  • Compare alternative configurations of the intervention on a common metric.
  • Bring several evaluation lenses, such as economic, health and diffusion, into a single coherent simulation.
  • Disaggregate the result to the geographic scale at which the decision is taken.
Key points

A baseline that anchors the simulation in reality

  • Characterisation of the population, supply and demand that the intervention acts on.
  • Identification of the structural heterogeneity (geographic, demographic, access) that shapes the result.
  • A realistic base to which the projections are anchored, instead of an assumed homogeneous population.

A parametric engine for the scenario space

  • Combination of the decision axes (variant, intensity, coverage, impact pathway) in a full grid.
  • Precomputation of the scenarios for instant response in an interactive dashboard, instead of on-the-fly calculation.
  • Comparable outputs across every configuration in the grid, not isolated results.

Diffusion and reach modelled, not assumed

  • The reach of an intervention is not uniform: it depends on how it spreads across an area or through a network.
  • When the intervention involves a good that is physically distributed, we model its redistribution with realistic geographic friction (e.g. gravity models over real travel times).
  • When it spreads through a social or contact network, reach is modelled on that structure, not on a flat, even spread.

Several lenses, several levels

  • Indicators of different kinds, such as economic, health or diffusion indicators, estimated on the same simulation.
  • Results at national scale and at the geographic or subgroup resolution at which decisions are made.
  • Metrics weighted by the sampling design at each level of aggregation.

What it is for

  • Assess the potential impact of a policy before committing resources to its implementation.
  • Compare alternative configurations by variant, intensity and coverage, on indicators of different kinds at the same time.
  • Support a roll-out decision with a quantified scenario space, rather than a single assumption.
Why choose this service

Testing a policy in the field to see whether it works is the most expensive experiment there is

Rolling out an intervention and waiting to see the result costs years and budget, and if the configuration chosen was not the best one, it is too late to change it. Simulating the scenario space first lets you compare configurations and rule out the worst ones without paying to learn the lesson in the field.

A baseline that respects real heterogeneity

A policy does not act on a homogeneous population. We start from a baseline that characterises the population, supply and demand area by area or subgroup by subgroup. The simulation then does not assume the intervention reaches everywhere equally; it reflects the reality the intervention is rolled out into.

Reach is modelled the way it actually happens

The effect of an intervention depends on how it spreads: a product distributed by road, a campaign circulating through a social network, a screening programme whose uptake depends on distance. We model that diffusion with the structure that fits it, such as real geographic friction or network topology, instead of assuming an idealised spread.

Compare configurations, don't defend one

The engine combines variants, intensities and coverage levels into a grid of precomputed scenarios. Instead of defending a single hypothesis, you put every configuration on the table with its estimated impact and choose, on solid grounds, which one deserves to be rolled out.

Several lenses on the same scenario

A policy is rarely judged on a single dimension: it has an economic return and a health effect, and the two often diverge. We estimate the indicators that matter on the same simulation, at the scale at which the decision is made, so that the decision does not optimise one dimension while ignoring the other.

Our process

What working with us looks like

We apply our D²I (Data to Insights) methodology to every service. A structured, iterative and transparent process that turns complex data into actionable knowledge.

01

Kick-off and problem definition

We meet with you to understand the clinical problem, the data available and the objectives of the project. We agree on deliverables, timelines and communication channels, and we sign whatever confidentiality agreements you need to protect your data.

02

Data review and preparation

We assess the quality of your data, identify inconsistencies and limitations, and structure the data for analysis. If critical information is missing, we tell you before going any further. We document every cleaning decision so that the process is traceable and reproducible. In scenario simulation, this includes building the baseline for the population and for the supply and demand the intervention acts on, characterising the diffusion structure, whether geographic or network-based, and preparing the population profiles the engine will run on.

03

Analysis and modelling

We apply the statistical methodology that fits your questions. We work iteratively: we share preliminary results with you, discuss the findings and adjust the approach where needed. We do not work in the dark until the final delivery. For this service, we run the parametric engine over the scenario grid, apply the diffusion model that fits the intervention, and aggregate the indicators for each lens at national and sub-national scale.

04

Communicating results

We turn the findings into the format you need: a technical report, tables and figures for publication, an interactive dashboard or an executive presentation. We always include the clinical interpretation, not just the figures.

05

Impact review session

30 days after delivery we meet with you again for a 60-minute strategy session. By then you have had time to present the results internally, the real implementation questions have come up and you can assess the impact of the work with some perspective. We answer your questions, adjust interpretations where necessary and agree together on the way forward.

This is our general process. If you want to understand how we apply it technically to each type of analysis, see our full D²I methodology.

Have a data project on your hands?

Tell us about your case and we will work out together how to approach it.

Book a session
FAQs

Frequently asked questions

What is policy scenario simulation, and when do I need it?

Scenario simulation means building an engine that estimates the impact of different configurations of a policy or intervention before it is implemented. The engine works through the decision space, defined by variants, intensities and coverage levels, and returns, for each combination, its estimated effect on the indicators that matter. It applies when you need to decide how to configure an intervention before committing resources to its roll-out, and testing it in the field to see whether it works would be the most expensive experiment there is. Rolling out an intervention and waiting for the result costs years and budget, and if the configuration chosen was not the most suitable, correcting it afterwards can be far more costly. Simulating the scenario space lets you compare configurations and rule out the least promising ones without paying to learn the lesson in the field. What the service provides is a quantified scenario space to decide on, not a single assumption defended in advance.

Is this only for food or health policies, or for any intervention?

It is for any intervention whose impact can be parameterised and depends on how it is configured and how it reaches the population: the simulation engine is domain-agnostic. It applies to food, medicines, public information, surveillance or public health policies. The machinery is the same whatever the field: characterise a baseline, work through a grid of configurations, model diffusion and aggregate indicators. What changes from one domain to another is the nature of the intervention and of the indicators, not the logic of the engine. A campaign circulating through a social network and a good distributed by road are simulated with the same framework and a different diffusion module. That generality is deliberate: the service is defined by the question, which configuration of the intervention performs best, and not by a particular sector. What you receive is an engine adapted to your intervention, applicable across domains.

What baseline is the simulation run on? Isn't it just assuming an invented population?

The simulation runs on a baseline that characterises the population, supply and demand, as far as they are known or can be estimated for the decision context the intervention acts on, not on an assumed homogeneous population. This applies to any simulation, because the result depends on structural heterogeneity, whether geographic, demographic or in access, which an averaged population hides. The baseline identifies that heterogeneity and anchors the projections to it, so that the simulation does not assume the intervention reaches everywhere equally. One point of scope is worth making: the simulation estimates impact under explicit assumptions on a realistic base; it does not reproduce the future with certainty. Its credibility depends on how reasonable those assumptions are, and they are stated explicitly. When the available data are not enough to build the baseline, a synthetic population can be used as an input, but when real data exist, the engine runs on them. What you receive is a simulation anchored to the best available characterisation of the population, with its assumptions in plain view.

How do you model the fact that an intervention does not reach every area equally?

By modelling diffusion with the structure that matches how the intervention spreads, instead of assuming a flat spread. This applies whenever the reach of the intervention is not uniform, which is the norm: it depends on how the intervention is distributed across the area or through the contact network. When the intervention involves a good that is physically distributed, its redistribution is modelled with realistic geographic friction, for example with gravity models over real travel times, so that distance and access can be built in as factors in the expected reach. When the intervention spreads through a social or contact network, reach is modelled on that structure, not on an even spread. The diffusion module is chosen according to the nature of the intervention and the information available to parameterise it; none is applied by default. What you receive is reach modelled in a way that is consistent with the intervention's diffusion mechanism, such as geographic friction or network topology, not an idealised assumption of uniform coverage.

Can I compare several configurations at once, and on more than one indicator?

Yes: the engine combines variants, intensities and coverage levels into a grid of scenarios and estimates, for each one, its effect on the indicators that matter to the decision. This applies when there is more than one way to configure the intervention and more than one dimension at stake, which is common: a policy is rarely judged on a single metric. Outputs are built to be comparable across every configuration in the grid, not as isolated results, and the scenarios are precomputed so they can be explored quickly rather than calculated on the fly. Indicators of different kinds, economic, health or diffusion, are estimated on the same simulation. They often diverge, and estimating them together keeps the decision from optimising one dimension while ignoring another. What you receive is every configuration on the table, each with its estimated impact through each lens, so you can judge on solid grounds which configuration best fits the objectives and constraints of the decision.

Do you give me results only at national level, or by area or subgroup too?

At the scale at which the decision is made: the result is disaggregated to the geographic or subgroup resolution at which you decide, not only the national aggregate. This applies when a policy is rolled out or adjusted at regional, provincial or population-group level, and the national average hides differences that change the decision. Indicators are estimated at national scale and at the finest resolution the design allows, with metrics weighted by the sampling design where applicable and with aggregations consistent with each level of decision, so that the estimate for each area or subgroup is not a naive aggregation of the average. An intervention can perform well in aggregate and poorly in specific areas, and that heterogeneity is exactly what a roll-out decision needs to see. What you receive is the estimated effect at the scale at which you decide, not a single national figure that averages out different realities.

How does scenario simulation differ from synthetic population generation?

Scenario simulation is a decision engine that estimates and compares the impact of different configurations of a policy; synthetic population generation is a foundational technique that builds a statistically realistic artificial population when the available data are not enough. They are not the same and do not answer the same question: a synthetic population addresses a shortage of data; scenario simulation works out which configuration of the intervention is worth rolling out. They connect naturally. When a population base is missing, a synthetic population can be one of the inputs the engine runs on, but the engine also works on real data when they exist, and a synthetic population has uses of its own outside simulation. If the need is a population base you don't have, it is synthetic population generation; if it is comparing configurations of a policy, it is this service. One provides the base; the other, the decision across scenarios.

Is simulating scenarios the same as estimating the effect of an intervention?

Not exactly. Ex ante modelling estimates the potential effect of a specific intervention before it is introduced; scenario simulation is the engine that works through a space of configurations (intensities, coverage levels, sequences or combinations of measures) and compares their impact. The first asks, ‘What change might we expect from this intervention?’; the second, ‘Which configuration offers the best balance across indicators, and for whom?’ They can sit within the same project: ex ante modelling can draw on the simulation engine when the decision requires comparing many alternatives under explicit assumptions. If you only need the expected effect of one option, ex ante modelling is enough; if you need to work through and compare a broad space of configurations, scenario simulation is the better fit. We simulate, estimate and compare; the client decides which policy to implement.

Shall we talk?

Tell us what you are working on and we will give you a straight answer on how we can help.