Study design and statistical protocols
Methodology is decided before the first data point is collected, not after
What it is
Methodological support in the phase before data collection: defining the research question, choosing the design, specifying the outcomes, calculating the sample size and writing the statistical analysis plan.
It also includes the statistical review of protocols that are already written, before they go to a committee, a funding call or a journal.
Objectives
- Translate the research question into a design that can answer it validly.
- Define primary and secondary outcomes that are measurable and aligned with the objective.
- Calculate the sample size with explicit, justified assumptions.
- Write the statistical analysis plan before collecting data.
- Review the statistical protocol before it is submitted.
Design and research question
- Choice of design according to the question: observational (cohort, case-control, cross-sectional) or experimental (randomised, pragmatic or implementation trial).
- Definition of the target population, the inclusion and exclusion criteria and the unit of analysis.
- Identification of foreseeable sources of bias and confounding, with the strategy to control them built into the design.
Outcomes and variables
- Specification of the primary and secondary outcomes: operational definition, measurement scale and time of assessment.
- Selection of covariates and adjustment factors grounded in an explicit causal framework, not in which data happen to be available.
- Definition of composite or surrogate outcomes when the design requires them, with their limitations documented.
Sample size and power
- Sample size calculation based on the type of outcome, the minimum relevant effect and the target power.
- Explicit assumptions about variability, expected event rates and loss to follow-up.
- Sensitivity analysis of the sample size as the assumptions vary, and scenarios for limited samples.
Statistical analysis plan
- Writing the analysis plan with pre-specified methods for each outcome and the missing-data strategy.
- Definition of the analysis populations and of how multiplicity is handled when there are several comparisons.
- Statistical review of protocols written by the research team, with a report of recommended adjustments before submission.
What it is for
- Go into data collection with greater confidence that the design, the outcomes and the sample are aligned with the research question.
- Submit a protocol with a sound, pre-specified statistical section to an ethics committee, a competitive funding call or a journal.
- Avoid the cost of discovering, with the data already collected, that the study lacked power, carried too much bias or used an outcome that did not measure what it should.
A design flaw can't be corrected at the analysis stage. You pay for it with data already collected.
The moment of greatest influence over a study's validity is the one before the first data point is collected. A research question poorly translated into a design, an ambiguous outcome or an undersized sample shape everything that follows, and no statistical technique can repair them after the fact. The protocol stage is where methodological rigour pays off most.
The right design for your question
Not every design answers every question. We match the choice (observational or experimental, and the specific variant) to what the study needs to demonstrate and to the real constraints of carrying it out.
A calculated sample size, not a guess
The sample size is calculated with explicit assumptions about effect, variability and loss to follow-up. We document each assumption, so that the figure stands up to scrutiny by a committee or an assessor.
A pre-specified analysis plan
Defining the methods before seeing the data protects against opportunistic analysis and strengthens the credibility of the results. We leave the plan written down and traceable from the protocol onwards.
Statistical review before you submit
If your protocol is already written, we review its statistical component and return a report of recommended adjustments: the assumptions behind the calculation, the consistency between objectives and analysis, and the points a reviewer will question.
What working with us looks like
We apply our D²I (Data to Insights) methodology to every service. A structured, iterative and transparent process that turns complex data into actionable knowledge.
01
Kick-off and problem definition
We meet with you to understand the clinical problem, the data available and the objectives of the project. We agree on deliverables, timelines and communication channels, and we sign whatever confidentiality agreements you need to protect your data.
02
Data review and preparation
We assess the quality of your data, identify inconsistencies and limitations, and structure the data for analysis. If critical information is missing, we tell you before going any further. We document every cleaning decision so that the process is traceable and reproducible. At this stage no data have been collected yet: we review the planned sources, the operational definition of each variable and the feasibility of capturing it, so that the design does not depend on information the study will never have.
03
Analysis and modelling
We apply the statistical methodology that fits your questions. We work iteratively: we share preliminary results with you, discuss the findings and adjust the approach where needed. We do not work in the dark until the final delivery. We pre-specify the analysis plan (method for each outcome, populations, missing-data strategy and multiplicity) and validate the sample size by simulation when the standard assumptions do not fit the design.
04
Communicating results
We turn the findings into the format you need: a technical report, tables and figures for publication, an interactive dashboard or an executive presentation. We always include the clinical interpretation, not just the figures.
05
Impact review session
30 days after delivery we meet with you again for a 60-minute strategy session. By then you have had time to present the results internally, the real implementation questions have come up and you can assess the impact of the work with some perspective. We answer your questions, adjust interpretations where necessary and agree together on the way forward.
This is our general process. If you want to understand how we apply it technically to each type of analysis, see our full D²I methodology.
Have a data project on your hands?
Tell us about your case and we will work out together how to approach it.
Book a sessionFrequently asked questions
Why is it worth working on the study design before collecting data, rather than waiting for the analysis?
Because a design flaw cannot be corrected at the analysis stage: you pay for it with data already collected. This applies to the preliminary phase of any observational or experimental study, while the question, the design, the outcomes and the sample can still be decided. The moment of greatest influence over a study's validity is the one before the first data point is collected: a research question poorly translated into a design, an ambiguous outcome or an undersized sample shape everything that follows, and no statistical technique can repair them after the fact. Discovering, data in hand, that the study lacked power, carried too much bias or used an outcome that did not measure what it should means either redoing the study or defending a fragile result. The protocol stage is where methodological rigour pays off most, because it acts on decisions that are frozen afterwards.
How do I choose the right study design for my question?
The design is chosen according to what the study needs to answer, estimate or evaluate, not from a default template: not every design answers every question. This applies at the initial phase, when the research question has to be translated into a structure that can answer it validly. The choice distinguishes between observational designs, such as cohort, case-control or cross-sectional studies, and experimental ones, such as randomised, pragmatic or implementation trials, depending on the objective and the real constraints of carrying the study out. Alongside the design, we define the target population, the inclusion and exclusion criteria and the unit of analysis, and identify foreseeable sources of bias and confounding, with the strategy to control them built in from the start. Choosing the design well is the decision that most shapes validity, because a design unsuited to the question is rarely offset later by a more sophisticated analysis.
How is the sample size calculated, and why do I need to justify it?
The sample size is calculated from the type of outcome, the minimum relevant effect and the target power, with explicit assumptions about variability, expected event rates and loss to follow-up. This applies at the design stage, where the figure determines the feasibility of the whole study and is one of the first things a committee or an assessor examines. It is not an isolated number but a documented argument: each assumption is recorded so that the figure stands up to review. It comes with a sensitivity analysis showing how the sample size changes as the assumptions vary, and with specific scenarios for limited samples. When the standard assumptions do not fit the design, the sample size is validated by simulation. A sample size without its justification is the first decision a reviewer questions; with it, it stops being an arbitrary figure.
What is a pre-specified analysis plan, and why must it be written before data collection?
A pre-specified analysis plan is the document that sets, before the data are collected or seen, the analysis methods for each outcome, the analysis populations, the missing-data strategy and the handling of multiplicity. This applies to any study that wants to protect the credibility of its results, because defining the methods before seeing the data protects against opportunistic analysis. Choosing the method after the results are known opens the door to picking, consciously or not, the option that gives the desired result; pre-specifying reduces that risk and keeps the analysis traceable from the protocol onwards. The plan distinguishes the analysis populations and defines how multiplicity will be controlled when there are several comparisons. Having the plan written down from the protocol onwards is what helps distinguish a defensible confirmatory analysis from a later exploration of the data.
My protocol is already written. Can you review just the statistical part before I submit it?
Yes: the statistical review of a protocol that is already written is one of the ways into the service, intended for the point before it goes to a committee, a funding call or a journal. This applies if you already have a written protocol and want to make sure its statistical component will hold up under evaluation. The review returns a report of recommended adjustments covering the assumptions behind the sample size calculation, the consistency between the objectives and the proposed analysis, and the points a reviewer or a committee might question. You do not need to have designed the study with ADI to commission this review: it can be contracted as a self-contained entry point, just as the full design from scratch is another. What you receive is a critical, constructive assessment of the statistical component before it is read by whoever decides, while there is still room to adjust it.
If I haven't collected any data yet, do I need study design or biostatistics for clinical trials?
Study design and statistical protocols apply before data are collected, when the decision is how to set up the study: type of design, hypotheses, outcomes, sample size and analysis plan. Biostatistics for academic and pragmatic clinical trials covers the statistical cycle specific to a trial, including the analysis of the data once collected. They do not answer the same question: one helps you set up the study properly before it starts; the other supports and analyses the trial while it is under way or once it has closed. They can be two phases of the same project or two different entry points: if you have not started yet, you mainly need design; if your trial is already defined, under way or closed, you will usually need statistical support specific to the trial and, where relevant, the analysis of the data. This service covers any design, observational or experimental, whereas biostatistics for clinical trials focuses on the clinical trial as such.
Do study design and statistical protocols cover trials for a regulatory submission to the EMA or the FDA?
No. The service covers the design of observational studies and of academic, pragmatic and implementation trials, with a statistical protocol aimed at research ethics committees, competitive funding calls and publication. It does not cover the design of a formal phase I–III regulatory trial intended for a submission to agencies such as the EMA or the FDA, nor the production of the associated regulatory dossier, which is a different competence with its own framework. The line does not blur: academic and pragmatic study design, yes; trial design for a formal regulatory dossier, no. What is included is the methodological work of design, sizing and pre-specification that helps make a study valid and defensible in academic and research settings. If you need the design of a regulatory trial, you will find a clear boundary here, not a vague promise.
What do I need to provide, and what do you do, at the design stage?
The client provides the research question, knowledge of the context and the real constraints on carrying out the study; the service translates that question into a valid design, sizes the sample, pre-specifies the analysis plan and reviews the protocol. This applies to the phase before data collection, when there are no data yet and the work is methodological. At this stage we review the planned sources, the operational definition of each variable and the feasibility of capturing it, so that the design does not depend on information the study will never have. Afterwards, the client will carry out the study and collect and measure the data; the service leaves the methodological scaffolding, made up of the design, the sample size and the analysis plan, on which that data collection rests. What you receive is the methodological foundation of the study before it starts, not an analysis of data that do not yet exist.
Shall we talk?
Tell us what you are working on and we will give you a straight answer on how we can help.