Opens in a new tab

Multivariate and biomarker analysis

Identification and validation of diagnostic, prognostic and predictive biomarkers

What it is

Identification and validation of biomarkers using multivariate techniques and machine learning applied to clinical, laboratory and molecular data. The emphasis is on the clinical interpretation of the finding and on its replicability.

It combines rigorous variable selection with a biological reading of what each marker means, not just of its statistical weight.

Objectives

  • Identify biomarker combinations with validated diagnostic, prognostic or predictive performance.
  • Quantify the diagnostic performance of the marker or panel: sensitivity, specificity, AUC and likelihood ratios.
  • Ensure the finding is robust and replicable, not an artefact of one particular dataset.
  • Interpret the result in biological and clinical terms, not just statistical ones.
Key points

Variable selection

  • Feature selection with Boruta, RFE and LASSO to identify the informative panel.
  • Dimensionality reduction with principal component analysis (PCA) and discriminant analysis.
  • Overfitting control when there are many variables and few samples.

Diagnostic performance

  • ROC curves and AUC to assess discriminative ability.
  • Sensitivity, specificity, predictive values and likelihood ratios.
  • Cut-off points set on clinical criteria, not just statistical ones.

Robustness and validation

  • Cross-validation and external validation to ensure the panel generalises.
  • Assessment of model calibration, not just discrimination.
  • Stability analysis of the selected panel under resampling.

Interpretation and stratification

  • Explainable models (SHAP) to understand how each variable contributes.
  • Stratification of clinical subgroups and interaction analysis.
  • Integration of clinical and laboratory data in combined models.

What it is for

  • Turn a set of clinical and laboratory variables into a biomarker panel with measured, validated performance.
  • Stratify patients by molecular or clinical profile to guide management decisions or study design.
  • Generate robust, interpretable and publishable biomarker evidence that holds up under external validation.
Why choose this service

A biomarker that only works in your data isn't a finding. It's a mirage

Most biomarker panels fall apart at external validation: they were fitted so closely to the discovery set that they don't generalise. Finding a robust marker means controlling overfitting from the start and understanding what it measures biologically, not just what it correlates with.

Selection that keeps overfitting in check

With many variables and few samples, almost any combination looks predictive by chance. We apply rigorous feature selection (Boruta, RFE, LASSO) and honest cross-validation, keeping discovery separate from validation so that the resulting panel generalises and doesn't just memorise.

We understand what the marker measures

This is where we differ. We interpret what a cytokine, an immunological parameter or a metabolite means biologically, drawing on training in clinical biochemistry and immunology. That lets us tell a marker that makes mechanistic sense from a spurious correlation, and talk to the clinical researcher on equal terms.

Performance measured, not promised

We report the true performance of the marker or panel: ROC curves, AUC, sensitivity, specificity, likelihood ratios and calibration. Cut-off points are set on clinical criteria, not by maximising a statistic. A false negative does not cost the same as a false positive.

Models you can explain

A predictive model that nobody understands does not get adopted in the clinic. We apply explainability methods (SHAP) to show how each variable contributes to the prediction, so that the result is interpretable for the clinician and defensible to reviewers.

Our process

What working with us looks like

We apply our D²I (Data to Insights) methodology to every service. A structured, iterative and transparent process that turns complex data into actionable knowledge.

01

Kick-off and problem definition

We meet with you to understand the clinical problem, the data available and the objectives of the project. We agree on deliverables, timelines and communication channels, and we sign whatever confidentiality agreements you need to protect your data.

02

Data review and preparation

We assess the quality of your data, identify inconsistencies and limitations, and structure the data for analysis. If critical information is missing, we tell you before going any further. We document every cleaning decision so that the process is traceable and reproducible. In biomarker identification, this means separating the discovery set from the validation set from the outset, assessing the structure of the missing data and checking the quality of the laboratory measurements before any variable selection.

03

Analysis and modelling

We apply the statistical methodology that fits your questions. We work iteratively: we share preliminary results with you, discuss the findings and adjust the approach where needed. We do not work in the dark until the final delivery. For this service, we apply variable selection with overfitting control, validate the panel both by cross-validation and externally, assess calibration as well as discrimination, and interpret each marker in its biological context.

04

Communicating results

We turn the findings into the format you need: a technical report, tables and figures for publication, an interactive dashboard or an executive presentation. We always include the clinical interpretation, not just the figures.

05

Impact review session

30 days after delivery we meet with you again for a 60-minute strategy session. By then you have had time to present the results internally, the real implementation questions have come up and you can assess the impact of the work with some perspective. We answer your questions, adjust interpretations where necessary and agree together on the way forward.

This is our general process. If you want to understand how we apply it technically to each type of analysis, see our full D²I methodology.

Have a data project on your hands?

Tell us about your case and we will work out together how to approach it.

Book a session
FAQs

Frequently asked questions

When do I need a multivariate biomarker analysis rather than a univariate, marker-by-marker test?

Multivariate biomarker analysis is needed when the diagnostic or prognostic information lies not in a single marker but in the combination of several. It applies when you have a broad set of clinical, laboratory or molecular variables and are looking for the panel with better diagnostic, prognostic or predictive performance than any marker on its own. A marker-by-marker test ignores the correlation and the interaction between variables, raises the risk of spurious findings from multiple comparisons and does not estimate the combined performance of the panel. The service identifies that informative combination while controlling overfitting, and quantifies its true performance, not the apparent performance in the set where it was discovered.

What data do I need to identify and validate a biomarker panel?

You need a matrix of candidate variables (clinical, laboratory or molecular) measured in a cohort with a well-defined outcome of interest. The client measures and collects the markers; the service identifies, validates and interprets them. Ideally, the sample is large enough to split into a discovery set and a validation set, or at least to support honest cross-validation. The database does not need to arrive fully clean: missing data, basic consistency and the quality of the measurements are reviewed before any variable selection. If the database needs a full structural audit, it is worth planning a prior data quality phase. What does condition the scope is the imbalance between the number of variables and the number of samples, which is addressed explicitly.

I have far more variables than samples (p > n). Does that invalidate the analysis?

It doesn't invalidate it, but it dictates the method. When there are far more candidate variables than samples, almost any combination looks predictive by chance, and that is the setting in which a false finding is most easily produced. Depending on the design and the sample size, the service can apply variable selection with overfitting control, such as Boruta, recursive feature elimination (RFE) or LASSO regularisation, and, where appropriate, dimensionality reduction (PCA) or regularised discriminant models, to identify the informative subset. The key is not just to select but to validate that selection: the stability of the panel is assessed under resampling, so that the variables chosen do not depend on one particular split of the data. The honest limit: with very few samples, the result is hypothesis-generating, not confirmatory.

How is the performance of a biomarker or panel measured, and why isn't the AUC enough?

Performance is measured by combining discrimination and calibration, not with a single statistic. Discrimination, the ability to separate classes, is quantified with the ROC curve and the area under the curve (AUC), together with sensitivity, specificity, predictive values and likelihood ratios. But a high AUC does not ensure that the predicted probabilities are reliable. That is why calibration is also assessed: whether an estimated risk of 30% corresponds to an observed frequency close to 30%. A model that discriminates well but is poorly calibrated can lead to the wrong management decisions. Cut-off points are set on clinical criteria, not by maximising a statistic. The cost of a false negative rarely equals that of a false positive.

How do you reduce the risk that the panel won't generalise in external validation?

It is not possible to ensure that a panel will keep exactly the same performance in an external cohort. What can be done is to reduce the model's optimism by separating discovery from validation from the outset and not letting the validation set contaminate any modelling decision. Most panels that fail do so because they were fitted so closely to the set in which they were discovered that they do not generalise: the published performance is that of the training set itself. The service works with honest cross-validation (variable selection happens inside each fold, not before) and, where data are available, with external validation in an independent cohort. The distinction is deliberate: cross-validation estimates generalisation within the same population; external validation tests it in another. Without that separation, the reported performance tends to be optimistic and cannot be read as solid evidence of generalisation.

Do you deliver a "black box" model or something the clinician can interpret?

You receive an interpretable result, not a black box. A predictive model that is hard to interpret faces more barriers to adoption in clinical research and is harder to defend to reviewers. That is why, alongside performance, we provide a reading of how each variable contributes to the prediction, using explainability techniques such as SHAP, which break down the weight of each marker in each case. On top of this comes the biological interpretation of the finding, grounded in training in clinical biochemistry and immunology: the biological hypothesis that a cytokine, an immunological parameter or a metabolite might point to when it carries weight in the model. That mechanistic reading is what helps separate a marker with biological meaning from a spurious correlation that passed the statistical filter by chance.

How does multivariate biomarker analysis differ from omics data analysis?

Multivariate and biomarker analysis is used when you start from a bounded set of candidate variables, such as clinical or laboratory variables or a targeted molecular panel, and the aim is to identify and validate the combination with diagnostic or prognostic performance. Applied bioinformatics and omics data analysis fits when the starting point is a high-throughput experiment (transcriptomics, proteomics, metabolomics) with tens of thousands of variables and specific needs for processing, normalisation and false discovery control at that scale. The two can be combined in the same project, for example an omics screen that feeds a reduced panel which is then validated, but they do not answer the same question: omics analysis explores the full space; biomarker analysis validates a candidate panel methodologically for research, publication or preliminary clinical decision-making.

Does validating a biomarker panel include its regulatory approval as a diagnostic test?

No. The service covers the identification, methodological validation and characterisation of the diagnostic performance of a biomarker or panel: discrimination, calibration, robustness and external validation. That is traceable, reproducible scientific evidence. It does not include the formal analytical and clinical validation required for a regulatory agency to approve a diagnostic test: that is a regulatory process with its own framework, and it is outside ADI's scope. The boundary is clear: the service produces the methodological evidence that supports a biomarker and underpins a publication or a research decision; it neither issues nor manages the regulatory conformity of a diagnostic product. If you need the latter, you will find a methodological evidence base here, but not the regulatory validation or the management of the procedure.

Shall we talk?

Tell us what you are working on and we will give you a straight answer on how we can help.