Opens in a new tab

Bibliometrics and research output analysis

Quantitative mapping of research fields through network analysis, term co-occurrence, topic modelling and sentiment analysis of the scientific literature

What it is

Quantitative analysis of the structure, evolution and dynamics of a research field, based on bibliographic databases such as PubMed, Web of Science or Scopus.

It puts data behind claims that are usually made on intuition: that a topic is under-explored, that a group is a reference in its niche, that a line of research is growing or running out of steam.

Objectives

  • Map the structure of a research field: who publishes, where, with whom, on what topics and how it has evolved.
  • Identify emerging niches, established themes and declining areas using centrality-density thematic maps.
  • Quantify the tone and thematic orientation of the research output through sentiment analysis and topic modelling of abstracts.
Key points

Descriptive and temporal bibliometric analysis

  • Research output by year, author, institution, country and journal.
  • Lotka's law (author productivity), Bradford's law (journal scattering), Zipf's law (term frequency).
  • Evolution of themes over time and detection of turning points in output.

Network analysis and field structure

  • Co-authorship networks between researchers and institutions, with centrality and clustering metrics.
  • Keyword co-occurrence with multiple correspondence analysis (MCA) and k-means to identify thematic clusters.
  • Centrality-density thematic maps to classify themes as motor, basic, emerging or declining.

MeSH term analysis and field taxonomy

  • Extraction and analysis of MeSH terms (Major and Minor) to identify the taxonomic structure of the field.
  • UpSet plots to visualise MeSH term co-occurrence and frequent combinations.
  • Detection of thematic gaps: missing MeSH combinations that may represent research opportunities.

NLP on the scientific literature: sentiment and topic modelling

  • Lexicon-based sentiment analysis of abstracts (NRC for Plutchik's emotions, Bing for positive/negative polarity).
  • Topic modelling with LDA (Latent Dirichlet Allocation) to uncover latent themes in the corpus without supervision.
  • Visualisation with word clouds, stream plots and emotion radar charts to communicate results to decision-makers.

What it is for

  • Justify the novelty of a line of research in competitive funding calls, such as those of the Carlos III Health Institute (ISCIII), Horizon Europe or the ERC, with quantitative evidence that the niche exists and is under-explored.
  • Map a field before starting a systematic review, to define the search string, identify key authors and anticipate the volume of results.
  • Assess the position of a research group, institution or country within a field: who to collaborate with, where to publish, which topics to prioritise.
Why choose this service

Writing "this is an emerging field" in your grant proposal is not the same as proving it

Funding call evaluators and review committees ask for evidence that your line of research is relevant, novel and feasible. A generic sentence about "growing interest" is not evidence. A bibliometric map with collaboration networks, the evolution of output over time and detection of thematic niches is. And topic modelling of the field's abstracts tells you not only how much is published, but on what exactly and with what orientation.

A complete map of the field in a single deliverable

Output by year, author, institution, country and journal. Co-authorship and institutional networks. Keyword co-occurrence with clustering. Centrality-density thematic maps. All generated from the bibliographic records, without having to read every article. The result is a quantitative snapshot of the state of the field.

Niches and opportunities detected with quantitative evidence

Thematic maps place each cluster in one of four quadrants: motor themes (high centrality, high density), basic themes (high centrality, low density), emerging themes (low centrality, low density) and declining themes. MeSH UpSet plots identify missing thematic combinations that may represent unexplored lines of research.

NLP that goes beyond word counts

Sentiment analysis with NRC classifies the emotional tone of abstracts according to Plutchik's wheel (joy, trust, fear, surprise, sadness, disgust, anger, anticipation). LDA topic modelling uncovers latent themes that do not necessarily match the keywords the authors declared. Both reveal patterns that classic bibliometrics does not capture.

Works alongside a systematic review or infodemiology

Bibliometric analysis is often the first step before a systematic review (mapping the field, sizing the volume of results, identifying key authors) or a complement to an infodemiological study (comparing what people search for on Google with what researchers publish). We offer all three services and combine them when the project warrants it.

Our process

What working with us looks like

We apply our D²I (Data to Insights) methodology to every service. A structured, iterative and transparent process that turns complex data into actionable knowledge.

01

Kick-off and problem definition

We meet with you to understand the clinical problem, the data available and the objectives of the project. We agree on deliverables, timelines and communication channels, and we sign whatever confidentiality agreements you need to protect your data.

02

Data review and preparation

We assess the quality of your data, identify inconsistencies and limitations, and structure the data for analysis. If critical information is missing, we tell you before going any further. We document every cleaning decision so that the process is traceable and reproducible. In bibliometrics, this includes defining the search string for the relevant databases (PubMed, Web of Science, Scopus), downloading the records in a compatible format, removing duplicates, standardising author and institution names, and preparing the corpus for analysis with bibliometrix and tidytext.

03

Analysis and modelling

We apply the statistical methodology that fits your questions. We work iteratively: we share preliminary results with you, discuss the findings and adjust the approach where needed. We do not work in the dark until the final delivery. For this service, we run descriptive and structural bibliometric analysis with bibliometrix, build collaboration networks, generate centrality-density thematic maps, extract and analyse MeSH terms, and apply NLP (sentiment with NRC, topic modelling with LDA) to the abstracts in the corpus. Each visualisation is documented in Quarto with reproducible code.

04

Communicating results

We turn the findings into the format you need: a technical report, tables and figures for publication, an interactive dashboard or an executive presentation. We always include the clinical interpretation, not just the figures.

05

Impact review session

30 days after delivery we meet with you again for a 60-minute strategy session. By then you have had time to present the results internally, the real implementation questions have come up and you can assess the impact of the work with some perspective. We answer your questions, adjust interpretations where necessary and agree together on the way forward.

This is our general process. If you want to understand how we apply it technically to each type of analysis, see our full D²I methodology.

Have a data project on your hands?

Tell us about your case and we will work out together how to approach it.

Book a session
FAQs

Frequently asked questions

How can I show with data that my line of research is novel when applying for a competitive funding call?

With a bibliometric analysis that quantifies the state of the field: how much is published, on what topics, who leads and which niches are under-explored. It applies when an evaluator for a competitive funding call, such as the Carlos III Health Institute (ISCIII), Horizon Europe or the ERC, asks for evidence of relevance and novelty, and a sentence about "growing interest" does not provide it. The analysis maps output by year, author, institution and country, builds collaboration networks and generates thematic maps that classify each area as established, emerging or declining, so that the claim "this is an emerging field" moves from rhetoric to data. UpSet plots of MeSH terms add the detection of missing thematic combinations, which can point to unexplored lines of research. What you receive is quantitative evidence that helps support the case for novelty, not a promise that the proposal will be funded, which depends on many other factors.

Which bibliographic databases do you use, and who defines the search string?

The analysis draws on the major bibliographic databases, such as PubMed, Web of Science and Scopus, and the search string is defined by the service together with the client, rather than handed over ready-made by the client. This applies to any bibliometric project, where the quality of the map depends directly on how the corpus is delimited. A bibliometric search aims for broad, coherent coverage of the field, with different criteria from those of a systematic review, which pursues exhaustiveness under strict criteria. The service translates the client's question into a search string, downloads the records, removes duplicates and standardises author and institution names before the analysis. The client contributes knowledge of the field and validates the scope; the service builds and runs the search strategy and prepares the corpus. Defining the search string well is what separates a useful, defensible map from one skewed by a poorly framed search.

What is a centrality-density thematic map, and what does it tell me about the field?

A centrality-density thematic map classifies the themes of a field into four quadrants according to their structural relevance (centrality) and their degree of internal development (density). It applies when you want to understand not only how much is published, but how the themes are organised and where the field is heading. Themes are classified as motor themes, basic and transversal themes, highly specialised themes or, where the temporal reading allows it, emerging or declining themes. The map is built from keyword co-occurrence and thematic clustering techniques, depending on the approach chosen, to identify the thematic groups. One caveat: a theme's position depends on the corpus and the period analysed, so it is read as a snapshot of a delimited field, not as absolute truth. What it provides is an actionable reading of which themes to prioritise, consolidate or explore.

What do sentiment analysis and topic modelling of abstracts add to classic bibliometrics?

They add a reading of the content and tone of the corpus that bibliometric counts do not capture: what exactly is being discussed and with what orientation, beyond how much is published. This applies when you are interested in the thematic and emotional content of the literature, not only in its output and collaboration metrics. LDA topic modelling proposes latent thematic groupings in the abstracts without supervision, which do not always match the keywords the authors declared; sentiment analysis with lexicons such as NRC or Bing approximates the patterns of polarity or emotion in the language of the abstracts. One limit applies: these techniques describe lexical patterns in the corpus, not judgements on the quality or truthfulness of the research, and latent themes need expert interpretation to be useful. What they add is a content layer (what is said and how) that complements the structure classic bibliometrics provides.

How does bibliometrics differ from a meta-analysis?

Bibliometrics is used to map the structure, evolution and dynamics of a research field: who publishes, on what, with whom and how it changes over time. Meta-analysis fits when the question is quantitative and about a specific effect: combining the numerical results of several studies to estimate a pooled effect size. They do not answer the same question: bibliometrics analyses the literature as an object, that is, its output and its structure; meta-analysis synthesises the results of the literature to answer a clinical or epidemiological question. The search strategy also differs: in bibliometrics, the search string is built for broad coverage of the field; in meta-analysis, study selection follows explicit eligibility criteria and aims for exhaustiveness. They can be run in sequence, for example with a bibliometric map before deciding the scope of a synthesis, but they are different services.

Does bibliometrics replace a systematic review, or is it a preliminary step?

It does not replace it: bibliometrics is often the preliminary step that prepares and sizes a systematic review, not a substitute for it. This applies when a team is about to undertake a review and first needs to understand the terrain: exploring terms, authors, journals and the volume of literature before settling on a review strategy. The bibliometric map offers that quantitative overview of the field without reading every article, which helps narrow the scope before investing the effort of a full review. The limit is clear: bibliometrics describes the structure of the literature; it does not critically appraise the evidence or draw conclusions on the efficacy of an intervention, which is the job of the systematic review and, where applicable, the meta-analysis. One maps the field; the other appraises the evidence it contains.

Do you analyse text from health records, or only scientific literature?

Only scientific literature: the NLP in this service is applied to abstracts and bibliographic records, not to health records or patients' clinical text. This limit needs stating because "text analysis in health" can be read in two very different ways. Here the corpus consists of a field's abstracts, to which topic modelling and sentiment analysis are applied to characterise the themes and tone of the research output. Natural language processing of health records, with entity extraction, SNOMED-CT coding and clinical text mining, is a separate line of work, with its own sources, privacy framework and validation, and is not part of this service. The distinction is not a nuance: the sources, the risks and the methods all change. If you need to analyse clinical text, you will find a clear boundary here, not a vague promise.

What exactly do you deliver in a bibliometric analysis?

A quantitative map of the field, documented and reproducible: descriptive and temporal analysis of the output, co-authorship and institutional networks with centrality metrics, centrality-density thematic maps, MeSH term analysis and, when the project includes it, NLP on the abstracts (sentiment and topic modelling). This applies if you need a snapshot of the state of a field to justify a line of research, prepare a review or assess a group's position. The visualisations come with their interpretation, not as loose outputs: networks, thematic maps, UpSet plots, term visualisations, thematic evolution and lexical patterns. The analysis is documented in Quarto with reproducible code, so it can be reviewed and updated. The client contributes knowledge of the field and the question; the service builds the corpus, analyses it and interprets it. What you receive is an actionable map, not a dump of bibliographic metrics.

Shall we talk?

Tell us what you are working on and we will give you a straight answer on how we can help.