Data Mining of Systematic Reviews 1934-2023: A Bibliometric Analysis

Haneen Al-Abdallat

Badi Rawashdeh1

Introduction

In recent years, there has been a substantial increase in the number of annual publications of systematic reviews, which reflects the critical role that systematic reviews play in synthesizing evidence, informing clinical practice guidelines, cost-effective analysis, and policy decisions.1 Additionally, some organizations require researchers to provide systematic reviews in grant applications to support the case for proposed new research.1

Systematic reviews, as opposed to traditional narrative reviews, focus on a clearly defined research question, employ an explicit search strategy to find every relevant proof, assess studies using methodological standards that have been predetermined, and formally integrate the evidence-based findings.2,3

Therefore, a systematic review that has been properly performed is the best evidence to direct clinical practice, a foundation for the recommendations of evidence-based practice guidelines, and it should play a significant role in the planning of future research.4,5 Consequently, we performed a bibliometric analysis to determine research trends, the number of systematic reviews published over the years, the most frequently searched topics or subject areas for searches, the productivity and collaboration of authors and organizations, the mapping of the research network, and the identification of research gaps by examining the frequency of keywords and the distribution of published systematic reviews.

This study has the potential to shed light on the inner workings of systematic review publication, thereby influencing the direction of the discipline in the future.

Methods

Data collection and retrieval methods

We searched the PubMed database for systematic reviews using the systematic review filter presented by Salvador-Oliván and coauthors,6 which provides higher recall than the PubMed SR filter, better at retrieving potential systematic reviews with a likely high degree of precision. The search query ranged from 1934 to February 3, 2023. The data extraction was done by the 1st author and reviewed by the 2nd author.

((systematic* [ti] AND review [ti]) OR Systematic overview* [ti] OR Cochrane review* [ti] OR systemic review* [ti] OR scoping review [ti] OR scoping literature review [ti] OR mapping review [ti] OR Umbrella review* [ti] OR (review of reviews [ti] OR overview of reviews [ti]) OR meta-review [ti] OR (integrative review [ti] OR integrated review [ti] OR integrative overview [ti] OR meta-synthesis [ti] OR metasynthesis [ti] OR quantitative review [ti] OR quantitative synthesis [ti] OR research synthesis [ti] OR meta-ethnography [ti]) OR Systematic literature search [ti] OR Systematic literature research [ti] OR meta-analyses [ti] OR metaanalyses [ti] OR metaanalysis [ti] OR meta-analysis [ti] OR meta-analytic review [ti] OR meta-analytical review [ti] OR meta-analysis [pt] OR ((search* [tiab] OR medline [tiab] OR pubmed [tiab] OR embase [tiab] OR Cochrane [tiab] OR scopus [tiab] or web of science [tiab] OR sources of information [tiab] OR data sources [tiab] OR following databases [tiab]) AND (study selection [tiab] OR selection criteria [tiab] OR eligibility criteria [tiab] OR inclusion criteria [tiab] OR exclusion criteria [tiab])) OR systematic review [pt]) NOT (letter [pt] OR editorial [pt] OR comment [pt] OR case reports [pt] OR historical article [pt] OR report [ti] OR protocol [ti] OR protocols [ti] OR withdrawn [ti] OR retraction of publication [pt] OR retraction of publication as topic [mesh] OR retracted publication [pt] OR reply [ti] OR published erratum [pt]).

Data analysis

Using VOSviewer version 1.6.19 and Microsoft Excel, we analyzed the annual trends, institutions, authors, keywords and generated tables and network figures.

Using PubMed, we downloaded the timeline publication (in years), and we used Excel to analyze the last 5-year trend.

In institutions analysis, we choose a minimum of one document threshold to include all organizations in the analysis. Then we choose 1000 organizations to be selected, with the highest total link strength, then using Excel we combine the departments of each organization.

In the author’s analysis, we included the authors who have a minimum of 200 publications, presented them using VOSviewer 1.6.19, and used Excel duplicated was combined. The only duplicate found was “Murad, Mohammad Hassan” and “Murad, M Hassan”.

The most frequently occurring keywords were studied by limiting them to a minimum of 1000 occurrences. In the keyword analysis, we manually removed words that implied the study design and demographic data, such as “systematic review,” “meta-analysis,” and “case-control studies,” and redundant words such as “human,” “male,” “female,” and “adult.”

RESULTS

Included studies

All 378,685 articles resulting from the search filter were included and uploaded to VOSviewer 1.6.19.

Annual trends

We studied the trend in the last five years, from 2018-2022; the number of systematic reviews that were published in 2018, 2019, 2020, 2021, and 2022 were 31,751 (13.8%), 36,378 (15.8%), 45,252(19.6%), 56,168(24.30%), 61,237 (26.5%), respectively (Figure 1).

publication trends from (2018-2022)

Institutions

In terms of the total number of publications, of 857,388 organizations, the top contributing institutions were the University of Toronto and McMaster University from Canada (n = 1415, n = 1386), Tehran University of medical sciences (n = 1268) from Iran, University of Oxford from UK (n = 715), National University of Singapore (n = 612) from Singapore, and Harvard medical school (n = 607) from USA (Table 1).

158801
Top-contributing institutions according to the number of publications
Institutions-according to number of publications Country publications Total link of strength
University of Toronto Canada 1415 1631
McMaster university Canada 1386 2285
Tehran university of medical sciences Iran 1268 1826
University of oxford UK 715 7177
National university of Singapore Singapore 612 5400
Harvard medical school USA 607 6246
Mashhad university of medical sciences Iran 485 1860
Karolinska institutet Sweden 453 4638
University of Bristol UK 432 3088
Taipei medical university Taiwan 426 418
California institute of behavioral neurosciences & psychology USA 384 290
Iran University of medical sciences Iran 369 337
University of Cambridge UK 287 3886
University of Bern Switzerland 278 473
University of York UK 272 101
University College London UK 259 1950
Isfahan university of medical sciences Iran 239 432
University medical center Utrecht The Netherlands 237 553
Tabriz university of medical sciences Iran 236 700
Aarhus university Denmark 192 1035

With respect to the link strength and connections to other institutions, the University of Oxford, Harvard Medical School, National University of Singapore had the highest link strength attribution (n = 7177 and n = 6246, n = 5400), respectively.

Authors

A total of 963,261 authors were included in our analysis. Among them, 48 meet the threshold of 200 minimum number of documents per author; of those, some were not connected to each other, 44 were most connected to each other; the visualization of each author’s contribution and their interconnections is demonstrated in 4 clusters, (Figure 2)

visualization of the most publishing authors and their connections

7 authors have had at least 300 publications of systematic reviews. The top 5 were Wang W., Zhang W., Murad MH, Wang Y., and Zhang L. A complete list of the top-publishing authors is presented in Table (2)

158802
A list of the top-publishing authors
author documents total link strength author documents total link strength
Wang W. 484 78 Chen W. 239 42
Zhang W. 484 62 Lee YH. 239 0
Murad MH 451 99 Li H. 232 36
wang Y. 393 43 Liu W. 232 27
Zhang L. 367 58 Craig JC. 229 0
Wang J. 366 52 Wang H. 226 20
Li J. 304 28 Wang J. 225 19
Wang Y. 299 35 Maffulli N. 222 0
Ioannidis JPA. 294 35 Wang B. 221 18
Liu Y. 290 42 Wang L. 221 28
Stubbs B. 288 6 Wang X. 221 30
Li w. 279 40 Wang J. 217 45
Li y. 278 34 Li J. 215 35
Zhang l. 273 38 Pasty BM. 213 341
Zhang j. 271 34 Liu J. 212 39
Sahebkar A. 266 0 Takagi H. 212 0
Li L. 260 24 Bhandari M. 209 15
Wang L. 259 42 Liu J. 209 38
Zhang Y. 259 25 Rotter JI. 208 326
Cuijpers P. 257 12 Thabane L. 208 21
Hofman A. 254 310 Zhang Y. 206 25
Wang Z, 253 112 Zheng W. 206 53
Zhang Y. 248 45 Yang K. 205 26
Zhang Y. 240 28 van Duijn CM. 201 304

Regarding the total link strength between authors, Pasty BM., Rotter JI. And Hofman A. had the highest total link strength with authors with total link strength equal to n =341, n = 326, n = 310, respectively.

Keywords

After excluding the nonspecific key words such as “humans,” “female,” “male.” The top 10 most occurring keywords that are specific to a specialty in systematic reviews are shown in Table (3). All of them occurred over 5000 times: “genetic predisposition to disease” (n = 9747), “postoperative complications” (n = 9215), “neoplasm” (n = 8791), “stroke” (n = 7792), “covid-19” (n = 7651), “polymorphism, single nucleotide” (n = 7605), “biomarkers” (n = 7021), “depression” (n = 6921), “cardiovascular diseases” (n = 6141) and “diabetes mellitus, type 2” (n = 5973).

158803
The top 10 most occurring keywords that are specific to a specialty.
Keyword Occurrences
Genetic predisposition to disease 9747
Postoperative complications 9215
Neoplasms 8791
Stroke 7792
Covid-19 7651
Polymorphism, single nucleotide 7605
Biomarkers 7021
Depression 6921
Cardiovascular Diseases 6141
Diabetes Mellitus, type 2 5973

Figure (3) shows the top 50 specific keyword that represents a field of interest, grouped into 5 clusters, cluster number one contains 21 medical-related items: “anti-bacterial agents,” “asthma,” “atrial fibrillation,” “biomarkers,” “blood glucose,” “blood pressure,” “cardiovascular disease,” “chronic disease,” “coronary artery disease,” “diabetes mellitus,” “diabetes mellitus, type 2,” “diet,” “dietary supplements,” “dose-response relations,” “drug therapy, combinations,” “exercise therapy,” “heart failure,” “HIV infections,” “hypertension,” “myocardial infarction” and “stroke.” The second cluster includes 13 items that are related to neoplasms: “antineoplastic agents,” “antineoplastic combined chemotherapy protocols,” “biomarkers, tumor,” “breast neoplasms,” “cancer,” “colorectal neoplasms,” “laparoscopy,” “lung neoplasms,” “neoplasms recurrence, local,” “neoplasms staging,” “neoplasms,” “postoperative complications,” “prostatic neoplasms.” Cluster 3 is psychiatry-related: “anxiety,” “brain,” “cognition,” “depression,” “mental disorders,” “mental health,” and “schizophrenia.” Cluster 4 is genetic related: “genetic association studies,” “genetic predisposition to disease,” “genome-wide association study,” “genotype,” “polymorphism, genetic,” “polymorphism, single nucleotide.” The last cluster, which is COVID, pandemic related: “COVID-19,”pandemics,” and “SARS-COV-2.”

the top 50 specific keyword that represents a field of interest, grouped in 5 clusters, each color represents a cluster of related items.

Discussion

Although locating systematic reviews quickly and accurately can be challenging for clinicians and researchers due to lack of time and expertise in working with search strategies and database field.7,8 Systematic review publishing began in the late 1980s and has shown remarkable interest and growth ever since.9 The number of systematic reviews published over the last five years has increased from 31,751 to 61,237 in 2018 and 2022, with an average annual publication rate of 46,157 systematic reviews per year or roughly 128 systematic reviews per day.

There has been a recent uptick in the publication of systematic reviews, which can be traced back to the realization in the scientific and medical communities that there is so much research available that it needs to be integrated and that literature reviews written by experts are more trustworthy than relying on the results of individual studies.10,11 Moreover, some nations have developed a research culture that places a heavy emphasis on the production of systematic reviews,12 and there is a trend among some funding agencies to require applicants to support their research funding applications with a systematic review.13

Despite the wide range of numerous systematic reviews, our research found that the majority of systematic reviews are concentrated in four primary fields: genetics, cancer, mental illnesses, and cardiovascular diseases.

We found that the genetic field is the one that publishes systematic reviews the most, with the keyword “genetic predisposition to disease” ranking first with 9,747 occurrences. This can be correlated with the fact that systematic reviews have become a popular method for summarizing gene-disease connections.14 The growing interest in the genetic basis of common diseases has been observed during the past ten years, along with quick developments in high-throughput genotyping technologies.15 As the most common tumors to cause death worldwide, lung and colorectal cancers are the main topics of study in the field of cancer research.16

Within mental disorders, schizophrenia and depression are the most extensively reviewed topics. This finding was consistent with previous research in 2009, that found neurological and mental disorders to rank the largest number of systematic reviews,17 with depression and mental disorders being a major contributor to the disease burden in high-income countries18; such findings are expected.

Our research also uncovered important authors and institutions that are well-connected and influential in their respective fields. The University of Toronto and McMaster University in Canada are the top contributing institutions. The University of Oxford and Harvard Medical School have the strongest links and connections to other institutions, which could be attributed to their strong research financial support.19

It’s important to note that Pasty BM. is the author with the most co-authorship relationships and impact among other researchers, while Wang W. is determined to have the most systematic review publications.

Our bibliometric study, like other bibliometric research, had limitations. First, we searched only using the PubMed database; we did not search in the Web of Science Core Collection or Google Scholar. However, we utilized a search filter with a high degree of sensitivity in order to incorporate a maximum number of systematic reviews. Second, we did not include an analysis of citations or publications in our work. Despite this, our findings offer important insights into the present state of systematic reviews across a variety of fields and have the potential to help inform future research directions and collaborations.

Conclusion

Systematic reviews play a critical role in synthesizing evidence, informing clinical practice guidelines, cost-effective analysis, and policy decisions. Thus, this bibliometric analysis was conducted to add to the current body of knowledge regarding the features of systematic reviews, publication trends, the majority of publishing specialties, the productivity of authors and organizations, and the nature of their collaborative efforts. Within the realm of systematic reviews, the findings of this research have the potential to become an extremely helpful resource for academics, decision-makers, and healthcare practitioners. In addition, we encourage conducting systematic reviews in areas where there is limited or outdated evidence.

Conflict of interest

We declare that we have no competing interest to disclose. This research was not funded by any organization, and we have no conflict of interest to report.


  1. Corresponding author: Haneen Al-Abdallat, medical student from the University of Jordan. haneenabdalat@gmail.com.↩︎