Abstract
Purpose
International English language publication activities in orthopaedic surgery comparing the years 2008/09 to 2018/19 were analyzed.
Methods
20 international journals listed on PubMed were examined. The impact factor (IF) for each journal was determined using the InCites Journal Citation Report.
Results
9,205 publications in 2008/09 and 15,549 in 2018/19 with 21,435 cumulative IF (CIF) in 2008/09 and 50,552 in 2018/19 were registered. Most publications consisted of narrative reviews (42.0%), followed by clinical studies (22.0%), experimental investigations (16.9%), randomized controlled trials (6.0%), and meta-analyses (5.6%). The highest increase in publications was observed for narrative reviews from 33.5% in 2008/09 to 41.1% in 2018/19. The USA had the highest number of publications (2,981 and 4,796), followed by UK (806 and 879) and Germany (606 and 922) in 2008/09 and 2018/19, resp. Per 1 Mio inhabitants, Switzerland (13.6 and 28.4), Sweden (10.9 and 18.1), the Netherlands (9.6 and 15.4), and Denmark (9.0 and 21.8) were the most productive countries in 2008/09 and 2018/19, resp.
Conclusions
International publishing activity in orthopaedic surgery has increased substantially over the last 10 years. The quality of the published articles has not increased in the same way, as evidenced by the disproportionate rise in narrative reviews. Over the entire period, the US were the leader with respect to number of publications and CIF. In terms of population, however, smaller countries such as Switzerland and Sweden were much more active.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Introduction
This study addresses international English language publication activity in orthopaedics/trauma surgery. The aim was to examine how the publication activities of countries have changed over a ten-year period (comparing the years 2008/09 to 2018/19) and which countries were leading in terms of the number of publications and impact factors (IF). This analysis not only considered the most frequently used journals but also the types of studies.
International publication activity in orthopaedics/trauma surgery was formerly analyzed over a longer period by Lee et al. [1]. They observed an increase in the number of orthopedic/trauma surgical articles published worldwide, from 2,889 in the year 2000 to 6,909 in the year 2009, with an average annual increase of 384.6 articles (10.2%). The top three countries were the USA, Japan, and the UK. The generated impact factors (IF) were not evaluated. Hohmann et al. [2] compared the publication activity in orthopaedics/trauma surgery of individual US states in 15 journals over five consecutive years (2010–2014) and correlated the activities with both the population size and the average income in those states. They found that the top four cities of New York, Philadelphia, Boston, and Chicago were responsible for 28% of the academic output over a five-year study period. The generated IF was not investigated. Furthermore, publication types (meta-analyses, randomized controlled trials, clinical studies, narrative reviews, case reports, and experimental studies) were not analyzed.
A bibliometric analysis of international publication activities over a longer period considering not only the number of publications but also their IFs and the type of publications has been presented so far only by Hinrichs et al. [3] for visceral surgery. These authors compared international publication activity in 17 English language journals over a ten-year period (years 2006/07 and 2016/17) and observed a rise in the quantity of publications by 34.8, from 2,247 in the first period and 3,029 in the last period. The generated IFs increased even more, from 9,307.6 in 2006/07 to 14,260.2 in 2016/17, a rise of 53.2%. The top five countries in 2006/07 were the USA, Japan, the UK, Germany, and Italy, and in the second period USA, Japan, the Netherlands, the UK, and France.
Our bibliometric analysis follows a similar approach for orthopaedic/trauma surgery publications. The question was: How did publication activities change with respect to the publishing countries, the most frequent journals, and publication types?
Materials and methods
This study is based on the analysis of 20 international selected journals listed in PubMed with a focus on orthopaedics/trauma surgery, which were published in two time periods (2008/09 and 2018/19).
The selection of journals was based on two criteria: first, journals that had already been considered representative in a different context for the bibliometric analysis of trauma surgery journals were included. This included all journals selected by Hohmann et al. [2], provided they published in the years considered here and were listed in the Web of Science. These were the following 13 out of 15 journals:
-
Journal of Bone and Joint Surgery American Volume (JBJS American).
-
Journal of Bone and Joint Surgery British Volume / The Bone and Joint Journal (JBJS Brit / BJJ).
-
American Journal of Sports Medicine (AJSM).
-
Knee Surgery, Sports Traumatology, Arthroscopy (KSSTA).
-
Journal of Orthopaedic Research (J Orthop Res).
-
Acta Orthopaedica (Acta Orthop).
-
Clinical Orthopaedics and Related Research (CORR).
-
The Spine Journal (Spine J).
-
Spine (Spine).
-
Journal of Shoulder and Elbow Surgery (JSES).
-
Injury (Injury).
-
International Orthopaedics (Int Orthop).
-
European Spine Journal (Eur Spine J).
Two journals were not analyzed, as one did not publish during the years considered (Journal of Arthritis), and the other could not be identified in the Web of Science (abbreviated as ASC).
Since Hohmann’s analysis focused exclusively on the activities of US academic institutions, the range of journals was to be expanded to include those that were assumed to be more frequently published by Europeans. As a result, the total number of journals analyzed increased significantly compared to Hohmann’s from 15 to 20. The selection of the latter journals was based on impact factors and editorial boards, which were intended to be international rather than US-centric. These journals were:
-
Osteoarthritis and Cartilage (Osteoarthritis Cartilage).
-
Arthroscopy: The Journal of Arthroscopic Related Research (Arthroscopy).
-
Journal of Orthopaedics and Sports Physical Therapy (JOSPT).
-
The Journal of Arthroplasty (J Arthroplasty).
-
Archives of Orthopaedic and Trauma Surgery (Arch Orthop Trauma Surg).
-
BMC Musculoskeletal Disorders (BMC).
-
European Journal of Trauma and Emergency Surgery (Eur J of Trauma Emerg Surg).
Only printed articles with an abstract available on PubMed were included. To assign a publication to a country of origin, the nationality of the authors was checked. For publications originating from a single institution, there was only one author and one country. In the case of multinational publications, the publication was attributed to all nations involved in the publication. The number of publishing countries was then higher than the number of analyzed publications. The analyzed publications were categorized into meta-analyses, clinical studies, randomized controlled trials (RCTs), case reports, experimental investigations, narrative reviews, and other types.
The cumulative impact factors for journals and countries in each time period were calculated. The IF for each journal was determined using the InCites Journal Citation Report by Clarivate Analytics.
For this investigation, the authors did not conduct any studies on humans or animals.
Results
Number of publications in individual journals
A total of 9,205 publications were published in 2008 and 2009. The top three journals during this period were “Spine” with 1,218 publications (13.2% of all publications during this time frame), “CORR” with 776 publications (8.4%), and “JBJS American” with 560 publications (7.1%).
There were significant shifts in 2018/2019 in comparison to 2008/09, as shown in Table 1. In the last period, a total of 15,549 publications were published, representing a 68.9% increase compared to 2008/2009. The top three journals in 2018/2019 were “J Arthroplasty” with 1,452 publications (9.3%), “KSSTA” with 1,390 publications (9.0%), and “BMC” with 1,289 publications (8.3%).
Number of cumulative impact factors (CIF) by individual journals
In the years 2008 and 2009, a total of 21,435 IF were cumulated. The top three journals during the 2008 and 2009 period were “Spine” with 3,298 CIF (15.4%), “JBJS American” with 2,191 CIF (10.2%), and “Osteoarth Cartilage ” with 1,657 CIF (7.7%).
In 2018/19, a total of 50,552 IF were cumulated (Table 1), representing a 135.8% increase compared to 2008/2009. The top three journals in the last period were “AJSM” with 5,859 CIF (11.6% of all CIF), “J Arthroplasty” with 5,244 CIF (10.4% of all CIF), and “KSSTA” with 4,389 CIF (8.7% of all CIF).
Publication activities of the 14 most-publishing countries
The top three countries during the first analyzed time period were the USA with 2,981 publications (32.4%), the UK with 806 publications (8.8%), and Germany with 606 publications (6.6%).
There were shifts in the ranking of the publishing countries in 2018/2019, as shown in Table 2. The USA still led with 4,796 publications (30.8%), China was now in second place with 1,126 publications (7.2%), and Germany maintained its third position with 922 publications (5.9%). United Kingdom held now the fourth position.
Number of cumulative impact factors (CIF) by countries
In the years 2008 and 2009, the top three countries were the USA with 7,633 CIF (35.6%), the UK with 1,776 CIF (8.3%), and Japan with 1,352 CIF (6.3%).
In 2018/19, the USA held still the first position with 17,324 CIF (34.3%), followed now by China with 3,209 CIF (6.4%), and the UK with 2,864 CIF (5.7%) (Table 2).
Types of publications
Narrative reviews were the dominating publication type in both analyzed time periods, increasing from 33.5% to 47.1% of all publications (Table 3). Meta-analyses experienced a notable increase, accounting for only 2.3% in 2008/2009, but for 7.5% of all publications ten years later.
Types of publication per country
Table 4 presents the types of publication for the five most publishing countries in both analysed periods. In general, narrative reviews were the most published types, with an obvious increase in 2018/19 compared to 2008/09. However, an increase in meta-analyses is noticeable, where experimental studies, case reports and “others” are decreasing.
Ranking by number of RCTs and meta-analyses
RCTs, meta-analyses and systematic reviews represent the study designs with the highest level of evidence [7]. In 2008/09, the USA, UK and the Netherlands occupied the top three positions. Ten years later, the USA, China and Canada were the leading countries (Table 5).
Population-based publication activities and cumulative impact factors (CIF)
The publication activity per one million inhabitants of the 14 most-publishing countries is presented in Table 6. Switzerland ranked first in both study periods with 13.6 publications per one million inhabitants in 2008/2009 and 28.4 publications per one million inhabitants in 2018/2019. In the 2008/2009 period, Sweden, the Netherlands, and Denmark followed, and these countries also remained among the top performers in 2018/2019.
The cumulative impact factors (CIF) of the analyzed countries per one million inhabitants are also shown in Table 6. Switzerland, Sweden, the Netherlands, and Denmark led in this category as well. This ranking was consistent for both the 2008/2009 and 2018/2019 periods.
Discussion
This study found an increase of publication activity in orthopaedic surgery of 68.9% over a ten-year period. Sun et al. [4] also examined the publication activities of orthopedic journals, focusing on the years 2017–2020. They described an increase of publications by 37.4% over the analyzed time, which is significantly lower, probably because of the shorter analyzed period.
Hohmann et al. [2] investigated publication frequency in orthopaedics/trauma surgery in the USA across 15 selected journals, analyzing 8,100 articles over a four-year period (2010–2014). The three most publishing journals were “JBJS American”, “CORR”, and “Spine”. This only partially corresponds to the results presented in our study. Only “Spine” was also among the three most publishing journals with 2,279 publications in all four years.
In our study, in the years 2018/2019, “J Arthroplasty” published 1,452 articles, “KSSTA” published 1,390 articles, and “BMC Musculoskeletal Disorders” published 1,289 articles, making them the leading journals in this time period with an increase of 187.5%, 238.2%, and 284.8% respectively compared to 2008/2009. In contrast, there was a significant decline in publications for “Spine”, from 1,218 to 1,061 articles, and for “CORR”, from 776 to 400 articles, representing a decrease of 12.9% and 48.5% respectively in the same period. But overall, an increase in publications was observed (68,9%). Loder et al. [8] also examined publication frequency in individual journals based on the number of manuscripts. When comparing 2015/2016 with 2005/2006, they found an increase in publications over a decade (BONE, JOR, AJSM, Injury, JAR, JHSA, JOT) in seven out of 17 journals, five journals showed no significant changes, and five journals had fewer manuscripts (Arthroscopy, BJJ, FAI, JBJS, Spine).
Lee et al. [1] examined trends in publication frequency based on a total of 46,322 orthopedic/trauma articles published from 2000 to 2009. They observed an increase in the annual global publication of orthopedic/trauma articles from 2,889 in 2000 to 6,909 in 2009, with an average annual increase of 384.6 articles (10.2%). In this study, an increase from 9,205 to 15,549 articles over ten years was observed, which would theoretically represent an increase of 634.4 more articles per year.
Lee et al. [1] also analyzed publications by national origin. In descending order, the six most internationally publishing countries were in 2000 the USA, followed by Japan, the UK, China, Germany, and Korea. This order had shifted by 2009, with Korea now placed fourth and China sixth. The results of our study largely align with those. In 2018/2019, the same countries mentioned by Lee et al. [1] were among the top five, although in a different order, with the USA in the first place, followed by China, Germany, the UK, and Japan.
Hohmann et al. [5] analyzed 23,021 orthopaedic publications from 66 countries in 15 journals over a four-year period (2010 to 2014). The top three countries with the highest publication count were the USA, the UK, and Japan. The highest sum of impact factors was achieved by the USA, the UK, and Japan. These results correspond to this analysis, where the USA and the UK were also the most publishing countries.
Zhi et al. [9] also examined the publication activities of six individual countries based on a total of 143,138 orthopedic/trauma surgery articles published between 2005 and 2014. They only presented growth rates graphically, making it difficult to determine exact figures. As Chinese authors, they were primarily interested in precise data for China and reported that China contributed 2.9% of the total number of publications, compared to 24.9% for the USA, followed by the UK with 5.5%. The authors did not specify whether these were exclusively English-language journals and articles. Therefore, this study is not directly comparable with our analysis.
A bibliometric analysis by Mani et al. [10] focused on the orthopedic/trauma surgery publication frequency in 41 European countries that are members of EFORT. In that study, the UK, Italy, and Germany were the leading countries. In our European ranking the UK, Germany, and the Netherlands occupied the top positions, with Italy ranking fifth.
In this study, countries were also ranked by their cumulative impact factors (CIF). There were hardly any differences between the country rankings based on CIF compared to publication activity. The top four countries by CIF were the USA, the UK, Japan, and China.
Only Hohmann et al. [5] conducted a ranking of countries based on impact factors in the field of orthopaedic surgery. In their study, the top five countries accounted for 60.4% of all publications (n = 23,021) and 61.4% of all CIF (n = 66,496.7), which is nearly consistent with our analysis. In this study, the top five countries were responsible for 56.1% of all publications (n = 24,754) and 57.6% of all CIF (n = 71,987).
Publications in orthopaedics/trauma surgery were here differentiated into meta-analyses, clinical studies, randomized controlled trials, case reports, narrative reviews, and experimental studies (Table 3). We did not find a similar study on this topic. A significant decrease in published case reports by 50.9% was observed when comparing the years 2008/2009 to 2018/2019, while simultaneously, the impact factor of all analyzed journals increased. As the overall publication count increased, case reports accounted for only 2.7% of all publications in the second period, compared to 9.2% in the first period. Erivan et al. [6] analyzed only the impact of case reports on journal’s impact factor in orthopaedics/trauma surgery for the years 2015–2017. They described a decrease in the impact factor of scientific journals due to the publication of case reports. They calculated that 69 out of 79 analyzed journals would have had a higher impact factor, if they had completely avoided publishing case reports.
The increase in English-language publications observed by Hohmann et al. [5] for the years 2010 to 2014 was also confirmed in our analysis, comparing publications in 2008/09 and 2018/19 within a larger number of journals. An increase in the number of publications does not by itself indicate an improvement in quality, as does not an increase in impact factors (IFs) alone. Therefore, in this study for the first time the type of publications (meta-analyses, RCTs, clinical studies, case reports, etc.) has been examined. This is a crucial prerequisite for quality assessment, as the increase in impact factors (IFs) alone is insufficient, especially since the IF of all journals has risen equally during the observed period. While the number of RCTs and meta-analyses increased during the observation period, the greatest percentage increase was seen in narrative reviews, which accounted for almost half (47.1%) of all publications in the second observation period, but this does not demonstrate an improvement in publication quality. If one aims to present the publication quality of a country in an international comparison, rather the number of meta-analyses and RCTs should specifically be considered. For example, the USA published 30% of the total publications but only 25% of the meta-analyses and RCTs. In contrast, Canada, the UK, and the Netherlands accounted for 4.1%, 5.7%, and 3.4% respectively of the total publications, but 6.8%, 6.7%, and 5.8% respectively of the meta-analyses and RCTs. This indicates that the share of the latter countries in qualitative publications is higher than their percentage of the total number of publications.
Furthermore, a population-based ranking should be performed for every bibliometric comparative analysis in order to assess the performance of academic institutions and countries. In our analysis, the USA, the UK, Germany, and China ranked highest in terms of publication count. However, when considering population-based metrics, entirely different countries were leading, including Switzerland, Sweden, Denmark, and the Netherlands for both the 2008/2009 and 2018/2019 periods.
This trend aligns with an analysis by Lee et al. [1]. In that study, the USA, Japan, the UK, and Germany were the leading countries in terms of publication count in 2008 and 2009, while population based rankings included Switzerland, the UK, and Israel among the top performers.
Hohmann et al. [5] also examined each country’s publication performance in orthopaedics based on population in the period from 2010 to 2014. In terms of publication count, they identified the USA, the UK, Japan, South Korea, and Germany as the most publishing countries. However, in population-based rankings, Switzerland, Norway, Denmark, Sweden, and the Netherlands led. This corresponds with our study, where Switzerland and Scandinavian countries also ranked highest.
It seems quite clear that countries like Germany, Italy, and France do not have the same incentives to engage in scientific work compared to Switzerland, the Scandinavian countries, and the Netherlands. The reasons for this should be further analysed.
Limitations
One limitation of this study was the decision to select and analyze a specific number of journals (n = 20). For comparative purposes, 13 out of the 15 journals were chosen, which were also considered by Hohmann et al. [2]. The additional journals analyzed were selected based on their impact factor, ensuring that at least the most widely used English language journals in orthopaedics/trauma surgery were included. Therefore, it can be assumed that the 20 selected journals were representative for English-language orthopaedics/trauma surgery.
The fact that only English language publications were included in this study limits the ranking of non-English speaking countries.
Other limitations arise from the fact that only journals listed in PubMed were analyzed, meaning that non-PubMed-listed journals had no influence on the study results.
Conclusions
Our investigation highlights the significantly increasing English-language international publication activity from 2008/09 to 2018/19. This applies to both the number of publications and the impact factors of individual journals. The quality of the published articles has not increased in the same way, as evidenced by the disproportionate rise in narrative reviews from 33.5% to 47.1% of the total number of publications. Bibliometric analyses allow for the assessment of the scientific output of individual countries over time in an international comparison. However, population-based activities must also be considered: The USA were the most productive country in total number of publications, however, smaller countries were more active in relation to their population size.
Data availability
No datasets were generated or analysed during the current study.
References
Lee KM, Ryu MS, Chung CY, Choi IH, Kwon DG, Kim TW, Sung KH, Seo SG, Park MS. Characteristics and trends of orthopedic publications between 2000 and 2009. Clin Orthop Surg 2011;3:225-9. doi: 10.4055/cios.2011.3.3.225.
Hohmann E, Glatt V, Tetsworth K. Orthopaedic Academic Activity in the United States: Bibliometric Analysis of Publications by City and State. J Am Acad Orthop Surg Glob Res Rev 2018;2:e027. doi: 10.5435/JAAOSGlobal-D-18-00027.
Hinrichs DL, Debus ES, Grundmann RT. Surgical publication activity in English literature over a ten-year interval. BJS Open. 2019;3:696–703. doi: 10.1002/bjs5.50172.
Sun J, Mavrogenis AF, Scarlat MM. The growth of scientific publications in 2020: a bibliometric analysis based on the number of publications, keywords, and citations in orthopedic surgery. Int Orthop. 2021;45:1905–1910. doi: 10.1007/s00264-021-05171-6.
Hohmann E, Glatt V, Tetsworth K. Worldwide orthopedic research activity 2010–2014: Publication rates in the top 15 orthopedic journals related to population size and gross domestic product. World J Orthop. 2017;8:514–523. doi: 10.5312/wjo.v8.i6.514.
Erivan R, Dartus J, Villatte G, Marcheix PS, Descamps S, Boisgard S. Bibliometric analysis of case report citations and their effect on the impact factor: How does publishing case reports impact journals? Orthop Traumatol Surg Res. 2020;106:1463–1467. doi: 10.1016/j.otsr.2020.05.016.
Centre for Evidence-Based Medicine (CEBM). Oxford Centre for Evidence-based-Medicine– Levels of Evidence (March 2009) https://www.cebm.ox.ac.uk/resources/levels-of-evidence/oxford-centre-for-evidence-based-medicine-levels-of-evidence-march-2009 [accessed June 1, 2024]
Loder RT, Kacena MA, Ogbemudia B, Ngwe HN, Aasar A, Ninad N, Mufti O, Gunderson Z, Whipple EC. Bibliometric Analysis of the English Musculoskeletal Literature over the Last 30 Years. ScientificWorldJournal. 2021;2021:5548481. doi: 10.1155/2021/5548481.
Zhi X, Cui J, Gu Z, Cao L, Weng W, Li Q, Chen X, Su J. Orthopedics research output from China, USA, UK, Japan, Germany and France: A 10-year survey of the literature. Orthop Traumatol Surg Res. 2016;102(7):939–945. doi: 10.1016/j.otsr.2016.05.005.
Mani O, Nucci AM, Scaglione M, Bonicoli E, Parchi PD, Piolanti N. Bibliometric trend analysis in a decade of European Orthopaedic literature. Acta Biomed. 2021;92(3):e2021280. doi: 10.23750/abm.v92i3.9512.
Acknowledgements
Not applicable.
Funding
There is no funding source.
Open Access funding enabled and organized by Projekt DEAL.
Author information
Authors and Affiliations
Contributions
Conceptualization: all authors contributed to the study conceptualization and design. Methodology: C. Michels, R. T. Grundmann. Validation: C. Michels, R. T. Grundmann. Formal Analysis: C. Michels, R. T. Grundmann, E. S. Debus, K-H. Frosch, F. T. Beil. Investigation: C. Michels, R. T. Grundmann. Resources: C. Michels, R. T. Grundmann. Data Curation: C. Michels, R. T. Grundmann. Writing—Original Draft: R. T. Grundmann, C. Michels. Writing—Review and Editing: C. Michels, R. T. Grundmann, E. S. Debus, K-H. Frosch, F. T. Beil. Visualization: C. Michels, R. T. Grundmann. Supervision: R. T. Grundmann. Project administration: E. S. Debus, K-H. Frosch, F. T. Beil, R. T. Grundmann. All authors have read and agreed to the published version of the manuscript.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Conflict of interest
All authors declare that they have no conflict of interest.
Declaration of generative ai and ai-assisted technologies in the writing process
During the preparation of this work the authors used the tool ‘ChatGPT’ in order to improve the English version of the text. After using this service, the authors reviewed and edited the content as needed and take full responsibility for the content of the publication.
Consent for publication
Publication has been approved by all co-authors.
Informed consent
Not applicable.
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Michels, C., Frosch, KH., Beil, F.T. et al. International publication activity in orthopaedic surgery over a ten-year interval. Eur J Trauma Emerg Surg (2024). https://doi.org/10.1007/s00068-024-02665-x
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s00068-024-02665-x