Abstract
Background
Practice-based research networks (PBRNs) have been recognized as essential laboratories and mechanisms for developing primary care research. This scoping review aims to examine and map the features and development trends of productivity, research categories, and methods in original primary care research conducted by global PBRNs between 1991 and 2023.
Methods
We have assembled an interdisciplinary team that will undertake this scoping review, following the framework developed by Arksey and O’Malley. Targeted literature includes original primary care research conducted by PBRNs, published from January 1, 1991, to December 31, 2023. An integrated search strategy will gather publications from 3 electronic databases (PubMed, Web of Science, and Embase), 16 major primary health care journals, and 364 relevant organizations. Two experienced researchers will independently screen the titles, keywords, and abstracts of all references and extract data regarding eight key elements. Disagreements between the reviewers will be resolved through group discussions, moderated by a third reviewer. Articles to be included will (1) be conducted in the primary care context, (2) be led by PBRNs, (3) provide a full report of original research, and (4) be published in a peer-reviewed journal between the aforementioned dates in any language. Exclusions encompass reviews, letters, commentaries, case reports, and conference papers. Final data will be displayed using tables and charts according to different conceptual categories.
Discussion
This scoping review is one of the initial attempts to delineate the development trends and features of primary care research conducted by PBRNs. This study will provide reference information for researchers in countries/regions that are building their research infrastructure and capacity in general practice, family medicine, and primary care.
Systematic review registration
Registered in OSF on July 25, 2022 (https://osf.io/zgv9c).
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Background
Enhancing primary health care (PHC) is the most crucial approach to improving people’s health and social well-being and achieving health-related sustainable development goals [1]. In the 14 key levers supporting the successful implementation of PHC proposed by the World Health Organization (WHO), the role of developing PHC-oriented research is to support all the other levers by creating and providing knowledge, evidence, and intelligence. Therefore, it has unique features: covering all components of PHC, cooperating with a broad range of stakeholders, and pragmatically addressing important issues for the local community (“Act local, think global”) [2, 3].
Primary care research is defined as “research done in a primary care context” [4] and involves five research types (basic research, clinical research, health service research, health system research, and educational research) [5]. It is a “bottom-up” multidisciplinary research area that views primary care facilities and communities as the fundamental units and places the research focus on them [6]. The collaboration between primary care practitioners and researchers is crucial for developing primary care research, as this can integrate science and practice and facilitate mutual reinforcement [7, 8].
Over the last half-century, a key approach to achieving this collaboration has been practice-based research networks (PBRNs) [8]. The Agency for Healthcare Research and Quality (AHRQ) defines this as “a group of ambulatory practices devoted principally to the primary care of patients and affiliated in their mission to investigate questions related to community-based practice and to improve the quality of primary care” [9]. It highlights PBRNs’ three core features as a research laboratory: engagement in primary care research based on clear and stable purpose, structure, and resources [10, 11]; components including multiple primary care practices favorable to data collection [12]; and a focus on answering research questions derived from practice or conducting research, which is important for practice, especially regarding translating evidence into practice [13]. In some countries and regions, it is also named “primary care research network” [12].
The value of PBRNs for developing primary care research and related health science research has been widely recognized by the global academic community in recent decades [12, 14,15,16]. Since the initiation of health system reforms in 2009, which focused on augmenting human and financial resources for primary care, China has witnessed a rapid expansion of primary care and general practice [17]. Against this backdrop, a common concern in the local academic community in recent years is how to cultivate primary care research in China, a middle- to low-income country with a distinct health system backdrop, in order to better foster local primary care practices [18]. Consequently, creating a comprehensive map that chronicles the historical development trends in this domain over the past 30 years would serve as a macro-level reference for health and research policymakers and administrators, both in China and in countries with similar circumstances. Such a reference would provide them a panoramic view of the distinctive history and evolution of research derived from PBRNs.
In our previous study, we found that the number of studies recorded in the AHRQ’s literature database of PBRNs has been increasing rapidly since the 1990s [19]. The number of registered PBRNs and published primary care studies also increased during the same period [8, 16, 20, 21]. The spread of registered PBRNs across the world may be reflective of the change in the productivity of PBRNs. This trend is also seen in countries outside of North America, such as the UK, the Netherlands, and Australia [22, 23]. In addition, some changes to primary care research methods during this period may also reflect the evolution in the features of the studies conducted by PBRNs [24,25,26,27]. Therefore, we would like to further examine and map the global features and development trends of productivity, research categories, and methods in original primary care research conducted by PBRNs between 1991 and 2020. In bibliometrics, productivity is usually approximate to the number of available scientific publications, which is a key indicator for measuring the research output of a researcher, institution, or region/country [28], and has been used to assess the development of primary care research [20, 21].
We identified the innovative value of our study after conducting a preliminary search in PubMed, Web of Science, Embase, Cochrane Database, and Open Science Framework.
Methods
Study design
We plan to conduct this work following the recommended procedures developed by Arksey and O’Malley [29]. The procedure is a common and established approach for designing and conducting a scoping review and involves five stages: (1) identifying the research question, (2) identifying relevant studies, (3) selecting studies, (4) charting the data, and (5) collating, summarizing, and reporting results. Therefore, we assembled an interdisciplinary team (including YW and HF, primary health care researchers; XC, scientific editors of a primary care academic journal; and ZX, an academic general practitioner) to conduct this scoping review. Furthermore, we will report our results according to the PRISMA Extension for Scoping Reviews (PRISMA-ScR) checklist [30]. The scoping review protocol is being registered in the Open Science Framework database (https://osf.io/zgv9c).
Stage 1: Identifying the research question
This study aims to explore the following research question: “What are the features and development trends of productivity, research type, and methods of original primary care research that were conducted by PBRNs and published between 1991 and 2023?” We plan to initiate our search in January 2024. In this work, we restricted the meaning of “primary care research” to “research done in a primary care context,” based on Starfield’s definition [4]. As the meaning of “primary care context” may vary in different countries and regions, we will refer to the reference book on global primary care research published by the World Organization of Family Doctors (WONCA), which describes the primary care context in different regions [31]. In addition, we will also refer to the definitions proposed by major local academic associations. For example, in the USA, the American Academy of Family Physicians defines “primary care” as “health care services by physicians and their health care teams” and limited “primary care physician” to “a specialist in family medicine, general internal medicine, or general pediatrics” [32]. Further, according to the AHRQ definition, we defined “research conducted by PBRNs” as articles that meet any of the following conditions: (1) clearly labeled as a study by PBRNs; (2) the first author is affiliated to PBRNs (that is, PBRN researchers must have made major contributions); and (3) the contribution of PBRNs have been reported in the papers’ introduction or methods sections [9].
Stage 2: Identifying relevant studies
In our previous study, we recognized that adding more databases to the three main databases (PubMed, Web of Science, and Embase) does not improve the efficiency of obtaining target publications [19]. Moreover, the accuracy of the papers collected in AHRQ’s PBRN literature database that were defined as research conducted by PBRNs was less than 50% [19]. Therefore, we plan to search the target publications through three different approaches and then combine them.
Electronic database
We will conduct a comprehensive search of original articles published from January 1, 1991, to December 31, 2020, in PubMed, Web of Science, and Embase through a search strategy developed in previous work [33, 34] (Supplement Table 1).
Hand-searching of key journals
We will manually search 16 major primary health care journals indexed in the Journal Citation Report. Based on our initial search, it is possible to find published original research conducted by PBRNs in them (Supplement Table 2).
Relevant organizations
We will search PubMed for each PBRN’s name as an affiliation according to a PBRNs list (Supplement Table 3) that we compiled—which was based on the PBRNs mentioned in three important PBRNs-related information sources [6, 35, 36]—and three studies conducted by researchers experienced with PBRNs [19, 34, 37]. We reviewed the original list and removed PBRNs that did not meet our research aim; for example, we removed all non-primary care PBRNs from AHRQ’s PBRN registry website.
Stage 3: Selecting studies
After the search, all the information regarding the included articles will be imported to EndNote X9.2 software (Clarivate Analytics, Philadelphia, USA, 2019). We will remove duplicates using the software functions. The revision and study selection will then be performed by importing the literature information into Rayyan, a web and mobile app for conducting systematic reviews that improves screening efficiency with its semi-automation function [38]. Two researchers with expertise in reviewing academic papers (YW, XC) will screen the titles, keywords, and abstracts of the first 300 references to improve the eligibility criteria and ascertain that they are consistently understood through weekly comparisons and group discussions. A follow-up screening of approximately 10,000–15,000 articles will begin when the consistency between the two reviewers is greater than 90%. If the two reviewers fail to reach a consensus, the third researcher (ZX) will moderate specific group discussions to resolve discrepancies. Finally, we will use a PRISMA flow diagram to demonstrate the study selection process. Articles that meet the following criteria will be included:
-
1.
Conducted in the primary care context
-
2.
Conducted by PBRNs, including the three cases we elaborated on in Stage 1
-
3.
A full report of original research
-
4.
Published in a peer-reviewed journal between January 1, 1991, and December 31, 2023
-
5.
Published in any language
We will exclude reviews, letters, commentary, case reports, and conference papers. Given that the main mechanism of PBRNs in supporting primary care research is to generate research from primary care practice and translate or implement evidence into practice, we will include only original research in this review and will exclude non-research papers as well as reviews. We excluded review papers because the fundamental purpose of review studies is to “gather research, getting rid of rubbish and summarizing the best of what remains” [39], which essentially makes them secondary and information studies that can be conducted by any type of institution. Thus, they are not closely related to the unique mechanism between PBRNs and primary care research.
Stage 4: Charting the data
We plan to extract nine elements from each article according to the proposed data extraction form (Table 1). Of these elements, six (article title, publication year, journal’s name, first authors’ name, first authors’ affiliation, and country/region) can be extracted from the bibliometric record. We will clean and classify them with the support of Openrefine, an AI-based software that supports the efficient cleaning and transformation of bibliometric data [40]. In addition, two reviewers (YW and XC) will independently classify each included article by research category and research method according to the taxonomy of primary care research developed by WONCA and the research methods list summarized from the “appropriate research methodology” section of Research Agenda for General Practice/Family Medicine and Primary Health Care in Europe [3]. They may also add new but relevant classifications based on subsequent findings outside the aforementioned frameworks. They will first classify 50 papers, and after the raw agreement is higher than 90%, they will classify the remaining papers.
Stage 5: Collating, summarizing, and reporting results
The data will be presented in tables and charts depending on the conceptual categories. Tables and charts will present the distribution of years, countries/regions, type of first authors’ affiliations, research categories, and methods of the identified studies. Narrative summaries will be used to provide additional explanatory information based on the collected data. We also plan to use descriptive analysis and comparative statistics (including chi-squared test and nonparametric tests) to find possible common features and the development trend of a group of studies during a stable period.
Discussion
Based on our knowledge, this scoping review is one of the initial attempts to delineate the development trends and features of primary care research conducted by PBRNs. In it, we will generate a systematic search strategy to combine the information obtained from multiple approaches to ensure the comprehensiveness of the search. This study will provide reference information for researchers in countries/regions that are building their research infrastructure and capacity in general practice, family medicine, and primary care.
The findings of this study will present a macroscopic outline of how pioneer researchers in primary care, within various national and regional research environments and institutions, choose distinct principal research domains and methodologies, utilizing PBRNs as a fundamental base to conduct primary care research work. By offering a holistic view of the PBRN-grounded primary care research landscape across diverse regions and research settings, our work aspires to identify and illuminate the varied strategies, challenges, and successes encountered by researchers globally. Thus, this review not only encapsulates the historical and current trajectories of primary care research but also aims to equip researchers, practitioners, and policymakers with insights and benchmarks that can inform the design, initiation, and optimization of future PBRN studies and initiatives in different sociocultural and institutional contexts.
As the main contribution of PBRNs to primary care research is generating practice-based knowledge, this study will include only original articles and exclude reviews. This scoping review may miss some studies published in non-English journals that are not indexed in the Journal Citation Report.
Availability of data and materials
Not applicable.
Abbreviations
- PBRNs:
-
Practice-based research networks
- PHC:
-
Primary health care
- WHO:
-
World Health Organization
- AHRQ:
-
Agency for Healthcare Research and Quality
- PRISMA-ScR:
-
PRISMA Extension for Scoping Reviews
- WONCA:
-
World Organization of Family Doctors
References
World Health Organization. Declaration of Astana. Global conference on primary health care. Astana, Kazakhstan, 25–26 October 2018. WHO/HIS/SDS/2018.61.
World Health Organization, United Nations Children’s Fund. Operational framework for primary health care: transforming vision into action WHO. 2020. Available from: https://apps.who.int/iris/bitstream/handle/10665/337641/9789240017832-eng.pdf. Accessed November 24, 2022.
van Royen P, Beyer M, Chevallier P, Eilat-Tsanani S, Lionis C, Peremans L, et al. Series: the research agenda for general practice/family medicine and primary health care in Europe. Part 5: needs and implications for future research and policy. Eur J Gen Pract. 2010;16:244–8. https://doi.org/10.3109/13814788.2010.528385. PMID:21073268.
Starfield B. A framework for primary care research. J Fam Pract. 1996;42:181–5.
Beasley JW, Starfield B, van Weel C, Rosser WW, Haq CL. Global health and primary care research. J Am Board Fam Med. 2007;20:518–26. https://doi.org/10.3122/jabfm.2007.06.070172. (PMID:17954858).
Beasley J, Bazemore A, Mash B. The nature of primary care research. In: Goodyear-Smith F, Mash B, editors. International perspectives on primary care research. London: CRC Press, Taylor & Francis Group; 2016. p. 11–3.
Nutting PA, Green LA. Practice-based research networks: reuniting practice and research around the problems most of the people have most of the time. J Fam Pract. 1994;38:335–6 (PMID:8163956).
Green LA, Hickner J. A short history of primary care practice-based research networks: from concept to essential research laboratories. J Am Board Fam Med. 2006;19:1–10. https://doi.org/10.3122/jabfm.19.1.1. (PMID:16491999).
Agency for Healthcare Research and Quality. About PBRNs. 2021. https://www.ahrq.gov/ncepcr/research-transform-primary-care/pbrn/index.html. Accessed 6 Mar 2022.
Green LA, White LL, Barry HC, Nease DE, Hudson BL. Infrastructure requirements for practice-based research networks. Ann Fam Med. 2005;3:S5-11. https://doi.org/10.1370/afm.299,PMID:15928219PMCID:PMC1466956.
Davis MM, Keller S, DeVoe JE, Cohen DJ. Characteristics and lessons learned from practice-based research networks (PBRNs) in the United States. J Healthc Leadersh. 2012;4:107–16. https://doi.org/10.2147/JHL.S16441,PMID:26213481PMCID:PMC4512302.
van Weel C, Rosser WW. Improving health care globally: a critical review of the necessity of family medicine research and recommendations to build research capacity. Ann Fam Med. 2004;26:S5-16. https://doi.org/10.1370/afm.194,PMID:15655089PMCID:PMC1466768.
Nutting PA, Beasley JW, Werner JJ. Practice-based research networks answer primary care questions. JAMA. 1999;281(8):686–8. https://doi.org/10.1001/jama.281.8.686. (PMID:10052423).
Nutting PA. Practice-based research networks: building the infrastructure of primary care research. J Fam Pract. 1996;42:199–203 (PMID:8606312).
Westfall JM, Mold J, Fagnan L. Practice-based research –‘Blue Highways’ on the NIH roadmap. JAMA. 2007;297(4):403–6. https://doi.org/10.1001/jama.297.4.403. (PMID:17244837).
Hickner J, Green LA. Practice-based research networks (PBRNs) in the United States: growing and still going after all these years. J Am Board Fam Med. 2015;28:541–5. https://doi.org/10.3122/jabfm.2015.05.150227. (PMID:26355124).
Meng Q, Mills A, Wang L, Han Q. What can we learn from China’s health system reform? BMJ. 2019;19(365):l2349. https://doi.org/10.1136/bmj.l2349.PMID:31217222,PMCID:PMC6598719.
Fu Q, Jin H, Yu D. Development status and strategy of research capability of general practice and community health in China: based on the data of Chinese journals in general practice from 2001 to 2020. Chin Gen Pract. 2022;25(34):4252. https://doi.org/10.12114/j.issn.1007-9572.2022.0705(Chinese).
Wang Y, Xu ZJ, Li L, Kuang L, Xu Y, Han J. The development of practice-based research networks in North America in early stage: a literature review from historical perspective. Chin Gen Pract. 2021;24(28):3525–42. https://doi.org/10.12114/j.issn.1007-9572.2021.00.291(Chinese).
Glanville J, Kendrick T, McNally R, Campbell J, Hobbs FR. Research output on primary care in Australia, Canada, Germany, the Netherlands, the United Kingdom, and the United States: bibliometric analysis. BMJ. 2011;342:d1028. https://doi.org/10.1136/bmj.d1028,PMID:21385804PMCID:PMC3050436.
Hajjar F, Saint-Lary O, Cadwallader JS, Chauvin P, Boutet A, Steinecker M, et al. Development of primary care research in North America, Europe, and Australia from 1974 to 2017. Ann Fam Med. 2019;17(1):49–51. https://doi.org/10.1370/afm.2328PMID:30670396PMCID:PMC6342604.
Fleming DM. The role of research networks in primary care: based on a presentation at WONCA Dublin in June 1998. Eur J Gen Pract. 1998;4(3):96–9.
Pirotta M, Temple-Smith M. Practice-based research networks. Aust Fam Physician. 2017;46(10):793–5.
Tapp H, White L, Steuerwald M, Dulin M. Use of community-based participatory research in primary care to improve healthcare outcomes and disparities in care. J Comp Eff Res. 2013;2:405–19. https://doi.org/10.2217/cer.13.45PMID:24236682PMCID:PMC4042315.
Holtrop JS, Rabin BA, Glasgow RE. Dissemination and implementation science in primary care research and practice: contributions and opportunities. J Am Board Fam Med. 2018;31:466–78. https://doi.org/10.3122/jabfm.2018.03.170259. (PMID:29743229).
Plsek PE, Greenhalgh T. Complexity science: the challenge of complexity in health care. BMJ. 2001;323:625–8. https://doi.org/10.1136/bmj.323.7313.625,PMID:11557716PMCID:PMC1121189.
Creswell JW, Hirose M. Mixed methods and survey research in family medicine and community health. Fam Med Community Health. 2019;28(7):e000086. https://doi.org/10.1136/fmch-2018-000086,PMID:32148709PMCID:PMC6910743.
Haustein S, Larivière V. The use of bibliometrics for assessing research: possibilities, limitations and adverse effects. In: Welpe I, Wollersheim J, Ringelhan S, Osterloh M, editors. Incentives and performance. Cham: Springer; 2015. p. 121–39.
Arksey H, O’Malley L. Scoping studies: towards a methodological framework. Int J Soc Res Methodol. 2005;8:19–32. https://doi.org/10.1080/1364557032000119616.
Tricco AC, Lillie E, Zarin W, O’Brien KK, Colquhoun H, Levac D, et al. PRISMA Extension for scoping reviews (PRISMA-ScR): checklist and explanation. Ann Intern Med. 2018;169:467–73.
Goodyear-Smith F, Mash B, editors. International perspectives on primary care research. London: CRC Press, Taylor & Francis Group; 2017.
American Academy of Family Physicians. Primary care. https://www.aafp.org/about/policies/all/primary-care.html. Accessed 6 Mar 2022.
Gill PJ, Roberts NW, Wang KY, Heneghan C. Development of a search filter for identifying studies completed in primary care. Fam Pract. 2014;31:739–45. https://doi.org/10.1093/fampra/cmu066. (Epub 2014 Oct 18 PMID:25326923).
Dania A, Nagykaldi Z, Haaranen A, Muris JW, Evans PH, Mäntyselkä P, et al. A review of 50-years of international literature on the internal environment of building practice-based research networks (PBRNs). J Am Board Fam Med. 2021;34:762–97. https://doi.org/10.3122/jabfm.2021.04.200595. (PMID:34312269).
Gunn JM. Should Australia develop primary care research networks? Med J Aust. 2002;15(177):63–6. https://doi.org/10.5694/j.1326-5377.2002.tb04667.x. (PMID:12098340).
Agency for Healthcare Research and Quality. PBRN registry. https://www.ahrq.gov/ncepcr/communities/pbrn-registry/index.html. Accessed 6 Mar 2022.
Tierney WM, Oppenheimer CC, Hudson BL, Benz J, Finn A, Hickner JM, et al. A national survey of primary care practice-based research networks. Ann Fam Med. 2007;5:242–50. https://doi.org/10.1370/afm.699,PMID:17548852,PMCID:PMC1886484.
Ouzzani M, Hammady H, Fedorowicz Z, Elmagarmid A. Rayyan-a web and mobile app for systematic reviews. Syst Rev 20165:210. https://doi.org/10.1186/s13643-016-0384-4 PMID:27919275 PMCID:PMC5139140.
Grant MJ, Booth A. A typology of reviews: an analysis of 14 review types and associated methodologies. Health Info Libr J. 2009;26(2):91–108.
Ham K. Openrefine. 2.5 version. http://openrefine.org. free, open-source tool for cleaning and transforming data. J Med Libr Assoc 2013;101:233.
Acknowledgements
We appreciate Dr. Sheyu Li and Dr. Chenxi Liu for reviewing and advising on the initial version of the study design.
Funding
None.
Author information
Authors and Affiliations
Contributions
YW developed the first version of the protocol and search strategies. XC, ZX, and HF critically revised the protocol, search strategy, and manuscript for important intellectual content. All authors approved the final version to be published and agreed to be accountable for all aspects of the work.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
This study does not require ethical approval as human participants, and original, unpublished data were not involved. Patients and the public were not involved in the preparation of this protocol and will not be involved in the final scoping review.
Consent for publication
We plan to submit this study as a conference paper to the North American Primary Care Research Group 2024 annual meeting (USA) and as a review paper to a primary care academic journal.
Competing interests
The authors declare that they have no competing interests.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Additional file 1: Table S1.
Search strategy for PubMed, WOS, and Embase. Table S2. List of 16 primary care and family medicine journals. Table 3. List of PBRNs.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Wang, Y., Cao, X., Xu, Z. et al. Features and development trends of primary care research conducted by practice-based research networks from 1991 to 2023: a scoping review protocol. Syst Rev 12, 229 (2023). https://doi.org/10.1186/s13643-023-02395-y
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s13643-023-02395-y