Abstract
Background
The diagnosis of neurosyphilis is challenging due to the requirement of a lumbar puncture and cerebrospinal fluid (CSF) laboratory tests. Therefore, a convenient diagnostic nomogram for neurosyphilis is warranted. This study aimed to construct diagnostic models for diagnosing neurosyphilis.
Methods
This cross-sectional study included data of two patient cohorts from Western China Hospital of Sichuan University between September 2015 and April 2021 and Shangjin Hospital between September 2019 and April 2021 as the development cohort and the external validation cohort, respectively. A diagnostic model using logistic regression analysis was constructed to readily provide the probability of diagnosis at point of care and presented as a nomogram. The clinical usefulness of the diagnostic models was assessed using a receiver operating characteristic (ROC) and Harrell concordance (Harrell C) index for discrimination and calibration plots for accuracy, which adopted bootstrap resampling 500 times.
Results
One hundred forty-eight and 67 patients were included in the development and validation cohorts, respectively. Of those, 131 were diagnosed as having reactive neurosyphilis under the criteria of positive results in both CSF treponemal and non-treponemal tests. In the development cohort, male, psychiatric behaviour disorders, and serum toluidine red unheated serum test were selected as diagnostic indicators applying a stepwise procedure in multivariable logistic model. The model reached 80% specificity, 79% sensitivity, and 0·85 area under the curves (AUC) (95% confidence interval, 0·76–0·91). In the validation cohorts, the Harrell C index for the diagnostic possibility of reactive neurosyphilis was 0·71.
Conclusions
A convenient model using gender, presence of psychiatric behaviour disorders, and serum TRUST titre was developed and validated to indicate diagnostic results in patients suspected of neurosyphilis. Checking the model value of factors on nomogram is a feasible way to assist clinicians and primary health servers in updating patients’ medical charts and making a quantitatively informed decision on neurosyphilis diagnosis.
Trial registration
This research was retrospectively registered in the Ethics committee on biomedical research, West China Hospital of Sichuan University. The research registration and committee’s reference number was 1163 in 2020 approval.
Similar content being viewed by others
Background
Neurosyphilis (NS) is one of the most feared complications of syphilis [1], and dissemination of the pathogenic bacterium of neurosyphilis, Treponema pallidum subspecies pallidum, to the cerebrospinal fluid (CSF) and meninges can occur at any stage of the infection [1]. Importantly, the injury to brain tissues caused by Treponema pallidum invasion is irreversible [1]. Trend results from syphilis notification data in the 25 countries with comprehensive surveillance systems showed an increase, especially in Europe, of up to 70% since 2000 [2, 3]. However, the proportion of neurosyphilis among patients with syphilis is undetermined due to diagnostic limitations and requirement of skilful doctors to perform lumbar puncture and lab operators for special tests [4]. Further, necessary resources are usually not available in primary community healthcare centres of urban districts or common hospitals in smaller areas [5].
Prior to the advent of antibiotics, the typical symptoms of neurosyphilis, such as Argyll Robertson pupils, were used to diagnose neurosyphilis [1]. However, access to antibiotics has greatly increased and affected the disease process and manifestation of neurosyphilis [6]. Whether only signs and symptoms can be used for neurosyphilis identification is controversial. In the recent years, headache and blurred vision were reported as supportive factors for neurosyphilis diagnosis [7, 8], while other reports suggested various clinical manifestations of neurosyphilis with a lack of specificity [9]. Furthermore, most of the descriptions of neurosyphilis symptoms are derived from reports on American cohorts co-infected with HIV [8, 10] and there is a lack information on non-HIV patients with neurosyphilis, who constitute the majority of patients with neurosyphilis in Europe and Asia [9, 11].
The laboratory diagnosis of neurosyphilis was putatively based on positive results from serum and CSF serologic tests, as well as elevations in the CSF white cell count and protein levels [12, 13]. In 2015, an American guideline from the Centers for Disease Control and Prevention (CDC), U.S. Department of Health and Human Services, suggested the use of a decision tree for neurosyphilis diagnosis, which required a positive or reactive definition of non-specific, specific, or alternative tests in CSF for patients suspected with neurosyphilis [12]. A European guideline of the European Academy of Dermatology and Venerology recommends the cut-off value of CSF treponemal tests in patients co-infected with HIV [13]. Recent studies estimating serologic cut-off values have found that the accuracy of neurosyphilis diagnosis depends on the choice of controls with various clinical characteristics [14]. Combined usage of diagnostic tests for neurosyphilis needs further validation in the post-antibiotics era.
Variables in continuous form, instead of the traditional binary form as positive or negative report results referring to a certain threshold, can be utilised completely in the current analysis strategies for evidence-based medicine [15]. By combining continuous variables with clinical parameters and presenting them as a visual graph, a nomogram makes the results of a diagnostic model simpler to use. Furthermore, this single numerical estimate of the probability of an event facilitates the evaluation of patients with neurosyphilis, especially in poor areas that lack expert operators and resources to perform time-consuming tests [16]. Serum tests and CSF assessments have been extensively discussed as objective indicators of neurosyphilis, supporting the diagnosis; however, their usefulness remains inconclusive [8, 17]. The present study was designed to verify and explore the association between these factors for diagnostic confirmation using retrospective patient data. Using the patient clinical and laboratory characteristics, we developed a feasible diagnostic nomogram to assess the possibility of neurosyphilis in an HIV-negative population with an unknown syphilis duration, and further validated its validity and the score obtained.
Methods
This study included consecutive patients who presented with positive results of serum treponemal (Treponema pallidum chemiluminescence assay [TP CLIA] or Treponema pallidum particle agglutination assay [TPPA]) and a non-treponemal serological test (toluidine red unheated serum test [TRUST]) at the West China Hospital, Medical College of Sichuan University, from September 2015 to April 2021 and at Shangjin Hospital between September 2019 and April 2021. Patients met one of the following criteria: presence of neurological or ophthalmological symptoms or signs (such as headache, photophobia, blurred version, confusion, sleep disorders, vertigo, hearing loss, version loss, confusion, lethargy, memory change, progressive dementia, psychiatric behaviour disorders, personality change, numbness, fatigue or pain in limbs and trunk, seizure, tremor) and no symptom or syphilis of unknown duration, or failure of antibiotic treatment (titre of serum non-treponemal test failing to decrease by 4-folds or unable to serorevert following antibiotic treatment).
All methods were carried out in accordance with the Transparent Reporting of a multivariable prediction model for Individual Prognosis or Diagnosis (TRIPOD) guidelines and regulations.
The ethics committee on biomedical research, West China Hospital of Sichuan University approved the study and waived the need for informed consent from all subjects. The committee’s reference number was 1163 in 2020 approval.
Diagnostic criteria
Subjects who were enrolled at West Hospital of Sichuan University (n = 309) formed the development cohort and those enrolled at Shangjin Hospital (n = 95) formed the validation cohort (Fig. 1). The diagnostic criteria for neurosyphilis were based on the guidelines of the CDC in the USA and Europe and related literature [10, 11]. We applied a strict diagnostic criterion with a combination of two CSF laboratory methods to ensure diagnostic specificity among the suspected participants. Patients with double positive results in both the CSF TRUST and CSF TPPA tests were assigned to the confirmed reactive neurosyphilis group, and the others were assigned to the control group.
Laboratory methods
Serum samples were collected within 4 days of the lumbar puncture [8]. A serum non-treponemal test, TRUST (Rongsheng, Shanghai, China) and treponemal test, TPPA (Fujirebio, Tokyo, Japan) or chemiluminescent immunoassay (CLIA; Fujirebio, Tokyo, Japan) and Lumipulse G TP-N syphilis (Fujirebio, Tokyo, Japan) were performed.
Statistical analysis
Associations between categorical variables were assessed using a chi-squared test or Fisher’s exact test. Associations between continuous variables and categorical variables were assessed using the Mann–Whitney U test. Diagnostic factors were analysed and selected using univariable and multivariable regression analyses in a stepwise manner, for confirmation of reactive neurosyphilis and the other group including non-reactive and not neurosyphilis – as a binary classification out of clinical consideration. A two-tailed P value > 0·05 was used for the removal of variables. CSF items from clinical guidelines were assessed for possible additional effects, among which the collinearity was tested. Boot strapping was resampled 500 times to obtain a 95% confidence interval (CI) and quantify the effects of diagnostic indicator selection strategies on the model development. Performance measures included the average area under the ROC curve, sensitivity, specificity, a calibration plot, and the Harrell concordance (Harrell C) index. All analyses were weighted according to the analytical guidelines. P-values < 0·05 were considered statistically significant. R software (version 3.3.1; http://www.R-project.org) was used for the analysis.
Results
Demographic and clinical features
The demographic and clinical features of the 215 clinically suspected patients with neurosyphilis with complete information of treponemal and non-treponemal serum and CSF examination are summarized in Table 1. Among the 148 patients in the development cohort, 83·7% were male; 14 (21·3%) were non-symptomatic patients and required a CSF test. Further, 105 patients (70·9%) did not receive any prior antibiotic treatment. The most common symptoms of neurosyphilis were psychiatric behaviour disorders (50·0% in the development and 25·9% in the validation cohort). Other symptoms such as sleep disorders, photophobia, and blurred version were also observed (Supplement 1).
Laboratory findings and diagnostic yield
The univariable logistic regression analysis revealed that male sex and psychiatric behaviour disorders had a higher likelihood of a reactive neurosyphilis diagnosis, with odds ratio (OR) of 1·71 (95% CI 0·72–4·02, P = 0·222) and 3·89 (95% CI 1·70–8·89, P = 0·0001) respectively. Compared to the control group, the titre of serum TRUST above 1:16 had a significantly higher likelihood of a reactive neurosyphilis diagnosis, with (OR 9·00, 95% CI 1·82–44·59, P = 0·007). When creatine kinase was treated as a binary variable, elevated creatine kinase showed an association with reactive neurosyphilis (OR, 4·8; 95% CI, 1·1–21·8, P = 0·042, Table 2).
Multivariable logistic analysis shown in Table 3 indicated that the following factors were more likely related to reactive neurosyphilis: serum TRUST 1:8 (OR, 7·9; 95% CI, 1·1–54·5), 1:16 (OR, 16·0; 95% CI 0·6–97·7), 1:32 (OR, 33·6; 95% CI, 5·4–209·7), and 1:64 (OR, 71·9; 95% CI, 9·1–570·0), psychiatric behaviour disorders (OR, 5·1; 95% CI, 1·7–15·4), and male (OR, 1·00; 95% CI, 0·3–3 ·1).
The sensitivity and specificity of the diagnostic model in the development cohort were 80·0 and 79·0 respectively, and those in the validation cohort were 77·5 and 81·5, respectively (Table 4). The positive and negative perfective value was 90·8% and 60·3%, respectively. The receiver operating characteristics (ROC) curve of the model was similar between the development (0·85, 95% CI: 0·77–0·91) and validation cohorts (0·85, 95% CI: 0·74–0·93).
Figure 2 illustrates the nomogram with multi-variables for the diagnostic probability of reactive neurosyphilis (Fig. 2A). The nomogram demonstrated good accuracy in estimating the diagnostic probability of reactive neurosyphilis, with a bootstrap-corrected C index of 0·83 (Fig. 2B). The calibration plots were graphically good in the validation cohort; the nomogram displayed a C index of 0·71 for the estimation of reactive neurosyphilis diagnosis (Fig. 2C).
Discussion
In this study, two important clinical findings were obtained. First, male sex, psychiatric behaviour disorders, and serum TRUST titre were useful indicators for the diagnosis of neurosyphilis without lumbar puncture. Second, a diagnostic model for neurosyphilis was developed and validated using clinical characteristics and laboratory test data of patients and transformed into a nomogram.
Binary form of Serum TRUST titres is commonly used, reporting positive or negative results in patients with syphilis. However, we found that exact serum the TRUST titre in conjugation with sex and psychiatric behaviour disorders could be used to differentiate patients with reactive neurosyphilis from those suspected of having neurosyphilis. Comparing the results with those for non-reactive neurosyphilis and not neurosyphilis patients, the serum TRUST levels were higher in those with reactive neurosyphilis. Cai et al. also indicated a 5-fold increased likelihood of asymptomatic neurosyphilis in patients with a serum TRUST titre ≥1:64 [17]. Researchers noted that an increase in the serum TPPA titre and serum creatine kinase could serve as a surrogate for CSF clinical abnormalities after lumbar punctures [17, 18]. Unfortunately, we were unable to determine the titre grades of serum TPPAs, since the laboratory system of our hospital automatically sets and reports serum TPPA titres > 1:320 as positive. Xiao et al. suggested that elevated serum creatine kinase was linked to the non-HIV neurosyphilis group (including probable neurosyphilis with negative CSF TRUST, elevated protein or white blood cells in cerebrospinal fluid) in comparison with not neurosyphilis, when precluding asymptomatic patients [18]. Our data for the development cohort showed that elevated serum creatine kinase also was linked to reactive neurosyphilis, when our research cohort included asymptomatic patients.
We used an exploratory approach combing clinical parameters and serum TRUST titres to develop diagnostic models for neurosyphilis. When combined with clinical parameters, the diagnostic performance was improved compared to that with the use of serum TRUST alone. The number of male patients was three times higher than that of female patients in our cohort, and similar to that reported by the Public Health England [19]. The rate of the presence of classic symptoms and photophobia found in this study was consistent with that reported by Arielle, and was approximately 10% in HIV-negative patients with neurosyphilis [9]. The rate of neurosyphilis typical symptoms like Argyll Robertson pupils was seldom reported. Instead, the significant clinical parameters observed in this study were psychiatric behaviour disorders and memory deterioration, consistent with the Canadian and European case series reports of neurosyphilis and research in North China from He et al. [20,21,22,23].
ROC curve analysis was used to assess the diagnostic model’s performance. Approximately 85% of the AUC of the diagnostic model was similar between the development and validation cohorts. When we consider that lumbar puncture may be difficult for patients, nomogram having about 80% diagnostic probability may be sufficient to suggest diagnosis of neurosyphilis. However, in most cases, an 80% threshold probability is not sufficient, especially in cases with a high threshold to perform continuous intravenous antibacterial therapy. In such cases, it is better to complete CSF tests and conduct more specific diagnostic tests, such as the Venereal Disease Research Laboratory (VDRL) on the CSF, a well-known specific test, broadly used to diagnose idiopathic neurosyphilis in America, although it is time-consuming and less feasible, especially in countries with high rates of such patients [24]. The results of this study offer a sensitive screening nomogram for advising candidates with high diagnostic possibility of reactive neurosyphilis to undergo lumbar puncture, complete CSF regular tests, or undergo CSF-VDRL measurements. Furthermore, this nomogram was cheaper than a regular procedure in terms of prices of medical services and tests, referring to prices of these items in 2021 from West China hospital (Supplement 2).
This study had several limitations. First, it might have a sampling bias. We did not exclude patients who received insufficient antibiotic therapy before lumbar puncture. Under the current criterion of group assignment, false negatives were possible due to non-reactive neurosyphilis cases. In theory, disease duration should have been analysed as a risk factor for neurosyphilis, but it was difficult for patients with neuropsychological symptoms to provide the exact time of syphilis infection or information on sexual activities. Additionally, another limitation was the small sample size and that the pathological categories of neurosyphilis with sophisticated infectious degree and loci were not employed here. Our data (nine records of creatine kinase in validation cohort) were not sufficient to validate a model with the addition of an elevated creatine kinase level. Whether patients in each dedicated category had a different prognosis remains unknown due to lack of follow-up investigation. We intend to build a systematic database and prospectively design new studies to improve the quality of the evidence and facilitate more comprehensive patient care. In conclusion, to verify the validity of this model, future studies are warranted.
Conclusion
Importantly, an economical nomogram can be offered to assist clinicians and primary health servers in updating patient medical charts and making informed decisions on neurosyphilis diagnosis.
Availability of data and materials
The datasets used and/or analysed during the current study available from the corresponding author on reasonable request.
Abbreviations
- CSF:
-
Cerebrospinal fluid
- NS:
-
Neurosyphilis
- TP:
-
Treponema pallidum
- TPCA:
-
Treponema pallidum chemiluminescence assay
- TPPA:
-
Treponema pallidum particle agglutination assay
- TRUST:
-
Toluidine red unheated serum test
- VDRL:
-
Venereal Disease Research Laboratory
References
Ropper AH. Neurosyphilis. N Engl J Med. 2019;381(14):1358–63. https://doi.org/10.1056/NEJMra1906228 Erratum in: N Engl J Med. 2019 Oct 31;381(18):1789. PMID: 31577877.
Dombrowski JC, Pedersen R, Marra CM, Kerani RP, Golden MR. Prevalence estimates of complicated syphilis. Sex Transm Dis. 2015;42(12):702–4. https://doi.org/10.1097/OLQ.
CDC Sexually Transmitted Diseases Surveillance. 2015. http://www.cdc.gov/std/stats15/sysphilis.http
Tang W, Huang S, Chen L, Yang L, Tucker JD, et al. Late Neurosyphilis and tertiary syphilis in Guangdong Province, China: results from a cross-sectional study. Sci Rep. 2017;7:45339.
Zhu L, Gu X, Peng RR, Wang C, Gao Z, et al. Comparison of the cerebrospinal fluid (CSF) toluidine red unheated serum test and the CSF rapid plasma reagin test with the CSF venereal disease research laboratory test for diagnosis of neurosyphilis among HIV-negative syphilis patients in China. J Clin Microbiol. 2014;52(3):736–40. https://doi.org/10.1128/JCM.02522-13.
Clement ME, Okeke NL, Hicks CB. Treatment of syphilis: a systematic review. JAMA. 2014;312(18):1905–17. https://doi.org/10.1001/jama.2014.13259.
Dumaresq J, Langevin S, Gagnon S, Serhir B, Deligne B, et al. Clinical prediction and diagnosis of neurosyphilis in HIV-infected patients with early syphilis. J Clin Microbiol. 2013;51(12):4060–6.
Marra CM, Maxwell CL, Smith SL, Lukehart SA, Barnett SH. Cerebrospinal fluid abnormalities in patients with syphilis: association with clinical and laboratory features. J Infect Dis. 2004;189(3):369–76.
Zhang HL, Lin LR, Liu GL, Zeng YL, Wu JY, et al. Clinical Spectrum of Neurosyphilis among HIV-negative patients in the modern era. Dermatology. 2013;226(2):148–56.
Davis AP, Stern J, Tantalo L, Sahi S, Holte S, et al. How well do neurologic symptoms identify individuals with Neurosyphilis? Clin Infect Dis. 2018;66(3):363–7. https://doi.org/10.1093/cid/cix799.
Choe PG, Song JS, Song KH, Jeon JH, Park WB, et al. Usefulness of routine lumbar puncture in non-HIV patients with latent syphilis of unknown duration. Sex Transm Infect. 2010;86(1):39–40.
Workowski KA, Bolan GA. Centers for Disease Control and Prevention. Sexually transmitted diseases treatment guidelines, 2015. MMWR Recomm Rep. 2015;64(RR-03):1–137.
Janier M, Hegyi V, Dupin N, Unemo M, Tiplica GS, et al. 2014 european guideline on the management of syphilis. J Eur Acad Dermatol Venereol. 2014;28(12):1581–93.
Tuddenham S, Ghanem KG. Neurosyphilis: knowledge gaps and controversies. Sex Transm Dis. 2018;45(3):147–51.
Kingston M, French P, Higgins S, McQuillan O, Sukthankar A, et al. UK national guidelines on the management of syphilis 2015. Int J STD AIDS. 2016;27(6):421–46. https://doi.org/10.1177/0956462415624059.
Chinese Sexual Transmitted Disease Center. Guidelines for diagnosis and treatment of syphilis, gonorrhea, genital herpes, genital tract Chlamydia trachomatis infection. Chin J Dermatol. 2014;47(5). https://doi.org/10.3760/cma.j.issn.0412-4030.2014.05.022.
Xiao Y, Tong ML, Liu LL, Lin LR, Chen MJ, et al. Novel predictors of neurosyphilis among HIV-negative syphilis patients with neurological symptoms: an observational study. BMC Infect Dis. 2017;17(1):310.
Dumaresq J, Langevin S, Gagnon S, Tremblay C, et al. Clinical prediction and diagnosis of neurosyphilis in hiv-infected patients with early syphilis. J Clin Microbiol. 2013;51(12):4060–6.
Xiao Y, Tong ML, Liu LL, Lin LR, Chen MJ, et al. Novel predictors of neurosyphilis among HIV-negative syphilis patients with neurological symptoms: an observational study. BMC Infect Dis. 2017;17(1):310 Public Health England. Addressing the increase in syphilis in England: Phe action plan, 2019. Available: https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/806076/Addressing_the_increase_in_syphilis_in_England_Action_Plan_June_2019.pdf. Accessed 24 Jun 2019.
Beauchemin P, Laforce R. Neurocognitive changes in tertiary neurosyphilis: a retrospective chart review. Can J Neurol Sci Le Journal Canadien Des Sciences Neurologiques. 2014;41(04):452–8.
Ouwens ID, Koedijk F, Fiolet A, et al. Neurosyphilis in the mixed urban-rural community of the Netherlands. Acta Neuropsychiatrica. 2014;26(03):186–192.22.
He C, Kong Q, Shang X, Duan Y, Cui Y, Wang J, et al. Clinical, laboratory and brain magnetic resonance imaging (MRI) characteristics of asymptomatic and symptomatic HIV-negative neurosyphilis patients. J Infect Chemother. 2021;27(11):1596–601. https://doi.org/10.1016/j.jiac.2021.07.004 Epub 2021 Jul 28. PMID: 34330638.
Marra CM, Tantalo LC, Maxwell CL, Ho EL, Sahi SK, Jones T. The rapid plasma reagin test cannot replace the venereal disease research laboratory test for neurosyphilis diagnosis. Sex Transm Dis. 2012;39(6):453–7. https://doi.org/10.1097/OLQ.0b013e31824b1cde.
He C, Kong Q, Shang X, Duan Y, Cui Y, Wang J, et al. Clinical, laboratory and brain magnetic resonance imaging (MRI) characteristics of asymptomatic and symptomatic HIV-negative neurosyphilis patients. J Infect Chemother. 2021;27(11):1596–601. https://doi.org/10.1016/j.jiac.2021.07.004 Epub 2021 Jul 28. PMID: 34330638.
Acknowledgements
Not applicable.
Funding
This work was funded by the National Key Research and Development Program of China (Nos. 2018YFC1311400, 2018YFC1311401) and Clinical Research Incubation Project of West China Hospital of Sichuan University (Grant 2018HXFH022).
Author information
Authors and Affiliations
Contributions
WJ G analysed and interpreted the patient data regarding neurosyphilis and was a major contributor in writing the manuscript. YZ and LH instructed the study design of clinical research. CP performed part of lumber puncture. DD L instructed the interpretation of laboratory tests. LJ G instructed the data processing. JJ B and CL L helped process ethics profile. NC and LH provided the support of project grants. DZ proposed the study direction of neurosyphilis. All authors read and approved the final manuscript.
Corresponding authors
Ethics declarations
Ethics approval and consent to participate
All methods were carried out in accordance with Transparent Reporting of a multivariable prediction model for Individual Prognosis or Diagnosis (TRIPOD) guidelines and regulations.
Ethics committee on biomedical research, West China Hospital of Sichuan University approved the study and waived informed consent from all subjects. The committee’s reference number was 1163 in 2020 approval.
Consent for publication
Not applicable.
Competing interests
The authors declare that they have no competing interests.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Additional file 1: Supplement 1
Clinical symptoms and comorbidities. Supplement 2 Cost of neurosyphilis diagnosis tests.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Ge, W., Zhang, Y., Peng, C. et al. Development and external validation of a nomogram for neurosyphilis diagnosis among non-HIV patients: a cross-sectional study. BMC Neurol 21, 451 (2021). https://doi.org/10.1186/s12883-021-02454-8
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s12883-021-02454-8