Abstract
Outbreaks of emerging diseases, like Mpox in 2022, pose unprecedented challenges to global healthcare systems. Although Mpox cases globally decreased since the end of 2022, numbers are still significant in the African Region, European Region, Region of the Americas, and Western Pacific Region. Rapid and efficient detection of infected individuals by precise screening assays is crucial for successful containment. In these assays, analytical and clinical performance must be assessed to ensure high quality. However, clinical studies evaluating Mpox virus (MPXV) detection kits using patient-derived samples are scarce. This study evaluated the analytical and clinical performance of a new diagnostic MPXV real-time PCR detection kit (Sansure Monkeypox Virus Nucleic Acid Diagnostic Kit) using patient-derived samples collected in Germany during the MPXV clade IIb outbreak in 2022. Our experimental approach determined the Limit of Detection (LoD) to less than 200 cp/mL using whole blood samples and samples derived from vesicles or pustules. Furthermore, we tested potentially inhibiting substances and pathogens with homologous nucleic acid sequences or similar clinical presentation and detected no cross-reactivity or interference. Following this, the assay was compared to a CE-marked test in a clinical performance study and achieved a diagnostic sensitivity of 100.00% and diagnostic specificity of 96.97%. In summary, the investigated real-time PCR assay demonstrates high analytical performance and concurs with the competitor device with high specificity and sensitivity.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Introduction
In recent years, we have been facing a series of epidemic and pandemic outbreaks caused by emerging pathogens such as the SARS-CoV-2 and, more recently, the Mpox virus (MPXV). MPXV, formerly referred to as Monkeypox virus, is an enveloped double-stranded DNA virus classified within the Orthopoxvirus genus. The virus is known to infect a wide range of animal species, including squirrels, rats, dormice, and primates. Moreover, it has the potential for zoonotic transmission to humans, leading to the development of the Mpox disease [1].
Upon infection, individuals typically experience a 3- to 14-day incubation period before the onset of symptoms. Initial symptoms are often non-specific and may include fever, chills, fatigue, headaches, swollen lymph nodes, and the characteristic Mpox rash with highly infectious pustules and vesicles. The virus can spread through direct skin-to-skin contact or exposure to bodily fluids, such as blood, saliva, or sputum [2].
While Mpox has been endemic in some areas of Central and West Africa, a pandemic outbreak starting in 2022 has affected more than 100 countries and resulted in over 95,000 confirmed cases so far [3]. By the end of 2022, the Mpox cases have declined globally, but WHO reports a resurgence in Mpox cases since July 2023, mainly in the African Region, European Region, Region of the Americas, and Western Pacific Region [4].
Effective containment strategies depend on rapid and efficient screening, identification, and isolation of infected individuals. Real-time polymerase chain reaction (PCR) testing is recognized as the gold standard detection method for a wide range of pathogens. However, it necessitates a well-designed assay to ensure high sensitivity and pathogen-specificity.
While commercially available and regulatory-approved MPXV detection kits are limited [5, 6], most PCR protocols have been developed and published as laboratory-developed or laboratory-adapted tests [7,8,9,10,11,12]. However, these tests may exhibit significant disparities in specificity and sensitivity due to variations in reagents, equipment, and methodologies. Moreover, most of the available PCR protocols and test kits have only been evaluated using recombinant DNA, pseudo-virus particles, or cell-culture-derived MPXV samples, so the specified test parameters may not reflect the actual clinical performance. Furthermore, sample collection, preparation, storage, or handling, as well as variations in the MPXV genome from different patients, may influence the specificity and sensitivity [13, 14].
This emphasizes the need for more readily available, high-quality MPXV diagnostic tools with proven analytical and clinical performance.
In this study, we evaluated the analytical and clinical performance of a new diagnostic MPXV real-time PCR detection kit (Sansure Monkeypox Virus Nucleic Acid Diagnostic Kit). In the analytical performance study, we determined the Limit of Detection (LoD) using various sample types, including whole blood samples or swabs obtained from vesicles or pustules. We assessed cross-reactivity and interference by other pathogens and potentially inhibiting substances. In a clinical performance study, we compared the assay to another CE-marked comparator device using patient-derived samples collected in Germany during the MPXV clade IIb outbreak in 2022.
Materials and methods
Specimen collection and preparation
Samples were collected at the Technical University of Munich and the University of Cologne using the Copan Universal Transport Medium (UTM-RT®) System or Clinical Virus Transport Medium (Nobel Bioscience, Sinbaek-gil, South Korea). After collection, specimens were stored between − 25 °C and 4 °C.
Determination of Limit of Detection (LoD)
We used the ATCC Quantitative Synthetic Monkeypox virus DNA (VR-3270SD) to validate the LoD. Absolute quantification of MPXV DNA was determined using the Qiagen QIAcuity Platform.
DNA isolation
Nucleic acids were extracted using DNeasy Blood & Tissue Kit (Qiagen, Hilden, Germany) or Nucleic Acid Extraction-Purification Kit XCXB (Sansure, Changsha, China) according to the manufacturer’s instructions.
Real-time PCR
Samples were analyzed for MPXV DNA by real-time PCR on a QuantStudio 5 (ThermoFisher Scientific, Waltham, USA) or a Light cycler 480Z (Roche Diagnostics, Mannheim, Germany) using the Sansure Monkeypox Virus Nucleic Acid Diagnostic Kit (Fluorescence PCR) (Sansure, Changsha, China) or the Bosphore Monkeypox Detection Kit v1 (Anatolia Gene Works, Istanbul, Turkey).
Sansure Monkeypox Virus Nucleic Acid Diagnostic Kit (Fluorescence PCR) is compatible with multiple available PCR instruments and can be used with samples derived from an automated nucleic acid extraction system or a manual extraction. Samples were prepared according to Table 1, and the real-time PCR was performed according to Table 2.
For the Bosphore Monkeypox Detection Kit v1, samples were prepared according to Table 3, and the real-time PCR was performed according to Table 4.
Virus culturing
Collected patient samples medium was mixed with 2.5 mL of Dulbecco’s Modified Eagle Medium containing 10% heat-inactivated fetal bovine serum, 1% Penicillin/Streptomycin, and glutamine. Vero E6 cells were seeded into a T-25 flask, inoculated with the sample, and cultured until the cytopathic effect was visible. Once all cells were detached, the supernatant was collected and centrifuged for 10 min at 1,000 x g, the supernatant was discarded, and the pellet was reconstituted in Modified Eagle Medium. The suspension was then subjected to three freeze/thaw cycles (-80 C°/37 C°). Cytopathogenic effects were monitored using an EVOS 5000 microscope (ThermoFisher Scientific, Waltham, USA).
PCR amplification and sequencing
To verify the initial MPXV DNA diagnostic result, a PCR on extracted supernatants from virus culturing was performed using the Sansure Monkeypox Virus Nucleic Acid Diagnostic Kit (PCR) according to manufacturer instructions, as shown in Tables 5 and 6.
PCR products with a band of approx. 400 bp were gel purified, and Sanger sequenced using the primer MPXV-Seq forward (fw) and reverse (rv) with the sequences shown in Table 7.
Results
The Sansure Monkeypox Virus Nucleic Acid Diagnostic Kit was evaluated for its analytical and clinical performance with virus isolation, culturing, and sequencing to assess the viral viability of the clinical specimens and to confirm the initial diagnostic results.
Analytical performance
For analytical specificity, including specificity-cross reactivity and competitive and endogenous/exogenous interference analysis, we diluted a reference MPXV DNA in either whole blood samples or swaps taken from vesicles or pustules. Each test was conducted with independent extractions to evaluate precision for inter-batch, inter-day, and inter-operator variability. The inter-batch, inter-day, and inter-operator variabilities were all found to be less than 5% (Fig. 1 and Supplementary Tables 1–3).
The LoD of the assay was determined by gradually diluting MPXV DNA from 10e4 to 10e2, quantified by dPCR (Fig. 2A-C). Based on these measurements, we determined the LoD for whole blood samples and samples derived from vesicles or pustules as 182 cp/mL, 165 cp/mL, and 119 cp/mL, respectively (Fig. 2D).
Pathogen cross-reactivity was tested using pathogens with homologous nucleic acid sequences, similar clinical presentation, or pathogens frequently present in patients suffering from Mpox. In our analytical evaluation, we tested 19 pathogens in triplicates and could not detect any cross-reactivity (Table 8).
To assess competitive interference from commonly encountered endogenous or exogenous substances in the sample material, we evaluated the changes in Ct-values by adding different potentially interfering substances (Fig. 3). Detailed information about the concentration used can be found in Supplemental Table 4. None of the tested substances led to a statistically significant change in the Ct value compared to the original control sample.
Clinical performance
To assess the clinical performance of the assay, we adopted a cross-sectional, observational study design using 63 retrospective samples collected at two large university hospitals in Germany during the MPXV clade IIb outbreak in 2022 with clinical signs and symptoms of a potential infection. The typical symptoms included skin rashes, mucosal lesions, swollen lymph nodes, and fever.
In the initial diagnostic testing, 32 samples tested positive, while 31 tested negative for MPXV. Among the negative samples, there were 21 males and 11 females, with an average age of 51.44 years. Notably, the positive samples did not include females and had a lower average age of 36.74 years, which aligns with the WHO data on Mpox cases of the current outbreak that 96.4% of cases are male and the median age is 34 years [18].
The primary objectives of this study were the diagnostic performance parameters, including sensitivity and specificity. Secondary objectives included predictive values, likelihood ratios, and accuracy.
In the first step, we performed virus culturing followed by PCR amplification and Sanger sequencing to verify the initial diagnostic test results. Notably, all Sanger sequencing results were in accordance with the initial diagnostic results. Subsequently, the Sansure Monkeypox Virus Nucleic Acid Diagnostic Kit (Fluorescence PCR) was compared to another CE-marked comparator device (Bosphore Monkeypox Detection Kit v1). The results of the individual RT-PCRs, including Ct values and test results, are shown in Supplemental Tables 5 and 6. The primary objectives of the two compared devices are shown in Tables 9 and 10. Secondary objectives of the study are shown in Table 11. Both tested kits had high sensitivities and specificities, with the Sansure kit achieving 100% and 96.97%, respectively, and the Bosphore kit reaching 100% and 94.12%, respectively. Further assessed performance parameters in this study included positive and negative predictive values (96.88% and 100%, respectively, for the Sansure kit; 93.94% and 100%, respectively, for the Bosphore kit), and positive and negative likelihood ratios (33.00 and 0.00, respectively, for Sansure kit; 17.00 and 0.00, respectively, for Bosphore kit).
In summary, the Sansure Monkeypox Virus Nucleic Acid Diagnostic Kit and the Bosphore Monkeypox Detection Kit v1 demonstrated high sensitivity and specificity. However, the Sansure kit demonstrated slightly superior performance in specificity and positive predictive value.
Discussion
The containment of infectious diseases, such as Mpox, heavily depends on the availability of reliable in-vitro diagnostic tests. This study evaluated the analytical and clinical performance of the Sansure Monkeypox Virus Nucleic Acid Diagnostic Kit (Fluorescence PCR). Our results show high analytical sensitivity and specificity, reaching 100% in different sample matrixes tested over 21 days and 100% specificity against potentially cross-reacting pathogens. We determined the LoD for MPXV clade IIb to be < 200 cp/mL in different sample matrixes, comparable to other available detection kits [7, 10, 15, 16]. The test sensitivity, at MPXV DNA concentrations close to the calculated LoDs, was not impaired when endogenous or exogenous interfering substances or pathogens were present in the MPXV samples.
While the analytical performance primarily reflects the test´s ability to detect MPXV as a specific analyte, clinical testing is indispensable for assessing sensitivity and specificity in actual patient samples [17]. Thus, we conducted a clinical performance study, including 31 positive and 32 negative retrospective samples collected at two large university hospitals during the MPXV outbreak in Germany. The results of this study revealed that the Sansure Monkeypox Virus Nucleic Acid Diagnostic Kit had a diagnostic sensitivity of 100.00% and diagnostic specificity of 96.97%, achieving a better performance compared to the CE-certified Bosphore Monkeypox Virus Detection Kit with a sensitivity of 100.00% and a specificity of 94,12%, respectively.
Although the sample size might need an extension for a comprehensive evaluation, the results can be used as a performance estimation for statistical sample size calculation for future studies. Considering the current increase in Mpox cases in many world regions, sample collection from other study sites in these regions would be beneficial to cover a broader range of genetic variants of the virus [18, 19].
In conclusion, our results indicate high analytical sensitivity and specificity for the Sansure Monkeypox Virus Nucleic Acid Diagnostic Kit (Fluorescence PCR). The kit concurs in a clinical study with another CE-certified competitor device, the Bosphore Monkeypox Detection Kit v1, with high levels of specificity and sensitivity.
Data availability
No datasets were generated or analysed during the current study.
References
Beeson A et al (2023) Mpox respiratory transmission: the state of the evidence. Lancet Microbe 4(4):e277–e283
Bragazzi NL et al (2023) Epidemiological trends and clinical features of the ongoing monkeypox epidemic: a preliminary pooled data analysis and literature review. J Med Virol 95(1):e27931
Mathieu E et al Mpox (monkeypox). Our World in Data 2022; https://ourworldindata.org/monkeypox
WHO. 2022-23 Mpox Outbreak: Global Trends (2023) ; https://worldhealthorg.shinyapps.io/mpx_global/
Papadakis G et al (2023) Evaluation of 16 molecular assays for the detection of orthopox and mpox viruses. J Clin Virol 161:105424
Zhou Y, Chen Z (2023) Mpox: a review of laboratory detection techniques. Arch Virol 168(8):221
Wettengel JM et al (2023) Implementation and clinical evaluation of an Mpox virus laboratory-developed test on a fully automated random-access platform. J Med Virol 95(8):e29022
Yang J et al (2023) Development of highly accurate digital PCR method and reference material for monkeypox virus detection. Anal Bioanal Chem 415(7):1333–1337
Huo S et al (2022) Development of two multiplex real-time PCR assays for simultaneous detection and differentiation of monkeypox virus IIa, IIb, and I clades and the B. 1 lineage. Biosaf Health 4(06):392–398
Mills MG et al (2023) Evaluation and clinical validation of monkeypox (mpox) virus real-time PCR assays. J Clin Virol 159:105373
Ropp SL et al (1995) PCR strategy for identification and differentiation of small pox and other orthopoxviruses. J Clin Microbiol 33(8):2069–2076
Li Y et al (2010) Real-time PCR assays for the specific detection of monkeypox virus West African and Congo Basin strain DNA. J Virol Methods 169(1):223–227
Wu F et al (2023) Wide mismatches in the sequences of primers and probes for monkeypox virus diagnostic assays. J Med Virol 95(1):e28395
Yinda CK et al (2023) Stability of Monkeypox Virus in Body fluids and Wastewater. Emerg Infect Dis 29(10):2065–2072
Erster O et al (2023) A multi-laboratory evaluation of Commercial Monkeypox Virus Molecular tests. Microbiol Spectr 11(3):e00225–e00223
Michel J et al (2022) Evaluation of 11 commercially available PCR kits for the detection of monkeypox virus DNA, Berlin, July to September 2022. Euro Surveill, 27(45)
Union E, Amtsblatt L 2017:117:TOC. 2017 [cited 2023 14.10.2023]; https://eur-lex.europa.eu/legal-content/DE/TXT/?uri=OJ:L:2017:117:TOC
Organization WH (2022) -23 Mpox (Monkeypox) Outbreak: Global Trends. 2023 [cited 2023 14.10.2023]; https://worldhealthorg.shinyapps.io/mpx_global/
Bosmeny MS et al (2023) Global mpox lineage discovery and rapid outbreak tracking with nanopore sequencing. Virol J 20(1):90
Acknowledgements
We would like to thank the diagnostics teams at the Technical University of Munich, and the University of Cologne, and MVZ Labor Limbach for their support in conducting this study. We also like to thank the Department of Microbiology of the Technical University of Munich for providing us with samples for cross-specificity testing.
Funding
This research was funded by Requalite GmbH, Gräfelfing, Germany, on behalf of the National Genetic Detection Technology Application Demonstration Center, Changsha, People’s Republic of China, which is part of Sansure Biotech Inc.
Institutional Review Board Statement: The study was conducted in accordance with the Declaration of Helsinki and approved by the Ethics committee of the State Medical Association Baden-Württemberg (Ref. No. F-2023-004), Ethics committee of the Technical University of Munich (Ref. No. 2023-31-S-KK) and Ethics committee of the University of Cologne (Ref. No. 23-1014 and 13–364).
Open Access funding enabled and organized by Projekt DEAL.
Author information
Authors and Affiliations
Contributions
Conceptualization, T.B., A.Z., U.Y., H.I., G.K., R.K., N.B., U.E., D.T., L.D., X.R. and J.W.; methodology, T.B., P.H., G.R., R.K., N.B., J.K., M.K., U.E., D.T., L.D., X.R., U.P. and J.W.; software, T.B., A.Z., P.H., G.R., H.I., G.K., R.K., N.B., J.K., M.K., U.E. and J.W.; validation, T.B., A.Z., P.H., G.R., U.Y., H.I., G.K., R.K., N.B., J.K., M.K., U.E., D.T., L.D., X.R., U.P. and J.W. ; formal analysis, T.B., P.H., G.R., U.Y., R.K., N.B., J.K., M.K., U.E., D.T. and J.W.; investigation, T.B., P.H., G. R., R.K., N.B., J.K., M.K., U.E., D.T. and J.W.; resources, H.I., R.K., N.B., U.E., D.T., L.D., X.R., U.P. and J.W.; data curation, T.B., U.Y., G.K., R.K., N.B., U.E., D.T., L.D., X.R. and J.W.; writing—original draft preparation, T.B., A.Z., U.E., D.T. and J.W.; writing—review and editing, T.B., A.Z., P.H., G.R., U.Y., H.I., G.K., R.K., N.B., J.K., M.K., U.E., D.T., L.D., X.R., U.P. and J.W.; visualization, T.B., U.Y., R.K., N.B., U.E. and J.W.; supervision, A.Z., U.Y., H.I., G.K., R.K., U.E., L.D., X.R., U.P. and J.W.; project administration, A.Z., U.Y., H.I., G.K., R.K., U.E., D.T., L.D., X.R., U.P. and J.W.; funding acquisition, H.I., R.K., U.E., D.T., L.D., X.R., U.P. and J.W. All authors have read and agreed to the published version of the manuscript.
Corresponding author
Ethics declarations
Informed consent
For samples provided by the University of Cologne, broad consent for further use in research, including transfer to other centers and publication, was obtained in the context of a biobanking project (Ref. No. 13–364) at the time of sample collection. For samples provided by the Technical University of Munich, informed consent for the use of left-over samples was waived due to the use of anonymized samples, not conducting any analyses that could be of individual relevance to the patients or their family members and not transferring samples to third parties.
Conflict of interest
This study was sponsored by the National Genetic Detection Technology Application Demonstration Center, Changsha, People’s Republic of China, which is part of Sansure Biotech Inc. The authors D.T., L.D., and X.R. are affiliated with the National Genetic Detection Technology Application Demonstration Center, Changsha, People’s Republic of China. The authors A.Z., U.Y., H.I., and G.K. are affiliated with Requalite GmbH, who acted as a CRO on behalf of the sponsor and contributed to the study design. The sponsor agreed with the publication of the study’s results.
Competing interests
This study was sponsored by the National Genetic Detection Technology Application Demonstration Center, Changsha, People’s Republic of China, which is part of Sansure Biotech Inc. The authors D.T., L.D., and X.R. are affiliated with the National Genetic Detection Technology Application Demonstration Center, Changsha, People’s Republic of China. The authors A.Z., U.Y., H.I., and G.K. are affiliated with Requalite GmbH, who acted as a CRO on behalf of the sponsor and contributed to the study design. The sponsor agreed with the publication of the study’s results.
Additional information
Communicated by Isabelle Bekeredjian-Ding.
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Bunse, T., Ziel, A., Hagen, P. et al. Analytical and clinical evaluation of a novel real-time PCR-based detection kit for Mpox virus. Med Microbiol Immunol 213, 18 (2024). https://doi.org/10.1007/s00430-024-00800-4
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s00430-024-00800-4