Abstract
This study intended to evaluate the diagnostic accuracy of the prostate imaging reporting and data system (PI-RADS) and prostate-specific antigen density (PSAD) for clinically significant prostate cancer (csPCa) with PSA levels of 4–10 ng/ml. Between July 2018 and June 2022, a total of 453 patients with PSA levels of 4–10 ng/ml were retrospectively included, which were randomly assigned to the training group (323 patients) and validation group (130 patients). Sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) with their 95% CI were calculated. The overall diagnostic performance was determined with area under the receiver operating characteristic curve (AUC), and an integrated nomogram combining PI-RADS score and PSAD was constructed and tested in a validation cohort. In the training group, the AUC for PI-RADS 2.1 and PSAD alone were 0.875 (95% CI 0.834–0.916) and 0.712 (95% CI 0.648–0.775). At the cutoff PI-RADS score ≥ 4, the sensitivity and specificity were 86.2% (95% CI 77.4–1.9%) and 84.7% (95% CI 79.6–88.8%), respectively. For PSAD, the sensitivity and specificity were 73.3% (95% CI 63.0–82.4%) and 62.1% (95% CI 55.8–68.5%) at the cutoff 0.162 ng/ml/ml. While combining PI-RADS with PSAD, the diagnostic performance was improved significantly, with AUC of 0.893 (95% CI 0.853–0.933). In the validation group, the nomogram yielded a AUC of 0.871 (95% CI 0.807–0.934), which is significantly higher than PI-RADS alone (0.829, 95% CI 0.759–0.899, P = 0.02). For patients with PSA levels of 4–10 ng/ml, PSAD demonstrated moderate diagnostic accuracy whereas PI-RADS showed high performance. By combination of PSAD and PI-RADS together, the diagnostic performance could be improved significantly.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Introduction
Prostate cancer is a major health problem for men worldwide, it is estimated that 10 million living with PCa at present, and of which 7 million are living with metastatic disease1,2. In the management of PCa, serum prostate-specific antigen was used for screening and monitoring patients older than 50 years of age, intending to detect PCa at an early stage3,4. In the USA, a PSA level > 4.0 ng/ml was considered as the threshold that reference to prostate biopsy; however, PSA is not cancer-specific and elevated PSA levels can be owing to benign prostatic hyperplasia (BPH) and prostatitis5. Therefore, PSA demonstrates high sensitivity but low specificity, which may result in overdiagnosis and treatment of indolent prostate lesions6. Additionally, only 20.4% of men PSA level of 4–10 ng/ml were diagnosed with csPCa, which is called the gray zone7.
Over the past two decades, the application of MRI for the prostate has advanced substantially and is considered the most effective imaging modality for the detection and diagnosis of csPCa8,9,10. Furthermore, multiparametric magnetic resonance imaging (mpMRI)-based PI-RADS has been widely used in clinical practice. Nevertheless, like PSA, MRI also showed high sensitivity but lower specificity11,12,13. A recent meta-analysis including 10 studies demonstrated that the pooled sensitivity and specificity were 0.87 and 0.74 for PI-RADS v2.1, which means a number of unnecessary biopsies14. Moreover, mpMRI requires a long examination time of approximately 30–45 min, which is especially problematic in elderly or claustrophobic patients who cannot remain motionless for that long15. Therefore, it should balance these benefits against the potential short and long-term harms, including complications from biopsies and subsequent treatment, as well as the risk of overdiagnosis and overtreatment16. In recent years, PSAD has been investigated intensively and considered as an independent clinical variable or combination with others for the prediction of csPCa17,18. However, the diagnostic performance of PSAD and PI-RADS in patients of PSA gray zone only reported in few studies19. Therefore, this study aimed to assess the diagnostic performance of PI-RADS v2.1 and PSAD for the prediction of csPCa in patients with PSA levels of 4–10 ng/ml.
Materials and methods
Patient selection
This study was conducted in compliance with the guiding principles of the Declaration of Helsinki, and approved by ethics committee of Jiangsu Vocational College of Medicine (JD-HG-2023-92). The requirement of written informed consent was waived by our institutional review board (Jiangsu Vocational College of Medicine) due to retrospective nature of the study. All data were collected following the Health Insurance Portability and Accountability Act (HIPAA). Between July 2018 and June 2022, 531 consecutive patients with PSA levels of 4–10 ng/ml and suspected of PCa were identified from electronic databases at our institution, all patients underwent systematic TRUS-guided biopsy after at least 4 weeks of the MRI examination. After mpMRI examination, suspicious lesions underwent MRI-transrectal ultrasonography (TRUS) fusion-guided prostate-targeted biopsy (MRGB). Of which, 78 patients were excluded for reasons as follows: (1) history of biopsy or treatment (n = 34); (2) the images were fuzzy or with artifacts (n = 21); and (3) insufficient clinical data (n = 23). Finally, a total of 453 patients (mean age 68.11 ± 8.81 years; median PSA 6.89, interquartile range [IQR] 5.27–8.00 ng/ml) were analyzed, of whom 323 were randomly allocated to the training group and 130 were allocated to the validation group (with a ratio of 7:3). The patient selection procedure is demonstrated in Fig. 1.
MRI acquisition and interpretation
All patients underwent MRI examination with a 3.0 T scanner, and a pelvic 32-channel phased array coil (Ingenia 3.0 T CX Quasar Dual, Philips Medical Systems) was used. The mpMRI sequences included axial T1-weighted imaging; axial and sagittal turbo spin echo (TSE) T2-weighted imaging, single-shot echoplanar diffusion-weighted imaging, and dynamic contrast enhancement imaging. The apparent diffusion coefficient (ADC) maps were generated from DWI with b values of 0, 100, 1000, and 2000s/mm2. DCE was conducted immediately after injecting contrast agent of gadopentetate dimeglumine (Magnevist, Bayer Schering Pharma) with a dose of 0.1 ml/kg (2–3 ml/s), then followed by a 20 ml saline flush. Detailed MRI protocols used for imaging acquisition are provided in Table 1. MRI images were independently interpreted by two board-certified genitourinary radiologists (both with at least 5 years of experience), who were blinded to the final histopathology results and other clinical information. Each lesion was scored strictly according to the PI-RADS v2.1 criteria and assessed on a PACS workstation, and any discrepancies between radiologists were resolved through discussion.
Prostate biopsy procedure
All patients underwent standard 10-core TRUS biopsy after at least 4 weeks of the MRI examination, which was obtained in a double sextant pattern, sampling the lateral and medial portions of the apex, mid, and base of each hemi-gland. Lesions suspicious of PCa identified by MRI underwent targeted biopsy (1–2 cores/lesion, axial and/or sagittal planes). All biopsies were performed by a urologist (with 8 years of experience in prostate biopsy), utilizing an ESAOTE Mylab Twice color Doppler ultrasound device (with a 7.5-MHz transrectal end-fire probe). The location and Gleason score (GS) of an index tumor showing the highest GS were analyzed on the basis of biopsy results. When the highest GS was identified at multiple cores, the core location with the highest tumor percentage was considered the location of an index tumor. Identified lesions were annotated on the MRI T2WI by the radiologists and images of the prostate were segmented with real-time TRUS. For patients who underwent radical prostatectomy had their specimens fixed in 40% buffered formalin before being serially sectioned into horizontal slices, 3 mm thick. Subsequently, all tissues were embedded in paraffin, and sections measuring 4 μm in thickness were cut and stained with hematoxylin and eosin. An expert genitourinary pathologist (with more than 15 years of experience) evaluated the biopsy specimens and assigned each lesion a GS. Each lesion suspicious of PCa was assigned a corresponding International Society of Urological Pathology (ISUP) grade group20. In this study, csPCa was defined as GS ≥ 7 (3 + 4, ISUP ≥ 2), and/or extraprostatic extension (≥ pT3a). the prostate volume was calculated based on T2WI images, according to the ellipsoid volume formula: transverse width × transverse length × longitudinal height × 0.52.
Statistical analysis
The sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) with their 95% CI were calculated. The optimal cutoff value for diagnostic performance was obtained by the Youden index. The overall diagnostic performance of balance between sensitivity and specificity was evaluated using the AUC, and differences were compared with DeLong’s test, with the best being defined as the largest one21. All analysis was performed using STATA (version 16.1), with a P value less than 0.05 indicated as statistically significant. A nomogram for the prediction of csPCa was constructed by the combination of PSAD and PI-RADS v2.1.
Results
Patient characteristics
Among 323 lesions in the training cohort, 105 were located in the transition zone (TZ) and 218 in the peripheral zone (PZ). At targeted biopsy, 87 were diagnosed with csPCa (26.93%) and the remaining 236 were non-csPCa (73.07%), Table 2 summarizes the demographic characteristics of included patients. There were 206 patients (45.5%) with one lesion, for the remaining 247 patients (54.5%) with multiple lesions, 181 patients had two lesions, 43 patients had three lesions, 15 patients with for lesions, and 8 patients with five lesions. Of 46 patients underwent radical prostatectomy, there were 19 categorized as GS 4 + 3, 13 categorized as 4 + 4, and 14 categorized as > 4 + 4.
Diagnostic performance of PI-RADS v2.1 and PSAD
At the cutoff ≥ 4, the sensitivity and specificity of PI-RADS v2.1 for PSA 4–10 ng/ml were 86.2% (95% CI 77.4–91.9%) and 84.7% (95% CI 79.6–88.8%), respectively, with PPV and NPV of 67.6% (58.0–76.1%) and 94.3% (90.3–97.0%). While using PI-RADS score ≥ 3 as the cutoff value, the sensitivity increased to 95.4% (95% CI 88.8–98.2%) but with a significant decrease in specificity (55.9%, 95% CI 49.6–62.1%). The calculated AUC for PI-RADS v2.1 was 0.875 (95% CI 0.833–0.916). While analyzed according to the anatomy zone, the calculated AUC for the TZ was 0.882 (95% CI 0.824–0.93), whereas for the PZ was 0.826 (95% CI 0.752–0.900), no significant difference was found between the two areas (P = 0.24). When used PSAD as an independent predictor for csPCa, the calculated AUC was 0.712 (95% CI 0.648–0.775) and the best cutoff value was 0.162 ng/ml/ml, at which sensitivity and specificity were 73.3% (95% CI 63.0–82.4%) and 62.1% (95% CI 55.8–68.5%). When used 0.15 ng/ml/ml as the threshold, the corresponding sensitivity and specificity were 66.7% (95% CI 55.7–76.4%) and 64.8% (95% CI 58.4–70.9%). For 46 patients underwent radical prostatectomy, 28 were scored as PI-RADS 4 and 18 were scored as PI-RADS 5, and none of these patients were categorized as ≤ 3. In these patients, 6 patients (13.0%) with PSAD ≤ 0.1 ng/ml/ml, 19 patients (41.3%) with PSAD of 0.1–0.2 ng/ml/ml, and the remaining 21 patients (45.7%) were ≥ 0.2 ng/ml/ml.
A nomogram was constructed by combining two covariates, and the AUC of 0.893 (95% CI 0.853–0.933) suggested a significant improvement in diagnostic performance (P = 0.01, Fig. S1). The AUCs for PSAD, PI-RADS, and combination for the training group are demonstrated in Fig. 2A. The distribution of lesions according to PI-RADS score and PSAD is presented in Fig. 3. In the validation group, the AUC of PI-RADS v2.1 was 0.829 (95% CI 0.759–0.899), which improved significantly to 0.871 (95% CI 0.807–0.934) when combined with PSAD (P = 0.02), which is presented in Fig. 2B. With combined nomogram, there were 82 csPCa were detected, whereas for PI-RADS 70 csPCa were detected. No significant difference in missing csPCa between combined nomogram and PI-RADS, with 5 vs. 6. Table 3 summarizes the detailed diagnostic performance.
Discussion
In this study, we assessed the PI-RADS v2.1 and PSAD for patients with PSA levels of 4–10 ng/ml. In the training group, our analysis based on 323 patients revealed that PI-RADS had high sensitivity and specificity for the diagnosis of csPCa at the threshold of score ≥ 4, with an AUC of 0.875. By comparison, PSAD merely yielded an AUC of 0.712, which was significantly inferior to PI-RADS (P < 0.001). When combined PI-RADS and PSAD, the AUC of 0.893 suggestted significant improvement in diagnostic accuracy as compared to PI-RADS alone (P = 0.01). We constructed an integrated nomogram on the base of PI-RADS v2.1 and PSAD and test it in the validation set. The AUC of 0.871 for validation set showed that our nomogram performed well, which was significantly superior to either PI-RADS (AUC = 0.829, P = 0.02) or PSAD (AUC = 0.677, P < 0.001). In a previous study, Han et.al. investigated mpMRI and bpMRI combined PSAD for detecting csPCa in patients with PSA serum levels of 4–10 ng/ml19. In their study, the AUCs for mpMRI + PSAD and bpMRI + PSAD were 0.896 and 0.907, respectively, which is consistent with our results. Nevertheless, our study included more patients; moreover, we have constructed a nomogram and tested it in the validation cohort group including 130 patients.
Screening PCa with PSA intends to detect prostate cancer at an early stage thereby reducing the disease-specific mortality. Nonetheless, low specificity of PSA is associated with substantial overdetection of harmless, low-grade cancers and side-effects related to diagnosis and treatment, especially for those patients with PSA gray zone. In this study, as many as 26.27% of patients were benign or non-csPCa, which means a number of patients may suffer unnecessary biopsies or overtreatment. The use of mpMRI as a screening tool for PCa is costly and time-consuming because of the long scanning time to acquire multiple protocols. In addition, although the PI-RADS has been released for a decade as a consensus protocol guideline, adherence varies widely among hospitals22. In recent years, bpMRI has been investigated intensively, and many studies reported that it has comparable performance as compared with mpMRI. However, some studies demonstrated that for lesions of PI-RADS score ≥ 3, DCE has a statistically significant ability to identify csPCa or valuable for upgrading PI-RADS score 3 to PI-RADS score 4, especially for lesions located in the PZ23,24. Van der Leest et al. demonstrated a “fast bpMRI” protocol that used a monoplane (axial plane) in the detection of high-grade PCa in men with a PSA value ≥ 3 ng/ml. The results showed that with fast-bpMRI, the sensitivity was not decreased compared to mpMRI (both were 95%), only with a slight decrease in specificity (65% vs. 69%). However, the results have not been widely validated15.
In the past several years, PSAD has been demonstrated as a promising independent predictor or combination with other clinical variables for the prediction of csPCa. In a recent meta-analysis that summarized 39 studies for risk stratification of csPCa with PSAD alone, the 3 most commonly used cutoff values for PSAD were 0.15, 0.1, and 0.2 ng/ml/ml. At cutoff values of 0.15 ng/ml/ml, the pooled sensitivity and specificity were 74% and 61%, which is comparable with our findings. However, their meta-analysis also showed widely varied optimal cutoff values and significant heterogeneity between studies. Therefore, it is unfeasible to predict csPCa only depending on PSAD alone, especially for patients with PSA gray zone or PI-RADS score 3 lesions. Our study demonstrated that by combining PSAD with PI-RADS, the diagnostic performance was improved significantly for the prediction of csPCa.
The main strength of our study was the relatively large cohort study population as compared with previous studies; moreover, we constructed a model for risk stratification of patients with PSA gray zone. Additionally, we have tested it in an independent cohort group including 130 patients. However, our study had several limitations. First, we conducted our study retrospectively and in a single center, which may result in patient selection bias and limit the generalizability of our results and conclusions. Therefore, the findings need to be validated externally. Second, using systematic and/or MRI-TRUS fusion targeted biopsy as the reference standard may miss some lesions with positive pathology that are negative in MRI. Third, the inter-reader agreement between radiologists was not investigated, and all results were from two experienced readers. Therefore, the diagnostic performance of readers with less experience for the PSA level of gray zone is unknown.
Conclusions
The findings of the current study suggest that PI-RADS v2.1 had high diagnostic performance for csPCa with PSA gray zone. Nevertheless, the PSAD yielded only moderated accuracy as an independent predictor. By adding PSAD to PI-RADS v2.1 can significantly improve the performance for the prediction of csPCa. Further research, including prospective multicenter studies, is warranted to validate our findings.
Data availability
The data that support the findings of this study are available from the corresponding author upon reasonable request.
References
Sung, H. et al. Global cancer statistics 2020: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J. Clin. 71, 209–249. https://doi.org/10.3322/caac.21660 (2021).
Sandhu, S. et al. Prostate cancer. Lancet 398, 1075–1090. https://doi.org/10.1016/S0140-6736(21)00950-8 (2021).
Oesterling, J. E. Prostate specific antigen: a critical assessment of the most useful tumor marker for adenocarcinoma of the prostate. J. Urol. 145, 907–923. https://doi.org/10.1016/s0022-5347(17)38491-4 (1991).
Fitzpatrick, J. M., Banu, E. & Oudard, S. Prostate-specific antigen kinetics in localized and advanced prostate cancer. BJU Int. 103, 578–587. https://doi.org/10.1111/j.1464-410X.2009.08345.x (2009).
Pinsky, P. F. & Parnes, H. Screening for prostate cancer. N. Engl. J. Med. 388, 1405–1414. https://doi.org/10.1056/NEJMcp2209151 (2023).
Williams, I. S. et al. Modern paradigms for prostate cancer detection and management. Med. J. Aust. 217, 424–433. https://doi.org/10.5694/mja2.51722 (2022).
Catalona, W. J. et al. Measurement of prostate-specific antigen in serum as a screening test for prostate cancer. N. Engl. J. Med. 324, 1156–1161. https://doi.org/10.1056/NEJM199104253241702 (1991).
Tamada, T. et al. Prostate cancer detection in patients with total serum prostate-specific antigen levels of 4–10 ng/mL: Diagnostic efficacy of diffusion-weighted imaging, dynamic contrast-enhanced MRI, and T2-weighted imaging. AJR Am. J. Roentgenol. 197, 664–670. https://doi.org/10.2214/AJR.10.5923 (2011).
Vilanova, J. C. et al. Usefulness of prebiopsy multifunctional and morphologic MRI combined with free-to-total prostate-specific antigen ratio in the detection of prostate cancer. Am. J. Roentgenol. 196, W715–W722. https://doi.org/10.2214/AJR.10.5700 (2011).
Delongchamps, N. B. et al. Multiparametric magnetic resonance imaging for the detection and localization of prostate cancer: Combination of T2-weighted, dynamic contrast-enhanced and diffusion-weighted imaging. BJU Int. 107, 1411–1418. https://doi.org/10.1111/j.1464-410X.2010.09808.x (2011).
Barentsz, J. O. et al. ESUR prostate MR guidelines 2012. Eur. Radiol. 22, 746–757. https://doi.org/10.1007/s00330-011-2377-y (2012).
Weinreb, J. C. et al. PI-RADS prostate imaging—Reporting and data system: 2015, version 2. Eur. Urol. 69, 16–40 (2016).
Turkbey, B. et al. Prostate imaging reporting and data system version 2.1: 2019 update of prostate imaging reporting and data system version 2. Eur. Urol. 2019(76), 340–351. https://doi.org/10.1016/j.eururo.2019.02.033 (2019).
Park, K. J., Choi, S. H., Kim, M.-H., Kim, J. K. & Jeong, I. G. Performance of prostate imaging reporting and data system version 2.1 for diagnosis of prostate cancer: A systematic review and meta-analysis. J. Magn. Reson. Imaging 54, 103–112. https://doi.org/10.1002/jmri.27546 (2021).
Udayakumar, N. & Porter, K. K. How fast can we go: Abbreviated prostate MR protocols. Curr. Urol. Rep. 21, 59. https://doi.org/10.1007/s11934-020-01008-8 (2020).
Borghesi, M. et al. Complications after systematic, random, and image-guided prostate biopsy. Eur. Urol. 71, 353–365. https://doi.org/10.1016/j.eururo.2016.08.004 (2017).
Li, X., Li, C. & Chen, M. Patients with “Gray Zone” PSA levels: Application of prostate MRI and MRS in the diagnosis of prostate cancer. J. Magn. Reson. Imaging 57, 992–1010. https://doi.org/10.1002/jmri.28505 (2023).
Wen, J., Tang, T., Ji, Y. & Zhang, Y. PI-RADS v2.1 combined with prostate-specific antigen density for detection of prostate cancer in peripheral zone. Front. Oncol. https://doi.org/10.3389/fonc.2022.861928 (2022).
Han, C. et al. MRI combined with PSA density in detecting clinically significant prostate cancer in patients with PSA serum levels of 4–10 ng/mL: Biparametric versus multiparametric MRI. Diagn. Interv. Imaging 101, 235–244. https://doi.org/10.1016/j.diii.2020.01.014 (2020).
Epstein, J. I., Amin, M. B., Reuter, V. E. & Humphrey, P. A. Contemporary Gleason grading of prostatic carcinoma: An update with discussion on practical issues to implement the 2014 International Society of Urological Pathology (ISUP) Consensus Conference on Gleason grading of prostatic carcinoma. Am. J. Surg. Pathol. 41, e1–e7. https://doi.org/10.1097/PAS.0000000000000820 (2017).
DeLong, E. R., DeLong, D. M. & Clarke-Pearson, D. L. Comparing the areas under two or more correlated receiver operating characteristic curves: A nonparametric approach. Biometrics 44, 837–845 (1988).
Kim, S. J., Vickers, A. J. & Hu, J. C. Challenges in adopting level 1 evidence for multiparametric magnetic resonance imaging as a biomarker for prostate cancer screening. JAMA Oncol. 4, 1663. https://doi.org/10.1001/jamaoncol.2018.4160 (2018).
Xu, L. et al. Comparison of biparametric and multiparametric MRI in the diagnosis of prostate cancer. Cancer Imaging 19, 90. https://doi.org/10.1186/s40644-019-0274-9 (2019).
Taghipour, M. et al. Investigating the role of DCE-MRI, over T2 and DWI, in accurate PI-RADS v2 assessment of clinically significant peripheral zone prostate lesions as defined at radical prostatectomy. Abdom. Radiol. 44, 1520–1527. https://doi.org/10.1007/s00261-018-1807-6 (2019).
Author information
Authors and Affiliations
Contributions
W.J and L.W. designed the study, collected and analyzed data; S.X.C. and H.W. assisted with data analysis and manuscript preparation, data collection and analysis, manuscript review. All authors contributed to the article and approved the submitted version.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Additional information
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Wen, J., Liu, W., Shen, X. et al. PI-RADS v2.1 and PSAD for the prediction of clinically significant prostate cancer among patients with PSA levels of 4–10 ng/ml. Sci Rep 14, 6570 (2024). https://doi.org/10.1038/s41598-024-57337-y
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41598-024-57337-y
- Springer Nature Limited