Abstract
The prognosis of patients with hepatocellular carcinoma (HCC) and intrahepatic cholangiocarcinoma (ICC) is a research hotspot. This study aimed to incorporate important factors obtained from SEER database to construct and validate a nomogram for predicting the cancer-specific survival (CSS) of patients with HCC and ICC. We obtained patient data from SEER database. The nomogram was constructed base on six prognostic factors for predicting CSS rates in HCC patients. The nomogram was validated by concordance index (C-index), the receiver operating characteristic (ROC) curve and calibration curves. A total of 3227 patients diagnosed with HCC (3038) and ICC (189) between 2010 and 2015 were included in this study. The C-index of the nomogram for HCC patients was 0.790 in the training cohort and 0.806 in the validation cohort. The 3- and 5-year AUCs were 0.811 and 0.793 in the training cohort. The calibration plots indicated that there was good agreement between the actual observations and predictions. In conclusion, we constructed and validated a nomogram for predicting the 3- and 5-year CSS in HCC patients. We have confirmed the precise calibration and excellent discrimination power of our nomogram.
Similar content being viewed by others
Introduction
Primary liver cancer, the fourth leading cause of cancer-related mortality and the sixth most common cancer, is a global health issue1,2. Histologically, primary liver cancer includes three main subtypes: hepatocellular carcinoma (HCC), intrahepatic cholangiocarcinoma (ICC), and mixed hepatocellular cholangiocarcinoma3. HCC is the most frequent subtype of liver cancer, which accounts for more than 80% of all primary liver cancers4,5, in frequency only to HCC, ICC arises from the epithelial layer of the second-degree biliary tract and is highly malignant6. The prognosis of patients with HCC and ICC is a research hotspot because new and more effective treatment strategies need to be based on information regarding prognostic risks. Prognostic factors such as patient age, tumor grade, and the American Joint Committee on Cancer (AJCC) stage have been used to predict patients’ survival time and response to treatment7,8. However, oncologists face challenges with the use of these unconsolidated factors; therefore, it is necessary to integrate multiple prognostic factors into an easy-to-use predictive system to better inform oncologists and more accurately stratify patients.
A nomogram is a predictive tool that creates a simple graph based on a predictive statistical model9. It can be used to calculate the probability of a clinical event by considering the prognostic weight of each factor. Nomograms have been widely used to assist clinical decision- making10,11,12. This study aimed to incorporate important factors obtained from the Surveillance, Epidemiology, and End Results (SEER) database to construct and validate a nomogram for predicting the cancer-specific survival (CSS) of patients with HCC and ICC.
Methods
Ethics statement
Informed patient consent was not required for data obtained from SEER, as cancer is a publicly reportable disease in every state in the USA.
Study population
We obtained patient data from the SEER 18 Research Data + Hurricane Katrina Impacted Louisiana Cases, Nov 2018 Sub (2010–2015 varying) incidence database, using SEER*Stat version 8.3.6. Patients diagnosed with HCC or ICC (primary site code 220 or 221) were included. Cases that were not confirmed by microscopy or only by autopsy were excluded, as were those with missing or incomplete additional data. The following additional data (variables) were used in the analysis: patient age, race, and sex; AJCC staging for the extent of tumor (T), extent of spread to lymph nodes (N), and presence of metastasis (M); and tumor grade, surgery (Y/N), alpha fetoprotein (AFP) level, fibrosis score, months of survival, and cause of death. We applied the seventh edition of the AJCC staging system, which was available for patients between 2010 and 2015. Ultimately, we identified 3227 eligible patients for inclusion in our study.
Statistical analysis
For nomogram construction and validation, we randomly divided all the HCC patients into training (n = 2123) and validation (n = 915) cohorts, in a ratio of 7:313,14. Multivariate Cox proportional hazards regression analysis was performed to identify variables (P < 0.05) that significantly affected CSS in the training group. Using these identified prognostic factors, we constructed a nomogram for predicting 3- and 5-year CSS rates in HCC and ICC patients15.
The nomogram was validated internally in the training cohort and externally in the validation cohort. To evaluate the discriminative ability of the nomogram, we used the concordance index (C-index) and the receiver operating characteristic (ROC) curve and assessed the area under the curve (AUC)16,17. A C-index or AUC of 0.5 indicates a discrimination ability that is no better than chance, whereas that of 1.0 indicates a perfect discrimination ability18. Calibration curves were constructed using a bootstrap approach, with 500 resamples, to compare the predicted CSS with the CSS observed in the study.
All statistical analyses were conducted using SPSS (version 24.0; SPSS, Chicago, IL, USA) and R software (version 3.6.1; http://www.r-project.org/). A P value of less than 0.05 was considered to indicate statistical significance.
Results
Patient characteristics
A total of 3227 patients diagnosed with HCC (3038) and ICC (189) between 2010 and 2015 were included in this study. The training and validation cohorts of HCC patients consisted of 2123 and 915 cases, respectively, selected by the random split-sample method (split ratio: 7:3). In the total cohort of HCC patients, the majority of patients were under 65 years old (59.4%), white (66.5%), and male (76.0%). Furthermore, most of the patients had T1 (47.6%), N0 (95.7%), and M0 (93.5%); patients with a grade II tumor differentiation degree accounted for 50.5% of all cases. A large proportion of the patients had elevated AFP levels (64.9%) and cirrhosis (69.5%), and 46.6% of patients underwent tumor resection surgery. The characteristics of HCC patients in the training and validation cohorts were similar to those in the total cohort (Table 1).
For ICC patients, the training and validation cohorts consisted of 132 and 57 cases respectively. In the total cohort of ICC patients, most of characteristics (Age, Race, Sex, AJCC stage, Surgery and Grade) were similar to HCC patients. On the contrary, the majority of ICC patients had normal AFP levels (73.5%) and fibrosis level (66.7%). The characteristics of ICC patients in the training and validation cohorts were similar to those in the total cohort (Supplementary Table S1).
Screening for prognostic factors of CSS
For HCC patients, based on univariate and multivariate Cox proportional hazards regression analyses, we identified six independent prognostic factors in the training cohort. AJCC T2/T3/T4 (hazard ratio [HR] = 1.280/2.221/3.352, P < 0.01), AJCC M1 (HR = 2.540, P < 0.001), tumor resection (HR = 0.363, P < 0.001), liver transplantation (HR = 0.096, P < 0.001), grade II/III/IV (HR = 1.234/1.998/2.214, P < 0.05), elevated AFP level (HR = 1.336, P < 0.001) and cirrhosis (HR = 1.356, P < 0.001) were all significantly associated with CSS in HCC patients (Table 2).
For ICC patients, only three independent prognostic factors in the training cohort were identified. AJCC T3 + T4 (HR = 1.913, P = 0.015), AJCC M1 (HR = 4.036, P < 0.001), and surgery (HR = 0.328, P < 0.001) were all significantly associated with CSS in ICC patients (Supplementary Table S2).
Nomogram construction
Due to the small sample size (189) and few independent prognostic factors of ICC patients, the nomogram was only constructed for HCC patients. A nomogram based on the selected prognostic factors from the training cohort was developed for the prediction of HCC patient CSS at 3 and 5 years (Fig. 1). The nomogram demonstrated that surgery contributed the most to prognosis, followed by AJCC T, AJCC M, grade, fibrosis and AFP level. Each level of every variable was assigned a score on the points scale. The total score was obtained by adding the scores of each of the selected variables. The prediction corresponding to this total score then helped in estimating the 3- and 5-year CSS for each HCC patient.
Nomogram validation
The C-index of the nomogram (training cohort = 0.790, validation cohort = 0.806) was higher than which based on the AJCC stage (training cohort = 0.691, validation cohort = 0.675). Furthermore, the AUCs of the nomogram were higher than AJCC stage in both training (3-year AUC: 0.811 vs. 0.715, 5-year AUC: 0.793 vs.0.703, Fig. 2A,B) and validation (3-year AUC: 0.834 vs. 0.679, 5-year AUC: 0.808 vs. 0.667, Fig. 2C,D) cohorts for 3- and 5-year. These results indicate that the discrimination performance of the model was better than traditional AJCC stage in both the training and validation cohorts. The calibration plots for the 3- and 5-year CSS indicated that there was good agreement between the actual observations and predictions made using the nomogram in both the training cohort (Fig. 3) and the validation cohort (Fig. 4).
Discussion
Determining accurate tumor prognosis after definitive treatment is important19. Although the AJCC staging system is widely used for predicting prognosis in primary liver cancer patients, it has inherent defects because it neglects many significant risk factors such as race, age, and grade. Nomograms have been shown to be more accurate and user-friendly than the conventional staging system in many cancers20,21. In this study, we constructed a more comprehensive model based on a combination of various risk factors to better predict prognosis in HCC patients.
To identify independent prognostic factors, we performed univariate and multivariate Cox proportional hazards regression analysis. Univariate analysis indicated that race, sex, AJCC T, AJCC N, AJCC M, surgery, grade, AFP level, and fibrosis were potential prognostic factors for HCC patients. After multivariate analysis, only AJCC T, AJCC M, surgery, grade, AFP and fibrosis were independent prognostic factors for HCC patients and the nomogram was constructed based on those six factors. Our results showed that HCC patients who underwent liver transplantation had a better prognosis than those who underwent tumor resection. This is a useful conclusion for both doctors and patients.
For ICC patients, only AJCC T, AJCC M, and surgery were potential prognostic factors after univariate analysis and multivariate analysis. These factors were quite similar to traditional AJCC staging system and the sample size (189) of ICC patients was relatively small. Therefore it was not meaningful to construct a nomogram based on these three factors for ICC patients. A large sample size study including more risk factors in the future would be needed.
It is widely known that a model has relatively good discrimination if its C-index and AUC exceed 0.722; therefore, our model has a good discrimination ability. Furthermore, the calibration plot indicated that the CSS probabilities predicted by our nomogram were identical to the actual ones. The validation results indicate that our nomogram could be effective for application in the clinical setting.
Our study has some limitations. First, this large-sample retrospective study was based on the SEER database, which may have some inherent biases. Second, data regarding several potential important prognosis-related factors such as HBsAg, AST, CEA, and vascular invasion were not available in the SEER database. Third, due to the small sample size (189) and few independent prognostic factors of ICC patients, the nomogram was only constructed for HCC patients. Finally, our nomogram was internally validated, and it needs to be validated externally using other populations.
Conclusion
We constructed and validated a nomogram for predicting the 3- and 5-year CSS in HCC patients. The proposed nomogram considered six independent risk factors: AJCC T, AJCC M, surgery, tumor grade, AFP level and fibrosis. We have confirmed the precise calibration and excellent discrimination power of our nomogram. The predictive power of this nomogram may be improved by considering other potential important factors that we could not be obtained from the SEER database, and also by external validation.
Data availability
All data were acquired from the SEER database.
References
Ryerson, A. B. et al. Annual report to the nation on the status of cancer, 1975–2012, featuring the increasing incidence of liver cancer. Cancer 122, 1312–1337. https://doi.org/10.1002/cncr.29936 (2016).
Siegel, R. L., Miller, K. D. & Jemal, A. Cancer statistics, 2017. CA Cancer J. Clin. 67, 7–30. https://doi.org/10.3322/caac.21387 (2017).
Bray, F. et al. Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J. Clin. 68, 394–424. https://doi.org/10.3322/caac.21492 (2018).
Lafaro, K., Grandhi, M. S., Herman, J. M. & Pawlik, T. M. The importance of surgical margins in primary malignancies of the liver. J. Surg. Oncol. 113, 296–303. https://doi.org/10.1002/jso.24123 (2016).
Razumilava, N. & Gores, G. J. Cholangiocarcinoma. Lancet (London, England) 383, 2168–2179. https://doi.org/10.1016/s0140-6736(13)61903-0 (2014).
Najran, P. et al. Update on treatment options for advanced bile duct tumours: radioembolisation for advanced cholangiocarcinoma. Curr. Oncol. Rep. 19, 50. https://doi.org/10.1007/s11912-017-0603-8 (2017).
Shiani, A., Narayanan, S., Pena, L. & Friedman, M. The role of diagnosis and treatment of underlying liver disease for the prognosis of primary liver cancer. Cancer Control J. Moffitt Cancer Center 24, 1073274817729240. https://doi.org/10.1177/1073274817729240 (2017).
Bruix, J., Reig, M. & Sherman, M. Evidence-based diagnosis, staging, and treatment of patients with hepatocellular carcinoma. Gastroenterology 150, 835–853. https://doi.org/10.1053/j.gastro.2015.12.041 (2016).
Iasonos, A., Schrag, D., Raj, G. V. & Panageas, K. S. How to build and interpret a nomogram for cancer prognosis. J. Clin. Oncol. 26, 1364–1370. https://doi.org/10.1200/jco.2007.12.9791 (2008).
Cho, J. K. et al. Development and external validation of nomograms predictive of response to radiation therapy and overall survival in nasopharyngeal cancer patients. Eur. J. Cancer 51, 1303–1311. https://doi.org/10.1016/j.ejca.2015.04.003 (2015).
Li, J. et al. A nomogram predicting pulmonary metastasis of hepatocellular carcinoma following partial hepatectomy. Br. J. Cancer 110, 1110–1117. https://doi.org/10.1038/bjc.2014.19 (2014).
Kawachi, M. H. et al. NCCN clinical practice guidelines in oncology: prostate cancer early detection. JNCCN 8, 240–262. https://doi.org/10.6004/jnccn.2010.0016 (2010).
Collins, G. S., Reitsma, J. B., Altman, D. G. & Moons, K. G. (2015) Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD statement. BMJ 350, g7594. https://doi.org/10.1136/bmj.g7594 (2015).
Lei, Z. et al. Nomogram for preoperative estimation of microvascular invasion risk in hepatitis B virus-related hepatocellular carcinoma within the milan criteria. JAMA Surg. 151, 356–363. https://doi.org/10.1001/jamasurg.2015.4257 (2016).
Chen, S. et al. Development and validation of a nomogram for predicting survival in male patients with breast cancer. Front. Oncol. 9, 361. https://doi.org/10.3389/fonc.2019.00361 (2019).
Hanley, J. A. & McNeil, B. J. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology 143, 29–36. https://doi.org/10.1148/radiology.143.1.7063747 (1982).
Wolbers, M., Koller, M. T., Witteman, J. C. & Steyerberg, E. W. Prognostic models with competing risks: methods and application to coronary risk prediction. Epidemiology 20, 555–561. https://doi.org/10.1097/EDE.0b013e3181a39056 (2009).
Balachandran, V. P., Gonen, M., Smith, J. J. & DeMatteo, R. P. Nomograms in oncology: more than meets the eye. Lancet Oncol. 16, e173-180. https://doi.org/10.1016/s1470-2045(14)71116-7 (2015).
Wang, X. et al. Development and Validation of a Prognostic Nomogram in AFP-negative hepatocellular carcinoma. Int. J. Biol. Sci. 15, 221–228. https://doi.org/10.7150/ijbs.28720 (2019).
Hu, C. Y. et al. Nomograms for predicting long-term overall survival and cancer-specific survival in lip squamous cell carcinoma: a population-based study. 8, 4032–4042. https://doi.org/10.1002/cam4.2260 (2019).
Pan, Z. et al. Development and validation of a nomogram for predicting cancer-specific survival in patients with Wilms’ tumor. J. Cancer 10, 5299–5305. https://doi.org/10.7150/jca.32741 (2019).
EW, S. et al. Prediction of indolent prostate cancer: validation and updating of a prognostic nomogram. J. Urol. 177, 107–112; discussion 112, doi:https://doi.org/10.1016/j.juro.2006.08.068 (2007).
Acknowledgements
SEER database is an open database. We thank the staff at the SEER database. This work was supported by Grants from the Key R&D Project of Shaanxi Province (No. 2020GXLH-Z-001) and “the Fundamental Research Funds for the Central Universities” (Grant No. xzy022019032).
Author information
Authors and Affiliations
Contributions
Y.L. and Z.J.D. designed the study; K.L. and G.B.H. performed the research and acquired the data; T.L., W.Z. and P.K.C. analyzed the data; K.L. drafted the manuscript; Y.L. and Z.J.D. contributed significantly to the revision of the manuscript.
Corresponding authors
Ethics declarations
Competing interests
The authors declare no competing interests.
Additional information
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Liu, K., Huang, G., Chang, P. et al. Construction and validation of a nomogram for predicting cancer-specific survival in hepatocellular carcinoma patients. Sci Rep 10, 21376 (2020). https://doi.org/10.1038/s41598-020-78545-2
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41598-020-78545-2
- Springer Nature Limited
This article is cited by
-
High expression of TBRG4 in relation to unfavorable outcome and cell ferroptosis in hepatocellular carcinoma
BMC Cancer (2024)
-
Construction and evaluation of neonatal respiratory failure risk prediction model for neonatal respiratory distress syndrome
BMC Pulmonary Medicine (2024)
-
Development of a machine learning-based model to predict prognosis of alpha-fetoprotein-positive hepatocellular carcinoma
Journal of Translational Medicine (2024)
-
Development and validation of web-based nomograms for predicting survival status in patients with intrahepatic cholangiocarcinoma depending on the surgical status: a SEER database analysis
Scientific Reports (2024)
-
Deep learning models for predicting the survival of patients with hepatocellular carcinoma based on a surveillance, epidemiology, and end results (SEER) database analysis
Scientific Reports (2024)