Abstract
Weights assigned to comorbidities in predicting mortality may vary based on the type of index disease and advances in the management of comorbidities. We aimed to develop a modified version of the Charlson Comorbidity Index (CCI) using an Asian nationwide database (mCCI-A), enabling the precise prediction of mortality rates in this population. The main data source used in this study was the National Health Insurance Service-National Sample Cohort (NHIS-NSC) obtained from the National Health Insurance database, which includes health insurance claims filed between January 1, 2002, and December 31, 2013, in Korea. Of the 1,025,340 individuals included in the NHIS-NSC, 570,716 patients who were hospitalized at least once were analyzed in this study. In total, 399,502 patients, accounting for 70% of the cohort, were assigned to the development cohort, and the remaining patients (n = 171,214) were assigned to the validation cohort. The mCCI-A scores were calculated by summing the weights assigned to individual comorbidities according to their relative prognostic significance determined by a multivariate Cox proportional hazard model. The modified index was validated in the same cohort. The Cox proportional hazard model provided reassigned severity weights for 17 comorbidities that significantly predicted mortality. Both the CCI and mCCI-A were correlated with mortality. However, compared with the CCI, the mCCI-A showed modest but significant increases in the c statistics. According to the analyses using continuous net reclassification improvement, the mCCI-A improved the net mortality risk reclassification by 44.0% (95% confidence intervals (CI), 41.6–46.5; p < 0.001). The mCCI-A facilitates better risk stratification of mortality rates in Korean inpatients than the CCI, suggesting that the mCCI-A may be a preferable index for use in clinical practice and statistical analyses in epidemiological studies.
Similar content being viewed by others
Introduction
Comorbidity is among the most important predictors of inpatient outcomes1. Among the various methods used to predict mortality by weighting comorbidities, the Charlson Comorbidity Index (CCI) has been widely utilized by health researchers to measure the burden of diseases. In 1984, Charlson et al. identified the clinical conditions to be included in the index by reviewing 559 hospital charts of patients admitted to medical services at a single hospital and then assessed the associations of these comorbidities with the 1-year all-cause mortality2.
The ability of this index to predict mortality has been validated in various disease subgroups, including cancer3, renal disease4, stroke5 and intensive care6. Nevertheless, there are several reasons to recalibrate and subsequently validate this index with inpatients to obtain better predictions of their mortality rates. First, because the management of inpatients and their comorbidities has advanced significantly over the past 30 years, the contribution of comorbidities to the mortality rate has likely also changed. Second, this index is not suitable for predicting long-term outcomes in general hospitalized patients because in the development of the CCI, only a small sample and the one-year mortality rate were considered. Therefore, this index should be recalibrated and revalidated using more recent data.
The recalibration and validation of comorbidities indices have been performed in various disease group such as the index of coexistent disease7, Davies index8, Khan index9, a modified version of the CCI in incident hemodialysis patients (mCCI-IHD)10 and a modified version of the CCI in incident peritoneal dialysis patients (mCCI-PD)11. However, indices created from these specific disease groups may not be optimal to use as a tool to predict the outcomes of generalized patients.
Therefore, the present study aimed to develop a modified version of the Charlson Comorbidity Index (mCCI-A) using an Asian nationwide database that reflected the recent changes of mortality due to the development of medical technology and the difference in prevalence of diseases from racial differences and to compare its performance with the original CCI.
Results
Baseline characteristics of the entire cohort
The baseline characteristics of the entire cohort, development cohort and validation cohort are listed in Table 1 of the 570,716 participants, 46.3% of the patients were men. The overall mortality rate was 3.83%.
In total, 74.43% of the subjects had one or more comorbidities. Among the 17 comorbidities, the most prevalent comorbidity was chronic pulmonary disease (47.56%), followed by ulcer disease (37.1%) and mild liver disease (24.05%) (Table 2).
Development of the New Comorbidity Index (mCCI-A) for the prediction of mortality
Figure 1 shows the adjusted hazard ratios (HRs) and weights of each comorbidity. All comorbidities were significantly associated with mortality. Metastatic solid tumors were assigned the highest weight, followed by AIDS, moderate or severe liver disease, and any tumor, consecutively (Table 3).
Compared with the weights in the CCI, in the mCCI-A, the updated weights for cerebrovascular disease, myocardial infarction (MI), congestive heart failure (CHF), dementia, any tumor and moderate or severe liver disease increased; the updated weights for acquired immunodeficiency syndrome (AIDS) and metastatic solid tumors decreased; and the updated weights for diabetes without complication, diabetes with end organ damage, hemiplegia, and moderate or severe renal disease did not change (Fig. 1).
The mCCI-A scores were calculated by summing the updated weights. The scores were applied to each patient in the development cohort. Based on the CCI and mCCI-A scores, we categorized both scores into the following 4 risk groups: ≤ 50th percentile, 50th–80th percentile, 80th–90th percentile and > 90th percentile. To determine the cut-off values of the comorbidity scores in each risk group, we generated a histogram to represent the distributions of the scores (Fig. 2). The cut-off values of CCI scores corresponding to the 50th, 80th and 90th percentiles were 1, 3 and 5, respectively, whereas those of the mCCI-A scores were 1, 4 and 6, respectively.
Figure 3 shows the survival curves obtained using the Kaplan–Meier method in the development cohort, which were differentiated by the 4 risk groups of the CCI and mCCI-A. The risk groups in each index could discriminate the survival rates, indicating that increasing comorbidity index scores were associated with lower cumulative survival.
Application and validation of the mCCI-A
The baseline characteristics of the validation cohort (n = 171,214) are listed in Table 1. Males represented 46.26% of the subjects. The overall mortality was 3.83%. In total, 74.37% of the subjects had one or more comorbidities. Among the 17 comorbidities, the most prevalent comorbidity was chronic pulmonary disease (47.44%), followed by ulcer disease (37.17%) and mild liver disease (24.1%) (Table 2).
To assess the discrimination ability of each index, the c statistic and cNRI were calculated after adjusting for confounders in the following two analyses: univariate and multivariate. Significant differences were observed in the c statistics between the CCI and the mCCI-A in the univariate and multivariate analyses (Table 4). Additionally, a significant risk reclassification improvement was observed in the mCCI-A in the univariate and multivariate analyses using cNRI. In the multivariate analysis, compared with the CCI, the mCCI-A significantly improved the net mortality risk reclassification by 44.0% (95% CI 41.6–46.5; p < 0.001), indicating that the mCCI-A facilitates a better risk stratification of mortality in Korean inpatients than the CCI. Figure 3 shows the survival curves obtained using the Kaplan–Meier method in the validation cohort, which were differentiated by the 4 risk groups of the CCI and mCCI-A.
Application and validation of the mCCI-A to specific diseases
To assess the discrimination ability of each index, the c statistic and cNRI were calculated after adjusting for confounders in multivariate analysis in subgroups such as mild liver disease, chronic pulmonary disease, diabetes mellitus and moderate/severe renal disease patients composed of the total cohort. Significant differences were observed in the c statistics and cNRI between the CCI and the mCCI-A in multivariate analyses (Table 5).
Discussion
In this study, we modified the CCI using a nationwide population-based database and to developed a comorbidity index that provides better risk predictions in the general inpatient population. To the best of our knowledge, this study is the largest study to modify the CCI using a nationwide population-based database and develop a comorbidity index that provides better risk prediction in a general inpatient Asian population.
Since 1987, the CCI has been used as a comorbidity index throughout the medical community, and there have been efforts to predict the outcome of the general inpatient population using the CCI since the 1980s to 2000s. In 1996, the CCI was applied to 33,940 inpatients with ischemic heart disease12. In 1992, another study involving 27,111 patients who underwent lumbar spine surgery was conducted13. In both of the above mentioned studies, the diagnostic information used was based on International Classification of Disease, 9th revision codes (ICD-9). Using ICD codes may be useful in exploratory data analyses14. In the 2000s, a retrospective cohort study was conducted using National Health Insurance claims data (2001–2002) to compare the performance of three comorbidity measurements (Elixhauser, Charlson/Deyo, and Charlson/Romano method) among inpatients hospitalized for Chronic Obstructive Pulmonary Disease and Acute Myocardial Infarction in Taiwan15. However, these studies had two limitations. First, these studies investigated specific disease groups rather than general patients. Second, the purpose of these studies was to demonstrate superiority among the existing methods or to apply the methods to the general population.
Previous studies have directly applied the CCI to patients using a weight equal to that in the original index for each CCI index. However, the recalibration and validation of the weights of the CCI index diseases are needed for several reasons. First, the original CCI does not reflect the significant progress achieved in the treatment of each comorbidity and medical advancements over the previous 30 years. Second, the extent to which the original CCI reflects long-term outcomes considered important is unclear because the “training” population used to develop the original CCI was created based on the one-year mortality rate in general inpatients. Third, the original CCI was developed based on a relatively small number of patients.
In 1996, a study was conducted to update the CCI and scores using USA administrative databases of 6,326 patients who underwent bypass surgery, and the new index exhibited superior performance over the original CCI (c = 0.74 vs. 0.70)16. A new comorbidity index was developed by assigning specific weights to the original CCI in this study. However, AIDS was excluded because no patients with AIDS were included in the sample. In 2011, a study updated the CCI and scores using Canadian administrative databases of 55,929 patients admitted to a medical facility in the Calgary region (Alberta, Canada) (population 1.3 million)17. The authors excluded the 5 comorbidities found to have no statistical correlation with the mortality rates among the 17 comorbidities. The new index exhibited superior performance over the original CCI (c = 0.825 vs. 0.808). Although these two studies reflect the recent advances in medical management, there are limitations in that study. The evaluation of several comorbidities was limited (particularly AIDS), and there is still a need for further evidence regarding whether the index can be directly applied to Asians.
In Asia, the CCI has also been applied to various disease groups to evaluate the various outcomes of patients. However, the usefulness of the original CCI remains controversial. A Japanese study revealed that the CCI had been used to predict the overall survival of patients with solid tumors; however, the CCI is not considered a significant predictor18. The authors emphasized the necessity for developing scales that can more accurately predict patient outcomes.
Previously, we updated the CCI and scores in hemodialysis and peritoneal dialysis patients using the National Health Insurance dataset in Korea10,11. The first study involved 24,738 people who first started hemodialysis between 2005 and 200810. We developed the mCCI-IHD, which included 14 comorbidities with reassigned severity weights. In the validation cohort, compared with the CCI, the mCCI-IHD showed modest but significant increases in the c statistics at 6 months and 1 year. Compared with the CCI, the analyses using cNRI revealed that the mCCI-IHD improved the net mortality risk reclassification by 24.6%, 26.2% and 42.8% at 6 months and 1 and 2 years, respectively. The second study involved 7,606 people who first started peritoneal dialysis between 2005 and 200811. We developed the mCCI-IPD, which included 11 comorbidities with reassigned severity weights. In the validation cohort, compared with the CCI, although the mCCI-IHD showed no differences in the c statistics, the analyses using cNRI revealed that the mCCI-IHD provided a 38.2% improvement in mortality risk assessment.
Based on the results of the previous two studies, we extended this study to the entire inpatient population. In this study, we modified the CCI using administrative data that included nearly all Korean inpatients who were admitted between 2002 and 2013 and developed a comorbidity index that provides better risk stratification. In addition, we performed a cross validation of the new index. Additionally, the superior performance of the new index over the original CCI was shown. Notably, this report has two major implications. First, in contrast to the previous CCI, the mCCI-A score reflects the current medical environment. Comparing the weights in the CCI with the weights in the mCCI-A, the increased weights of cerebrovascular disease, circulatory systems (MI and CHF) and nonmetastatic tumors are likely associated with the increased prevalence of these diseases. This tendency is consistent with recent studies investigating populations with specific diseases in Korea10,11. Additionally, recent advances in the effectiveness of the treatment of metastatic cancer has led to a decreased mortality rate. This change is likely due to the decreased weights of metastatic cancer in this study. The second implication is that this study, based on the overall cohort of inpatients, overcame the limitations associated with the use of small sample sizes in previous studies. For example, AIDS was not considered in a previous study modifying the CCI due to the small sample size. However, in this study, obtaining the weights of AIDS was possible because of the large sample size.
This study has several limitations. First, in contrast to collecting data through chart reviews, the determination of the prevalence of diseases is generally problematic using administrative data19. Second, although the use of administrative data has advantages, such as the conservation of time and resources and consistency in diagnosis, the diagnoses may be inappropriate due to physician preferences regarding diagnostic codes. Third, administrative data do not include biochemical parameters such albumin and hemoglobin, which could affect the survival rate. Fourth, new values for the weight of each comorbidity were derived in this study, but no expert agreement on them could be derived and will need to be considered later. Fifth, because this study was conducted for patients from 2002 to 2013, there is a limitation to the application of hospitalized patients after 2013. Last, although there were interactions between variables and comorbidities that we considered in our analysis, the interaction test was not conducted in our study.
Methods
Data source and study samples
The main data source used in this study was the National Health Insurance Service-National Sample Cohort (NHIS-NSC) obtained from the National Health Insurance Service (NHIS) in South Korea. The NHIS-NSC database has been publicly available since July 2014 and contains a substantial amount of information regarding health care utilization, health screening, sociodemographic variables and mortality in Korean citizens. Detailed information obtained from the NHIS-NSC has been previously published20,21. Briefly, The NHIS-NSC covers health insurance claims filed between January 1, 2002 and December 31, 2013. Of the eligible population in 2002 (46,605,433 target individuals of 47,851,928 individuals constituting the entire Korean population), 1,025,340 participants (2.2% of the target population) were randomly selected until 2013 and were followed until 2013 (for 12 years). All traceable identifiers were removed before publishing to protect patient confidentiality.In this study, 578,547 patients (56.4% of the NHIS-NSC) who were hospitalized at least once were analyzed longitudinally. Except for 7,831 patients who died immediately or same month as hospitalization after admission, the total number of patients in our cohort was 570,716.
Study variables
Using the International Classification of Diseases, 10th revision (ICD-10), we identified the Charlson comorbidities among the secondary diagnoses based on all diseases that were diagnosed from both inpatient and outpatient services before discharge22. To develop the modified index, we used the same comorbid conditions covered by the CCI, including MI, CHF, peripheral vascular disease, cerebrovascular disease, dementia, chronic pulmonary disease, connective tissue disease, ulcer disease, mild liver disease, diabetes, hemiplegia, diabetes with end-organ damage, any tumor (including leukemia and lymphoma), moderate to severe liver disease, metastatic solid tumors and AIDS. We retrieved all records of each patient from the National Health Insurance database prior to the date of the discharge to identify the comorbidities. A patient was considered to have a comorbid condition if the condition was present in the index admission records. The outcomes included all-cause long-term mortality within the follow-up period after admission. Additionally, the National Health Insurance claims databases were used to identify mortality. Death occurring between January 1, 2002 and December 31, 2013, was considered in the development and validation cohorts. However, patients with admission and death occurring in the same month were excluded. The demographic information of both cohorts included age, sex, region, and family income.
Statistical analysis
First, to analyze the baseline characteristics of the study population, we merged the demographic and medical utilization data. A Cox regression analysis adjusted for age (quartile), sex, region and family income ratio was performed to develop new weights for the comorbidities. We obtained the adjusted HRs and 95% confidence intervals (CIs) after adjusting for age, sex, region, family income ratio, and all 17 comorbidities. The prognostic weights of the mCCI-A were computed by dividing the HRs associated with each comorbidity by the lowest HRs23. Then, the relative weights were truncated to integer values rounded to zero decimal places. The comorbidity score of each patient was calculated by summing the weights. Kaplan–Meier survival curves24 were generated to compare the performance of the CCI to the performance of the mCCI-A.
We performed internal-validation partitioning of the main data set into two sets comprising 70% of the sample for training and 30% of the sample for testing using a random sampling function with the variable of death as a reference parameter. In total, 70% (n = 399,502) of the sample was used for training to develop new comorbidity weights, and the remaining 30% (n = 171,214) of the sample was used as a validation cohort.
To assess the capacity of discriminating between the indices, a c statistic was calculated using the area under the receiver-operator curve25. To determine the statistical significance and 95% CIs of the c statistic, a Mann–Whitney test was performed with a contrast test. The continuous net reclassification improvement (cNRI) score obtained by performing logistic regression models was calculated to evaluate the reclassification26. For the binary response, i.e., death, the function improveprob in R was used to determine whether the predictions obtained from the model of mCCI-A significantly differed from those obtained from the model of the original CCI27. The cNRItotal is the sum of cNRIEvent and cNRINon-event, indicating the sum of the net proportions of subjects who died (Event) and who did not die (Non-event) were correctly reassigned a predicted risk.
The data were analyzed by using SAS 9.4 for Windows software (SAS Institute, Cary, NC, USA) and R software version 4.0.0 (Comprehensive R Archive Network: https://cran.r-project.org). In all analyses, p < 0.05 was considered statistically significant.
Ethical approval
This study was conducted in accordance with the principles of the Declaration of Helsinki. The study was approved by the Institutional Review Board (IRB) of Seoul National University Hospital (1610-038-797), and the study protocol was approved by the IRB. Under IRB approval, the informed consent waived.
Data availability
The datasets generated during and/or analyzed during the current study are available from the corresponding author on reasonable request.
References
Valderas, J. M., Starfield, B., Sibbald, B., Salisbury, C. & Roland, M. Defining comorbidity: implications for understanding health and health services. Ann. Fam. Med.7, 357–363. https://doi.org/10.1370/afm.983 (2009).
Charlson, M. E., Pompei, P., Ales, K. L. & MacKenzie, C. R. A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. J. Chronic Dis.40, 373–383. https://doi.org/10.1016/0021-9681(87)90171-8 (1987).
Singh, B. et al. Validation of the Charlson comorbidity index in patients with head and neck cancer: a multi-institutional study. Laryngoscope107, 1469–1475. https://doi.org/10.1097/00005537-199711000-00009 (1997).
Fried, L., Bernardini, J. & Piraino, B. Charlson comorbidity index as a predictor of outcomes in incident peritoneal dialysis patients. Am. J. Kidney Dis.37, 337–342. https://doi.org/10.1053/ajkd.2001.21300 (2001).
Tessier, A., Finch, L., Daskalopoulou, S. S. & Mayo, N. E. Validation of the Charlson Comorbidity Index for predicting functional outcome of stroke. Arch. Phys. Med. Rehabil.89, 1276–1283. https://doi.org/10.1016/j.apmr.2007.11.049 (2008).
Christensen, S., Johansen, M. B., Christiansen, C. F., Jensen, R. & Lemeshow, S. Comparison of Charlson comorbidity index with SAPS and APACHE scores for prediction of mortality following intensive care. Clin. Epidemiol.3, 203–211. https://doi.org/10.2147/clep.s20247 (2011).
Athienites, N. V. et al. Comorbidity assessment in hemodialysis and peritoneal dialysis using the index of coexistent disease. Semin. Dial.13, 320–326. https://doi.org/10.1046/j.1525-139x.2000.00095.x (2000).
van Manen, J. G. et al. How to adjust for comorbidity in survival studies in ESRD patients: a comparison of different indices. Am. J. Kidney Dis Off. J. Natl. Kidney Found.40, 82–89. https://doi.org/10.1053/ajkd.2002.33916 (2002).
Khan, I. H. et al. Influence of coexisting disease on survival on renal-replacement therapy. Lancet (London, England)341, 415–418. https://doi.org/10.1016/0140-6736(93)93003-j (1993).
Park, J. Y. et al. Recalibration and validation of the Charlson comorbidity index in Korean incident hemodialysis patients. PLoS ONE10, e0127240. https://doi.org/10.1371/journal.pone.0127240 (2015).
Cho, H. et al. Development and validation of the modified Charlson comorbidity index in incident peritoneal dialysis patients: a national population-based approach. Perit. Dial. Int. J. Int. Soc. Perit. Dial.37, 94–102. https://doi.org/10.3747/pdi.2015.00201 (2017).
D’Hoore, W., Bouckaert, A. & Tilquin, C. Practical considerations on the use of the Charlson comorbidity index with administrative data bases. J. Clin. Epidemiol.49, 1429–1433. https://doi.org/10.1016/s0895-4356(96)00271-5 (1996).
Deyo, R. A., Cherkin, D. C. & Ciol, M. A. Adapting a clinical comorbidity index for use with ICD-9-CM administrative databases. J. Clin. Epidemiol.45, 613–619. https://doi.org/10.1016/0895-4356(92)90133-8 (1992).
Schneeweiss, S. & Maclure, M. Use of comorbidity scores for control of confounding in studies using administrative databases. Int. J. Epidemiol.29, 891–898. https://doi.org/10.1093/ije/29.5.891 (2000).
Chu, Y. T., Ng, Y. Y. & Wu, S. C. Comparison of different comorbidity measures for use with administrative data in predicting short- and long-term mortality. BMC Health Serv. Res.10, 140. https://doi.org/10.1186/1472-6963-10-140 (2010).
Ghali, W. A., Hall, R. E., Rosen, A. K., Ash, A. S. & Moskowitz, M. A. Searching for an improved clinical comorbidity index for use with ICD-9-CM administrative data. J. Clin. Epidemiol.49, 273–278. https://doi.org/10.1016/0895-4356(95)00564-1 (1996).
Quan, H. et al. Updating and validating the Charlson comorbidity index and score for risk adjustment in hospital discharge abstracts using data from 6 countries. Am. J. Epidemiol.173, 676–682. https://doi.org/10.1093/aje/kwq433 (2011).
Nakaya, A. et al. Retrospective analysis of Charlson comorbidity index (CCI). Gan to kagaku ryoho Cancer Chemother.41, 673–675 (2014).
Lee, D. S. et al. Comparison of coding of heart failure and comorbidities in administrative and clinical data for use in outcomes research. Med. Care43, 182–188. https://doi.org/10.1097/00005650-200502000-00012 (2005).
Cheol Seong, S. et al. Data resource profile: The National Health Information Database of the National Health Insurance Service in South Korea. Int. J. Epidemiol.46, 799–800. https://doi.org/10.1093/ije/dyw253 (2017).
Lee, J., Lee, J. S., Park, S. H., Shin, S. A. & Kim, K. Cohort profile: The National Health Insurance Service-National Sample Cohort (NHIS-NSC) South Korea. Int. J. Epidemiol.46, e15. https://doi.org/10.1093/ije/dyv319 (2017).
Quan, H. et al. Coding algorithms for defining comorbidities in ICD-9-CM and ICD-10 administrative data. Med. Care43, 1130–1139. https://doi.org/10.1097/01.mlr.0000182534.19832.83 (2005).
Hemmelgarn, B. R., Manns, B. J., Quan, H. & Ghali, W. A. Adapting the Charlson Comorbidity Index for use in patients with ESRD. Am. J. Kidney Dis.42, 125–132. https://doi.org/10.1016/s0272-6386(03)00415-3 (2003).
Kaplan, E. L. & Meier, P. Nonparametric estimation from incomplete observations. J. Am. Stat. Assoc.53, 457–481 (1958).
Harrell, F. E. Jr., Lee, K. L. & Mark, D. B. Multivariable prognostic models: issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors. Stat. Med.15, 361–387. https://doi.org/10.1002/(sici)1097-0258(19960229)15:4%3c361::aid-sim168%3e3.0.co;2-4 (1996).
Pencina, M. J., D’Agostino, R. B. Sr., D’Agostino, R. B. Jr. & Vasan, R. S. Evaluating the added predictive ability of a new marker: from area under the ROC curve to reclassification and beyond. Stat. Med.27, 157–172. https://doi.org/10.1002/sim.2929 (2008) (discussion 207-112).
Pencina, M. J., D’Agostino, R. B. Sr. & Steyerberg, E. W. Extensions of net reclassification improvement calculations to measure usefulness of new biomarkers. Stat. Med.30, 11–21. https://doi.org/10.1002/sim.4085 (2011).
Acknowledgements
This research was supported by the Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education (No. 2017R1D1A1B03034584) and a clinical research grant-in-aid from the Seoul National University Boramae Medical Center (Grant/Award Number: 03-2016-11), which had no roles in the study design, data collection, analysis, interpretation or in manuscript writing.
Author information
Authors and Affiliations
Contributions
J.P.L., M.H.K designed the study. M.H.K., Y.H.L., H.J.B. collected data sources. J.S.C., M.H.K., Y.C.K., J.H.N., J.Y.P., J.P.L. analyzed and interpreted the data. J.S.C., M.H.K., J.Y.P., J.P.L. wrote the manuscript. J.S.C., M.H.K., J.Y.P., D.K.K., J.P.L. reviewed and revised the manuscript.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Additional information
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Choi, J.S., Kim, MH., Kim, Y.C. et al. Recalibration and validation of the Charlson Comorbidity Index in an Asian population: the National Health Insurance Service-National Sample Cohort study. Sci Rep 10, 13715 (2020). https://doi.org/10.1038/s41598-020-70624-8
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41598-020-70624-8
- Springer Nature Limited