Abstract
Introduction
The pharmacokinetics of vancomycin are highly variable among neonates, which makes dosing challenging in this population. However, adequate drug exposure is critical, especially when treating methicillin-resistant Staphylococcus aureus (MRSA) infections. Utilization of population pharmacokinetic models and Bayesian methods offers the potential for developing individualized therapeutic approaches. To meet this need, a neonatal vancomycin population pharmacokinetic model was recently published. The current study sought to externally evaluate the predictive performance and generalizability of this model.
Methods
A retrospective chart review of neonates who received vancomycin and had ≥1 peak and ≥1 trough concentrations at five Intermountain Healthcare neonatal intensive care units from 2006 to 2013 was performed and served as the external validation cohort. The published population pharmacokinetic model was implemented in NONMEM 7.2 with the structural and variance parameter values set equal to the estimates reported previously. The model was then used to predict the first peak and trough concentration for each neonate in the validation cohort and the model prediction error and absolute prediction error were calculated. Normalized prediction distribution errors (NPDE) were also evaluated.
Results
A total of 243 neonates were studied with a median postmenstrual age of 33 (range: 23–54) weeks and a median weight of 1.6 (range: 0.4–6.8) kg. The model predicted the observed vancomycin concentrations with reasonable precision. For all vancomycin concentrations, the median prediction error was −0.8 (95% CI: −1.4 to −0.4) mg/L and the median absolute prediction error was 3.0 (95% CI: 2.7–3.5) mg/L. No trends in NPDE across weight, postmenstrual age, serum creatinine, or time after dose were observed.
Conclusion
An evaluation of a recently published neonatal vancomycin population pharmacokinetic model in a large external dataset supported the predictive performance and generalizability of the model. This model may be useful in evaluating neonatal vancomycin dosing regimens and estimating the extent of drug exposure.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Introduction
Optimizing vancomycin dosing to rapidly achieve adequate drug exposure is imperative in treating neonatal sepsis, particularly when treating invasive methicillin-resistant Staphylococcus aureus (MRSA) infections [1]. However, this has been challenging in neonates as the pharmacokinetics of vancomycin are highly variable among neonates due to developmental and pathophysiological changes [2, 3]. Recent studies have shown that standard neonatal vancomycin dosing strategies, such as those outlined in NeoFax® (Truven Health Analytics), do not reliably achieve trough concentrations >10 mg/L [4, 5]. In addition, the ratio of the 24-h area under the concentration–time curve (AUC24) to the minimum inhibitory concentration (MIC)—the best predictor of successful outcomes when treating invasive MRSA infections—is not routinely utilized to assess the appropriateness of vancomycin dosing in neonates, presumably due to practical limitations associated with calculating the AUC24.
Innovative vancomycin dosing strategies are therefore needed in neonates that: (1) incorporate known patient-specific determinants of vancomycin pharmacokinetics such as size, maturation, and renal function in the dose selection, and (2) allow for assessment of AUC24 based on the dosing history and vancomycin concentration(s) measured as part of routine therapeutic drug monitoring [3, 6, 7]. To develop such an individualized therapeutic approach in neonates, utilization of population pharmacokinetic models and Bayesian methods will be essential [8–11]. We recently developed a neonatal vancomycin population pharmacokinetic model that capitalized on patient data readily available in the electronic medical record: weight (an indicator of size), postmenstrual age (an indicator of maturation), and serum creatinine (an indicator of renal function) [7]. The model has the potential to improve our ability to define vancomycin dosing regimens that reliably achieve recommended exposure targets; however, it is critical to first evaluate whether this model and its findings are generalizable to neonates outside of the original population used to develop the model. The objective of the current study was to conduct an external evaluation of this published pharmacokinetic model and to enhance our understanding of the relationship between vancomycin trough concentration and AUC24 in neonates.
Methods
Validation Cohort
Approval to conduct this study was granted by the University of Utah and Primary Children’s Hospital (PCH) Institutional Review Boards. PCH is a freestanding children’s hospital with a level IV neonatal intensive care unit that is staffed by University of Utah neonatologists. PCH is owned and operated by Intermountain Healthcare, which is a large, not-for-profit, vertically integrated healthcare delivery system that serves Utah, Idaho, Wyoming, Nevada, and Montana. In addition to PCH, four other level II-III neonatal intensive care units operated by Intermountain Healthcare were included in this study.
A retrospective chart review was conducted for all neonates who had vancomycin therapeutic drug monitoring performed from 2006 to 2013 at five Intermountain Healthcare neonatal intensive care units. Neonates were included if they were <54 weeks postmenstrual age and had ≥2 doses of vancomycin, ≥1 peak concentration, ≥1 trough concentration, and ≥1 serum creatinine level. Vancomycin concentrations were quantified using a particle-enhanced turbidimetric inhibition immunoassay on an Abbott Architect System platform (Abbott Laboratories, Abbott Park, IL, USA). Vancomycin concentrations were defined based on their temporal relationship to dosing records. Trough concentrations were defined as concentrations obtained within 3 h of the next vancomycin dose and peak concentrations were defined as concentrations obtained within 3 h of the preceding dose. Serum creatinine levels collected within ±48 h of vancomycin dosing and concentration records were carried forward and backward and were used in the analyses. To account for the known difference in measured serum creatinine concentrations between the Jaffe method (used in the original model derivation cohort) and the enzymatic method (used in the current external validation cohort), a previously described linear conversion factor was applied to all of the enzymatic serum creatinine concentrations included in this external validation (\( {\text{enzymatic concentration}} = 1.050 \times {\text{Jaffe method concentration}} - 0.122 \)) [12]. Exclusion criteria included a diagnosis of congenital kidney disease, major congenital heart disease (other than ventricular septal defect, atrial septal defect, or patent ductus arteriosus), or extracorporeal membrane oxygenation during the vancomycin course.
Model Evaluation
The published neonatal vancomycin population pharmacokinetic model was implemented in the non-linear mixed effects modeling software NONMEM 7.2 (ICON Development Solutions, Ellicott City, MD, USA) as previously described [7]. Briefly, a one compartment model with first-order elimination was used to describe vancomycin pharmacokinetics. Clearance (CL) was predicted by weight (an indicator of size), postmenstrual age (PMA; an indicator of maturation) and serum creatinine (Cr; an indicator of renal function) according to the following equation:
Volume of distribution (V) was predicted by weight:
After accounting for known predictors, the remaining variation between neonates was described by an exponential error model for both CL (% coefficient of variation [% CV] 21.6%) and V (% CV 10.9%). Residual variability (a measure of the difference between the model predicted concentration for a neonate and the observed concentration in that neonate) was captured using a combined proportional (% CV 20.5%) and additive error model (standard deviation [SD] ± 1.3 mg/L).
For each neonate in the external validation cohort, vancomycin concentrations were then predicted using the parameters of the population pharmacokinetic model and simulating the actual dosing regimen given to the neonate (using the NONMEM MAXEVAL = 0 POSTHOC command). Only concentrations at times for which a neonate had therapeutic drug monitoring performed were simulated. Model predicted vancomycin concentrations (PRED from the NONMEM output) were then compared with the corresponding observed vancomycin concentrations. As described by Sheiner and Beal [13], the bias and precision of the model were assessed by calculating the median prediction error and median absolute prediction error for the first trough and peak concentration according to the following formulas:
where Concpred refers to the model predicted vancomycin concentration and Concobs refers to the observed vancomycin concentration. Model predicted vancomycin concentrations calculated using each patient’s individual Bayesian estimate of CL and V (i.e., the IPRED from the NONMEM output, which incorporates the patient’s drug concentrations in addition to the fixed covariate effects in the model predictions) were also evaluated using the same approach.
The predictive performance of the model was further evaluated using simulation-based diagnostic methods. Normalized prediction distribution errors (NPDE) were calculated by simulating 1,000 data sets and comparing the predicted concentrations to the observed concentrations using the NPDE command in NONMEM [14, 15]. The NPDE should follow a normal distribution with a theoretical mean of 0 and variance equal to 1 [14].
Trough Concentration and AUC24 Relationship
Following model evaluation, the relationship between trough concentration and AUC24 was examined. Bayesian estimates of CL for each neonate from the population pharmacokinetic model were used to calculate AUC24 at the time that vancomycin trough concentrations were collected [8]. AUC24 was calculated as the daily dose ÷ CL. For a given trough concentration, the proportion of neonates with that trough concentration who achieved an AUC24 ≥400 was calculated. An AUC24 ≥400 mg × hr/L would predict an AUC24/MIC ≥400 for an MIC of ≤1 mg/L. AUC24 calculations, descriptive statistics, and graphical analyses were performed in R 3.1.1 (R Foundation for Statistical Computing, Vienna, Austria).
Results
External Validation Cohort
Overall, 243 neonates had vancomycin dose and concentration data available and served as the external validation cohort (see Fig. S1 in the electronic supplementary material [ESM]). The median dose was 15.5 (interquartile range [IQR]: 13.9–19.3) mg/kg and the median dosing interval was 11.5 (IQR: 8.0–12.5) h. Demographic and clinical characteristics of the neonates in the external validation cohort are shown in Table 1. For comparison, demographic and clinical characteristics of the neonates in the cohort used to develop the original published pharmacokinetic model are also shown. Overall, the validation cohort was of lower weight and age and had higher serum creatinine concentrations.
In the external validation cohort, a total of 734 vancomycin concentrations were available for analysis. Each neonate contributed a mean of 3.0 (±1.8) vancomycin concentrations. The time of vancomycin concentration collection relative to the previous dose is shown in Table 2. All neonates had at least one concentration measured within three hours of the end of the vancomycin infusion. No concentrations were below the lower limit of quantitation.
Model Evaluation
The vancomycin pharmacokinetic model adequately described the observed vancomycin concentrations in the external cohort of neonates (Fig. 1a). Model predicted vancomycin concentrations (PRED) were slightly lower than the observed concentrations (median prediction error −0.8 [95% CI: −1.4 to −0.4] mg/L). The precision of the model was reasonable with a median absolute prediction error of 3.1 (95% CI: 2.7–3.2) mg/L. The predictive performance of the model for peak and trough concentrations is featured in Table 3. When incorporating patient concentrations to obtain Bayesian estimates of pharmacokinetic parameters for each neonate, the precision of the model predicted vancomycin concentrations (IPRED) improved (Table 4). For example, the median IPRED absolute prediction error was 1.7 (95% CI: 1.5–1.8) mg/L.
Simulation-based diagnostics of the vancomycin pharmacokinetic model demonstrated a mean NPDE of 0.05 and a variance of 0.96, indicating no bias and an ability of the model to reasonably capture the underlying variability in the external validation cohort. Additionally, there were no trends in NPDE across weight, postmenstrual age, serum creatinine, or time after dose (Fig. 2).
Trough Concentration and AUC24 Relationship
A linear relationship between increased AUC24 and higher trough concentrations was observed in the external validation cohort (r 2 = 0.60; Fig. 3a). AUC24 was highly variable at a given trough concentration (i.e., a two- to threefold range of AUC24 was achieved at a given trough concentration), and therefore, AUC24 could not be precisely predicted for an individual neonate based on a trough concentration alone. However, a trough concentration of 11 mg/L predicted the achievement of an AUC24 ≥400 in 93% of neonates (Fig. 3b). The median (range) AUC24 at this trough concentration was 542 (308 to 649) mg × hr/L.
Discussion
External validation of a population pharmacokinetic model is described by the United States Food and Drug Administration as “the most stringent method for testing a developed model” [16]. Yet, external validation is performed in <10% of published pharmacokinetic models and concerns about the clinical utility of the model often remain [17]. The external validation performed in the current study strengthens a previously published neonatal vancomycin population pharmacokinetic model. Namely, we found the pharmacokinetic model to be unbiased across the largest cohort of neonates used in a validation study to date. The precision of the model when utilizing only a neonate’s postmenstrual age, weight, and serum creatinine was 12.6% for peak concentrations and 20.1% for trough concentrations. When a neonate’s drug concentrations are incorporated into the model (such as would occur after therapeutic drug monitoring in the NICU), the precision further improved to 8.4 and 9.1% for peak and trough concentrations, respectively. This level of precision suggests that the model may be useful in evaluating vancomycin dosing regimens and estimating the extent of drug exposure in the clinical setting.
A recent clinical study by Ringenberg et al. [4] highlights the current challenges with vancomycin dosing in neonates. In a multicenter retrospective evaluation, vancomycin dosing guidelines from Neofax resulted in only 25% of the neonates studied achieving a target trough concentration of 10–20 mg/L with empiric dosing [4]. Moreover, the authors reported that 20% of the neonates included in their study had a trough concentration <5 mg/L (Theresa Ringenberg, personal communication, April 15, 2015). Even after therapeutic drug monitoring and dose adjustment, only 45% of neonates achieved the goal trough concentration of 10–20 mg/L at any point during their course of therapy. This study clearly reveals the significant clinical challenge associated with reliably achieving therapeutic and safe vancomycin concentrations in this highly variable patient population [4]. More innovative vancomycin dosing strategies and approaches are needed in neonates that can help providers personalize empiric dose selection, interpret therapeutic drug monitoring data, and adjust dosing so that exposure targets are achieved.
Population pharmacokinetic models are a powerful tool that can aid clinicians and help inform dosing decisions [18, 19]. By incorporating patient-specific characteristics, dosing information, drug concentrations, and consideration of the variability between patients, population pharmacokinetic models offer the opportunity to provide a more personalized approach to therapeutic decision making. This is especially valuable in a highly variable population, such as neonates, receiving a narrow therapeutic window drug such as vancomycin.
In adults, Bayesian approaches utilizing population pharmacokinetic models have already been shown to have the potential to help support vancomycin dosing decisions [19, 20]. Advancement of similar approaches in neonates is needed. The development and external validation of a neonatal vancomycin population pharmacokinetic model lays the foundation for this future work. For example, our group is currently developing a model-based approach to individualize the empiric dose in neonates that incorporates the predictors of weight, postmenstrual age, and serum creatinine. Using a simulation framework, the vancomycin dose for a given neonate that is most likely to achieve an AUC24 ≥400 while still maintaining a trough concentration <20 mg/L is calculated. A user-friendly, web-based application is currently being developed to facilitate the adoption of this model in our neonatal intensive care units, including integration into the electronic health record. In addition, the ability to estimate AUC24 and assist providers with dose adjustment within the clinical workflow would be of high value.
Until more robust clinical dosing support tools are developed, clinicians will continue to rely on trough concentration monitoring to help guide vancomycin dosing in neonates. Our findings reinforce the large variability observed in vancomycin trough concentrations among neonates and the inability of a trough concentration alone to reliably predict an individual neonate’s AUC24. Targeting an AUC24/MIC ≥400 is recommended by the Infectious Disease Society of America when treating invasive MRSA infections and a trough concentration of 15–20 mg/L is suggested in adults to achieve this target [1, 21]. The current study provides further support that in neonates a vancomycin trough concentration of 15–20 mg/L is unnecessary to achieve an AUC24/MIC ≥400 with an MIC ≤1 mg/L and that lower trough concentrations are likely adequate based on AUC24 considerations [7]. Accordingly, a trough concentration of approximately 10 mg/L is likely a reasonable first-line target that will provide adequate exposure for invasive MRSA while also appropriately covering for coagulase negative staphylococcal infections. Further dose adjustment and individualization of the therapeutic approach should be guided by the specific pathogen identified, susceptibility testing, clinical status, etc. For example, for MRSA infections with MICs ≥2 mg/L, an alternative to vancomycin may be necessary since an AUC24/MIC ≥400 will not be achieved in neonates even at trough concentrations of 15–20 mg/L [7]. Lastly, the extent to which the target AUC24/MIC ≥400 is generalizable to neonates is unclear and requires further study.
Conclusions
In summary, an evaluation of a recently published neonatal vancomycin population pharmacokinetic model in a large external dataset supported the predictive performance and generalizability of the model. The model may be useful in evaluating vancomycin dosing regimens and for estimating the extent of drug exposure in neonates.
References
Liu C, Bayer A, Cosgrove SE, et al. Clinical practice guidelines by the infectious diseases society of america for the treatment of methicillin-resistant Staphylococcus aureus infections in adults and children. Clin Infect Dis An Off Pub Infect Dis Soc Am. 2011;52(3):e18–55.
Kearns GL, Abdel-Rahman SM, Alander SW, Blowey DL, Leeder JS, Kauffman RE. Developmental pharmacology–drug disposition, action, and therapy in infants and children. New Eng J Med. 2003;349(12):1157–67.
Stockmann C, Roberts JK, Yu T, et al. Vancomycin pharmacokinetic models: informing the clinical management of drug-resistant bacterial infections. Expert Rev Anti Infect Ther. 2014;12(11):1371–88.
Ringenberg T, Robinson C, Meyers R, et al. Achievement of therapeutic vancomycin trough serum concentrations with empiric dosing in neonatal intensive care unit patients. Pediat Infect Dis J; 2015; (Epub ahead of print).
Vandendriessche A, Allegaert K, Cossey V, Naulaers G, Saegeman V, Smits A. Prospective validation of neonatal vancomycin dosing regimens is urgently needed. Curr Ther Res Clin Exp. 2014;76:51–7.
Jacqz-Aigrain E, Zhao W, Sharland M, van den Anker JN. Use of antibacterial agents in the neonate: 50 years of experience with vancomycin administration. Sem Fetal Neo Med. 2013;18(1):28–34.
Frymoyer A, Hersh AL, El-Komy MH, et al. Association Between Vancomycin Trough Concentration and AUC in Neonates. Antimicr Agents Chemother; 2014.
Sheiner LB, Beal S, Rosenberg B, Marathe VV. Forecasting individual pharmacokinetics. Clin Pharmacol Ther. 1979;26(3):294–305.
Sheiner LB, Rosenberg B, Melmon KL. Modelling of individual pharmacokinetics for computer-aided drug dosage. Comput Biomed Res Int J. 1972;5(5):411–59.
Sheiner LB, Beal SL. Bayesian individualization of pharmacokinetics: simple implementation and comparison with non-Bayesian methods. J Pharm Sci. 1982;71(12):1344–8.
Schumacher GE, Barr JT. Bayesian approaches in pharmacokinetic decision making. Clin Pharm. 1984;3(5):525–30.
Srivastava T, Alon US, Althahabi R, Garg U. Impact of standardization of creatinine methodology on the assessment of glomerular filtration rate in children. Pediatr Res. 2009;65(1):113–6.
Sheiner LB, Beal SL. Some suggestions for measuring predictive performance. J Pharmacokinet Biopharm. 1981;9(4):503–12.
Brendel K, Comets E, Laffont C, Laveille C, Mentre F. Metrics for external model evaluation with an application to the population pharmacokinetics of gliclazide. Pharm Res. 2006;23(9):2036–49.
Brendel K, Comets E, Laffont C, Mentre F. Evaluation of different tests based on observations for external model evaluation of population analyses. J Pharmacokinet Pharmacodyn. 2010;37(1):49–65.
US FDA. Guidance for industry: population pharmacokinetics [online]. Available from: http://www.fda.gov/downloads/Drugs/Guidances/UCM072137.pdf. Accessed 18 Sep 2014.
Brendel K, Dartois C, Comets E, et al. Are population pharmacokinetic and/or pharmacodynamic models adequately evaluated? A survey of the literature from 2002 to 2004. Clin Pharmacokinet. 2007;46(3):221–34.
Lee JY, Garnett CE, Gobburu JV, et al. Impact of pharmacometric analyses on new drug approval and labelling decisions: a review of 198 submissions between 2000 and 2008. Clin Pharmacokinet. 2011;50(10):627–35.
Neely MN, Youn G, Jones B, et al. Are vancomycin trough concentrations adequate for optimal dosing? Antimicrob Agents Chemother. 2014;58(1):309–16.
Nunn MO, Corallo CE, Aubron C, Poole S, Dooley MJ, Cheng AC. Vancomycin dosing: assessment of time to therapeutic concentration and predictive accuracy of pharmacokinetic modeling software. Annal Pharmacother. 2011;45(6):757–63.
Rybak MJ, Lomaestro BM, Rotschafer JC, et al. Vancomycin therapeutic guidelines: a summary of consensus recommendations from the infectious diseases Society of America, the American Society of Health-System Pharmacists, and the Society of Infectious Diseases Pharmacists. Clin Infect Dis An Off Pub Infect Dis Soc Am. 2009;49(3):325–7.
Acknowledgments
The authors received financial support from the American Foundation for Pharmaceutical Education, Primary Children’s Hospital Foundation, and the National Institutes of Health, which supported their effort spent conducting this study as noted in the conflict of interest section. No funding or sponsorship was received for the publication of this article. All named authors meet the International Committee of Medical Journal Editors (ICJME) criteria for authorship for this manuscript, take responsibility for the integrity of the work as a whole, and have given final approval for the version to be published.
Conflict of interest
CS is supported by the American Foundation for Pharmaceutical Education’s Clinical Pharmaceutical Sciences Fellowship. JKR is supported by the Pharmacotherapy Subspecialty Award from the Primary Children’s Hospital Foundation. AF is supported by the National Institutes of Health (NICHD 1K23HD079557). ALH is supported by the National Institutes of Health (NICHD K08HS023320). JB, EKK, MGS, and CMTS declare that they have no conflicts of interest.
Compliance with ethics guidelines
All procedures followed were in accordance with the ethical standards of the responsible committee on human experimentation (institutional and national) and with the Helsinki Declaration of 1975, as revised in 2013. A waiver of informed consent was granted by the Institutional Review Boards of the University of Utah and Primary Children’s Hospital for the retrospective data presented in this study.
Open Access
This article is distributed under the terms of the Creative Commons Attribution Noncommercial License which permits any noncommercial use, distribution, and reproduction in any medium, provided the original author(s) and the source are credited.
Author information
Authors and Affiliations
Corresponding author
Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (https://creativecommons.org/licenses/by/4.0), which permits use, duplication, adaptation, distribution, and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
About this article
Cite this article
Stockmann, C., Hersh, A.L., Roberts, J.K. et al. Predictive Performance of a Vancomycin Population Pharmacokinetic Model in Neonates. Infect Dis Ther 4, 187–198 (2015). https://doi.org/10.1007/s40121-015-0067-9
Received:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s40121-015-0067-9