Avoid common mistakes on your manuscript.
Dear Editor,
We read with great interest the article by Fahrbach and colleagues [1], which reported the results of a systematic literature review (SLR) and network meta-analysis (NMA) to estimate the relative clinical effectiveness of crisaborole 2% ointment compared with other topical treatments for mild-to-moderate atopic dermatitis (AD). We would like to point out some concerns regarding the methodology and outcomes presented in this article.
Firstly, it appears that the authors did not include all studies available for pimecrolimus (versus vehicle/placebo/cream) in their analysis. While the search algorithm and the inclusion/exclusion criteria used by the authors appear robust, they were able to find only one relevant publication for pimecrolimus (Eichenfield et al.) [2]. Of the various trials that compared pimecrolimus with vehicle in mild-to-moderate AD, we believe that Leung et al. [3] (which reported Investigator's Global Assessment [IGA] data at week 6), the Novartis study ASM981C2322 [4] (which reported IGA data at weeks 1, 2, and 4), and Emer et al. [5] (which reported Physician Global Assessment data at weeks 2 and 4) meet the inclusion criteria of the review and should have been included in the analysis.
In the article [1], relative treatment effects were analyzed in terms of the hazard ratio (HR), which takes into account the number of patients experiencing the event (here, achieving an Investigator’s Static Global Assessment [ISGA] score of 0/1) along with the timing of the event in the two arms that are being compared. While presenting a single HR over the entire follow-up provides information on the likelihood of obtaining ISGA 0/1, it does not provide information on how soon these outcomes may occur. While time-to-event analysis and the use of HR as an endpoint is uncommon in AD, it would have been helpful if the authors had reported the time-dependent HR profile for the comparisons being made in order to show how the relative effects evolve over time. Alternatively, other more common metrics such as the relative risk and the odds ratio at various time points (weeks 1, 2, 3, and 4) could have been used. Reporting outcomes using such metrics would have enabled the study results to be validated with previously published SLRs and meta-analyses. For example, the HR for pimecrolimus versus vehicle was reported by the authors to be 1.28 (95% credible interval 0.92–1.78; probability that treatment is better than vehicle 93.5%) [1]. This contrasts with the underlying study [2] and other previously published SLRs and meta-analyses [6,7,8], which show that pimecrolimus is significantly better than vehicle at weeks 4 and 6.
The analysis performed by the authors utilized a complementary log–log (clog-log) link to adjust for different follow-up durations across trials by assuming a Poisson process in each trial [1]. The authors point out that this necessitates an assumption that HRs are constant over the entire duration of follow-up [1]. This seems to be a strong assumption that has not been validated by the authors and does not seem to be a likely possibility across all the studies included in the review.
The NMA was performed with baseline risk regression to adjust for differences in vehicle response across the studies included [1]. The authors mention that this was necessitated by the variation in vehicle composition and the heterogeneity in patient characteristics [1]. While the vehicle bases used in the trials were not identical (ointment in crisaborole and tacrolimus trials, cream in pimecrolimus trials), there is insufficient evidence in the literature to suggest that the response rate varies with the emollient used in the treatment; indeed, a 2017 Cochrane review did not find any reliable evidence for such a variation [9]. In fact, even though the two crisaborole trials (AD-301 and AD-302) used the same vehicle base, the vehicle response rates were dissimilar [10], indicating that the difference in vehicle response could be due to patient heterogeneity and unexplained random variation rather than a difference in vehicle composition. Furthermore, if the authors believe that all the vehicle arms are indeed different across the studies, a NMA may not be appropriate at all. If the authors had access to patient-level data, a matching-adjusted indirect comparison could have been carried out to validate and support the evidence reported in the article.
In the NMA [1], the adjustment for baseline risk via regression was based on a limited number of studies (three for tacrolimus, two for crisaborole, and one for pimecrolimus). We believe that the sample size is too small to assess and quantify the relationship between vehicle response and relative treatment effects. Also, the assumption that this relationship holds true for all three treatments seems doubtful.
The authors present the results from the clog-log model adjusted for baseline risk and class effects because that model adjusted for those effects and had the lowest deviance information criterion (DIC) [1]. All the models tested by the authors had a DIC of between 124.7 and 130 [1]—a maximum difference of 5.3. A general rule when interpreting the DIC is that it could be misleading to report only the model with the lowest DIC if the difference in DIC is less than 5 and the models make very different inferences. It would therefore have been useful if the authors had also presented outcomes for the other five models to ascertain whether different models lead to different inferences.
We looked at the ISGA scores for crisaborole and pimecrolimus in the underlying studies used in the NMA [2, 10] (Table 1). Based on an unadjusted comparison, pimecrolimus would appear to be superior to crisaborole (Table 1). However, based on the NMA, the authors concluded that crisaborole was superior to pimecrolimus in terms of ISGA 0/1 at 28–42 days [1]. Given that the inference reverses depending on the model type used, it would be inappropriate to make a conclusion based solely on a single model.
While we believe that a simple random-effects NMA model that does not adjust for vehicle response may be inaccurate, drawing a conclusion solely based on the use of the authors’ model [1] is also misleading, and the comparative effectiveness of crisaborole and pimecrolimus (and probably crisaborole and tacrolimus) is therefore uncertain. Given the uncertainties in the NMA [1], head-to-head clinical trials would be required to assess the relative effectiveness of crisaborole versus pimecrolimus, and that of crisaborole versus tacrolimus.
In conclusion, there are uncertainties regarding the methodology used in the NMA, and the results of the analysis should be interpreted with caution.
References
Fahrbach K, Tarpey J, Washington EB, et al. Crisaborole ointment, 2%, for treatment of patients with mild-to-moderate atopic dermatitis: systematic literature review and network meta-analysis. Dermatol Ther (Heidelb). 2020;10:681–94.
Eichenfield LF, Lucky AW, Boguniewicz M, et al. Safety and efficacy of pimecrolimus (ASM 981) cream 1% in the treatment of mild and moderate atopic dermatitis in children and adolescents. J Am Acad Dermatol. 2002;46:495–504.
Leung DY, Hanifin JM, Pariser DM, et al. Effects of pimecrolimus cream 1% in the treatment of patients with atopic dermatitis who demonstrate a clinical insensitivity to topical corticosteroids: a randomized, multicentre vehicle-controlled trial. Br J Dermatol. 2009;161:435–43.
Novartis. Study ASM981 C2322. A 4-week, randomized, multicenter, double-blind, vehicle-controlled, parallel-group clinical trial to evaluate the efficacy and safety of pimecrolimus cream 1% in the short-term treatment of patients with mild-to-moderate atopic dermatitis (eczema). Available from: https://www.novctrd.com/ctrdweb/trialresult/trialresults/pdf?trialResultId=1936. Accessed 23 Nov 2020
Emer JJ, Frankel A, Sohn A, Lebwohl M. A bilateral comparison study of pimecrolimus cream 1% and a topical medical device cream in the treatment of patients with atopic dermatitis. J Drugs Dermatol. 2011;10:735–43.
Chen SL, Yan J, Wang FS. Two topical calcineurin inhibitors for the treatment of atopic dermatitis in pediatric patients: a meta-analysis of randomized clinical trials. J Dermatolog Treat. 2010;21:144–56.
Ashcroft DM, Dimmock P, Garside R, Stein K, Williams HC. Efficacy and tolerability of topical pimecrolimus and tacrolimus in the treatment of atopic dermatitis: meta-analysis of randomised controlled trials. BMJ. 2005;330:516.
Chia BK, Tey HL. Systematic review on the efficacy, safety, and cost-effectiveness of topical calcineurin inhibitors in atopic dermatitis. Dermatitis. 2015;26:122–32.
van Zuuren EJ, Fedorowicz Z, Christensen R, Lavrijsen A, Arents BWM. Emollients and moisturisers for eczema. Cochrane Database Syst Rev. 2017;2:CD012119.
Paller AS, Tom WL, Lebwohl MG, et al. Efficacy and safety of crisaborole ointment, a novel, nonsteroidal phosphodiesterase 4 (PDE4) inhibitor for the topical treatment of atopic dermatitis (AD) in children and adults. J Am Acad Dermatol. 2016;75(494–503):e6.
Acknowledgements
Funding
SmartAnalyst, an Ashfield Advisory Company, part of UDG Healthcare plc, conducted an analysis of the methodology used in the article by Fahrbach et al. [1], which was funded by Meda Pharma S.p.A., a Viatris company. No Rapid Service Fee was received by the journal for the publication of this article.
Medical Writing Assistance
Medical writing assistance in the preparation of this letter was provided by Jane Murphy (Ashfield MedComms, an Ashfield Health Company), and funded by Meda Pharma S.p.A., a Viatris company.
Authorship
All named authors meet the International Committee of Medical Journal Editors (ICMJE) criteria for authorship for this article, take responsibility for the integrity of the work as a whole, and have given their approval for this version to be published.
Disclosures
Thomas Luger has participated as principal investigator in clinical trials and on advisory boards and has given lectures sponsored by Novartis, Lilly, La Roche Posay, Pfizer, Janssen, and Sanofi. He has received consultancy/speaker honoraria from Novartis, Abbvie, Galderma, La Roche Posay, Viatris, Janssen, and Sanofi, and has acted as a scientific advisory board member for Abbvie, Celgene, La Roche Posay, Janssen, Pfizer, Menlo, Viatris, Galderma, Symrise, and Lilly. He has received research grants from Celgene, Janssen-Cilag, Leo, Viatris and Pfizer. Sandip Ranjan is an employee of SmartAnalyst, an Ashfield Advisory Company, part of UDG Healthcare plc; this company received payment from Meda Pharma S.p.A., a Viatris company, to conduct an analysis of the methodology used in the article by Fahrbach et al. [1].
Compliance with Ethics Guidelines
This letter is based on previously conducted studies and does not contain any studies with human participants or animals performed by any of the authors.
Peer Review
Please note that, contrary to the journal’s standard single-blind peer review process, this letter underwent review by a member of the journal’s Editorial Board.
Author information
Authors and Affiliations
Corresponding author
Additional information
Digital Features
To view digital features for this article go to https://doi.org/10.6084/m9.figshare.13859156.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License, which permits any non-commercial use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by-nc/4.0/.
About this article
Cite this article
Luger, T., Ranjan, S. Letter to the Editor Regarding ‘Crisaborole Ointment, 2%, for Treatment of Patients with Mild-to-Moderate Atopic Dermatitis: Systematic Literature Review and Network Meta-Analysis’. Dermatol Ther (Heidelb) 11, 639–642 (2021). https://doi.org/10.1007/s13555-021-00503-1
Received:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s13555-021-00503-1