Abstract
Introduction/objectives
To assess and compare the performance of the giant cell arteritis probability score (GCAPS), Ing score, Bhavsar-Khalidi score (BK score), color Doppler ultrasound (CDUS) halo count, and halo score, to predict a final diagnosis of giant cell arteritis (GCA).
Method
A prospective cohort study was conducted from April to December 2021. Patients with suspected new-onset GCA referred to our quaternary CDUS clinic were included. Data required to calculate each clinical and CDUS probability score was systematically collected at the initial visit. Final diagnosis of GCA was confirmed clinically 6 months after the initial visit, by two blinded vasculitis specialists. Diagnostic accuracy and receiver operator characteristic (ROC) curves for each clinical and CDUS prediction scores were assessed.
Results
Two hundred patients with suspected new-onset GCA were included: 58 with confirmed GCA and 142 without GCA. All patients with GCA satisfied the 2022 ACR/EULAR classification criteria. A total of 5/15 patients with GCA had a positive temporal artery biopsy. For clinical probability scores, the GCAPS showed the best sensitivity (Se, 0.983), whereas the BK score showed the best specificity (Sp, 0.711). As for CDUS, a halo count of 1 or more was found to have a Se of 0.966 and a Sp of 0.979. Combining concordant results of clinical and CDUS prediction scores showed excellent performance in predicting a final diagnosis of GCA.
Conclusion
Using a combination of clinical score and CDUS halo count provided an accurate GCA prediction method which should be used in the setting of GCA Fast-Track clinics.
Key Points • In this prospective cohort of participants with suspected GCA, 3 clinical prediction tools and 2 ultrasound scores were compared head-to-head to predict a final diagnosis of GCA. • For clinical prediction tools, the giant cell arteritis probability score (GCAPS) had the highest sensitivity, whereas the Bhavsar-Khalidi score (BK score) had the highest specificity. • Ultrasound halo count was both sensitive and specific in predicting GCA. • Combination of a clinical prediction tool such as the GCAPS, with ultrasound halo count, provides an accurate method to predict GCA. |
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
Introduction
Giant cell arteritis (GCA) is the most common primary systemic vasculitis in adult patients [1]. GCA usually occurs over the age of 50 years, with a peak incidence at 80 years of age [2, 3]. The lifetime risk of developing GCA is 1% in women, 0.5% in men, and is more common in northern European countries [4]. GCA manifestations are often nonspecific and the various clinical phenotypes pose a diagnostic challenge. A new persistent headache is the most common symptom, occurring in 50–80% of cases [5]. Visual symptoms are reported in 15–26% of patients, with the dreaded complication of permanent visual loss mainly due to anterior ischemic optic neuropathy [7]. Rapid identification and treatment of GCA is therefore important to prevent permanent vision loss and contralateral eye involvement [8].
Temporal artery biopsy (TAB) is not available in all centers and its performance is highly variable. Prolonged use of glucocorticoids may influence TAB results. Furthermore, the presence of vasculitis may be missed due to the presence of segmental arteritis (skip lesions), irrespective of TAB length [9, 10]. Overall, false negative TAB is reported in 15–60% of patients with GCA [10,11,12].
Because TAB is not always accurate or available, clinical assessment of patients remains important [6]. Pre-test probability should be estimated to appropriately plan subsequent investigations, when required. If suspicion of GCA is high, empiric therapy with glucocorticoids should be initiated [13].
Many clinical probability tools have been developed in the last years to predict GCA (Table S1, supplementary data). The giant cell arteritis probability score (GCAPS) was published in 2019 and is simple to calculate without a computer [14]. Similarly, the Bhavsar-Khalidi score (BK score) is a point system that was developed based on clinical experience and literature review. The BK score stratifies the risk of GCA as low, intermediate, or high [15]. The Ing score consists of an online multivariate tool which takes into account clinical features and outputs a percentage risk as part of a stratum [16].
Color Doppler ultrasound (CDUS) of cranial and extra-cranial arteries is increasingly used in patients with suspected GCA. The presence of a hypoechoic circumferential intima-media thickening (halo sign) due to inflammation is consistent with the presence of vasculitis [17,18,19]. CDUS has excellent sensitivity (Se) and specificity (Sp) when performed by experienced clinicians with appropriate training [20]. CDUS is now the first-line diagnostic modality recommended in recent recommendations for the use of imaging in large-vessel vasculitis (LVV) [21]. Moreover, positive temporal or axillary artery CDUS is now part of the 2022 American College of Rheumatology/European League Against Rheumatism (ACR/EULAR) GCA classification criteria [22].
CDUS halo count (range from 0 to 8) refers to the total number of arterial branches (superficial, parietal, frontal temporal arteries, and axillary arteries) where a halo sign is found [23]. CDUS halo score (range from 0 to 48) is calculated by grading the maximum intima-media thickening (in millimeters) for each arterial branch (Table S2 and S3, supplementary data) [23, 24].
External validation of these clinical and CDUS prediction tools is required. Furthermore, no study has directly compared these tools head-to-head. The objective of this study is to assess and compare the performance of the GCAPS, Ing score, BK score, halo count, and halo score, to predict a final diagnosis GCA.
Materials and methods
Study design and patient population
We conducted a prospective cohort study at our quaternary vasculitis clinic from April to December 2021. To be included, participants had to be (i) adult patients over 18 years of age, (ii) referred to our GCA Fast-Track clinic with a suspicion of new-onset GCA, and (iii) provide informed written consent to the study. Patients were excluded if they were (i) referred for a GCA relapse, (ii) currently taking chronic glucocorticoids (at any dose, currently and for more than 30 consecutive days) or immunosuppressive therapy (current use and for more than 30 consecutive days), and (iii) if they had a TAB performed prior to CDUS.
Clinical data elements
At the initial visit, participants underwent a complete clinical assessment, physical examination, and had a CDUS of temporal and axillary arteries. A standardized case report form (CRF) was used to document every clinical and CDUS element required to calculate probability scores. Data collected also included patient characteristics, past medical history, clinical presentation, detailed physical examination, previous bloodwork (prior or within 72 h of glucocorticoid initiation), cumulative glucocorticoid dose, and whether an alternative diagnosis to GCA was considered.
Color Doppler ultrasound of cranial and axillary arteries
During that same visit, CDUS was performed by one of three experimented GCA specialists (VB, SDB, JPM) using a Canon XarioTM 200 Platinum series with an 18L7 probe for cranial arteries, and a 14L5 probe for axillary arteries. All branches of temporal arteries (common superficial, frontal, parietal) were scanned in longitudinal and transverse planes, using two-dimensional grayscale ultrasound with and without color Doppler. Axillary arteries were scanned using the same technique. Performance and external validation of the CDUS equipment, technique, and ultrasound cut-off values for positivity had already been performed with results published [11]. Halo sign was defined as a hypoechoic circumferential intima-media complex, with a thickening of at least 0.4mm, 0.3mm, 0.3mm, and 1.0mm for the common superficial temporal artery, frontal temporal artery, parietal temporal artery, and axillary artery, respectively. The presence of a halo sign was confirmed by the inability to compress the artery (compression sign). Intima-media complex was quantitatively measured in each arterial branch at the site of maximal thickness.
Confirmation of GCA diagnosis and blinding
Final diagnosis of GCA was confirmed clinically by two independent vasculitis specialists, 6 months after the initial visit. The physicians confirming GCA were blinded to the CRF containing CDUS and clinical prediction tools. GCA was confirmed in the presence of unequivocal symptoms, bloodwork, investigations, clinical evolution, and response to therapy. In patients without GCA, alternative diagnoses were investigated and documented.
Clinical and CDUS probability scores
Every item required to calculate clinical and CDUS probability scores was collected at the initial visit. GCAPS, Ing score, BK score, halo count, and halo scores were officially calculated six months following the initial visit, using the CRF containing data systematically collected for that purpose. Scores were calculated by two independent investigators, blinded to the final diagnosis.
Statistical analyses
Descriptive statistics were calculated for patient characteristics. When appropriate, statistical tests were performed using chi-squared test for categorical variables and independent samples t-test for continuous variables. A significance level of 0.05 was used. Receiver operator characteristic (ROC) curve was plotted for each clinical and ultrasound probability score and the best cut-off value was determined. Area under the curve (AUC) was calculated for each ROC analysis. Se, Sp, positive predictive value (PPV), and negative predictive value (NPV) were assessed for GCAPS, Ing score, BK score, halo count, and halo score individually. Furthermore, the combination of clinical scores with CDUS scores was evaluated using logistic regression models and combined ROC analyses. Paired-sample area difference under the ROC curves was calculated for each combination of clinical-CDUS score. Analyses were performed using Stata (StataCorp LLC) SE V17.0.
Ethics approval
The study (protocol number 2020-1890) was approved by the scientific committee and research ethics board of Montreal Sacre-Coeur Hospital. Patients provided written informed consent. The study was performed in accordance with the principles of the Declaration of Helsinki and Good Clinical Practice guidelines.
Results
Out of the 266 patients referred to our Fast-Track clinic, 200 were included for analysis: 58 with confirmed GCA and 142 without GCA (Fig. 1). All 58 patients with GCA satisfied the official 2022 ACR/EULAR classification criteria for GCA. Out of 15 patients who had a TAB, 5 of them were consistent with GCA. Baseline characteristics, clinical features, laboratory findings, and investigation modalities are detailed in Table 1. An alternative diagnosis was established in most patients without GCA (Table S4, supplementary data).
Performance of clinical probability scores
Established cut-off values considered positive were > 9.5 points for GCAPS, 14% cut point for Ing score (level 3 or more), and ≥ 5 points for BK score (moderate probability or more).
ROC AUC was excellent for the GCAPS and good for both Ing score and BK score (Fig. 2, Table 2). GCAPS had the highest Se: 0.983 (95% confidence interval [95%CI]: 0.908–0.999), while BK score had the highest Sp of 0.711 (95%CI: 0.629–0.784). NPV was highest for GCAPS followed by BK score, respectively, 0.989 (95% CI: 0.926–0.998) and 0.935 (95% CI: 0.877–0.969) (Table 2). The accuracy of each clinical probability score (probability of correct classification) was 0.725, 0.685 and 0.760 for the GCAPS, Ing score, and BK score, respectively.
Performance of CDUS probability scores
Established cut-off values considered positive were ≥ 1 for halo count, and ≥ 2 for halo score. Seven participants had a halo count of 1 (only one abnormal arterial segment with halo sign). GCA was the final diagnosis in six of those participants.
Both CDUS scores performed well, with an excellent ROC AUC of 0.979 (95% CI: 0.954–1.000) for halo count and 0.953 (95% CI: 0.923–0.983) for halo score (Fig. 2). Se was 0.966 (95% CI: 0.881–0.996) for both halo count and halo score. Sp was 0.979 (95% CI: 0.939–0.996) and 0.845 (95%CI: 0.775–0.900) for halo count and halo score, respectively (Table 2). Positive likelihood ratio (LR+) was 45.7 (95% CI: 14.9–140.2) and 6.2 (95% CI: 4.2–9.2), for halo count and halo score, respectively. The accuracy (probability of correct classification) of halo count was 0.975 and 0.880 for halo score.
Combination of clinical and CDUS score to predict GCA
Classification of patients using a combination of clinical scores and CDUS halo count is presented in Table 3. Combination of GCAPS and CDUS halo count showed the best overall classification accuracy. In patients with GCA, none had a normal GCAPS/normal halo count combination. GCAPS allowed the identification of GCA in two patients with a negative halo count. Logistic regression models and paired-sample area difference under the ROC curves showed that the performance of this combination is mainly driven by the halo count (Table S5 and S6, supplementary data).
Discussion
This prospective cohort study directly compared clinical and CDUS prediction scores in GCA. Moreover, every patient with a final diagnosis of GCA satisfied the 2022 ACR/EULAR classification criteria.
The three clinical prediction scores are easy to calculate. The GCAPS and BK score do not require a calculator or spreadsheet. The GCAPS was found to have the highest Se and lowest negative likelihood ratio (LR-). This is comparable to data previously published [11, 14]. With a GCAPS < 9.5 points, clinicians may therefore feel comfortable in excluding a diagnosis of GCA. The BK score showed the highest specificity and PPV at the established cut-off value. However, similarly to the GCAPS and Ing score, a positive score only mildly increased (LR+ 3.1) the probability of GCA. This highlights the wide range of nonspecific symptoms in GCA and its large differential diagnosis.
The performance of CDUS scores was excellent; however, halo count had the best PPV and LR+. Halo count requires subjective interpretation of vessel wall echogenicity. It is calculated by counting arterial branches where a hypoechoic circumferential intima-media thickening (halo sign) is present. Halo sign has previously proven to be specific in confirming the presence of vasculitis. It is a visual representation of active inflammation within the vessel wall [23]. Threshold values of intima-media complex defining a halo sign is debated amongst GCA experts and may vary according to the equipment used. The values used in this study are widely recognized and have been externally validated in our center in a previous study [11]. In contrast, halo score is purely quantitative and involves measuring and grading the maximal intima-media thickness for each arterial branch. However, thickening of the vessel wall may occur in the presence of atherosclerosis (isoechoic or hyperechoic) and increases the halo score. Halo score may therefore be less specific, and increased in the absence of active, hypoechoic, vessel wall inflammation.
High doses of glucocorticoids may affect CDUS prediction scores by reducing vessel wall inflammation [25, 26]. In our cohort, a higher proportion of patients with GCA had empirical glucocorticoids initiated before study inclusion (Table 1). Moreover, the cumulative glucocorticoid dose was double in participants with GCA compared to those without GCA. The performance of halo count and halo score may therefore have been underestimated.
Combining the GCAPS with halo count allowed correct identification of all patients with GCA. Thus, GCA may be excluded with confidence in the setting of a low clinical suspicion of GCA on the GCAPS combined with a normal halo count on CDUS.
Based on the CDUS halo count alone, only 5 patients were misclassified: 2 with a false negative (FN) and 3 with a false positive (FP) result. In one patient with a FN halo count, all three clinical scores were positive. In the other patient with a FN halo count, only the GCAPS was positive and allowed prediction of GCA. Both patients with FN halo count also had a negative TAB but had evidence of extra-cranial GCA on large vessel imaging. In the three patients with FP halo count, one patient had negative clinical scores, while the other two patients had positive clinical scores. The two patients with FP clinical scores and halo count both had a negative TAB and an alternate diagnosis at follow-up (head and neck pathology, and viral infection).
TAB was not required in our protocol as it is no longer considered a reference test in most GCA studies. Prospective clinical follow-up of participants to confirm GCA was performed, which is now routinely used in GCA diagnostic accuracy studies. Using composite reference tests (CDUS, cranial MRA, cranial PET-CT, large vessel imaging) combined with prospective clinical follow-up could improve the certainty of a final diagnosis of GCA. This is often difficult to perform in studies due to limited availability of tests and required expertise, cost, and the risks associated with TAB and/or cumulative radiation exposure.
Our study had several strengths. We included a large number of participants and assessed five GCA prediction tools simultaneously. Data collection on prediction scoring items was performed prospectively to reduce recall bias. Final diagnosis of GCA was performed by two investigators, independently, without knowledge of prediction scores to avoid an overestimation of effect.
Our study also had limitations. Not every patient had a formal ophthalmologic examination, which is a scoring item in the GCAPS. Patients without any visual symptoms were attributed a score of 0 for that GCAPS item in the absence of a formal retinal examination. Although unlikely, subclinical retinal changes may have been missed and would have resulted in a higher GCAPS. However, patients without visual symptoms are usually not referred to ophthalmologists and this represents “real life” practice for most clinicians.
In conclusion, many clinical and CDUS prediction scores are available to predict GCA. GCAPS was the clinical prediction score with the highest sensitivity, whereas the BK score had the highest specificity. The performance of CDUS prediction scores, mostly the halo count, is excellent. Combining GCAPS and halo count allowed correct identification of all patients with GCA and should be considered in the setting of GCA Fast-Track clinics.
Data availability
Dr. Makhzoum confirms the accuracy, completeness, and availability of the data. The datasets generated during and/or analyzed during the current study are available from the corresponding author on reasonable request.
References
Younger DS (2019) Giant Cell Arteritis. Neurol Clin 37(2):335–344
Dejaco C, Brouwer E, Mason JC, Buttgereit F, Matteson EL, Dasgupta B (2017) Giant cell arteritis and polymyalgia rheumatica: current challenges and opportunities. Nat Rev Rheumatol 13(10):578–592
Kermani TA, Warrington KJ (2018) Prognosis and monitoring of giant cell arteritis and associated complications. Expert Rev Clin Immunol 14(5):379–388
Li KJ, Semenov D, Turk M, Pope J (2021) A meta-analysis of the epidemiology of giant cell arteritis across time and space. Arthritis Res Ther 23(1):1–10
Rinden T, Miller E, Nasr R (2019) Giant cell arteritis: an updated review of an old disease. Cleve Clin J Med 86(7):465–472
Van Der Geest KSM, Sandovici M, Brouwer E, Mackie SL (2020) Diagnostic accuracy of symptoms, physical signs, and laboratory tests for giant cell arteritis. JAMA Intern Med 180(10):1295
He J, Williamson L, Ng B, Wang J, Manolios N, Angelides S et al (2022) The diagnostic accuracy of temporal artery ultrasound and temporal artery biopsy in giant cell arteritis: a single center Australian experience over 10 years. Int J Rheum Dis 25(4):447–453
Baalbaki H, Jalaledin D, Lachance C, Febrer G, Rhéaume M, Makhzoum J-P (2021) Characterization of visual manifestations and identification of risk factors for permanent vision loss in patients with giant cell arteritis. Clin Rheumatol: J Int League Assoc Rheumatol 40(8):3207–3217
Klein RG, Campbell RJ, Hunder GG, Carney JA (1976) Skip lesions in temporal arteritis. Mayo Clin Proc 51(8):504–510
Chu R, Foster C, Ali M, Chaba T, Clifford AH, Mahr A et al (2020) Optimal length and usefulness of temporal artery biopsies in the diagnosis of giant cell arteritis: a 10-year retrospective review of medical records. Lancet Rheumatol 2(12):e774–e7e8
Zarka F, Rhéaume M, Belhocine M, Goulet M, Febrer G, Mansour A-M et al (2021) Colour Doppler ultrasound and the giant cell arteritis probability score for the diagnosis of giant cell arteritis: a Canadian single-centre experience. Rheumatol adv pract 5(3):rkab083
Maleszewski JJ, Younge BR, Fritzlen JT, Hunder GG, Goronzy JJ, Warrington KJ et al (2017) Clinical and pathological evolution of giant cell arteritis: a prospective study of follow-up temporal artery biopsies in 40 treated patients. Mod Pathol 30(6):788–796
Roberts J, Clifford A (2017) Update on the management of giant cell arteritis. Ther Adv Chronic Dis 8(4-5):69–79
Laskou F, Coath F, Mackie SL, Banerjee S, Aung T, Dasgupta B (2019) A probability score to aid the diagnosis of suspected giant cell arteritis. Clin Exp Rheumatol 37(Suppl 117(2)):104–108
Hu A, Beattie K, Bhavsar S, Legault K, Rebello R, Thayaparan A et al (2019) 090. A clinical scoring system for risk stratification of giant cell arteritis. Rheumatology 58(Supplement_2):kez058–kez030
Ing EB, Lahaie Luna G, Toren A, Ing R, Chen J, Arora N et al (2017) Multivariate prediction model for suspected giant cell arteritis: development and validation. Clin Ophthalmol 11:2031–2042
Diamantopoulos AP, Haugeberg G, Hetland H, Soldal DM, Bie R, Myklebust G (2014) Diagnostic value of color Doppler ultrasonography of temporal arteries and large vessels in giant cell arteritis: a consecutive case series. Arthritis Care Res 66(1):113–119
Schmidt WA, Kraft HE, Vorpahl K, Völker L, Gromnica-Ihle EJ (1997) Color duplex ultrasonography in the diagnosis of temporal arteritis. N Engl J Med 337(19):1336–1342
Schmidt WA (2018) Ultrasound in the diagnosis and management of giant cell arteritis. Rheumatology 57(suppl_2):ii22–ii31
Duftner C, Dejaco C, Sepriano A, Falzon L, Schmidt WA, Ramiro S (2018) Imaging in diagnosis, outcome prediction and monitoring of large vessel vasculitis: a systematic literature review and meta-analysis informing the EULAR recommendations. RMD Open 4(1):e000612
Dejaco C, Ramiro S, Duftner C, Besson FL, Bley TA, Blockmans D et al (2018) EULAR recommendations for the use of imaging in large vessel vasculitis in clinical practice. Ann Rheum Dis 77(5):636–643
Ponte C, Grayson PC, Robson JC, Suppiah R, Gribbons KB, Judge A et al (2022) American College of Rheumatology/EULAR Classification Criteria for Giant Cell Arteritis. Arthritis Rheum 81(12):1647–1653
Van Der Geest KSM, Borg F, Kayani A, Paap D, Gondo P, Schmidt W et al (2020) Novel ultrasonographic Halo Score for giant cell arteritis: assessment of diagnostic accuracy and association with ocular ischaemia. Ann Rheum Dis 79(3):393–399
Molina Collada J, Martínez-Barrio J, Serrano-Benavente B, Castrejón I, Caballero Motta LR, Trives Folguera L et al (2020) Diagnostic value of ultrasound halo count and Halo Score in giant cell arteritis: a retrospective study from routine care. Ann Rheum Dis 81(9):e175–e175
Seitz L, Christ L, Lötscher F, Scholz G, Sarbu AC, Bütikofer L et al (2021) Quantitative ultrasound to monitor the vascular response to tocilizumab in giant cell arteritis. Rheumatology (Oxford) 60(11):5052–5059
Pinnell J, Tiivas C, Mehta P, Dubey S (2022) Corticosteroids reduce vascular ultrasound sensitivity in fast- track pathways (FTP): results from Coventry Multi-Disciplinary FTP for cranial Giant Cell Arteritis. Scand J Rheumatol 52(3):283–292
Acknowledgements
Mrs. Guylaine Marcotte (research coordinator), Mrs. Audrey Martineau (research assistant), and Dr Alexandra Mereniuk (collaborator).
Funding
Montreal Sacre-Coeur Hospital Foundation provided a grant (5,000$) and the ultrasound used in this study. This funding source had no role in the design of this study and did not have any role during its execution, analyses, interpretation of the data, or decision to submit results.
Author information
Authors and Affiliations
Contributions
All authors were involved in drafting the article or critically reviewing it for important intellectual content. All authors approved the final version to be published. Study conception and design (JPM), acquisition of data (SDB, JPM, RSM, CR, CS), analysis, and interpretation of data (JPM, CS). Dr Makhzoum had full access to all the data in the study and takes full responsibility for the integrity of all aspects of the work.
Corresponding author
Ethics declarations
Ethics approval
The study (protocol number 2020-1890) was approved by the scientific committee and research ethics board of Montreal Sacre-Coeur Hospital. Patients provided written informed consent. The study was performed in accordance with the principles of the Declaration of Helsinki and Good Clinical Practice guidelines.
Conflicts of interests
Dr Makhzoum has received consultation or presentation fees from Roche®, Otsuka®, GlaxoSmithKline®, Astra-Zeneca®, Sanofi ® and is an investigator in clinical trials funded by Health Canada, the Vasculitis Clinical Research Consortium (VCRC), Janssen® and Novartis® outside the submitted work. Dr Ross has received consultation fees from Otsuka® outside the submitted work. Dr Ducharme-Benard has received presentation and focus group fees from Novartis® outside the submitted work. All other authors had no conflicts of interests to declare.
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary information
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Sargi, C., Ducharme-Benard, S., Benard, V. et al. Assessment and comparison of probability scores to predict giant cell arteritis. Clin Rheumatol 43, 357–365 (2024). https://doi.org/10.1007/s10067-023-06721-6
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10067-023-06721-6