Abstract
This work proposes a convolutional neural network (CNN) that utilizes different combinations of parametric images computed from cine cardiac magnetic resonance (CMR) images, to classify each slice for possible myocardial scar tissue presence. The CNN performance comparison in respect to expert interpretation of CMR with late gadolinium enhancement (LGE) images, used as ground truth (GT), was conducted on 206 patients (158 scar, 48 control) from Centro Cardiologico Monzino (Milan, Italy) at both slice- and patient-levels. Left ventricle dynamic features were extracted in non-enhanced cine images using parametric images based on both Fourier and monogenic signal analyses. The CNN, fed with cine images and Fourier-based parametric images, achieved an area under the ROC curve of 0.86 (accuracy 0.79, F1 0.81, sensitivity 0.9, specificity 0.65, and negative (NPV) and positive (PPV) predictive values 0.83 and 0.77, respectively), for individual slice classification. Remarkably, it exhibited 1.0 prediction accuracy (F1 0.98, sensitivity 1.0, specificity 0.9, NPV 1.0, and PPV 0.97) in patient classification as a control or pathologic. The proposed approach represents a first step towards scar detection in contrast-free CMR images. Patient-level results suggest its preliminary potential as a screening tool to guide decisions regarding LGE-CMR prescription, particularly in cases where indication is uncertain.
Graphical abstract
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
1 Introduction
Ischemic cardiomyopathy (ICM) is the most common cause of heart failure. At its first stage, ICM causes a reversible loss in cardiac function due to reduced oxygenation. When ischemia is prolonged, irreversible damage to myocardial tissue occurs, leading to fibrosis through a tissue remodeling process. Myocardial fibrosis impacts the contractile properties of the affected area, setting the stage for increased arrhythmogenicity [1].
Cardiac magnetic resonance (CMR) with late gadolinium (Gd) enhancement (CMR-LGE) is the elective imaging modality for myocardial scar characterization [2,3,4,5]. CMR-LGE imaging relies on the different accumulation of Gd in different tissues, with a larger uptake in chronically damaged myocardium. This contrast-enhanced imaging modality relies on visual interpretation, being dependent on observer’s experience and expertise. Despite subjective factors that may lead to user-related measurement errors and high inter-observer variability, in clinical practice, the visual inspection of CMR-LGE represents the conventional technique to assess cardiac viability and to identify myocardial scars [6,7,8].
Recent studies have shown that CMR-LGE is highly contraindicated in patients with severe kidney disorders, and the exposure to Gd contrast agent has been associated with nephrogenic systemic fibrosis [9]. Studies also showed that Gd may represent a long-term risk factor as it can be retained in the cerebral and cerebellar nuclei by crossing the blood–brain barrier [10], and it can accumulate in the bone, skin, liver, and lungs [11]. For these reasons, Gd-based contrast agent administration should be considered carefully with respect to potential risks and benefits, and only used when required, as well as standard dosing should be used, and repeated administrations should be avoided unless necessary [12, 13].
Non-contrast CMR can be considered as an alternative [14], as the use of Gd-free steady-state free precession (SSFP) cine CMR pulse sequences could be explored to potentially identify scars in an indirect way. In fact, as the left ventricular (LV) wall motion and contractile properties are modified by the presence of nonviable scar tissue, researchers are investigating the potential of deep learning (DL) as a strategy to support the physician in identifying fibrotic tissue in the LV myocardial wall in Gd-free CMR cine sequences [15], thus overcoming the problem of Gd toxicity concerns [16].
Although previous methods [8, 16,17,18,19,20], based on capturing dynamic changes in videointensity across various spatial locations within the heart and temporal phases of the cardiac cycle, potentially enable the detection of myocardial fibrosis, they are still subject to limitations. In fact, due to the poorly contrasted scar tissue in cine frames, to apply this spatio-temporal learning paradigm, an increase in feature size is introduced, as they are extracted from all frames in the cardiac cycle, thus posing issues relevant to overfitting. In addition, hence optical flow-based methods for motion analysis are valuable, they could potentially be sensitive to through-plane motion artifacts, image quality, and brightness variation along the cine sequence [21, 22].
To overcome these issues, we hypothesized that the use of parametric images, derived from SSFP cine CMR images, integrating spatial and temporal information on LV wall motion in a compact way [23, 24], could overcome the intrinsic complexity of modeling motion deformation of the LV myocardium by synthetizing it into a single image [24,25,26].
Accordingly, our aim was to propose a novel DL approach, utilizing a convolutional neural network (CNN) that exploits the information from a single static end-diastolic (ED) frame together with multiple parametric images derived from the cine CMR loop, computed by two different approaches (i.e., Fourier transform and monogenic signal), to obtain a classification for each image slice, indicating the presence or absence of LV scar tissue.
To evaluate the effectiveness of this methodology, by testing various combinations of parametric images, its performance will be compared against the use of LGE images and expert interpretation, considered as the ground truth (GT). Such approach could be used to attract attention of the medical observer interpreting the cine CMR images towards those slices where the scar presence has been detected, thus serving as a support to the decision-making process of prescribing LGE imaging, in particular in cases in which the clinical indication is uncertain [14].
2 Materials and methods
2.1 Study population and image acquisition
This retrospective study included a cohort of consecutive patients who were referred for LGE-CMR imaging at the IRCCS Centro Cardiologico Monzino (Milan, Italy) between 2010 and 2016. Patients were excluded if standard contraindications to CMR-LGE existed, such as a glomerular filtration rate of ≤ 30 mL/min/1.73 m2. Institution’s ethical committee approved the protocol (ref. R659/17-CCM 698), and all patients gave written consent.
Images from 158 patients with ischemic dilated cardiomyopathy (DCM) showing the presence of fibrotic tissue in the LV myocardium, and from 48 control patients with a negative CMR-LGE, were studied. The main clinical and anthropometric parameters relevant to the enrolled subjects as a whole, and separately as DCM and control group, are reported in Table 1, together with the result of their statistical comparison (Mann–Whitney, or chi-square test).
All CMR acquisitions were performed using a 1.5 T scanner (Discovery MR 450, GE Healthcare, Milwaukee, Wisconsin, USA), using phased-array surface receiver coils, and electrocardiogram triggering. Breath-hold SSFP cine imaging was performed in vertical and horizontal long-axis orientations as well as in short-axis, using the following parameters: field of view (FOV) 380 × 380 mm2, repetition time 3.2 ms, echo time 1.4 ms, flip angle 50°, image matrix size 224 × 256 pixels, bandwidth 488.3 Hz/pixel, and slice thickness 8 mm with no gap.
In addition, a contrast-enhanced, breath-hold, segmented T1-weighted inversion-recovery gradient-echo sequence (FOV 380 × 380 mm2, repetition time 6.6 ms, echo time 1.5 ms, flip angle 20°, image matrix size 224 × 192 pixels, bandwidth 122.1 Hz/pixel, slice thickness 8 mm) was used: LGE imaging was performed 10 to 20 min after the administration of an intravenous bolus of 0.1 mmol/kg of Gd-based contrast agent (Gadovist; Bayer AG, Berlin, Germany) at a flow rate of 3 ml/s, followed by 20 ml of saline flush with the same rate. Inversion time was individually adapted to null the signal of remote myocardium (220 to 300 ms) [27].
2.2 Ground truth assessment
All images were analyzed using cvi42 cardiac software (version 5.11, Circle Cardiovascular Imaging Inc., Calgary, Canada) by an expert cardiologist (EACVI Level III CMR certified). For each patient, short-axis cine and LGE were extracted at matched anatomical slices.
On the stack of LGE images, the LV endocardium and epicardium borders were traced, and the myocardial fibrosis was outlined by the expert cardiologist through manual contouring, after appropriate setting of the display window level and width. Subsequently, each LGE image was automatically labeled based on the presence or absence of the scar in it, and this label was used as GT.
Additionally, in the matched cine short-axis view, the LV endocardium and epicardium borders at ED frame, automatically selected as the one with the largest LV blood pool at the mid-ventricular level, were manually contoured by the expert to include papillary muscles and trabeculations as part of the LV cavity, in agreement with recent guidelines [28,29,30].
2.3 Deep learning model
2.3.1 Data pre-processing and augmentation
To reduce the processing area, CNN computational cost and memory requirement, in accordance with literature, a squared bounding-box including the whole LV myocardium was automatically retrieved and used to crop each ED image. To guarantee better generalization to unseen data, reducing overfitting, and preventing gradient-related issues, images were normalized to achieve zero mean and unit standard deviation, and resized to 224 × 224.
The dataset consisted of a total number of 1793 ED cropped images, of which 1047 with scar (SCAR) from the 158 DCM patients, and 746 without (NL) from the 48 control patients, based on the GT interpretation.
Our CNN embedded the encoding branch of U-Net [31], with one convolutional block followed by three residual blocks characterized by skip connections that connect the input of the block directly to the next one. Figure 1 shows the architecture of the proposed CNN.
The first initial convolutional block was made of a convolutional layer (number of kernels = 64, kernel size 3 × 3) with batch normalization [32]. The three residual blocks differed by filter size, respectively 128, 256, and 512, and had the following structure: two convolutional blocks (as in the initial convolutional block) and a max-pooling layer (size 2 × 2) [33]. A skip-connection was introduced between the input and the output of the residual block. All convolutional layers were characterized by a kernel size 3 × 3, rectified linear unit (ReLU) [33] as activation function and He uniform as kernel initializer. This convolutional module was connected through a tensor flattening layer to two sequential fully connected (FC) layers with 256 and 128 neurons, respectively, each followed by a batch normalization layer and a dropout layer (rate 0.2) [33, 34]. A final dense layer with one node and sigmoid activation function was used for binary classification.
2.3.2 Parametric images computation
The parametric imaging technique is based on the measurement of signal variability within the same pixel coordinates over the cardiac cycle to capture dynamic information of the LV myocardium [25]. For each extracted signal over time, amplitude and phase were computed as representative of the myocardium wall motion throughout the cardiac cycle, according to the applied approach (i.e., Fourier or monogenic signal analysis).
Fourier analysis
Along each cine loop, for each image pixel coordinate, the time series of video intensity values was obtained [24, 35] and approximated to a best-fit curve by using the standard least squares analysis. As during the cardiac cycle the signal is assumed to be periodic, based on the Fourier theorem, this continuous and periodic function can be decomposed into a linear combination of harmonics and represented by the Fourier series (Eq. 1).
For each pixel at a particular location, focusing on the fundamental series of order n = 1, the amplitude \({A}_{1}\) and the phase \({P}_{1}\) of this first harmonic were exploited to create the two corresponding parametric images. This process was applied for each cine-loop available from the study (Fig. 2).
Monogenic signal analysis
In the second approach, based on the monogenic signal, information of the myocardial displacement was obtained considering only the ED and the end-systolic (ES) frames for each cardiac cycle, following the method described in [21, 36]. In brief, the monogenic signal \({S}_{m}\) (Eq. 4) was obtained by first convolving the image \(I\) with the even log-Gabor filter \(H\) (Eq. 2), and then convolving its result \(w\) with two odd filters \({h}_{1}\) and \({h}_{2}\) (Eq. 3), calculated applying to \(H\) the Riesz transform (Fig. 3).
The signal \({S}_{m}\) was then decomposed in a standard spherical polar coordinates system to obtain its amplitude (Eq. 5) and phase (Eq. 6) values.
The corresponding parametric images of amplitude (Eq. 7) and phase (Eq. 8) were obtained computing the difference between the corresponding ED and ES values:
2.4 Model inputs
Five different types of parametric images were considered for each patient for each slice: the region of interest in correspondence to the myocardium of the ED cine frame (C), the amplitude (FA) and phase (FP) from Fourier analysis, the amplitude (MA), and phase (MP) from monogenic signal. As regards the ED cine frame, the LV endocardium and epicardium contours traced by the expert were used as a mask to maintain the videointensity content only in the region of interest in correspondence to the myocardium, and zero values elsewhere.
Different combinations of those images were composed to create n-channel input with whom to train and validate the CNN by computing the relevant performance compared to the GT label, thus generating different evaluation protocols, as shown in Fig. 4. In the first one (P1), only the single ED frame (static information) was included as reference: in this way, the added value of including motion features from consecutive cine frames obtained through parametric images (dynamic information) by Fourier (P2, P3, P4) or monogenic signal (P5, P6, P7) analysis could be derived. In P8 and P9, only amplitude and phase images, respectively, were added, while in P10, all parametric images were jointly utilized. Additionally, in P11 and P12, a combination of FA with MP, and of FP with MA, respectively, were considered.
2.5 Model evaluation and experimental protocol
The dataset was randomly divided (patient-wise) into training and test set by stratifying the two groups according to the global label of the patient (SCAR and NL) and allocating 80% of the initial patients to the training set (164 patients, resulting in 840 SCAR and 587 NL images) and 20% to the test set (42 patients, resulting in 207 SCAR and 159 NL images).
The training set was further divided (patient-wise) to allocate 15% of these patients for validation (25 patients, resulting in 132 SCAR and 83 NL images) and 85% for the actual training set (139 patients, resulting in 708 SCAR and 504 NL images). The training dataset was augmented applying random image flipping, width and height shifting (randomly from 0 to 0.2), and rotation (randomly from − 20 to 20°).
The performance of each protocol was evaluated by considering the target label of each individual image for the classification of SCAR and NL images. For CNN training, stochastic gradient descent was used as the optimizer (with 0.001 as learning rate) to minimize the binary cross-entropy. The maximum number of epochs was set to 200, with an early stopping if a plateau of validation loss was reached over 16 consecutive epochs. The batch size was fixed to 32 for the training set.
To evaluate the performance of the model on the test set, the confusion matrix was computed and accuracy (acc), F1, sensitivity and specificity, positive (PPV) and negative (NPV) predictive values, together with the area under the curve (AUCs) of the receiver operating characteristic (ROC) curve, were derived.
In the second step, the performance of the CNNs obtained in the defined protocols was tested at patient-level by considering as target label the existence of at least one scar (i.e., a patient in the DCM group) or none (i.e., a patient in the control group) in the acquired slices. Patient-wise accuracy was calculated as the number of correctly classified patients divided by the total number of patients in the test set, and reported together with F1, sensitivity, specificity, PPV, and NPV.
3 Results
The different performance, in terms of test set accuracy, F1, sensitivity and specificity of the CNN trained with the examined protocols are shown in Fig. 5, while relevant NPV and PPV are reported in Table 2. The accuracy (acc) obtained using only the static information (P1) was lower to all but one (P5, adding the amplitude of monogenic signal) the remaining protocols. P2, which adds the Fourier parametric amplitude, reached the highest values (acc 0.79). Adding also the Fourier phase information did not further improve the results (P4, acc 0.78), while for monogenic signal the only addition of the phase image resulted in a better performance (P6, acc 0.75) than combining both amplitude and phase (P7, acc 0.72). Considering only amplitudes FA and MA (P8, acc 0.74), or phase FP and MP (P9, acc 0.75) parametric images resulted in intermediate values. The combination of Fourier amplitude and monogenic phase (P11, acc 0.78), as well as of Fourier phase and monogenic amplitude (P12. acc 0.77) did not further improve the performance. Finally, the inclusion of all the parametric images (P10, acc 0.75) appeared constrained to the lower results obtained by the monogenic approach.
The AUCs for all protocols, with similar findings, are shown in Fig. 6.
When comparing the performance obtained using the Fourier and the monogenic signal analyses, Fourier approach showed the best accuracy and AUCs results (P2, acc 0.79; AUC ROC, 0.86).
3.1 Patient-level analysis
The accuracy, F1, sensitivity and specificity values of the proposed CNN considering the global label of the patient are shown in Fig. 7, and relevant NPV and PPV are reported in Table 3. Results were very good for all the considered protocols, with the worst performance in P10 (all parametric images together), and the best in P6 and P8, in which all patients were correctly classified as DCM or control, thus achieving an accuracy equal to 1.0. When considering P2, P5, and P11, a quasi-excellent performance (acc 0.98) was found, with 41/42 patients classified correctly and only one false positive.
4 Discussion
In this study, a DL method was proposed for the classification of the presence or absence of scar in LV myocardial tissue from Gd-free cine CMR images using the static ED frame combined with a diverse set of parametric images, each defining distinct protocols.
For each slice, the inclusion of motion features computed from consecutive cine frames proved to be more effective with respect to considering the ED frame only. Specifically, the parametric images synthetize the abnormal movement of the LV myocardial wall in presence of fibrotic tissue [37] inside one single frame, thus allowing the network, taking advantage from the encoder branch of the U-Net, to extract additional features useful to better distinguish healthy myocardium from the scarred one, without the risk of drastically increasing the feature size [24,25,26].
We previously tested a similar approach using a Random Forest (RF) classifier [35] in a small group of 40 patients, in which a parametric image was computed using the Fourier analysis. In this work, we extended our study by considering a wider population, by applying a CNN, and by comparing the performance of using several combinations of parametric images, computed both with the Fourier analysis and the monogenic signal [21, 38].
Unlike the Fourier analysis, the monogenic signal computation is not based on the hypothesis of periodicity of the videointensity signal through the cardiac cycle, and also has the advantage of requiring less computational resources, being based on the convolution of the ED and ES frames with specific filters. Despite these benefits, the approach based on the Fourier analysis provided better results, probably due to the punctual evaluation pixel by pixel of the videointensity oscillations along the entire cine sequence, thus allowing the extraction of more detailed and comprehensive dynamic information.
Among the multitude of benefits provided by the integration of residual blocks into the CNN architecture, one of the most significant is their ability in addressing the vanishing gradient problem [39, 40]. In fact, in deep neural networks, the gradient of the loss function approaches zero during the backpropagation, making the early layers parameter update negligible. However, the inclusion of residual blocks overcomes this limitation providing alternative shortcut paths for the propagation of the gradient. In advance, CNN including residual blocks can learn intricate and complex mapping, capturing hierarchical and multi-scale features from the input data. In fact, by transmitting information directly to deeper layers, skip connections allow the network to simultaneously preserve fine-grained details while progressively extracting highly abstract features delving deeper into the network. This combination of information at various scales and levels of abstraction enables the network to tackle challenging image classification tasks [40]. Furthermore, skip connections enhance the generalization capabilities of deep neural networks, grasping meaningful representations of underlying patterns in data without becoming overly specific to the training dataset. In this way, the CNN with residual blocks becomes more robust and reliable in real-world applications thus preventing overfitting [39].
Given the network’s capability to classify slices as either SCAR or NL (with an accuracy of 0.79 and an AUC ROC of 0.86), the proposed method could serve as a tool for clinicians to focus their attention on slices representing myocardium with potential scar tissue, to confirm or not such classification by visualizing the corresponding dynamic cine images to check for wall motion abnormalities, and subsequently prescribe CMR-LGE imaging for possible confirmation of the diagnosis.
Similarly, by repeating this classification for all the slices of the cine CMR exam, it could be possible to preliminary classify a patient as a control or pathologic based on the presence or not of a scar in the whole myocardium. Specifically, using P6 and P8 combinations, no false negative and false positive classifications were present when considering such patient-level analysis. Due to its high sensitivity and specificity, the proposed DL-model could represent a possible preliminary screening tool to serve as support to the decision of performing or not LGE in those cases in which its clinical indication is uncertain [14]. Indeed, several studies showed that about 50% of patients with a specific type of cardiomyopathy have no scar but undergo repeated Gd-based CMRs throughout their life [8].
On the other hand, in patients in which both cine CMR and the CMR-LGE images have been acquired, the proposed approach could represent a valuable tool to facilitate and speed up the clinician in the examination of the Gd-enhanced images, by flagging those slices classified as having a possible scar for further confirmation.
In specific clinical applications, such as cardiac resynchronization therapy, where it is not necessary to quantify the scar area but to localize its presence along the slices, our approach could provide insightful information. As a scar in the basal wall (i.e., over the LV pacing site) has been shown to be associated to an adverse impact on long-term prognosis [8, 41, 42], a preliminary assessment for the presence of a scar in that slice could be initially performed without contrast medium using the proposed approach.
Table 4 shows the comparison of the results obtained in this work with similar studies using machine learning (ML) or DL methods for scar detection from contrast-free cine sequences.
In particular, Larroza et al. [16] used a ML classifier to identify the presence of nonviable segments in LV sectors using local binary patterns (LBP), computed from the cine dynamic images using a 2D + t approach, as textural descriptors.
Applying a DL approach, Zhang et al. [17] proposed a recurrent neural network (RNN) capable of extracting global and local motion features using optical flow and achieving an AUC of 0.94 in the scar detection task. Xu et al. [18] introduced a long short-term memory (LSTM) RNN to demonstrate the correspondence between motion features extracted from non-enhanced images and tissue properties allowing to determine the tissue identity in each pixel from its motion pattern, further proposing a progressive sequential causal generative adversarial network (PSCGAN) for LGE-equivalent image generation and simultaneous scar segmentation, resulting in an AUC of 0.90 [19].
More recently, Zhang et al. [20] proposed a method to generate virtual LGE-like images combining cine images and T1-maps through a learning-based strategy, thus reaching an overall accuracy of 0.84 in detecting scars, but being limited to a single frame analysis and not exploiting the LV motion features. Fahmy et al. [8] performed scar detection in cine sequences using a logistic regression (LR) classifier exploiting a set of radiomics features combined with DL features obtained through a pre-trained network, reaching an AUC of 0.81, without considering the motion information.
The results obtained in this study at slice-level with CNN relying on parametric images were comparable to [16] obtained with Support Vector Machines (SVM). On the contrary, our performance at slice-level appears slightly inferior to studies in which more elaborate network architectures were used for automatic motion feature extraction [19, 20] or used in combination with local and global motion features extracted through optical flow [17, 18]. On the other hand, when compared to [8, 35] where the classification models were based on ML approach, this work showed higher performance. Furthermore, results of our network reached the highest accuracy, sensitivity and specificity when considering the analysis at patient-level.
4.1 Limits and future developments
A possible limitation of our study concerns the relatively small size of the dataset. Collecting more data to expand the input dataset would improve the performance of the network. Moreover, the GT definition was constrained by the limited availability of specialized experts, due to its time-consuming aspect, thus relying solely on myocardial fibrosis outlined by one expert cardiologist through manual contouring on the LGE images; future studies should be designed to include multiple independent annotations from which to derive consensus, or considering interobserver variability in the definition of the GT, to widen the reliability and applicability of the findings. Another limit of this work is that only a single trial was performed for each protocol. As it is well known, there is a certain component of variability in neural networks training; therefore, to make the conclusions more robust, several trials could be run to compute the mean and standard deviation. Similarly, we opted for a simple validation method based on a random split instead of multifold cross-validation due to the associated computational complexity and the significant increase in processing time in this specific case, which included the implementation of multimodal protocols. Future research could incorporate multifold cross-validation to more rigorously validate the models. In addition, since images were acquired through one single scanner, it would be beneficial to consider the influence of different CMR acquisition systems, to test for external validity of the proposed CNN.
An additional limitation is that the proposed method does not provide scar segmentation and quantification of its area, but only the possible presence of the scar in the slice of interest (or at patient-level). However, this could be seen as a first step towards that goal that would require a larger and more extensive validation.
Further developments may involve the implementation and comparison of new techniques for including temporal information, such as optical flow or new types of parametric images.
5 Conclusion
The possibility of using Gd-free cine CMR images to classify the presence of scar tissue at both slice and patient-level using a DL approach, utilizing a custom-made convolutional neural network (CNN) that exploits several parametric images to capture dynamic wall motion information, was tested.
The innovation in this study primarily lies in the different methods (i.e., Fourier analysis and monogenic signal) to generate the parametric images, and the comparison of their multiple combinations to define the most performant one compared to the expert interpretation of LGE images. Globally, the use of parametric images in the CNN improved the accuracy of properly classifying a slice compared to the use of only the static ED image, with the best performance obtained by adding the parametric image of the Fourier’s transform module. At patient-level, an accuracy of 1.0 in classifying normal or pathologic patient was achieved, thus suggesting its potential use as a preliminary screening tool to guide decision making in performing LGE-CMR in those cases in which its indication is uncertain.
References
Bhandari BBS, Quintanilla Rodriguez, and W. Masood (2023) Ischemic Cardiomyopathy. In: StatPearls, Treasure Island (FL): StatPearls Publishing. Accessed: Aug. 03, 2023. [Online]. Available: http://www.ncbi.nlm.nih.gov/books/NBK537301/
Brahim K, Arega TW, Boucher A, Bricq S, Sakly A, Meriaudeau F (2022) An improved 3D deep learning-based segmentation of left ventricular myocardial diseases from delayed-enhancement MRI with inclusion and classification prior information U-Net (ICPIU-Net). Sensors (Basel) 22(6):2084. https://doi.org/10.3390/s22062084
Krittayaphong R, Zhang S, Tanapibunpon P, Kaolawanich Y, Nakyen S (2022) Dark-blood late gadolinium-enhancement cardiac magnetic resonance imaging for myocardial scar detection based on simplified timing scheme: single-center experience in patients with suspected coronary artery disease. Quant Imaging Med Surg 12(2):1037–1050. https://doi.org/10.21037/qims-21-704
Polacin M et al (2020) Analysis of Segmental Strain for the Detection of Chronic Ischemic Scars in Non-Contrast Cardiac MRI Cine Images: A Feasibility Study. https://doi.org/10.21203/rs.3.rs-125451/v1
Vöhringer M, Mahrholdt H, Yilmaz A, Sechtem U (2007) Significance of late gadolinium enhancement in cardiovascular magnetic resonance imaging (CMR). Herz 32(2):129–137. https://doi.org/10.1007/s00059-007-2972-5
Hsu L-Y, Ingkanisorn WP, Kellman P, Aletras AH, Arai AE (2006) Quantitative myocardial infarction on delayed enhancement MRI. Part II: Clinical application of an automated feature analysis and combined thresholding infarct sizing algorithm. J Magn Reson Imaging 23(3):309–314. https://doi.org/10.1002/jmri.20495
Tao Q, Piers SRD, Lamb HJ, van der Geest RJ (2015) Automated left ventricle segmentation in late gadolinium-enhanced MRI for objective myocardial scar assessment. J Magn Reson Imaging 42(2):390–399. https://doi.org/10.1002/jmri.24804
Fahmy AS, Rowin EJ, Arafati A, Al-Otaibi T, Maron MS, Nezafat R (2022) Radiomics and deep learning for myocardial scar screening in hypertrophic cardiomyopathy. J Cardiovasc Magn Reson 24(1):40. https://doi.org/10.1186/s12968-022-00869-x
Ersoy H, Rybicki FJ (2007) Biochemical safety profiles of gadolinium-based extracellular contrast agents and nephrogenic systemic fibrosis. J Magn Reson Imaging 26(5):1190–1197. https://doi.org/10.1002/jmri.21135
Kanda T, Ishii K, Kawaguchi H, Kitajima K, Takenaka D (2014) High signal intensity in the dentate nucleus and globus pallidus on unenhanced T1-weighted MR images: relationship with increasing cumulative dose of a gadolinium-based contrast material. Radiology 270(3):834–841. https://doi.org/10.1148/radiol.13131669
Goischke H-K (2017) Safety assessment of gadolinium-based contrast agents (GBCAs) requires consideration of long-term adverse effects in all human tissues. Mult Scler J Exp Transl Clin 3(2):2055217317704450. https://doi.org/10.1177/2055217317704450
Costa AF et al (2018) Gadolinium deposition in the brain: a systematic review of existing guidelines and policy statement issued by the Canadian Association of Radiologists. Can Assoc Radiol J 69(4):373–382. https://doi.org/10.1016/j.carj.2018.04.002
Cheong BYC, Wilson JM, Preventza OA, Muthupillai R (2022) Gadolinium-based contrast agents: updates and answers to typical questions regarding gadolinium use. Tex Heart Inst J 49(3):e217680. https://doi.org/10.14503/THIJ-21-7680
Hendel RC et al (2006) ACCF/ACR/SCCT/SCMR/ASNC/NASCI/SCAI/SIR 2006 Appropriateness Criteria for Cardiac Computed Tomography and Cardiac Magnetic Resonance Imaging: A Report of the American College of Cardiology Foundation Quality Strategic Directions Committee Appropriateness Criteria Working Group, American College of Radiology, Society of Cardiovascular Computed Tomography, Society for Cardiovascular Magnetic Resonance, American Society of Nuclear Cardiology, North American Society for Cardiac Imaging, Society for Cardiovascular Angiography and Interventions, and Society of Interventional Radiology. J Am College Cardiol 48(7):1475–1497. https://doi.org/10.1016/j.jacc.2006.07.003
Mannil M, Eberhard M, von Spiczak J, Heindel W, Alkadhi H, Baessler B (2020) Artificial intelligence and texture analysis in cardiac imaging. Curr Cardiol Rep 22(11):131. https://doi.org/10.1007/s11886-020-01402-1
Larroza A et al (2018) Texture analysis of cardiac cine magnetic resonance imaging to detect nonviable segments in patients with chronic myocardial infarction. Med Phys 45(4):1471–1480. https://doi.org/10.1002/mp.12783
Zhang N et al (2019) Deep learning for diagnosis of chronic myocardial infarction on nonenhanced cardiac cine MRI. Radiology 291(3):606–617. https://doi.org/10.1148/radiol.2019182304
Xu C et al (2018) Direct delineation of myocardial infarction without contrast agents using a joint motion feature learning architecture. Med Image Anal 50:82–94. https://doi.org/10.1016/j.media.2018.09.001
Xu C, Xu L, Ohorodnyk P, Roth M, Chen B, Li S (2020) Contrast agent-free synthesis and segmentation of ischemic heart disease images using progressive sequential causal GANs. Med Image Anal 62:101668. https://doi.org/10.1016/j.media.2020.101668
Zhang Q et al (2022) Artificial intelligence for contrast-free MRI: scar assessment in myocardial infarction using deep learning–based virtual native enhancement. Circulation 146(20):1492–1503. https://doi.org/10.1161/CIRCULATIONAHA.122.060137
Benameur N et al (2018) Left ventricular MRI wall motion assessment by monogenic signal amplitude image computation. Magn Reson Imaging 54:109–118. https://doi.org/10.1016/j.mri.2018.08.004
Xavier M, Lalande A, Walker PM, Brunotte F, Legrand L (2012) An adapted optical flow algorithm for robust quantification of cardiac wall motion from standard cine-MR examinations. IEEE Trans Inf Technol Biomed 16(5):859–868. https://doi.org/10.1109/TITB.2012.2204893
Caiani EG et al (2002) Improvement in echocardiographic evaluation of left ventricular wall motion using still-frame parametric imaging. J Am Soc Echocardiogr 15(9):926–934. https://doi.org/10.1067/mje.2002.120503
Caiani EG, Toledo E, MacEneaney P, Collins KA, Lang RM, Mor-Avi V (2004) The role of still-frame parametric imaging in magnetic resonance assessment of left ventricular wall motion by non-cardiologists. J Cardiovasc Magn Reson 6(3):619–625. https://doi.org/10.1081/jcmr-120038083
Benameur N, Caiani EG, Arous Y, Ben Abdallah N, Kraiem T (2018) Parametric imaging for the assessment of cardiac motion: a review. Cardiovasc Eng Technol 9(3):377–393. https://doi.org/10.1007/s13239-018-0362-1
Caiani E et al (2001) Echocardiographic evaluation of left ventricular wall motion using still-frame parametric imaging. In: Computers in Cardiology 2001. Vol.28 (Cat. No.01CH37287), pp 89–92. https://doi.org/10.1109/CIC.2001.977598
Andreini D et al (2022) Cardiac magnetic resonance features of left dominant arrhythmogenic cardiomyopathy: differential diagnosis with myocarditis. Int J Cardiovasc Imaging 38(2):397–405. https://doi.org/10.1007/s10554-021-02408-8
Schulz-Menger J et al (2020) Standardized image interpretation and post-processing in cardiovascular magnetic resonance-2020 update: Society for Cardiovascular Magnetic Resonance (SCMR): Board of Trustees Task Force on Standardized Post-Processing. J Cardiovasc Magn Reson 22(1):19. https://doi.org/10.1186/s12968-020-00610-6
Riffel JH et al (2019) Cardiovascular magnetic resonance of cardiac morphology and function: impact of different strategies of contour drawing and indexing. Clin Res Cardiol 108(4):411–429. https://doi.org/10.1007/s00392-018-1371-7
Han Y, Olson E, Maron MS, Manning WJ, Yeon SB (2008) 2075 Papillary muscles and trabeculations significantly impact ventricular volume, ejection fraction, and regurgitation assessment by cardiovascular magnetic resonance in patients with hypertrophic cardiomyopathy. J Cardiovasc Magn Reson 10:. https://doi.org/10.1186/1532-429X-10-S1-A344
Ronneberger O, Fischer P, Brox T (2015) U-Net: Convolutional Networks for Biomedical Image Segmentation. In: Medical Image Computing and Computer-Assisted Intervention – MICCAI 2015, Navab N, Hornegger J, Wells WM, Frangi AF, Eds., In: Lecture Notes in Computer Science. Cham: Springer International Publishing pp 234–241. https://doi.org/10.1007/978-3-319-24574-4_28
Bjorck J, Gomes C, Selman B, Weinberger KQ (2018) Understanding Batch Normalization.” arXiv, 30. https://doi.org/10.48550/arXiv.1806.02375
Zabihollahy F, White JA, Ukwatta E (2019) Convolutional neural network-based approach for segmentation of left ventricle myocardial scar from 3D late gadolinium enhancement MR images. Med Phys 46(4):1740–1751. https://doi.org/10.1002/mp.13436
Guo T, Dong J, Li H, Gao Y (2017) Simple convolutional neural network on image classification,” In: 2017 IEEE 2nd International Conference on Big Data Analysis (ICBDA), pp 721–724. https://doi.org/10.1109/ICBDA.2017.8078730
Moccia S et al (2020) A Novel Approach Based on Spatio-temporal Features and Random Forest for Scar Detection Using Cine Cardiac Magnetic Resonance Images. In: 2020 Computing in Cardiology, pp 1–4. https://doi.org/10.22489/CinC.2020.050
Bridge C (2017) Introduction To The Monogenic Signal,” ArXiv, Accessed: Aug. 03, 2023. [Online]. Available: https://www.semanticscholar.org/paper/Introduction-To-The-Monogenic-Signal-Bridge/b6ae56ec6d72f7506c6db41f91b2f068468abcb9#citing-papers
Benameur N, Mahmoudi R, Caiani EG, Arous Y, Saâdaoui F, Mahjoubi H (2022) Assessment of the relationship between regional wall motion abnormality score revealed by parametric imaging and the extent of LGE with CMR. Clin Imaging 89:68–77. https://doi.org/10.1016/j.clinimag.2022.05.007
Alessandrini M, Basarab A, Liebgott H, Bernard O (2013) Myocardial motion estimation from medical images using the monogenic signal. IEEE Trans Image Process 22(3):1084–1095. https://doi.org/10.1109/TIP.2012.2226903
He K, Zhang X, Ren S, Sun J (2016) Deep Residual Learning for Image Recognition, In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp 770–778. https://doi.org/10.1109/CVPR.2016.90
Hassan R, Fraz MM, Rajput A, Shahzad M (2023) Residual learning with annularly convolutional neural networks for classification and segmentation of 3D point clouds. Neurocomputing 526:96–108. https://doi.org/10.1016/j.neucom.2023.01.026
O’Brien H et al (2021) Automated Left Ventricle Ischemic Scar Detection in CT Using Deep Neural Networks. Front Cardiovasc Med 8:655252. https://doi.org/10.3389/fcvm.2021.655252
Chan RH et al (2014) Prognostic value of quantitative contrast-enhanced cardiovascular magnetic resonance for the evaluation of sudden death risk in patients with hypertrophic cardiomyopathy. Circulation 130(6):484–495. https://doi.org/10.1161/CIRCULATIONAHA.113.007094
Acknowledgements
EC and FR also acknowledge the support of the Italian Space Agency (call DC-VUM-2020-7, contract 2022-09-U.0 and 2022-10-U.0, recipient Enrico G. Caiani).
Funding
Open access funding provided by Politecnico di Milano within the CRUI-CARE Agreement. This research project was developed at Centro Cardiologico Monzino IRCCS and supported by the Italian Ministry of Health-Ricerca Corrente.
Author information
Authors and Affiliations
Contributions
Study conception and design: Caiani, Righetti, Rubiu, Penso, and Moccia. Data acquisition: Carerj, Pepi, and Pontone. Data analyisis and interpretation: Righetti, Rubiu, Caiani, Penso, and Moccia. Article drafting: Righetti and Caiani. Article revising: Righetti, Rubiu, Penso, Moccia, Carerj, Pepi; Pontone, and Caiani. All authors approved the final manuscript.
Corresponding author
Ethics declarations
Ethical approval
The study was approved by the Ethics Committee of the Centro Cardiologico Monzino and complied with the Declaration of Helsinki. All individuals gave written informed consent before participating in the study.
Conflict of interest
The authors declare no competing interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Righetti, F., Rubiu, G., Penso, M. et al. Deep learning approaches for the detection of scar presence from cine cardiac magnetic resonance adding derived parametric images. Med Biol Eng Comput (2024). https://doi.org/10.1007/s11517-024-03175-z
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s11517-024-03175-z