Abstract
Purpose of Review
Rigid image registration is an important image processing tool for the assessment of musculoskeletal chronic disease. In this paper, we critically review applications of rigid image registration in terms of similarity measurement methods over the past three years (2019–2022) in the context of monitoring longitudinal changes to bone microstructure and mechanical properties using computed tomography. This review identifies critical assumptions and trade-offs underlying different similarity measurement methods used in image registration and demonstrates the effect of using different similarity measures on registration outcomes.
Recent Findings
Image registration has been used in recent studies for: correcting positional shifts between longitudinal scans to quantify changes to bone microstructural and mechanical properties over time, developing registration-based workflows for longitudinal assessment of bone properties in pre-clinical and clinical studies, and developing and validating registration techniques for longitudinal studies.
Summary
In evaluating the recent literature, it was found that the assumptions at the root of different similarity measures used in rigid image registration are not always confirmed and reported. Each similarity measurement has its advantages and disadvantages, as well as underlying assumptions. Breaking these assumptions can lead to poor and inaccurate registration results. Thus, care must be taken with regards to the choice of similarity measurement and interpretation of results. We propose that understanding and verifying the assumptions of similarity measurements will enable more accurate and efficient quantitative assessments of structural changes over time.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
Introduction
Musculoskeletal diseases are defined by the World Health Organization (WHO) as being of long duration, taking decades to progress and whose high prevalence presents an increasing burden on both the national and family economies [1, 2]. Quantitatively assessing and tracking bone microstructure and bone mechanical properties can support diagnosis [3], monitoring [4], and establishment of treatment options [5]. To this end, 3D imaging modalities such as computed tomography (CT) and its related imaging techniques such as micro-computed tomography (microCT) [6], high-resolution peripheral quantitative computed tomography (HR-pQCT) [7], and cone-beam computed tomography (CBCT) [8] have been deployed. Conceptually, longitudinal analysis of bone microstructure and mechanical properties can be achieved by simply superimposing common volumes of interest (VOI) from images taken at different time points [9]. Nevertheless, in practice, it is difficult to control positioning shifts between longitudinal scans, even if scans were conducted by experienced and skilled imaging technologists. Mismatches related to repositioning between scans over time can result in different VOIs and inaccurate results, if not corrected.
Rigid, intensity-based, image registration is a principal tool to determine the optimal correspondence between two or more images of the same scene taken at different time points, from different viewpoints, or by different imaging modalities to locate matching VOIs over longitudinal datasets [10]. It can identify and reduce repositioning shifts introduced between scans and thus improve the precision and reproducibility of detected longitudinal changes. This is achieved by optimising the similarity between two images which can be measured in a number of ways [11•]. Popular similarity measurements that are used for image registration in the current literature are: sum of squared differences (SSD), correlation coefficient (CC), and mutual information (MI). SSD is computationally simple and assumes that the sum of mean and variance of the images is the same during the optimisation process [12•]. CC can eliminate global variations, that are introduced during scanning, by standardising the images to zero mean and unit variance [13•]. The assumption associated with CC depends on the chosen implementation of correlation [11•]. MI and its derived measures are suitable for cross-modality registration since they only assume that tissues in one image can be mapped to the same tissue in the other using approaches based on probability and information theory [14•, 15•].
In the last three years (2019–2022), the application of CT-based rigid image registration in longitudinal musculoskeletal studies has been primarily focussed on three overarching objectives: (i) applying registration to correct for repositioning shifts to reveal changes to bone microstructure [16,17,18,19] and mechanical properties over time [19,20,21,22]; (ii) development of registration-based workflows for longitudinal assessment of bone properties in pre-clinical [23, 24] and clinical studies [25•, 26, 27]; and (iii) development and validation of registration techniques for longitudinal research [28•, 29,30,31].
Given the growing interest in using CT-based methods for longitudinal assessment of bone quality in chronic disease, it is necessary to compare the available similarity measurements, each with inherent assumptions, so that informed decisions can be made. The primary objective of this paper is to review the application of image registration and its similarity measurement methods used in the CT field from 2019 to 2022 and identify critical assumptions and trade-offs underlying each similarity measurement method. This review demonstrates how assumptions for each similarity measures can be checked and how these assumptions may affect registration results if not considered. The focus of this review is on techniques used in recent CT literature, where frequently used algorithms are also detailed and described, where appropriate. To avoid ambiguity, in this study, image registration refers to rigid image registration only.
Application of Image Registration in Longitudinal CT Studies
The growth in computational speed and accuracy has led many authors to incorporate image registration in their studies. Sixteen publications between 2019 to 2022 utilising image registration in longitudinal studies are reviewed and listed in Table 1 according to the study objective, along with similarity measurements. Literature is categorised according to three identified applications of image registration in the field (Fig. 1): (i) correcting repositioning shifts for quantitative assessments of bone properties; (ii) development of registration-based workflows; and (iii) development and validation of registration techniques.
Correcting Repositioning Shifts for Quantitative Assessments of Bone Properties
Bone microstructural properties (e.g., porosity, thickness [32]) and mechanical properties (e.g., stiffness, failure load [33]) play an important role in the progression of chronic musculoskeletal diseases such as osteoarthritis [34] and osteoporosis [35]. Correcting for repositioning shifts using image registration allows for accurate quantitative tracking of these changes which can provide insights into disease progression and establish markers for treatment options [20].
Many studies have used registration to uncover changes to bone microstructure over time. Zhang et al. [16] explored cortical bone changes in mouse tibia at multiple temporal and spatial frequencies by performing a wavelet-based analysis method on registered microCT scans using SSD. Brunet et al. [17] used registration based on CC to track the development of cortical erosion in early inflammatory arthritis using HR-pQCT scans of human metacarpophalangeal joint. Van Rietbergen et al. [18] applied CC to register follow-up grayscale HR-pQCT images of human radius and tibia from an elderly cohort and quantified changes to the endosteal contours. Heilmeier et al. [19] performed registration based on normalised MI to characterise 5-year changes in distal tibial and radial microstructures in postmenopausal women using HR-pQCT. Du et al. [20] also successfully used image registration using MI to examine localised trabecular microstructural changes in the distal tibia of postmenopausal women after a regimen of six-month regular hopping exercise.
Other studies have focused on using registration to correct for repositioning shifts prior to longitudinal finite element analysis to reveal changes in bone mechanical properties. Tourolle né Betts et al. [21] applied registration using SSD to a microCT dataset of mouse femur prior to evaluating changes to mechanical property over the bone fracture healing process. Plett et al. [22] performed image registration using CC to longitudinally assess bone strength from HR-pQCT scans of human radius. Their findings indicated an association between local mechanical strains and the formation of mineralised tissue at defect sites.
These studies have shown that registration is a useful tool for correcting longitudinal repositioning shifts and allowing for sensitive quantification of bone changes at multiple sites. They were focussed on revealing biological changes overtime; however, there are further works focussing on developing registration-based workflows with a goal to quantify these biomechanical changes.
Development of Registration-Based Workflow for Longitudinal Research
To obtain sensitive and accurate longitudinal measurements of bone microstructural and mechanical properties, studies have proposed and evaluated acquisition and processing workflows incorporating image registration.
Investigating the effect of the microCT scanning protocol and radiation dose on bone remodelling over time, Wehrle et al. [23] registered successive scans of the mouse femur by applying SSD to grayscale images, and found that the protocol did not significantly interfere with bone formation and resorption. Ning et al. [24] provided a non-invasive microCT-based method to quantify bone growth in rat tibia, where image registration using MI is adopted to register cortical and trabecular bone, respectively. To reduce the impact of artifacts caused by stack shift from patient movement during image acquisition with HR-pQCT, Brunet et al. [25•] developed a multi-stack registration tool based on CC to reduce the number of discarded scans in their longitudinal studies of rheumatoid arthritis in metacarpophalangeal joint. Verhelst et al. [26] proposed an image processing workflow involving registration using MI for analysing human mandibular condyle using CBCT scans. Atkins et al. [27] developed and applied an analysis tool based on image registration for HR-pQCT scans to investigate local bone formation and resorption during fracture healing in human radius.
Studies with this objective were mainly focussed on applying existing registration routines into wider workflows for longitudinal assessment of bone [23, 24, 25•, 26, 27]. There are also a number of other works that are actively contributing to the improvement and validation of existing registration techniques [28•, 29,30,31].
Development and Validation of Registration Techniques
In recent years, many image registration techniques in use are 3D registration methods where a combination of rotation and translation operations are performed [28•, 29, 30]. However, a computationally simpler approach to image registration can also be performed in a slice-matched manner, where only translation is included [36]. Chiba et al. [28•] compared the variation in quantitative bone measurements between 3D registration using SSD and slice-matched registration with binarised HR-pQCT scans of healthy human radius and tibia. Their results showed that 3D registration yielded lower variation for measurements of bone mineral density and microstructural parameters between follow-up scans. Hosseinitabatabaei et al. [29] and Kemp et al. [30] reached a similar conclusion after investigating the effect of 3D registration using CC and slice-matched registration on the precision of bone microstructural and mineral density measurements in human radius and tibia using greyscale HR-pQCT datasets.
In a separate development, Koide et al. [31] implemented and compared an automated registration using normalised MI with manual registration workflow in clinical planning CT and post-operative contrast-enhanced CT of the human spine. The study found comparable outcomes between both approaches, suggesting that automated registration using MI for surgical planning could be an efficient alternative to manual registration. Notably, semi-automatic techniques—also available and prevalent—often also suffer from efficiency and reproducibility issues as observed by Koide et al. [31] with manual image registration. Fully automatic techniques are still preferred wherever applicable.
There are many studies employing image registration for longitudinal applications, and with an increasing interest in acquisition of longitudinal CT data in bone research, there is a need to critically evaluate the different similarity measurement techniques used for image registration and their suitability for the research question. In the following sections, a mathematical introduction to image registration and the fundamental underlying assumptions associated with each commonly used similarity measurement is presented.
Assumptions in Similarity Measurements for Registration
A CT image can be converted into a 2D matrix by stacking slices of data along one specific dimension (typically stacked along the z-dimension) [37], where each element contains an intensity value from a single voxel. In their 2D matrix forms, consider the baseline image, \({\varvec{U}}\), and the follow-up image with the same dimension, \({\varvec{V}}\). The objective of image registration is to perform transformation, \(T\), such that the difference between the baseline image, \({\varvec{U}}\), and the transformed follow-up image, \(T({\varvec{V}})\), is minimised. This can be achieved by optimising a measure of similarity, \(c\), between the baseline image, \({\varvec{U}}\), and the transformed follow-up image, \(T\left({\varvec{V}}\right)\), to obtain the optimal transformation, \({T}_{opt}\):
Intensity-based registration methods utilise voxel information from the images for the computation of similarity measure, \(c\). As mentioned in earlier sections, there are several approaches for measuring similarity [38]. The most widely used measures, including SSD, CC, and MI, are described here.
Sum of Squared Differences
Similarity measure based on SSD, \({c}_{SSD}\), has been widely used in [16, 21, 23, 28•] and is defined as follows:
where \(u\) and \(T\left(v\right)\) are the scalar forms of CT image, \({\varvec{U}}\), and transformed image, \(T\left({\varvec{V}}\right)\). \(N\) denotes the total number of voxels in each image and \(\rho\) represents correlation, \(\sum_{i}^{N}{u}_{i}{T\left(v\right)}_{i}\), between \({\varvec{U}}\) and \(T\left({\varvec{V}}\right)\). Mean and variance of \({\varvec{U}}\) and \(T({\varvec{V}})\) are written as \(\overline{u }\), \({\sigma }_{u}^{2}\), \(\overline{T\left(v\right)}\), and \({\sigma }_{T\left(v\right)}^{2}\), respectively, and can be calculated directly from each image. The optimal value of \({c}_{SSD}\) is the value that has the smallest magnitude (i.e., smallest difference between \({\varvec{U}}\) and \(T\left({\varvec{V}}\right)\)).
Equation (4) shows multiple terms summing up to calculate\({c}_{SSD}\), among which, correlation,\(\rho\), is the only element that measures the similarity between baseline and transformed follow-up image, while other terms,\(\overline{u }\),\({\sigma }_{u}^{2}\),\(\overline{T\left(v\right)}\), and\({\sigma }_{T\left(v\right)}^{2}\), are their inherent properties. For \({c}_{SSD}\) to be accurate in measuring similarity between two images, \({c}_{SSD}\) should be only proportional to correlation,\(\rho\). As baseline, \(\overline{u }\) and \({\sigma }_{u}^{2}\) are constant throughout the optimisation search, which is the process of searching for minimum of\({c}_{SSD}\). However, it should be noted that during optimisation search, the value of\(\overline{T\left(v\right)}\), and\({\sigma }_{T\left(v\right)}^{2}\), can be altered. During rotational and translational search, the transformed image may have to be cropped and padded to maintain consistent image dimension. Depending on the cropping and padding approaches, this can lead to changing\(\overline{T\left(v\right)}\), and\({\sigma }_{T\left(v\right)}^{2}\), in addition to the already changing correlation,\(\rho\). Thus, to ensure that \({c}_{SSD}\) reflects the changing \(\rho\) during the optimisation process, the sum of \(\overline{T\left(v\right)}\) and \({\sigma }_{T\left(v\right)}^{2}\) should be constant throughout, which is the key assumption in the SSD method.
Small deviations from this assumption should be tolerable but will introduce more registration errors. These deviations from assumption and registration errors should be discussed when interpreting the quantitative analysis results. Additionally, the presence of severe outliers, such as may result from intensity variation introduced by use of contrast agents, or extensive bone remodelling, can lead to substantially larger deviation in \(\overline{T\left(v\right)}\) and \({\sigma }_{T\left(v\right)}^{2}\) [12•]. In the worst scenario, outliers can cause a significant shift in \(\overline{T\left(v\right)}\) and \({\sigma }_{T\left(v\right)}^{2}\) during optimisation search, such that the calculated transformation that optimises \({c}_{SSD}\) is different from the transformation that optimises the correlation between the images. To avoid this, it is recommended to maintain constant sum of \(\overline{T\left(v\right)}\) and \({\sigma }_{T\left(v\right)}^{2}\) during an optimisation search. This can be achieved by employing periodic boundary padding [39] or by considering alternative similarity measures.
Of the five studies under review that apply SSD-based registration, Zhang et al. [16], Tourolle né Betts et al. [21], Wehrle et al. [23], and Atkins et al. [27] assumed sufficiently accurate rigid registration to not discuss registration as a potential source of error when reporting results. Chiba et al. [28•] mentioned inaccuracies in their trabecular bone resorption and formation results and recognised that imperfect registration could be a contributor. In this work [28•], registration error was attributed to acquisition issues such as motion artifacts, noise, and instability of the CT device. Additionally, their registration issues could possibly stem from the use of binary, rather than greyscale, images for registration, which could lead to inaccurate results due to loss of information during the binarisation process [40].
None of the five SSD studies considered in this report verified that their data satisfied the mean and variance assumption implicit in SSD (see Eq. (4) to be clear). These studies did not use contrast agent and saw no substantial bone remodelling; consequently, the assumption was likely satisfied. However, by not validating adherence to the assumption underlying SSD, their quantitative results may be affected by inaccuracies in the registration.
SSD can be advantageous as it is computationally efficient, with an \(O\left(n\right)\) complexity, which indicates that the number of operations required to calculate the similarity measure grows proportionally with image size, n. However, the implicit assumption that the mean and variance remain constant can be easily violated. Rotating an image during optimisation search changes the voxels that fall within the image frame, impacting estimation of the mean, \(\overline{T\left(v\right)}\), and variance, \({\sigma }_{T\left(v\right)}^{2}\), of the transformed follow-up image. This may affect the similarity measure calculated for different rotations, potentially causing inaccurate registration and impacting microstructural measurement results. To ensure reproducibility across trials and different registrations, it is critical to ensure that precision error of image registration falls within specified confidence intervals. Glüer et al. [41] provide guidance on how to calculate precision error for user specified confidence intervals specifically for bone densitometric techniques.
Correlation Coefficient
Correlation based approaches, denoted CC, use a measure of linear association between a baseline image, \({\varvec{U}}\), and a transformed image, \(T\left({\varvec{V}}\right)\), to determine similarity, \({c}_{CC}\). The assumption associated with \({c}_{CC}\) therefore depends on the chosen implementation of correlation. There are a number of correlation measures utilised for registration in the literature, the most common being Pearson’s correlation [42•],
In this form, correlation measures linear association between baseline image, \({\varvec{U}}\), and transformed image, \(T\left({\varvec{V}}\right)\), and has \(O(n)\) complexity. Correlation standardises the inputs to zero mean and unit variance, so that it is robust to changes in image intensity. Correlation makes an implicit assumption that the relationship between the two images is linear [43]. The optimal value of \({c}_{CC}\) is given by the transformation resulting in the input images having the strongest linear association.
The strength of the linear relationship can be determined by directly calculating correlation between two images using multiple methods, including but not limited to Spearman’s correlation [42•] and Kendall’s tau [44]. Several reviewed studies utilized commercial image processing platform IPL (SCANCO Medical AG, Brüttisellen, Switzerland) to perform image registration using CC in their longitudinal studies [17, 18, 22, 29, 30]. Additionally, toolboxes are also available in MATLAB (MathWorks, Natick, MA, USA) [45], along with other cost-free packages in ITK [24], and Python [46]. All image registration using CC considered in this review, as well as most available registration toolboxes, employed Pearson’s correlation [17, 18, 22, 25•, 29, 30].
None of the studies reviewed discussed the linearity assumptions. Brunet et al. [25•] acknowledged that slight errors in registration may lead to inaccuracies in the results. Even though CC is widely accessible, the exact correlation approach and their assumptions should always be checked (e.g., performing Spearman’s correlation or Kendall’s tau) before implementation. A demonstration of how these assumptions can be checked is available in the following section “Demonstration of critical assumptions on registration results from different similarity measures” and the supplementary material of this manuscript.
Mutual Information
MI-based registration has gained much popularity since it was performed by Viola et al. [14•] and Maes et al. [15•] as it only assumes that one tissue in the baseline image can be mapped to the same tissue in the follow-up image. Instead of performing voxel-size evaluation of similarity as is done in SSD and CC, MI use techniques from information theory to calculate the amount of information one image contains about the other [47].
For this section, the baseline and transformed follow-up images are considered as random variables, \(U\) and \(T(V)\). Their Shannon entropy can be written as \(H\left(U\right)\) and \(H\left(T(V)\right)\) [48], where:
with \({P}_{U}(m)\) being the probability that a voxel in image \(U\) would have an intensity \(m\), and \({P}_{T(V)}(n)\) being the probability that a voxel in image \(T(V)\) would have an intensity \(n\). A joint histogram of the two images can be used to estimate a joint probability distribution [47]. The Shannon entropy, \(H\left(U,T(V)\right)\), of the joint distribution can be, then, written as:
where \({P}_{U,T(V)}\left(m,n\right)\) is the joint probability that a voxel with intensity \(m\) in the image \(U\) correspond to intensity \(n\) in the image \(T(V)\).
With the terms described, similarity measurement using MI, \({c}_{MI}\), can be defined as:
The magnitude of MI is dependent on \(H\left(U\right)\), \(H\left(V\right)\), and \(H\left(U,T(V)\right)\), ranging from 0 to infinite, where an optimised MI value has the largest magnitude. However, the magnitude of \({c}_{MI}\) can be unintuitive and difficult to interpret due to its unbounded range. Kvalseth et al. [49] proposed normalised mutual information (NMI) to enable comparison by scaling \({c}_{MI}\) to a bounded range, defined as the ratio between mutual information and sum of entropy of two images:
Mutual information can also be normalised using other quantities, such as, joint entropy [50]. In this review, two studies [24, 26] used MI and three used NMI [19, 20, 31] as their similarity measure to perform registration.
It is worth noting that using MI-based similarity measure is computationally more complex than SSD and CC. With complexity of \(O(nlogn)\) [51], MI can introduce efficiency and memory issues in longitudinal registration of large datasets using high resolution scans where SSD and CC, with \(O(n)\) complexity, could have achieved the same result with fewer resources. In fact, no study using MI-based registration in this review incorporated a large number of datasets. Compared to the study of van Rietbergen et al. [18] using more than 1000 HR-pQCT scans with CC for registration, the largest dataset using MI-based registration is from Ning et al. [24], with 144 microCT scans.
Table 2 provides a summary of recommendations for various scenarios, with pros and cons for each similarity measure. For scenarios involving slight changing bone structure and no contrast agent, SSD is recommended to be adopted to perform image registration due to its computational efficiency \(O\left(n\right)\). On the other hand, CC is recommended when no contrast agent and rapid changing bone microstructure is involved, and high correlation between two images is ensured. The minimal assumptions introduced by MI makes it suitable for applications where rapidly changing bone microstructures or the intensity of images are shifted by the introduction of contrast agent.
Demonstration of Critical Assumptions on Registration Results from Different Similarity Measures
To demonstrate how assumptions for each similarity measures can be checked and how they affect registration results, this section presents an example application of microCT images of the rat femur from a previous study of osteoarthritis [52]. For computational efficiency and simplicity in the presentation of results, a down-sampled 2D slice is used to present the 3D image. All operations were performed in MATLAB (R2022a, MathWorks, Natick, MA, USA). Figure 2 shows the baseline and follow-up input images, their histograms, and summary statistics. The baseline image (Fig. 2a) was acquired at the beginning of the study and the follow up image (Fig. 2b) was acquired after injecting a contrast solution into the joint cavity. The histogram and summary statistics of the baseline image (Fig. 2c) and the follow-up image (Fig. 2d) are presented. The introduction of a contrast solution has enhanced brightness and caused a substantial increase in the mean and variance of the follow-up image, resulting in a low Spearman’s correlation (0.14) between the two.
A brute-force optimal transformation search was performed by translating the follow-up image from -50 to + 50 pixels along the x- and y-axis at 1 pixel increment and rotating the follow-up image from -180˚ to + 180˚ clockwise with a step size of 1˚, with translation and rotation performed independently. For each transformation, similarity measures (SSD, CC, MI) were evaluated as described and are shown in Fig. 3. The highest value for each similarity measure was selected as ‘optimised’ and the subsequent registration results presented. To achieve this, SSD scores were inverted for consistent interpretation. Since the baseline and follow-up images are already in a very similar starting position, minimal translation and rotation are expected in the registration result.
Similarity scores for translation show that SSD has detected multiple optimised points around the extremities of the translation (x = 34, y = -34, and x = 30, y = 25, Fig. 3a). Though CC (Fig. 3b) has correctly estimated that minimal translation is needed, multiple optimised points can be seen around the translation centre (0,0). While MI showed clear optimised points even with the intensity distortion caused by contrast solution (Fig. 3c). These results can be better observed in the detailed view of similarity scores calculated using SSD (Fig. 3d), CC (Fig. 3e), and MI (Fig. 3f).
Similarity scores for rotation also show that SSD has falsely detected multiple peaks at ± 100˚ rotation (Fig. 3g), while CC (Fig. 3h) and MI (Fig. 3i) have correctly approximated minimal rotation. These similarity measures are reflected in their respective registration results where registration using SSD failed (Fig. 3j) while registration using CC (Fig. 3k) and MI (Fig. 3l) registrations show good similarity to the baseline image.
These results are expected as it can be seen from the registration result for SSD (Fig. 3j), the bright areas on both sides of follow-up image (Fig. 2b) were rotated to optimise \({c}_{SSD}\) and cropped to maintain consistent image dimension, which lead to incorrect registration result. Though the low Spearman’s correlation between baseline and follow-up images translates to an approximate successful CC-based registration, the multiple peaks around the optimal extremity could cause the algorithm to be trapped in local extrema, and could lead to an inaccurate registration result. MI, having the least strict assumption, shows the sharpest optimised peak in its similarity scores (Fig. 3c, f, i) which is reflected in its registration result (Fig. 3l).
More examples and use cases can be found in the supplementary documentation. To validate the algorithm, two identical image examples are used to perform image registration. To further explore how breaking SSD assumptions can affect the registration result, a longitudinal registration example using microCT scans from a mouse tibia is also available.
Perspectives and Conclusion
Recent literature, from 2019 to 2022, that applied image registration for the longitudinal assessment of bone microstructural and mechanical properties has been critically reviewed, where the goal and type of registration in those studies were analysed. An introduction to image registration methods reporting various similarity measures and their underlying assumptions were examined, and the effect of these assumptions on longitudinal microCT data was demonstrated.
This review found that despite the increasing popularity of image registration in longitudinal studies using CT, choices regarding similarity measures has not been regularly discussed. As shown in this review, each similarity measure has its own assumptions which, if broken, would lead to poor and inaccurate registration results. SSD is computationally simple to perform and implement but comes with a strict assumption which can be easily broken in longitudinal studies; namely the constant sum of mean and variance of the transformed, follow-up image during optimising process. CC based on Pearson’s correlation is also computationally efficient, but care must be taken to ensure high linear correlation between the images. MI is arguably the most robust of the major measures of similarity; however, it is computationally expensive. High-resolution 3D data, such as those from a mouse study of osteoarthritis [53], have x, y, and z dimensions of 3198 × 3198 × 335 voxels (3.4 × 109 voxels) for a single scan. Using MI, with its \(O(nlogn)\) complexity, could lead to a registration time of several days longer than either CC or SSD. To improve time-efficiency of the registration process, it is recommended to implement image registration with a with a multi-resolution or pyramid strategy [12•].
Additionally, image registration, ubiquitous in its application, is not a perfect tool. Whether performed manually or automatically, registration errors can still be introduced. Registration errors should be accounted for during study planning and appropriately discussed when reporting results.
In summary, advances in image registration have stimulated many studies to use it as a critical tool for time-lapse CT imaging to monitor changes to bone microstructure and mechanical property. The understanding and verification of the assumptions and trade-offs behind different similarity measurements will enable a more accurate and efficient quantitative measurements while appreciating the nuances of each image registration approach.
Data Availability
The authors declare that original data supporting the perspectives of this review are available within the paper and its supplementary information files.
References
Papers of particular interest, published recently, have been highlighted as: • Of importance
Mendis S, Armstrong T, Bettcher D, Branca F, Lauer J, Mace C, Poznyak V, Riley L, Da Costa E Silva V, Stevens G. Global status report on noncommunicable diseases 2014. World Health Organisation. 2014. https://apps.who.int/iris/handle/10665/148114. Accessed 31 May 2023.
Chronic musculoskeletal conditions. In: Australian Institute of Health and Welfare. 2022. https://www.aihw.gov.au/reports/chronic-musculoskeletal-conditions/musculoskeletal-conditions. Accessed 31 May 2023.
Oei EHG, Van Tiel J, Robinson WH, Gold GE. Quantitative radiologic imaging techniques for articular cartilage composition: Toward early diagnosis and development of disease-modifying therapeutics for osteoarthritis. Arthritis Care Res (Hoboken). 2014. https://doi.org/10.1002/acr.22316.
Lord AE, Zhang L, Erickson JE, Bryant S, Nelson CM, Gaudette SM, Phillips LA, Schwartz Sterman AJ, Mitra S. Quantitative in vivo micro-computed tomography for monitoring disease activity and treatment response in a collagen-induced arthritis mouse model. Sci Rep. 2022. https://doi.org/10.1038/s41598-022-06837-w.
Feehan LM, Li LL, McKay HA. Micro-structural bone changes in early rheumatoid arthritis persist over 1-year despite use of disease modifying anti-rheumatic drug therapy. BMC Musculoskelet Disord. 2017. https://doi.org/10.1186/s12891-017-1888-3.
du Plessis A, Broeckhoven C, Guelpa A, le Roux SG. Laboratory x-ray micro-computed tomography: A user guideline for biological samples. Gigascience. 2017. https://doi.org/10.1093/gigascience/gix027.
Wong AKO. A Comparison of Peripheral Imaging Technologies for Bone and Muscle Quantification: a Mixed Methods Clinical Review. Curr Osteoporos Rep. 2016. https://doi.org/10.1007/s11914-016-0334-z.
Maret D, Telmon N, Peters OA, Lepage B, Treil J, Inglese JM, Peyre A, Kahn JL, Sixou M. Effect of voxel size on the accuracy of 3D reconstructions with cone beam CT. Dentomaxillofac Radiol. 2012. https://doi.org/10.1259/dmf/81804525.
Waarsing JH, Day JS, Van Der Linden JC, Ederveen AG, Spanjers C, De Clerck N, Sasov A, Verhaar JAN, Weinans H. Detecting and tracking local changes in the tibiae of individual rats: A novel method to analyse longitudinal in vivo micro-CT data. Bone. 2004. https://doi.org/10.1016/j.bone.2003.08.012.
Mani VRS, Arivazhagan S. Survey of Medical Image Registration. J Biomed Eng Technol. 2013;1:8–25. https://doi.org/10.1016/S1361-8415(01)80026-8.
• Oliveira FPM, Tavares JMRS. Medical image registration: A review. Comput Methods Biomech Biomed Eng. 2014.https://doi.org/10.1080/10255842.2012.670855.A comprehensive review of automated registration methodologies. Useful to provide reference for those who are looking for registration methods for a specific application.
• Thévenaz P, Ruttimann UE, Unser M. A pyramid approach to subpixel registration based on intensity. IEEE Trans Image Process. 1998. https://doi.org/10.1109/83.650848. This manuscript proposed sum of squared differences as the similarity measurement method for image registration, with the drawback of which included.
• Roche A, Malandain G, Pennec X, Ayache N. The correlation ratio as a new similarity measure for multimodal image registration. Lect Notes in Comput Sci (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). 1998.https://doi.org/10.1007/bfb0056301. A manuscript that proposed correlation ratio as a similarity method.
Viola P, Wells WM. Alignment by Maximization of Mutual Information. Int J Comput Vis. 1997.https://doi.org/10.1023/A:1007958904918. This paper is one of the first studies that performed mutual information to solve image registration problem.
• Maes F, Collignon A, Vandermeulen D, Marchal G, Suetens P. Multimodality image registration by maximization of mutual information. IEEE Trans Med Imaging. 1997. https://doi.org/10.1109/42.563664. This paper is one of the first studies that performed mutual information to solve image registration problem.
Zhang Y, Dall’Ara E, Viceconti M, Kadirkamanathan V. A new method to monitor bone geometry changes at different spatial scales in the longitudinal in vivo μCT studies of mice bones. PLoS One. 2019.https://doi.org/10.1371/journal.pone.0219404.
Brunet SC, Finzel S, Engelke K, Boyd SK, Barnabe C, Manske SL. Bone changes in early inflammatory arthritis assessed with High-Resolution peripheral Quantitative Computed Tomography (HR-pQCT): A 12-month cohort study. Joint Bone Spine. 2021. https://doi.org/10.1016/j.jbspin.2020.07.014.
van Rietbergen B, Biver E, Chevalley T, Ito K, Chapurlat R, Ferrari S. A Novel HR-pQCT Image Registration Approach Reveals Sex-Specific Changes in Cortical Bone Retraction With Aging. J Bone Miner Res. 2021. https://doi.org/10.1002/jbmr.4285.
Heilmeier U, Joseph GB, Pasco C, et al. Longitudinal Evolution of Bone Microarchitecture and Bone Strength in Type 2 Diabetic Postmenopausal Women With and Without History of Fragility Fractures—A 5-Year Follow-Up Study Using High Resolution Peripheral Quantitative Computed Tomography. Front Endocrinol (Lausanne). 2021. https://doi.org/10.3389/fendo.2021.599316.
Du J, Hartley C, Brooke-Wavell K, Paggiosi MA, Walsh JS, Li S, Silberschmidt VV. High-impact exercise stimulated localised adaptation of microarchitecture across distal tibia in postmenopausal women. Osteoporos Int. 2021. https://doi.org/10.1007/s00198-020-05714-4.
Tourolle né Betts DC, Wehrle E, Paul GR, Kuhn GA, Christen P, Hofmann S, Müller R. The association between mineralised tissue formation and the mechanical local in vivo environment: Time-lapsed quantification of a mouse defect healing model. Sci Rep. 2020.https://doi.org/10.1038/s41598-020-57461-5.
Plett RM, Kemp TD, Burt LA, Billington EO, Hanley DA, Boyd SK. Using 3D image registration to maximize the reproducibility of longitudinal bone strength assessment by HR-pQCT and finite element analysis. Osteoporos Int. 2021. https://doi.org/10.1007/s00198-021-05896-5.
Wehrle E, Tourolle né Betts DC, Kuhn GA, Scheuren AC, Hofmann S, Müller R. Evaluation of longitudinal time-lapsed in vivo micro-CT for monitoring fracture healing in mouse femur defect models. Sci Rep. 2019.https://doi.org/10.1038/s41598-019-53822-x.
Ning B, Londono I, Laporte C, Villemure I. Validation of an in vivo micro-CT-based method to quantify longitudinal bone growth of pubertal rats. Bone. 2022. https://doi.org/10.1016/j.bone.2021.116207.
• Brunet SC, Kuczynski MT, Bhatla JL, Lemay S, Pauchard Y, Salat P, Barnabe C, Manske SL. The utility of multi-stack alignment and 3D longitudinal image registration to assess bone remodeling in rheumatoid arthritis patients from second generation HR-pQCT scans. BMC Med Imaging. 2020.https://doi.org/10.1186/s12880-020-00437-8. A paper that used image registration to reduce the number of discarded scans in their longitudinal study and acknowledged that registration errors may lead to inaccuracies in the results.
Verhelst PJ, Shaheen E, de Faria VK, van der Cruyssen F, Shujaat S, Coudyzer W, Salmon B, Swennen G, Politis C, Jacobs R. Validation of a 3D cBcT-based protocol for the follow-up of mandibular condyle remodeling. Dentomaxillofac Radiol. 2020. https://doi.org/10.1259/dmfr.20190364.
Atkins PR, Stock K, Ohs N, et al. Formation Dominates Resorption With Increasing Mineralized Density and Time Postfracture in Cortical but Not Trabecular Bone: A Longitudinal HRpQCT Imaging Study in the Distal Radius. JBMR Plus. 2021. https://doi.org/10.1002/jbm4.10493.
• Chiba K, Okazaki N, Isobe Y, Miyazaki S, Yonekura A, Tomita M, Osaki M. Precision of 3D Registration Analysis for Longitudinal Study of Second-Generation HR-pQCT. J Clin Densitom. 2021;24:319–329.https://doi.org/10.1016/j.jocd.2020.10.001. A paper that discussed the imperfect registration when reporting their results and recognized possible attributes to this.
Hosseinitabatabaei S, Mikolajewicz N, Zimmermann EA, Rummler M, Steyn B, Julien C, Rauch F, Willie BM. 3D Image Registration Marginally Improves the Precision of HR-pQCT Measurements Compared to Cross-Sectional-Area Registration in Adults With Osteogenesis Imperfecta. J Bone Miner Res. 2022. https://doi.org/10.1002/jbmr.4541.
Kemp TD, de Bakker CMJ, Gabel L, Hanley DA, Billington EO, Burt LA, Boyd SK. Longitudinal bone microarchitectural changes are best detected using image registration. Osteoporos Int. 2020. https://doi.org/10.1007/s00198-020-05449-2.
Koide Y, Shimizu H, Miyauchi R, et al. Fully automated rigid image registration versus human registration in postoperative spine stereotactic body radiation therapy: a multicenter non-inferiority study. J Radiat Res. 2022. https://doi.org/10.1093/jrr/rrab113.
Bouxsein ML, Boyd SK, Christiansen BA, Guldberg RE, Jepsen KJ, Müller R. Guidelines for assessment of bone microstructure in rodents using micro-computed tomography. J Bone Miner Res. 2010. https://doi.org/10.1002/jbmr.141.
Morgan EF, Unnikrisnan GU, Hussein AI. Bone Mechanical Properties in Healthy and Diseased States. Annu Rev Biomed Eng. 2018. https://doi.org/10.1146/annurev-bioeng-062117-121139.
Goldring SR, Goldring MB. Changes in the osteochondral unit during osteoarthritis: Structure, function and cartilage bone crosstalk. Nat Rev Rheumatol. 2016. https://doi.org/10.1038/nrrheum.2016.148.
Lambers FM, Kuhn G, Schulte FA, Koch K, Müller R. Longitudinal assessment of in vivo bone dynamics in a mouse tail model of postmenopausal osteoporosis. Calcif Tissue Int. 2012. https://doi.org/10.1007/s00223-011-9553-6.
Ellouz R, Chapurlat R, van Rietbergen B, Christen P, Pialat JB, Boutroy S. Challenges in longitudinal measurements with HR-pQCT: Evaluation of a 3D registration method to improve bone microarchitecture and strength measurement reproducibility. Bone. 2014. https://doi.org/10.1016/j.bone.2014.03.001.
Qiu W, Martorella M, Zhou J, Zhao H, Fu Q. Three-dimensional inverse synthetic aperture radar imaging based on compressive sensing. IET Radar Sonar Navig. 2015. https://doi.org/10.1049/iet-rsn.2014.0260.
Razlighi QR, Kehtarnavaz N, Yousefi S. Evaluating similarity measures for brain image registration. J Vis Commun Image Represent. 2013. https://doi.org/10.1016/j.jvcir.2013.06.010.
Tian W, Qi L, Chao X, Liang J, Fu M. Periodic boundary condition and its numerical implementation algorithm for the evaluation of effective mechanical properties of the composites with complicated micro-structures. Compos B Eng. 2019. https://doi.org/10.1016/j.compositesb.2018.10.053.
Schulte FA, Lambers FM, Mueller TL, Stauber M, Müller R. Image interpolation allows accurate quantitative bone morphometry in registered micro-computed tomography scans. Comput Methods Biomech Biomed Eng. 2014. https://doi.org/10.1080/10255842.2012.699526.
Glüer CC, Blake G, Lu Y, Blunt BA, Jergas M, Genant HK. Accurate assessment of precision errors: how to measure the reproducibility of bone densitometry techniques. Osteoporos Int. 1995;5(4):262–70. https://doi.org/10.1007/BF01774016.
Mukaka MM. Statistics corner: A guide to appropriate use of correlation coefficient in medical research. Malawi Med J. 2012;24:69–71. A manuscript that provided a guide to appropriate use of main correlation coefficients in medical research, including practical use of correlation coefficient.
Schober P, Schwarte LA. Correlation coefficients: Appropriate use and interpretation. Anesth Analg. 2018. https://doi.org/10.1213/ANE.0000000000002864.
Liu S, Tu P, Xu W, Xie S, Wu W, Zhang Y, Zhou Y. Application of Kendall’s rank function for digital image correlation. Meas Sci Technol. 2019;30:045003. https://doi.org/10.1088/1361-6501/aaf2e4.
Becker K, Stauber M, Schwarz F, Beißbarth T. Automated 3D–2D registration of X-ray microcomputed tomography with histological sections for dental implants in bone using chamfer matching and simulated annealing. Comput Med Imaging Graph. 2015;44:62–8. https://doi.org/10.1016/j.compmedimag.2015.04.005.
Jönsson H, Ekström S, Strand R, Pedersen MA, Molin D, Ahlström H, Kullberg J. An image registration method for voxel-wise analysis of whole-body oncological PET-CT. Sci Rep. 2022;12:18768. https://doi.org/10.1038/s41598-022-23361-z.
Pluim JPW, Maintz JBAA, Viergever MA. Mutual-information-based registration of medical images: A survey. IEEE Trans Med Imaging. 2003. https://doi.org/10.1109/TMI.2003.815867.
Shannon CE. The Mathematical Theory of Communication. MD Comput. 1997;14:306–17.
KvÅlseth TO. Entropy and Correlation: Some Comments. IEEE Trans Syst Man Cybern. 1987. https://doi.org/10.1109/TSMC.1987.4309069.
Studholme C, Hill DLG, Hawkes DJ. An overlap invariant entropy measure of 3D medical image alignment. Pattern Recognit. 1999. https://doi.org/10.1016/S0031-3203(98)00091-0.
Evans D. A computationally efficient estimator for mutual information. Proc R Soc A: Math Phys Eng Sci. 2008. https://doi.org/10.1098/rspa.2007.0196.
Besler BA, Schadow JE, Durongbhan P, et al. Quantitative measures of bone shape, cartilage morphometry and joint alignment are associated with disease in an ACLT and MMx rat model of osteoarthritis. Bone. 2021. https://doi.org/10.1016/j.bone.2021.115903.
Durongbhan P, Silva MO, Li Z, Ansari N, Kour RYN, Davey CE, Stok KS. A microCT imaging protocol for reproducible and efficient quantitative morphometric analysis (QMA) of joint structures of the in situ mouse tibio-femoral joint. Bone. 2023;166:116606. https://doi.org/10.1016/j.bone.2022.116606.
Schulte FA. In silico bone biology in a murine model of bone adaptation. Diss., Eidgenössische Technische Hochschule ETH Zürich, Nr. 19679. 2011. https://doi.org/10.3929/ethz-a-006541344.
Acknowledgements
The work is supported by the Discovery Projects scheme of the Australian Research Council (DP180101838) and Han Liu is a recipient of a China Scholarship Council stipend.
Funding
Open Access funding enabled and organized by CAUL and its Member Institutions
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest
The authors declare no conflict of interest, financial or otherwise.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Liu, H., Durongbhan, P., Davey, C.E. et al. Image Registration in Longitudinal Bone Assessment Using Computed Tomography. Curr Osteoporos Rep 21, 372–385 (2023). https://doi.org/10.1007/s11914-023-00795-6
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11914-023-00795-6