access icon free Multimodal image registration based on the expectation–maximisation methodology

© The Institution of Engineering and Technology
Received 04/03/2017, Accepted 20/08/2017, Revised 11/07/2017, Published 22/08/2017

In this study, a new framework for multimodal image registration is proposed based on the expectation–maximisation (EM) methodology. This framework allows to address simultaneously parametric and elastic registrations independently on the modality of the target and source images without making any assumptions about their intensity relationship. The EM formulation for the image registration problem leads to a regularised quadratic optimisation scheme to compute the displacement vector field (DVF) that aligns the images and depends on their joint intensity distribution. At the first stage, a parametric transformation is assumed for the DVF, where the resulting quadratic optimisation is computed recursively to calculate its optimal parameters. Next, a general unknown deformation models the elastic part of the DVF, which is represented by an additive structure. The resulting optimisation process by the EM formulation results in a cost function that involves data and regularisation terms, which is also solved recursively. A comprehensive evaluation of the parametric and elastic proposals is carried out by comparing to state-of-the-art algorithms and images from different application fields, where an advantage is visualised by the authors’ proposal in terms of a compromise between accuracy and robustness.

Inspec keywords: expectation-maximisation algorithm; image registration; quadratic programming; recursive estimation

Other keywords: EM methodology; displacement vector field; expectation–maximisation methodology; parametric transformation; quadratic optimisation scheme; target image; joint intensity distribution; general unknown deformation model; cost function; source image; multimodal image registration; optimal parameter calculation; elastic registration; DVF; additive structure; parametric registration

Subjects: Other topics in statistics; Optimisation techniques; Optical, image and video signal processing; Computer vision and image processing techniques; Other topics in statistics; Optimisation techniques

References

    1. 1)
      • 24. Gatta, C., Pujol, O., Leor, O., et al: ‘Fast rigid registration of vascular structures in IVUS sequences’, IEEE Trans. Inf. Technol. Biomed., 2009, 13, (6), pp. 1006–1011.
    2. 2)
      • 13. Ma, J., Zhao, J., Ma, Y., et al: ‘Non-rigid visible and infrared face registration via regularized Gaussian fields criterion’, Pattern Recognit., 2015, 48, (3), pp. 772–784.
    3. 3)
      • 5. Hahn, D., Daum, V., Hornegger, J.: ‘Automatic parameter selection for multimodal image registration’, IEEE Trans. Med. Imaging, 2010, 29, (5), pp. 1140–1155.
    4. 4)
      • 8. Araki, T., Ikeda, N., Dey, N., et al: ‘A comparative approach of four different image registration techniques for quantitative assessment of coronary artery calcium lesions using intravascular ultrasound’, Comput. Methods Programs Biomed., 2015, 118, (2), pp. 158–172.
    5. 5)
      • 27. Vercauteren, T., Pennec, X., Perchant, A., et al: ‘Diffeomorphic demons: efficient non-parametric image registration’, NeuroImage, 2009, 45, (1, Supplement 1), pp. S61–S72.
    6. 6)
      • 3. Sotiras, A., Davatzikos, C., Paragios, N.: ‘Deformable medical image registration: a survey’, IEEE Trans. Med. Imaging, 2013, 32, (7), pp. 1153–1190.
    7. 7)
      • 11. Gong, M., Zhao, S., Jiao, L., et al: ‘A novel coarse-to-fine scheme for automatic image registration based on SIFT and mutual information’, IEEE Trans. Geosci. Remote Sens., 2014, 52, (7), pp. 4328–4338.
    8. 8)
      • 28. Rivaz, H., Zahra, K., Louis Collins, D.: ‘Self-similarity weighted mutual information: a new nonrigid image registration metric’, Med. Image Anal., 2014, 18, (2), pp. 343–358.
    9. 9)
      • 33. Metz, C., Klein, S., Schaap, M., et al: ‘Nonrigid registration of dynamic medical imaging data using nd+t b-splines and a groupwise optimization approach’, Med. Image Anal., 2011, 15, (2), pp. 238–249.
    10. 10)
      • 2. Zitova, B., Flusser, J.: ‘Image registration methods: a survey’, Image Vis. Comput., 2003, 21, (11), pp. 977–1000.
    11. 11)
      • 7. Broggi, S., Scalco, E., Belli, M., et al: ‘A comparative evaluation of 3 different free-from defornable image registration and contour propagation method for head and neck MRI: the case of parotid changes during radiotherapy’, Technol. Cancer Res. Treat., 2017, 16, (3), pp. 373–381.
    12. 12)
      • 12. Zosso, D., Bresson, X., Thiran, J.: ‘Geodesic active fields – a geometric framework for image registration’, IEEE Trans. Image Process., 2011, 20, (5), pp. 1300–1312.
    13. 13)
      • 21. Arce-Santana, E., Campos-Delgado, D., Alba, A.: ‘Affine image registration guided by particle filter’, IET Image Process., 2012, 6, (5), pp. 455–462.
    14. 14)
      • 14. Arce-Santana, E., Campos-Delgado, D., Alba, A.: ‘A non-rigid multimodal image registration method based on particle filter and optical flow’, Lect. Notes Comput. Sci., Adv. Vis. Comput., 2010, 6453, pp. 35–44.
    15. 15)
      • 18. Woo, J., Stone, M., Prince, J.L.: ‘Multimodal registration via mutual information incorporating geometric and spatial context’, IEEE Trans. Image Process., 2015, 24, (2), pp. 757–769.
    16. 16)
      • 26. Zhuang, X., Arridge, S., Hawkes, D., et al: ‘A nonrigid registration framework using spatially encoded mutual information and free-form deformations’, IEEE Trans. Med. Imaging, 2011, 30, (10), pp. 1819–1828.
    17. 17)
      • 20. Wong, A.: ‘An adaptive Monte Carlo approach to phase-based multimodal image registration’, IEEE Trans. Inf. Technol. Biomed., 2010, 14, (1), pp. 173–179.
    18. 18)
      • 25. Chun, S.Y., Fessler, J.: ‘A simple regularizer for b-spline nonrigid image registration that encourages local invertibility’, IEEE J. Sel. Top. Signal Process., 2009, 3, (1), pp. 159–169.
    19. 19)
      • 10. Uss, M.L., Vozel, B., Lukin, V., et al: ‘Multimodal remote sensing image registration with accuracy estimation at local and global scales’, IEEE Trans. Geosci. Remote Sens., 2016, 54, (11), pp. 6587–6605.
    20. 20)
      • 29. Arce-Santana, E., Campos-Delgado, D.U., Vigueras-Gomez, F., et al: ‘Non-rigid multimodal image registration based on the expectation–maximization algorithm’, Lect. Notes Comput. Sci., Image Video Technol., 2014, 8333, pp. 36–47.
    21. 21)
      • 32. Faggiano, E., Cattaneo, G., Ciavarro, C., et al: ‘Validation of an elastic registration technique to estimate anatomical lung modification in non-small-cell lung cancer tomotherapy’, Radiat. Oncol., 2011, 6, (1), pp. 31–40.
    22. 22)
      • 31. Periaswamy, S.: ‘Medical image registration with partial data’, Med. Image Anal., 2006, 10, (3), pp. 452–464.
    23. 23)
      • 6. Rueckert, D., Aljabar, P.: ‘Nonrigid registration of medical images: theory, methods, and applications’, IEEE Signal Process. Mag., 2010, 27, (4), pp. 113–119.
    24. 24)
      • 1. Spiclin, Z., Likar, B., Pernus, F.: ‘Groupwise registration of multimodal images by an efficient joint entropy minimization scheme’, IEEE Trans. Image Process., 2012, 21, (5), pp. 2546–2558.
    25. 25)
      • 23. Serifović-Trbalić, A., Demirović, D., Prljaća, N., et al: ‘Intensity-based elastic registration incorporating anisotropic landmark errors and rotational information’, Int. J. Comput. Assist. Radiol. Surg., 2009, 4, (5), pp. 463–468.
    26. 26)
      • 4. Oliveira, F.P.M., Tavares, J.M.R.S.: ‘Medical image registration: a review’, Comput. Methods Biomech. Biomed. Eng., 2014, 17, (2), pp. 73–93.
    27. 27)
      • 30. Styner, M., Brechbuhler, C., Szckely, G., et al: ‘Parametric estimate of intensity inhomogeneities applied to MRI’, IEEE Trans. Med. Imaging, 2000, 19, (3), pp. 153–165.
    28. 28)
      • 19. Wachowiak, M., Smolikova, R., Zheng, Y., et al: ‘An approach to multimodal biomedical image registration utilizing particle swarm optimization’, IEEE Trans. Evol. Comput., 2004, 8, (3), pp. 289–301.
    29. 29)
      • 17. Chiang, M.-C., Leow, A., Klunder, A., et al: ‘Fluid registration of diffusion tensor images using information theory’, IEEE Trans. Med. Imaging, 2008, 27, (4), pp. 442–456.
    30. 30)
      • 34. Cocosco, C.A., Kollokian, V., Kwan, R.K.S., et al: ‘Online interface to a 3D MRI simulated brain database’, NeuroImage, 1997, 5, (4), p. S425.
    31. 31)
      • 15. Narayanan, R., Fessler, J., Park, H., et al: ‘Diffeomorphic nonlinear transformations: a local parametric approach for image registration’, Lect. Notes Comput. Sci., Inf. Process. Med. Imaging, 2005, 3565, pp. 174–185.
    32. 32)
      • 22. Yang, X., Xue, Z., Liu, X., et al: ‘Topology preservation evaluation of compact-support radial basis functions for image registration’, Pattern Recognit. Lett., 2011, 32, (8), pp. 1162–1177.
    33. 33)
      • 16. Reducindo, I., Mejia-Rodriguez, A.R., Arce-Santana, E.R., et al: ‘Multimodal non-rigid registration methods based on local variability measures in computed tomography and magnetic resonance brain images’, IET Image Process., 2014, 8, (12), pp. 699–707.
    34. 34)
      • 9. Jiang, D., Shi, Y., Chen, X., et al: ‘Fast and robust multimodal image registration using a local derivative pattern’, Med. Phys., 2017, 44, (2), pp. 497–509.
http://iet.metastore.ingenta.com/content/journals/10.1049/iet-ipr.2017.0234
Loading

Related content

content/journals/10.1049/iet-ipr.2017.0234
pub_keyword,iet_inspecKeyword,pub_concept
6
6
Loading