No Access

Department of Computer Science and Engineering, Sathyabama Institute of Science and Technology, Chennai 600119, Tamil Nadu, India

and

M. S. Godwin Premi

Department of Electronics and Communication Engineering, Sathyabama Institute of Science and Technology, Chennai 600119, Tamil Nadu, India

E-mail Address: msgodwinpremi@gmail.com

Corresponding author.

Search for more papers by this author

https://doi.org/10.1142/S1469026823410067Cited by:7 (Source: Crossref)

This article is part of the issue:

Special Issue on Smart Fuzzy Optimization for Decision-Making in Uncertain Environments
Guest Editors: Er Meng Joo, Danilo Pelusi and Shiping Wen

Abstract

Multi-modality medical image fusion (MMIF) methods were widely used in a variety of clinical settings. For specialists, MMIF could provide an image containing anatomical and physiological information that can help develop diagnostic procedures. Different models linked to MMIF were proposed previously. However, there would be a need to enhance the functionality of prior methodologies. In this proposed model, a unique fusion model depending upon optimal thresholding and deep learning approaches are presented. An enhanced monarch butterfly optimization (EMBO) determines an optimal threshold with fusion rules as in shearlet transform. The efficiency of the fusion process mainly depends on the fusion rule and the optimization of the fusion rule can improve the efficiency of the fusion. The extraction element of the deep learning approach was then utilized to fuse high- and low-frequency sub-bands. The fusion technique was carried out using a convolutional neural network (CNN). The studies were carried out for MRI and CT images. The fusion results were attained and the proposed model was proved to offer effective performance with reduced values of error and improved values of correlation.

Keywords:

Remember to check out the Most Cited Articles!
Check out these titles in artificial intelligence!

References

1. R. Behzad and M. Saadatmand-Tarzjan, A new algorithm for multimodal medical image fusion based on the surfacelet transform, 2017 7th Int. Conf. Computer and Knowledge Engineering (ICCKE, 2017). Google Scholar
2. R. Gharbia et al., Multispectral and panchromatic image fusion approach using stationary wavelet transform and swarm flower pollination optimization for remote sensing applications, Future Gener. Comput. Syst. 88 (2018) 501–511. Crossref, Google Scholar
3. M. Elhoseny and K. Shankar, Optimal bilateral filter and convolutional neural network based denoising method of medical image measurements, Measurement 143 (2019) 125–135. Crossref, Google Scholar
4. K. Shankar et al., An efficient optimal key based chaos function for medical image security, IEEE Access 6 (2018) 77145–77154. Crossref, Google Scholar
5. S. K. Lakshmanaprabu et al., Optimal deep learning model for classification of lung cancer on CT images, Future Gener. Comput. Syst. 92 (2019) 374–382. Crossref, Google Scholar
6. A. P. James and B. V. Dasarathy, Medical image fusion: A survey of the state of the art, Inf. Fus. 19 (2014) 4–19. Crossref, Google Scholar
7. P. Ganasala and A. D. Prasad, Medical image fusion based on Frei-Chen masks in NSST domain, 2018 5th Int. Conf. Signal Processing And Integrated Networks (SPIN, 2018). Crossref, Google Scholar
8. M. B. Abdulkareem, Design and development of multimodal medical image fusion using discrete wavelet transform, 2018 Second Int. Conf. Inventive Communication And Computational Technologies (ICICCT, 2018), 20–21 April 2018, Coimbatore, India. Google Scholar
9. W. Jiang et al., Medical images fusion by using weighted least squares filter and sparse representation, Comput. Electr. Eng. 67 (2018) 252–266. Crossref, Google Scholar
10. W. Li et al., Multimodal medical image fusion by cloud model theory, Signal Image Video Process. 12(3) (2017) 437–444. Crossref, Google Scholar
11. Z. Guo et al., Medical image segmentation based on multi-modal convolutional neural network: Study on image fusion schemes, 2018 IEEE 15th Int. Symp. On Biomedical Imaging (ISBI, 2018), 4–7 April 2018, Washington DC. Crossref, Google Scholar
12. X. Liu et al., Image fusion based on shearlet transform and regional features, AEU – Int. J. Electron. Commun. 68(6) (2014) 471–477. Crossref, Google Scholar
13. P. Ganasala and V. Kumar, Feature-motivated simplified adaptive PCNN-based medical image fusion algorithm in NSST domain, J. Digit. Imag. 29(1) (2015) 73–85. Crossref, Google Scholar
14. H. Hermessi et al., Convolutional neural network-based multimodal image fusion via similarity learning in the shearlet domain, Neural Comput. Appl. 30(7) (2018) 2029–2045. Crossref, Google Scholar
15. M. Chen et al., Image decomposition and denoising based on shearlet and nonlocal data fidelity term, Signal Image Video Process. 12(7) (2018) 1411–1418. Crossref, Google Scholar
16. W. Wu et al., Visible and infrared image fusion using NSST and deep Boltzmann machine, Optik 157 (2018) 334–342. Crossref, Google Scholar
17. V. Murugan et al., Multimodality image fusion using centre-based genetic algorithm and fuzzy logic, Int. J. Biomed. Eng. Technol. 28(4) (2018) 322. Crossref, Google Scholar
18. V. S. Parvathy and S. Pothiraj, Multi-modality medical image fusion using hybridization of binary crow search optimization, Health Care Manag. Sci. 23(4) (2019) 661–669. Crossref, Google Scholar
19. C. B. Du et al., Multi-focus image fusion using deep support value convolutional neural network, Optik 176 (2019) 567–578. Crossref, Google Scholar
20. P.-H. Dinh, A novel approach based on Grasshopper optimization algorithm for medical image fusion, Expert Syst. Appl. 171 (2021) 114576. Crossref, Google Scholar
21. W.-Q. Lim, The discrete shearlet transform: A new directional transform and compactly supported shearlet frames, IEEE Trans. Image Process. 19(5) (2010) 1166–1180. Crossref, Google Scholar
22. G.-G. Wang et al., A new monarch butterfly optimization with an improved crossover operator, Oper. Res. 18(3) (2016) 731–755. Crossref, Google Scholar
23. L. Ning et al., LCD: A fast contrastive divergence based algorithm for restricted Boltzmann machine, 2017 IEEE Int. Conf. Data Mining (ICDM), 2017. Crossref, Google Scholar
24. M. C. Reginald et al., FUSIONET: A hybrid model towards image classification, Int. J. Comput. Intell. Appl. 20(4) (2021) 2150021. Link, Google Scholar