No Access

Integration of Dynamic Multi-Atlas and Deep Learning Techniques to Improve Segmentation of the Prostate in MR Images

Hamid Moradi

Department of Biomedical Engineering, Engineering Faculty, Shahed University, Tehran, Iran

E-mail Address: h.moradi@shahed.ac.ir

Search for more papers by this author

and

Amir Hossein Foruzan

Department of Biomedical Engineering, Engineering Faculty, Shahed University, Tehran, Iran

E-mail Address: a.foruzan@shahed.ac.ir

Corresponding author.

Search for more papers by this author

https://doi.org/10.1142/S0219467822500310Cited by:0 (Source: Crossref)

Abstract

Accurate delineation of the prostate in MR images is an essential step for treatment planning and volume estimation of the organ. Prostate segmentation is a challenging task due to its variable size and shape. Moreover, neighboring tissues have a low-contrast with the prostate. We propose a robust and precise automatic algorithm to define the prostate’s boundaries in MR images in this paper. First, we find the prostate’s ROI by a deep neural network and decrease the input image’s size. Next, a dynamic multi-atlas-based approach obtains the initial segmentation of the prostate. A watershed algorithm improves the initial segmentation at the next stage. Finally, an SSM algorithm keeps the result in the domain of allowable prostate shapes. The quantitative evaluation of 74 prostate volumes demonstrated that the proposed method yields a mean Dice coefficient of $0.83 \pm 0.05$ $0.83 \pm 0.05$ . In comparison with recent researches, our algorithm is robust against shape and size variations.

Keywords:

Remember to check out the Check out our Most Cited Articles!
Check out these titles on Image Analysis

References

1. P. A. Humphrey , Prostate Pathology (American Society for Clinical Pathology, Chicago, 2003). Google Scholar
2. J. Ferlay, M. Colombet, I. Soerjomataram, C. Mathers, D. M. Parkin, M. Piñeros, A. Znaor and F. Bray , “Estimating the global cancer incidence and mortality in 2018: GLOBOCAN sources and methods,” Int. J. Cancer 144(8), 1941–1953 (2019). Crossref, Web of Science, Google Scholar
3. F. H. Martini , Fundamentals of Anatomy & Physiology, 7th edn. (Pearson Education, 2006). Google Scholar
4. U. L. Stephansen, “Level-set appearance modeling for segmentation of anatomical structures in 3-d medical images,” Aalborg University (2012), pp. 5–13. Google Scholar
5. D. P. Huyskens, P. Maingon, L. Vanuytsel, V. Remouchamps, T. Roques, B. Dubray, B. Haas, P. Kunz, T. Coradi, R. Bühlman and R. Reddick , “A qualitative and a quantitative analysis of an auto-segmentation module for prostate cancer,” Radiother. Oncol. 90(3), 337–345 (2009). Crossref, Web of Science, Google Scholar
6. C. G. Roehrborn, P. Boyle, D. Bergner, T. Gray, M. Gittelman, T. Shown, A. Melman, R. B. Bracken, R. D. White, A. Taylor and D. Wang , “Serum prostate-specific antigen and prostate volume predict long-term changes in symptoms and flow rate: Results of a four-year, randomized trial comparing finasteride versus placebo,” Urology 54(4), 662–669 (1999). Crossref, Web of Science, Google Scholar
7. G. Litjens, R. Toth, W. van de Ven, C. Hoeks, S. Kerkstra, B. van Ginneken, G. Vincent, G. Guillard, N. Birbeck, J. Zhang and R. Strand , “Evaluation of prostate segmentation algorithms for MRI: The PROMISE12 challenge,” Med. Image Anal. 18(2), 359–373 (2014). Crossref, Web of Science, Google Scholar
8. S. Ghose, J. Mitra, A. Oliver, R. Marti, X. Lladó, J. Freixenet, J. C. Vilanova, D. Sidibé and F. Meriaudeau , “A random forest based classification approach to prostate segmentation in MRI,” in MICCAI Grand Challenge: Prostate MR Image Segmentation (Nice, France, 2012), pp. 125–128. Google Scholar
9. S. Ghose, A. Oliver, R. Martí, X. Lladó, J. C. Vilanova, J. Freixenet, J. Mitra, D. Sidibé and F. Meriaudeau , “A survey of prostate segmentation methodologies in ultrasound, magnetic resonance and computed tomography images,” Comput. Methods Programs Biomed. 108(1), 262–287 (2012). Crossref, Web of Science, Google Scholar
10. N. Bloch, A. Madabhushi, H. Huisman, J. Freymann, J. Kirby, M. Grauer, A. Enquobahrie, C. Jaffe, L. Clarke and K. Farahani, NCI-ISBI 2013 challenge: Automated segmentation of prostate structures. The Cancer Imaging Archive, 2015. Available at https://wiki.cancerimagingarchive.net/display/Public/NCI-ISBI+2013+Challenge+-+Automated+Segmentation+of+Prostate+Structures (accessed on 12 July 2021). Google Scholar
11. Y. Guo, Y. Gao and D. Shen , “Deformable MR prostate segmentation via deep feature learning and sparse patch matching,” IEEE Trans. Med. Imaging 35(4), 1077–1089 (2015). Crossref, Web of Science, Google Scholar
12. A. S. Nelson, J. Brockway, M. Lu, A. Javorek, S. Pirozzi and J. W. Piper , “Evaluation of an atlas-based segmentation method for prostate MRI,” Int. J. Radiat. Oncol. Biol. Phys. 90(1), S419–S420 (2014). Crossref, Web of Science, Google Scholar
13. D. Karimi, G. Samei, C. Kesch, G. Nir and S. E. Salcudean , “Prostate segmentation in MRI using a convolutional neural network architecture and training strategy based on statistical shape models,” Int. J. Comput. Assist. Radiol. Surg. 13(8), 1211–1219 (2018). Crossref, Web of Science, Google Scholar
14. Y. Zhang, J. Wu, W. Chen, Y. Chen and X. Tang, Prostate Segmentation Using Z-NET, arXiv:1901.06115v1. Google Scholar
15. N. Aldoj, F. Biavati, M. Rutz, F. Michallek, S. Stober and M. Dewey , “Automatic prostate and prostate zones segmentation of magnetic resonance images using convolutional neural networks,” Sci. Rep. 10, 14315 (2019). Crossref, Web of Science, Google Scholar
16. L. Yu, X. Yang, H. Chen, J. Qin and P. A. Heng , “Volumetric ConvNets with mixed residual connections for automated prostate segmentation from 3d mr images,” 31st AAAI Conf. Artificial Intelligence (San Francisco, California, USA, 2007), pp. 66–72. Google Scholar
17. R. Cheng, R. H. Roth, N. S. Lay, L. Lu, B. Turkbey, W. Gandler, E. S. McCreedy, T. J. Pohida, P. A. Pinto, P. L. Choyke and M. J. McAuliffe , “Automatic magnetic resonance prostate segmentation by deep learning with holistically nested networks,” J. Med. Imaging 4(4), 041302 (2017). Crossref, Web of Science, Google Scholar
18. Y. Zhu, R. Wei, G. Gao, L. Ding, X. Zhang, X. Wang and J. Zhang , “Fully automatic segmentation on prostate MR images based on cascaded fully convolution network,” J.Magn. Reson. Imaging 49(4), 1149–1156 (2019). Crossref, Web of Science, Google Scholar
19. G. Bredell, C. Tanner and E. Konukoglu , “Iterative interaction training for segmentation editing networks,” in Int. Workshop Machine Learning in Medical Imaging (Springer, Cham, 2018). Crossref, Google Scholar
20. G. Vincent, G. Guillard and M. Bowes , “Fully automatic segmentation of the prostate using active appearance models,” in MICCAI Grand Challenge: Prostate MR Image Segmentation, Vol. 2012 (2012) (Manchester 2012). Google Scholar
21. M. Kirschner, F. Jung and S. Wesarg , “Automatic prostate segmentation in MR images with a probabilistic active shape model,” in MICCAI Grand Challenge: Prostate MR Image Segmentation (2012). Google Scholar
22. B. Maan and F. van der Heijden , “Prostate MR image segmentation using 3D active appearance models,” in MICCAI Grand Challenge: Prostate MR Image Segmentation (2012). Google Scholar
23. T. F. Cootes, G. J. Edwards and C. J. Taylor , “Active appearance models,” in Euro Conf. Computer Vision (Springer, Berlin, Heidelberg, 1998). Crossref, Google Scholar
24. F. Mesadi, M. Cetin and T. Tasdizen , “Disjunctive normal shape and appearance priors with applications to image segmentation,” in Int. Conf.Medical Image Computing and Computer-Assisted Intervention (Springer, Cham, 2015). Crossref, Google Scholar
25. N. Makni, P. Puech, R. Lopes, A. S. Dewalle, O. Colot and N. Betrouni , “Combining a deformable model and a probabilistic framework for an automatic 3D segmentation of prostate on MRI,” Int. J. Comput. Assist. Radiol. Surg. 4(2), 181 (2009). Crossref, Web of Science, Google Scholar
26. G. Litjens, N. Karssemeijer and H. Huisman , “A multi-atlas approach for prostate segmentation in MR images,” MICCAI Grand Challenge: Prostate MR Image Segmentation 2012, (2012). Google Scholar
27. D. Stojanov and S. Koceski , “Topological MRI prostate segmentation method,” in 2014 Federated Conf. Computer Science and Information Systems (IEEE, 2014). Crossref, Google Scholar
28. H. Moradi, A. H. Foruzan and Y. W. Chen , “Automatic segmentation of prostate in MR images using deep learning and multi-atlas techniques,” in 2018 25th National and 3rd Int. Iranian Conf. Biomedical Engineering (ICBME) (2018), pp. 1–4. Crossref, Google Scholar
29. Livestrong (2003), https://www.livestrong.com/article/339359-normal-prostate-weight. Google Scholar
30. C. Dong, Y. W. Chen, A. H. Foruzan, L. Lin, X. H. Han, T. Tateyama, X. Wu, G. Xu and H. Jiang , “Segmentation of liver and spleen based on computational anatomy models,” Comput. Biol. Med. 67, 146–160 (2015). Crossref, Web of Science, Google Scholar
31. M. Delavari, A. H. Foruzan and Y. W. Chen , “Accurate point correspondences using a modified coherent point drift algorithm,” Biomed. Signal Process. Control 52, 429–444 (2019). Crossref, Web of Science, Google Scholar