No Access

CALCIFICATION CLUSTERS AND LESIONS ANALYSIS IN MAMMOGRAM USING MULTI-ARCHITECTURE DEEP LEARNING ALGORITHMS

Hao-Hung Tsai

Department of Medical Imaging, Chung Shan Medical University Hospital, Taichung, Taiwan, ROC

Department of Medical Imaging in School of Medicine, Chung Shan, Medical University, Taichung, Taiwan, ROC

Department of Medical Imaging and Radiological Sciences, Chung Shan Medical University, Taichung, Taiwan, ROC

Search for more papers by this author

Chia-Shin Wei

Department of Medical Informatics, Chung Shan Medical University, Taichung, Taiwan, ROC

Search for more papers by this author

Ya-Chu Hsieh

Department of Medical Informatics, Chung Shan Medical University, Taichung, Taiwan, ROC

Search for more papers by this author

I-Miao Chen

Department of Medical Informatics, Chung Shan Medical University, Taichung, Taiwan, ROC

Search for more papers by this author

Pin-Yu Yeh

Department of Medical Informatics, Chung Shan Medical University, Taichung, Taiwan, ROC

Search for more papers by this author

Darren Shih

Morrison Academy Taichung, Taichung, Taiwan, ROC

Search for more papers by this author

, and

Chiun-Li Chin

Department of Medical Informatics, Chung Shan Medical University, Taichung, Taiwan, ROC

E-mail Address: ernestli@csmu.edu.tw

Corresponding author.

Search for more papers by this author

https://doi.org/10.4015/S1016237222500223Cited by:1 (Source: Crossref)

Abstract

Today, radiologists observe a mammogram to determine whether breast tissue is normal. However, calcifications on the mammogram are so small that sometimes radiologists cannot locate them without a magnified observation to make a judgment. If clusters formed by malignant calcifications are found, the patient should undergo a needle localization surgical biopsy to determine whether the calcification cluster is benign or malignant. However, a needle localization surgical biopsy is an invasive examination. This invasive examination leaves scars, causes pain, and makes the patient feel uncomfortable and unwilling to receive an immediate biopsy, resulting in a delay in treatment time. The researcher cooperated with a medical radiologist to analyze calcification clusters and lesions, employing a mammogram using a multi-architecture deep learning algorithm to solve these problems. The features of the location of the cluster and its benign or malignant status are collected from the needle localization surgical biopsy images and medical order and are used as the target training data in this study. This study adopts the steps of a radiologist examination. First, VGG16 is used to locate calcification clusters on the mammogram, and then the Mask R-CNN model is used to find micro-calcifications in the cluster to remove background interference. Finally, an Inception V3 model is used to analyze whether the calcification cluster is benign or malignant. The prediction precision rates of VGG16, Mask R-CNN, and Inception V3 in this study are 93.63%, 99.76%, and 88.89%, respectively, proving that they can effectively assist radiologists and help patients avoid undergoing a needle localization surgical biopsy.

Keywords:

References

1. Waks AG, Winer EP , Breast cancer diagnosis: A review, JAMA Network 321(3) :288, 2019. Google Scholar
2. Baker R, Rogers KD, Shepherd N, Stone N , New relationships between breast microcalcifications and cancer, Br J Cancer 103(7) :1034–1039, 2010. Crossref, Web of Science, Google Scholar
3. Melekoodappattu JG, Subbian PS , A hybridized ELM for automatic micro calcification detection in mammogram images based on multi-scale features, J Med Syst 43(7) :1–12, 2019. Crossref, Web of Science, Google Scholar
4. O’Grady S, Morgan MP , Microcalcifications in breast cancer: From pathophysiology to diagnosis and prognosis, Biochimica et Biophysica Acta (BBA)-Rev Cancer 1869(2) :310–320, 2018. Crossref, Web of Science, Google Scholar
5. Wang J, Yang X, Cai H, Tan W, Jin C, Li L , Discrimination of breast cancer with microcalcifications on mammography by deep learning, Sci Rep 6(1) :1–9, 2016. Google Scholar
6. Lee KS, Kim JY, Jeon ET, Choi WS, Kim NH, Lee KY , Evaluation of scalability and degree of fine-tuning of deep convolutional neural networks for COVID-19 screening on chest X-ray images using explainable deep-learning algorithm, Natl Lib Med 10(4) :213, 2020. Google Scholar
7. Simonyan K, Zisserman A, Very Deep Convolutional Networks for Large-Scale Image Recognition, Cornell University, arXiv:1409.1556, 2014. Google Scholar
8. Sukegawa S, Yoshii K, Hara T, Yamashita K, Nakano K, Yamamoto N, Nagatsuka H, Furuki Y , Deep neural networks for dental implant system classification, Biomolecules 10(7) :984, 2020. Crossref, Web of Science, Google Scholar
9. Nkwentsha X, Hounkanrin A, Nicolls F , Automatic classification of medical X-ray images with convolutional neural networks, 2020 Int SAUPEC/RobMech/PRASA Conf, pp. 1–4, 2020. Crossref, Google Scholar
10. Szegedy C, Vincent V, Sergey L, Jonathon S, Zbigniew W , Rethinking the inception architecture for computer vision, Proc IEEE Comput Soc Conf Comput Vis Pattern Recognit, pp. 2818–2826, 2016. Crossref, Google Scholar
11. Li J, Wang P, Li Y, Zhao Y, Liu X, Luan K , Transfer learning of pre-trained Inceptionv3 model for colorectal cancer lymph node metastasis classification, Proc IEEE Conf Mechatronics and Automation, pp. 1650–1654, 2018. Google Scholar
12. Guan Q, Wang Y, Ping B, Li D, Du J, Qin Y, Lu H, Wan X, Xiang J , Deep convolutional neural network VGG-16 model for differential diagnosing of papillary thyroid carcinomas in cytological images: A pilot study, J Cancer 10(20) :4876–4882, 2019. Crossref, Web of Science, Google Scholar
13. He K, Gkioxari G, Dollár P, Girshick R , Mask R-CNN, Proc IEEE Comput Soc Conf Comput Vis, pp. 2961–2969, 2017. Crossref, Google Scholar
14. Shu JH, Nian FD, Yu MH, Li X , An improved mask R-CNN model for multiorgan segmentation, Math Problems Eng 2020 :8351725, 2020. Crossref, Web of Science, Google Scholar
15. Wessel J, Heinrich MP, Berg JV, Franz A, Saalbach A , Sequential rib labeling and segmentation in chest X-Ray using mask R-CNN, Image Video Process 1908 :08329, 2019. Google Scholar
16. Liu M, Dong J, Dong X, Yu H, Qi L , Segmentation of lung nodule in CT images based on Mask R-CNN, 2018 9th Int Conf Awareness Science And Technology (iCAST), pp. 1–6, 2018. Crossref, Google Scholar
17. Hu Q, de F., Souza LF, Holanda GB, Alves SSA, Dos S, Silva FH, Han T, Rebouças Filho PP , An effective approach for CT lung segmentation using mask region-based convolutional neural networks, Artif Intell Med 103 :101792, 2020. Crossref, Web of Science, Google Scholar
18. Salazar-Licea LA, Mendoza C, Aceves MA, Pedraza JC , Automatic segmentation of mammograms using a scale-invariant feature transform and K-means clustering algorithm, 2014 11th Int Conf Electrical Engineering, Computing Science and Automatic Control (CCE), pp. 1–6, 2014. Crossref, Google Scholar
19. Ribli D, Horváth A, Unger Z, Pollner P, Csabai I , Detecting and classifying lesions in mammograms with deep learning, Sci Rep 8 :4165, 2018. Crossref, Web of Science, Google Scholar
20. Cai H, Huang Q, Rong W, Song Y, Li J, Wang J, Chen J, Li L , Breast Microcalcification diagnosis using deep convolutional neural network from digital mammograms, Comput Math Methods Med 2019 :2717454, 2019. Crossref, Web of Science, Google Scholar
21. Alqudah AM, Algharib HM, Algharib AM, Algharib HM , Computer aided diagnosis system for automatic two stages classification of breast mass in digital mammogram images, Biomed Eng, Appl Basis Commun 31(1) :1950007, 2019. Link, Web of Science, Google Scholar
22. Min H, Wilson D, Huang Y, Kelly S, Crozier S, Bradley A, Chandra S , Fully automatic computer-aided mass detection and segmentation via pseudo-color mammograms and Mask R-CNN, 2020 IEEE 17th Int Symp Biomedical Imaging (ISBI), pp. 1111–1115, 2020. Crossref, Google Scholar
23. VGG image annotator (VIA), Available at http://www.robots.ox.ac.uk/˜/software/via/, 2016. Google Scholar
24. Lin TY, Dollar P, Girshick R, He K, Hariharan B, Belongie S , Feature pyramid networks for object detection, 2017 IEEE Conf Computer Vision and Pattern Recognition (CVPR), pp. 936–944, 2017. Crossref, Google Scholar
25. Ren S, He K, Girshick R, Sun J , Faster R-CNN: Towards real-time object detection with region proposal networks. In NIPS, IEEE Trans Pattern Analysis and Machine Intelligence, pp. 91–99, 2015. Google Scholar