Deep Learning Approach for Cardiac MRI Images
Subject Areas : Image Processing
Afshin Sandooghdar
1
,
Farzin Yaghmaee
2
*
1 - Electrical and Computer Engineering Department, Semnan University, Semnan, Iran
2 - Electrical and Computer Engineering Department, Semnan University, Semnan, Iran
Keywords: Deep Learning, Neural Networks, Magnetic Resonance Imaging (MRI), Disease Prediction.,
Abstract :
Deep Learning (DL) is the most widely used image-analysis process, especially in medical image processing. Though DL has entered image processing to solve Machine Learning (ML) problems, identifying the most suitable model based on evaluation of the epochs is still an open question for scholars in the field. There are so many types of function approximators like Decision Tree, Gaussian Processes and Deep Learning, used in multi-layered Neural Networks (NNs), which should be evaluated to determine their effectiveness. Therefore, this study aimed to assess an approach based on DL techniques for modern medical imaging methods according to Magnetic Resonance Imaging (MRI) segmentation. To do so, an experiment with a random sampling approach was conducted. One hundred patient cases were used in this study for training, validation, and testing. The method used in this study was based on full automatic processing of segmentation and disease classification based on MRI images. U-Net structure was used for the segmentation process, with the use of cardiac Right Ventricular Cavity (RVC), Left Ventricular Cavity (LVC), Left Ventricular Myocardium (LVM), and information extracted from the segmentation step. With train and using random forest classifier, and Multilayer Perceptron (MLP), the task of predicting the pathologic target class was conducted. Segmentation extracted information was in the form of comprehensive features handcrafted to reflect demonstrative clinical strategies. Our study suggests 92% test accuracy for cardiac MRI image segmentation and classification. As for the MLP ensemble, and for the random forest, test accuracy was equal to 91% and 90%, respectively. This study has implications for scholars in the field of medical image processing.
[1]“Automated Cardiac Diagnosis Challenge.” https://www.who.int/news-room/fact-sheets/detail/cardiovascular-diseases-(cvds).
[2]C. Chen et al., “Deep learning for cardiac image segmentation: A review,” arXiv, 2019, doi: 10.3389/fcvm.2020.00025.
[3]M. H. Hesamian, W. Jia, X. He, and P. Kennedy, “Deep Learning Techniques for Medical Image Segmentation: Achievements and Challenges,” J. Digit. Imaging, vol. 32, no. 4, pp. 582–596, 2019, doi: 10.1007/s10278-019-00227-x.
[4] M. Samieiyeganeh, R. W. B. O. K. Rahmat, F. B. Khalid, and K. A. Bin Kasmiran, “An overview of deep learning techniques in echocardiography image segmentation,” Journal of Theoretical and Applied Information Technology, vol. 98, no. 22. pp. 3561–3572, 2020.
[5] V. François-Lavet, P. Henderson, R. Islam, M. G. Bellemare, and J. Pineau, “An introduction to deep reinforcement learning,” Foundations and Trends in Machine Learning, vol. 11, no. 3–4. pp. 219–354, 2018, doi: 10.1561/2200000071.
[6] O. Bernard et al., “Deep Learning Techniques for Automatic MRI Cardiac Multi-Structures Segmentation and Diagnosis: Is the Problem Solved?,” IEEE Trans. Med. Imaging, vol. 37, no. 11, pp. 2514–2525, 2018, doi: 10.1109/TMI.2018.2837502.
[7] A. S. Lundervold and A. Lundervold, “An overview of deep learning in medical imaging focusing on MRI,” arXiv. 2018.
[8] C. A. Miller et al., “Quantification of left ventricular indices from SSFP cine imaging: Impact of real-world variability in analysis methodology and utility of geometric modeling,” J. Magn. Reson. Imaging, vol. 37, no. 5, pp. 1213–1222, 2013, doi: 10.1002/jmri.23892.
[9] M. Khened, V. A. Kollerathu, and G. Krishnamurthi, “Fully convolutional multi-scale residual DenseNets for cardiac segmentation and automated cardiac diagnosis using ensemble of classifiers,” Med. Image Anal., vol. 51, pp. 21–45, 2019, doi: 10.1016/j.media.2018.10.004.
[10] Q. Zheng, H. Delingette, N. Duchateau, and N. Ayache, “3-D Consistent and Robust Segmentation of Cardiac Images by Deep Learning With Spatial Propagation,” IEEE Trans. Med. Imaging, vol. 37, no. 9, pp. 2137–2148, 2018, doi: 10.1109/TMI.2018.2820742.
[11] A. Suinesiaputra et al., “from Cardiac MRI: A Collation Study.” pp. 88–97, 2012.
[12] C. Petitjean et al., “Right ventricle segmentation from cardiac MRI: A collation study,” Medical Image Analysis, vol. 19, no. 1. pp. 187–202, 2015, doi: 10.1016/j.media.2014.10.004.
[13] X. Zhuang et al., “Cardiac Segmentation on Late Gadolinium Enhancement MRI: A Benchmark Study from Multi-Sequence Cardiac MR Segmentation Challenge,” no. Mi, 2020, [Online]. Available: http://arxiv.org/abs/2006.12434.
[14] C. Petitjean and J. N. Dacher, “A review of segmentation methods in short axis cardiac MR images,” Medical Image Analysis, vol. 15, no. 2. pp. 169–184, 2011, doi: 10.1016/j.media. 2010.12.004.
[15] L. M. C. Leon, K. C. Ciesielski, and P. A. V. Miranda, “Efficient Hierarchical Multi-Object Segmentation in Layered Graphs,” Math. Morphol. - Theory Appl., vol. 5, no. 1, pp. 21–42, 2021, doi: 10.1515/mathm-2020-0108.
[16] H. Wei, W. Xue, and D. Ni, “Left ventricle segmentation and quantification with attention-enhanced segmentation and shape correction,” ACM Int. Conf. Proceeding Ser., pp. 226–230, 2019, doi: 10.1145/3364836.3364881.
[17] I. Symposium and B. Imaging, “SEGMENTING THE LEFT VENTRICLE IN CARDIAC IN CARDIAC MRI : FROM HANDCRAFTED TO DEEP REGION BASED DESCRIPTORS Daniela O . Medley , Carlos Santiago , and Jacinto C . Nascimento Institute for Systems and Robotics , Instituto Superior T ´ ecnico , Lisbon , Por,” no. Isbi, pp. 644–648, 2019.
[18] W. Wang, Y. Wang, Y. Wu, T. Lin, S. Li, and B. Chen, “Quantification of Full Left Ventricular Metrics via Deep Regression Learning with Contour-Guidance,” IEEE Access, vol. 7, pp. 47918–47928, 2019, doi: 10.1109/ACCESS.2019.2907564.
[19] W. Bai, W. Shi, C. Ledig, and D. Rueckert, “Multi-atlas segmentation with augmented features for cardiac MR images,” Medical Image Analysis, vol. 19, no. 1. pp. 98–109, 2015, doi: 10.1016/j.media.2014.09.005.
[20] S. Moradi et al., “MFP-Unet: A novel deep learning based approach for left ventricle segmentation in echocardiography,” Phys. Medica, vol. 67, no. 110, pp. 58–69, 2019, doi: 10.1016/j.ejmp.2019.10.001.
[21] E. Shelhamer, J. Long, and T. Darrell, “IEEE Transactions on Pattern Analysis and Machine Intelligence Fully Convolutional Networks for Semantic Segmentation.” [Online]. Available: http://www.ieee.org/publications_standards/publications/rights/index.html.
[22] R. P. K. Poudel, P. Lamata, and G. Montana, “Recurrent fully convolutional neural networks for multi-slice MRI cardiac segmentation,” Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 10129 LNCS. pp. 83–94, 2017, doi: 10.1007/978-3-319-52280-7_8.
[23] Y. Jang, Y. Hong, S. Ha, S. Kim, and H. J. Chang, “Automatic segmentation of LV and RV in cardiac MRI,” Lect. Notes Comput. Sci. (including Subser. Lect. Notes Artif. Intell. Lect. Notes Bioinformatics), vol. 10663 LNCS, pp. 161–169, 2018, doi: 10.1007/978-3-319-75541-0_17.
[24] J. Duan et al., “Automatic 3D Bi-Ventricular Segmentation of Cardiac Images by a Shape-Refined Multi- Task Deep Learning Approach,” IEEE Trans. Med. Imaging, vol. 38, no. 9, pp. 2151–2164, 2019, doi: 10.1109/TMI.2019.2894322.
[25] A. S. Fahmy, H. El-Rewaidy, M. Nezafat, S. Nakamori, and R. Nezafat, “Automated Analysis of Myocardial Native T1 Mapping Images Using Fully Convolutional Neural Networks,” Journal of Cardiovascular Magnetic Resonance, vol. 21, no. 7. pp. 1–12, 2019.
[26] M. Kendirci, S. Nowfar, and W. J. G. Hellstrom, “The impact of vascular risk factors on erectile function,” Timely topics in medicine. Cardiovascular diseases, vol. 9. p. E11, 2005.
[27] E. Ermis et al., “The relationship between erectile dysfunction and the Atherogenic Index of Plasma,” Int. J. Impot. Res., vol. 32, no. 4, pp. 462–468, 2020, doi: 10.1038/s41443-019-0167-2.
[28] C. Zotti, Z. Luo, A. Lalande, and P. M. Jodoin, “Convolutional Neural Network with Shape Prior Applied to Cardiac MRI Segmentation,” IEEE J. Biomed. Heal. Informatics, vol. 23, no. 3, pp. 1119–1128, May 2019, doi: 10.1109/JBHI.2018.2865450.
[29] J. Patravali, S. Jain, and S. Chilamkurthy, “2D-3D fully convolutional neural networks for cardiac MR segmentation,” Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 10663 LNCS. pp. 130–139, 2018, doi: 10.1007/978-3-319-75541-0_14.
[30] S. Jahangard and M. Shahedi, “U-Net Based Architecture for an Improved Multiresolution Segmentation in Medical Images,” pp. 1–22, 2020.
[31] F. B. M. Suah, “Preparation and characterization of a novel Co(II) optode based on polymer inclusion membrane,” Analytical Chemistry Research, vol. 12. pp. 40–46, 2017, doi: 10.1016/j.ancr.2017.02.001.
[32] P. F. Christ et al., “Automatic liver and lesion segmentation in CT using cascaded fully convolutional neural networks and 3D conditional random fields,” Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 9901 LNCS. pp. 415–423, 2016, doi: 10.1007/978-3-319-46723-8_48.