A fused deep learning architecture for viewpoint classification of echocardiography
Article
Gao, X., Li, W., Loomes, M. and Wang, L. 2017. A fused deep learning architecture for viewpoint classification of echocardiography. Information Fusion. 36, pp. 103-113. https://doi.org/10.1016/j.inffus.2016.11.007
Type | Article |
---|---|
Title | A fused deep learning architecture for viewpoint classification of echocardiography |
Authors | Gao, X., Li, W., Loomes, M. and Wang, L. |
Abstract | This study extends the state of the art of deep learning convolutional neural network (CNN) to the classification of video images of echocardiography, aiming at assisting clinicians in diagnosis of heart diseases. Specifically, the architecture of neural networks is established by embracing hand-crafted features within a data-driven learning framework, incorporating both spatial and temporal information sustained by the video images of the moving heart and giving rise to two strands of two-dimensional convolutional neural network (CNN). In particular, the acceleration measurement along the time direction at each point is calculated using dense optical flow technique to represent temporal motion information. Subsequently, the fusion of both networks is conducted via linear integrations of the vectors of class scores obtained from each of the two networks. As a result, this architecture maintains the best classification results for eight viewpoint categories of echo videos with 92.1% accuracy rate whereas 89.5% is achieved using only single spatial CNN network. When concerning only three primary locations, 98% of accuracy rate is realised. In addition, comparisons with a number of well-known hand-engineered approaches are also performed, including 2D KAZE, 2D KAZE with Optical Flow, 3D KAZA, Optical Flow, 2D SIFT and 3D SIFT, which delivers accuracy rate of 89.4%, 84.3%, 87.9%, 79.4%, 83.8% and 73.8% respectively. |
Keywords | Deep leaming; Classification architecture for echo video images; Convolutional neural network ; Echocardiography; KAZE; SIFT ; SURF |
Publisher | Elsevier |
Journal | Information Fusion |
ISSN | 1566-2535 |
Electronic | 1872-6305 |
Publication dates | |
Online | 10 Nov 2016 |
01 Jul 2017 | |
Publication process dates | |
Deposited | 10 Nov 2016 |
Accepted | 09 Nov 2016 |
Output status | Published |
Accepted author manuscript | License File Access Level Open |
Copyright Statement | © 2016. This manuscript version is made available under the CC-BY-NC-ND 4.0 license http://creativecommons.org/licenses/by-nc-nd/4.0/ |
Digital Object Identifier (DOI) | https://doi.org/10.1016/j.inffus.2016.11.007 |
Scopus EID | 2-s2.0-84995804182 |
Web of Science identifier | WOS:000394070100008 |
Language | English |
https://repository.mdx.ac.uk/item/86v66
Download files
Accepted author manuscript
0-A fused architecture of deep learning .pdf | ||
License: CC BY-NC-ND 4.0 | ||
File access level: Open |
67
total views41
total downloads3
views this month4
downloads this month