Title

A survey of feature extraction and fusion of deep learning for detection of abnormalities in video endoscopy of gastrointestinal-tract

Authors

Hussam Ali, COMSATS Institute of Information Technology, PakistanFollow
Muhammad Sharif, COMSATS Institute of Information Technology, Pakistan
Mussarat Yasmin, COMSATS Institute of Information Technology, Pakistan
Mubashir Husain Rehmani, Department of Computer Science, Munster Technological University, Bishopstown Campus, Cork, IrelandFollow
Farhan Riaz, Department of Computer & Software Engineering, CE&ME, National University of Sciences and Technology (NUST), Islamabad, Pakistan

ORCID

http://orcid.org/0000-0002-3565-7390

Document Type

Article

Disciplines

Artificial Intelligence and Robotics | Computer Sciences | Diseases | Gastroenterology | Health Information Technology

Publication Details

Artificial Intelligence Review 53, 2635–2707 (2020).

This is a post-peer-review, pre-copyedit version of an article published in Artificial Intelligence Review. The final authenticated version is available online at: http://dx.doi.org/10.1007/s10462-019-09743-2

Abstract

A standard screening procedure involves video endoscopy of the Gastrointestinal tract. It is a less invasive method which is practiced for early diagnosis of gastric diseases. Manual inspection of a large number of gastric frames is an exhaustive, time-consuming task, and requires expertise. Conversely, several computer-aided diagnosis systems have been proposed by researchers to cope with the dilemma of manual inspection of the massive volume of frames. This article gives an overview of different available alternatives for automated inspection, detection, and classification of various GI abnormalities. Also, this work elaborates techniques associated with content-based image retrieval and automated systems for summarizing endoscopic procedures. In this survey, we perform a comprehensive review of feature extraction techniques and deep learning methods which were specifically developed for automatic analysis of endoscopic videos. In addition, we categorize features extraction techniques according to image processing domains and further we classify them based on their visual descriptions. We also review hybrid feature extraction techniques which are developed by the fusion of different kind of basic descriptors. Moreover, this survey covers various endoscopy data-sets available for the bench-marking of vision based algorithms. On the basis of literature, we explain emerging trends in computerized analysis of endoscopy. We also survey important issues, challenges, and future research directions to the development of computer-assisted systems for detection of maladies and interactive surgery in the GI tract.

Recommended Citation

Ali, H., Sharif, M., Yasmin, M. et al. A survey of feature extraction and fusion of deep learning for detection of abnormalities in video endoscopy of gastrointestinal-tract. Artif Intell Rev 53, 2635–2707 (2020) 10.1007/s10462-019-09743-2.