Download PDF
Endoscopy 2021; 53(08): 832-836
DOI: 10.1055/a-1266-1066
Innovations and brief communications

Automatic detection of colorectal neoplasia in wireless colon capsule endoscopic images using a deep convolutional neural network

Atsuo Yamada
1   Department of Gastroenterology, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan
,
Ryota Niikura
1   Department of Gastroenterology, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan
,
Keita Otani
2   Graduate School of Information Science and Technology, The University of Tokyo, Tokyo, Japan
,
Tomonori Aoki
1   Department of Gastroenterology, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan
,
Kazuhiko Koike
1   Department of Gastroenterology, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan
› Author Affiliations
› Further Information
Also available at
    Permissions and Reprints

Abstract

Background Although colorectal neoplasms are the most common abnormalities found in colon capsule endoscopy (CCE), no computer-aided detection method is yet available. We developed an artificial intelligence (AI) system that uses deep learning to automatically detect such lesions in CCE images.

Methods We trained a deep convolutional neural network system based on a Single Shot MultiBox Detector using 15 933 CCE images of colorectal neoplasms, such as polyps and cancers. We assessed performance by calculating areas under the receiver operating characteristic curves, along with sensitivities, specificities, and accuracies, using an independent test set of 4784 images, including 1850 images of colorectal neoplasms and 2934 normal colon images.

Results The area under the curve for detection of colorectal neoplasia by the AI model was 0.902. The sensitivity, specificity, and accuracy were 79.0 %, 87.0 %, and 83.9 %, respectively, at a probability cutoff of 0.348.

Conclusions We developed and validated a new AI-based system that automatically detects colorectal neoplasms in CCE images.

Fig. 1s, Tables 1s, 2s



Publication History

Received: 28 May 2020

Accepted: 18 September 2020

Accepted Manuscript online:
18 September 2020

Article published online:
16 December 2020

© 2020. Thieme. All rights reserved.

Georg Thieme Verlag KG
Rüdigerstraße 14, 70469 Stuttgart, Germany

 

  • References

  • 1 Niikura R, Yasunaga H, Yamada A. et al. Factors predicting adverse events associated with therapeutic colonoscopy for colorectal neoplasia: a retrospective nationwide study in Japan. Gastrointest Endosc 2016; 84: 971-982.e976
    CrossrefPubMedGoogle Scholar
  • 2 Saito Y, Saito S, Oka S. et al. Evaluation of the clinical efficacy of colon capsule endoscopy in the detection of lesions of the colon: prospective, multicenter, open study. Gastrointest Endosc 2015; 82: 861-869
    CrossrefPubMedGoogle Scholar
  • 3 Ota Y, Yamada A, Kobayashi Y. et al. Diagnostic capability of colon capsule endoscopy for advanced colorectal cancer: A pilot study. Dig Endosc 2017; 29: 695-701
    CrossrefPubMedGoogle Scholar
  • 4 Eliakim R, Yassin K, Niv Y. et al. Prospective multicenter performance evaluation of the second-generation colon capsule compared with colonoscopy. Endoscopy 2009; 41: 1026-1031
    Article in Thieme ConnectPubMedGoogle Scholar
  • 5 Ozawa T, Ishihara S, Fujishiro M. et al. Automated endoscopic detection and classification of colorectal polyps using convolutional neural networks. Therap Adv Gastroenterol 2020; 13: 1756284820910659
    CrossrefPubMedGoogle Scholar
  • 6 Misawa M, Kudo SE, Mori Y. et al. Artificial Intelligence-Assisted Polyp Detection for Colonoscopy: Initial Experience. Gastroenterology 2018; 154: 2027-2029.e2023
    CrossrefPubMedGoogle Scholar
  • 7 The Paris endoscopic classification of superficial neoplastic lesions: esophagus, stomach, and colon: November 30 to December 1, 2002. Gastrointest Endosc 2003; 58: S3-S43
    CrossrefPubMedGoogle Scholar
  • 8 Eliakim R, Fireman Z, Gralnek IM. et al. Evaluation of the PillCam Colon capsule in the detection of colonic pathology: results of the first multicenter, prospective, comparative study. Endoscopy 2006; 38: 963-970
    Article in Thieme ConnectPubMedGoogle Scholar
  • 9 Liu W, Anguelov D, Erhan D. et al. SSD: Single Shot MultiBox Detector. Computer Vision – ECCV 2016; 9905: 21-37
    PubMedGoogle Scholar
  • 10 Saito H, Aoki T, Aoyama K. et al. Automatic detection and classification of protruding lesions in wireless capsule endoscopy images based on a deep convolutional neural network. Gastrointest Endosc 2020; 92: 144-151.e1
    CrossrefPubMedGoogle Scholar
  • 11 Schisterman EF, Perkins NJ, Liu A. et al. Optimal cut-point and its corresponding Youden Index to discriminate individuals using pooled blood samples. Epidemiology 2005; 16: 73-81
    CrossrefPubMedGoogle Scholar
  • 12 DeLong ER, DeLong DM, Clarke-Pearson DL. Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics 1988; 44: 837-845
    CrossrefPubMedGoogle Scholar
  • 13 Blanes-Vidal V, Baatrup G, Nadimi ES. Addressing priority challenges in the detection and assessment of colorectal polyps from capsule endoscopy and colonoscopy in colorectal cancer screening using machine learning. Acta Oncol 2019; 58: S29-S36
    CrossrefPubMedGoogle Scholar
  • 14 Aoki T, Yamada A, Aoyama K. et al. Automatic detection of erosions and ulcerations in wireless capsule endoscopy images based on a deep convolutional neural network. Gastrointest Endosc 2019; 89: 357-363.e352
    CrossrefPubMedGoogle Scholar