Journal of Information Processing Systems

Korea Information Processing Society (한국정보처리학회)
권호 표지
DOI QR코드

DOI QR Code

Class-Labeling Method for Designing a Deep Neural Network of Capsule Endoscopic Images Using a Lesion-Focused Knowledge Model

  • Park, Ye-Seul (Dept. of Electrical and Computer Engineering, Ajou University) ;
  • Lee, Jung-Won (Dept. of Electrical and Computer Engineering, Ajou University)
  • Received : 2018.01.11
  • Accepted : 2019.10.29
  • Published : 2020.02.29
Download PDF
⟨ Previous Next ⟩

Abstract

Capsule endoscopy is one of the increasingly demanded diagnostic methods among patients in recent years because of its ability to observe small intestine difficulties. It is often conducted for 12 to 14 hours, but significant frames constitute only 10% of whole frames. Thus, it has been designed to automatically acquire significant frames through deep learning. For example, studies to track the position of the capsule (stomach, small intestine, etc.) or to extract lesion-related information (polyps, etc.) have been conducted. However, although grouping or labeling the training images according to similar features can improve the performance of a learning model, various attributes (such as degree of wrinkles, presence of valves, etc.) are not considered in conventional approaches. Therefore, we propose a class-labeling method that can be used to design a learning model by constructing a knowledge model focused on main lesions defined in standard terminologies for capsule endoscopy (minimal standard terminology, capsule endoscopy structured terminology). This method enables the designing of a systematic learning model by labeling detailed classes through differentiation of similar characteristics.

Keywords

References

  1. D. Moneghini, G. Missale, L. Minelli, and R. Cestari, "P.18.2 upper and lower gastrointestinal lesions overlooked at conventional endoscopy and further diagnosed with small bowel capsule endoscopy: the crucial role of endoscopic experience in patients with obscure gastrointestinal bleeding," Digestive and Liver Disease, vol. 48(Suppl. 2), p. e216, 2016.
  2. A. Bar-Gil Shitrit, B. Koslowsky, D. M. Livovsky, D. Shitrit, K. Paz, T. Adar, S. N. Adler, and E. Goldin, "A prospective study of fecal calprotectin and lactoferrin as predictors of small bowel Crohn's disease in patients undergoing capsule endoscopy," Scandinavian Journal of Gastroenterology, vol. 52, no. 3, pp. 328-333, 2017. https://doi.org/10.1080/00365521.2016.1253769
  3. M. Fischer, S. Siva, J. M. Wo, and H. M. Fadda, "Assessment of small intestinal transit times in ulcerative colitis and Crohn's disease patients with different disease activity using video capsule endoscopy," AAPS Pharmscitech, vol. 18, no. 2, pp. 404-409, 2017. https://doi.org/10.1208/s12249-016-0521-3
  4. M. Lujan-Sanchis, E. Perez-Cuadrado-Robles, J. Garcia-Lledo, J, F. J. Fernandez, L. Elli, V. A. Jimenez- Garcia, et al., "Role of capsule endoscopy in suspected celiac disease: a European multi-centre study," World Journal of Gastroenterology, vol. 23, no. 4, pp. 703-711, 2017. https://doi.org/10.3748/wjg.v23.i4.703
  5. H. Chen, X. Wu, G. Tao, and Q. Peng, "Automatic content understanding with cascaded spatial-temporal deep framework for capsule endoscopy videos," Neurocomputing, vol. 229, pp. 77-87, 2017 https://doi.org/10.1016/j.neucom.2016.06.077
  6. Y. Yuan and M. Q. H. Meng, "Deep learning for polyp recognition in wireless capsule endoscopy images," Medical Physics, vol. 44, no. 4, pp. 1379-1389, 2017. https://doi.org/10.1002/mp.12147
  7. P. Li, Z. Li, F. Gao, L. Wan, and J. Yu, "Convolutional neural networks for intestinal hemorrhage detection in wireless capsule endoscopy images," in Proceedings of 2017 IEEE International Conference on Multimedia and Expo (ICME), Hong Kong, China, 2017, pp. 1518-1523.
  8. T. Zhou, G. Han, B. N. Li, Z. Lin, E. J. Ciaccio, P. H. Green, and J. Qin, "Quantitative analysis of patients with celiac disease by video capsule endoscopy: a deep learning method," Computers in Biology and Medicine, vol. 85, pp. 1-6, 2017. https://doi.org/10.1016/j.compbiomed.2017.03.031
  9. L. Aabakken, B. Rembacken, O. LeMoine, K. Kuznetsov, J. F. Rey, T. Rosch, G. Eisen, P. Cotton, and M. Fujino, "Minimal standard terminology for gastrointestinal endoscopy-MST 3.0," Endoscopy, vol. 41, no. 8, pp. 727-728, 2009. https://doi.org/10.1055/s-0029-1214949
  10. L. Y. Korman, M. Delvaux, G. Gay, F. Hagenmuller, M. Keuchel, S. Friedman, et al., "Capsule endoscopy structured terminology (CEST): proposal of a standardized and structured terminology for reporting capsule endoscopy procedures," Endoscopy, vol. 37, no. 10, pp. 951-959, 2005. https://doi.org/10.1055/s-2005-870329
  11. B. Taha, N. Werghi, and J. Dias, "Automatic polyp detection in endoscopy videos: a survey," in Proceedings of 2017 13th IASTED International Conference on Biomedical Engineering (BioMed), Innsbruck, Austria, 2017, pp. 233-240.
  12. X. Jia and M. Q. H. Meng, "A deep convolutional neural network for bleeding detection in wireless capsule endoscopy images," in Proceedings of 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Orlando, FL, 2016, pp. 639-642.
  13. X. Jia and M. Q. H. Meng, "A study on automated segmentation of blood regions in wireless capsule endoscopy images using fully convolutional networks," in Proceedings of 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI), Melbourne, Australia, 2017, pp. 179-182.
  14. X. Jia and M. Q. H. Meng, "Gastrointestinal bleeding detection in wireless capsule endoscopy images using handcrafted and CNN features," in Proceedings of 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Seogwipo, Korea, 2017, pp. 3154-3157.
  15. X. Li, H. Zhang, X. Zhang, H. Liu, and G. Xie, "Exploring transfer learning for gastrointestinal bleeding detection on small-size imbalanced endoscopy images," in Proceedings of 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Seogwipo, Korea, 2017, pp. 1994-1997.
  16. X. Wu, H. Chen, T. Gan, J. Chen, C. W. Ngo, and Q. Peng, "Automatic hookworm detection in wireless capsule endoscopy images," IEEE Transactions on Medical Imaging, vol. 35, no. 7, pp. 1741-1752, 2016. https://doi.org/10.1109/TMI.2016.2527736
  17. E. J. Ciaccio, C. A. Tennyson, G. Bhagat, S. K. Lewis, and P. H. Green, "Classification of videocapsule endoscopy image patterns: comparative analysis between patients with celiac disease and normal individuals," Biomedical Engineering Online, vol. 9, article no. 44, 2010.
  18. S. Bejakovic, R. Kumar, T. Dassopoulos, G. Mullin, and G. Hager, "Analysis of Crohn's disease lesions in capsule endoscopy images," in Proceedings of 2009 IEEE International Conference on Robotics and Automation, Kobe, Japan, 2009, pp. 2793-2798.
  19. R. Kumar, Q. Zhao, S. Seshamani, G. Mullin, G. Hager, and T. Dassopoulos, "Assessment of Crohn's disease lesions in wireless capsule endoscopy images," IEEE Transactions on Biomedical Engineering, vol. 59, no. 2, pp. 355-362, 2011. https://doi.org/10.1109/TBME.2011.2172438
  20. E. Gal, A. Geller, G. Fraser, Z. Levi, and Y. Niv, "Assessment and validation of the new capsule endoscopy Crohn's disease activity index (CECDAI)," Digestive Diseases and Sciences, vol. 53, no. 7, pp. 1933-1937, 2008. https://doi.org/10.1007/s10620-007-0084-y
  21. S. Segui, M. Drozdzal, G. Pascual, P. Radeva, C. Malagelada, F. Azpiroz, and J. Vitria, "Generic feature learning for wireless capsule endoscopy analysis," Computers in Biology and Medicine, vol. 79, pp. 163-172, 2016. https://doi.org/10.1016/j.compbiomed.2016.10.011
  22. K. Pogorelov, K. R. Randel, C. Griwodz, S. L. Eskeland, T. de Lange, D. Johansen, et al., "Kvasir: a multiclass image dataset for computer aided gastrointestinal disease detection," in Proceedings of the 8th ACM on Multimedia Systems Conference, Taipei, Taiwan, 2017, pp. 164-169.
  23. J. Chen, Y. Zou, and Y. Wang, "Wireless capsule endoscopy video summarization: a learning approach based on Siamese neural network and support vector machine," in Proceedings of 2016 23rd International Conference on Pattern Recognition (ICPR), Cancun, Mexico, 2016, pp. 1303-1308.
  24. K. Yan, Y. Peng, V. Sandfort, M. Bagheri, Z. Lu, and R. M. Summers, "Holistic and comprehensive annotation of clinically significant findings on diverse CT images: learning from radiology reports and label ontology," in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Long Beach, CA, 2019, pp. 8523-8532.
  25. T. Zheng, Y. Gao, F. Wang, C. Fan, X. Fu, M. Li, Y. Zhang, S. Zhang, and H. Ma, "Detection of medical text semantic similarity based on convolutional neural network," BMC Medical Informatics and Decision Making, vol. 19, article no.156, 2019.
  26. H. Nakawala, R. Bianchi, L. E. Pescatori, O. De Cobelli, G. Ferrigno, and E. De Momi, ""Deep-Onto" network for surgical workflow and context recognition," International Journal of Computer Assisted Radiology and Surgery, vol. 14, no. 4, pp. 685-696, 2019. https://doi.org/10.1007/s11548-018-1882-8