DOI QR코드

DOI QR Code

Feature Extraction of Non-proliferative Diabetic Retinopathy Using Faster R-CNN and Automatic Severity Classification System Using Random Forest Method

  • Received : 2022.03.04
  • Accepted : 2022.05.23
  • Published : 2022.10.31

Abstract

Non-proliferative diabetic retinopathy is a representative complication of diabetic patients and is known to be a major cause of impaired vision and blindness. There has been ongoing research on automatic detection of diabetic retinopathy, however, there is also a growing need for research on an automatic severity classification system. This study proposes an automatic detection system for pathological symptoms of diabetic retinopathy such as microaneurysms, retinal hemorrhage, and hard exudate by applying the Faster R-CNN technique. An automatic severity classification system was devised by training and testing a Random Forest classifier based on the data obtained through preprocessing of detected features. An experiment of classifying 228 test fundus images with the proposed classification system showed 97.8% accuracy.

Keywords

Acknowledgement

This work was supported by the ICT R&D program of MSIT/IITP in Republic of Korea (No. 2018-0-00242, Development of AI ophthalmologic diagnosis and smart treatment platform based on big data).

References

  1. L. Qiao, Y. Zhu, and H. Zhou, "Diabetic retinopathy detection using prognosis of microaneurysm and early diagnosis system for non-proliferative diabetic retinopathy based on deep learning algorithms," IEEE Access, vol. 8, pp. 104292-104302, 2020. https://doi.org/10.1109/access.2020.2993937
  2. S. Chaudhary, J. Zaveri, and N. Becker, "Proliferative diabetic retinopathy (PDR)," Disease-a-Month, vol. 67, No. 5, article no. 101140, 2021. https://doi.org/10.1016/j.disamonth.2021.101140
  3. Early Treatment Diabetic Retinopathy Study Research Group, "Grading diabetic retinopathy from stereoscopic color fundus photographs: an extension of the modified Airlie House classification (ETDRS Report Number 10)," Ophthalmology, vol. 127, no. 4, pp. S99-S119, 2020. https://doi.org/10.1016/j.ophtha.2020.01.030
  4. Y. Zhou, B. Wang, L. Huang, S. Cui, and L. Shao, "A benchmark for studying diabetic retinopathy: segmentation, grading, and transferability," IEEE Transactions on Medical Imaging, vol. 40, no. 3, pp. 818-828, 2021. https://doi.org/10.1109/TMI.2020.3037771
  5. M. M. Abdelsalam and M. A. Zahran, "A novel approach of diabetic retinopathy early detection based on multifractal geometry analysis for OCTA macular images using support vector machine," IEEE Access, vol. 9, pp. 22844-22858, 2021. https://doi.org/10.1109/ACCESS.2021.3054743
  6. V. Gulshan, L. Peng, M. Coram, M. C. Stumpe, D. Wu, A. Narayanaswamy, et al., "Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs," JAMA, vol. 316, no. 22, pp. 2402-2410, 2016. https://doi.org/10.1001/jama.2016.17216
  7. H. Pratt, F. Coenen, D. M. Broadbent, S. P. Harding, and Y. Zheng, "Convolutional neural networks for diabetic retinopathy," Procedia Computer Science, vol. 90, pp. 200-205, 2016. https://doi.org/10.1016/j.procs.2016.07.014
  8. A. Tolkachev, I. Sirazitdinov, M. Kholiavchenko, T. Mustafaev, and B. Ibragimov, "Deep learning for diagnosis and segmentation of pneumothorax: the results on the Kaggle competition and validation against radiologists," IEEE Journal of Biomedical and Health Informatics, vol. 25, no. 5, pp. 1660-1672, 2021. https://doi.org/10.1109/JBHI.2020.3023476
  9. S. Das, K. Kharbanda, M. Suchetha, R. Raman, and E. Dhas, "Deep learning architecture based on segmented fundus image features for classification of diabetic retinopathy," Biomedical Signal Processing and Control, vol. 68, article no. 102600, 2021. https://doi.org/10.1016/j.bspc.2021.102600
  10. Padmanayana and B. K. Anoop, "Binary classification of DR-diabetic retinopathy using CNN with fundus colour images," Materials Today: Proceedings, vol. 58, pp. 212-216, 2022. https://doi.org/10.1016/j.matpr.2022.01.466
  11. R. Adriman, K. Muchtar, and N. Maulina, "Performance evaluation of binary classification of diabetic retinopathy through deep learning techniques using texture feature," Procedia Computer Science, vol. 179, pp. 88-94, 2021. https://doi.org/10.1016/j.procs.2020.12.012
  12. S. B. Hathwar and G. Srinivasa, "Automated grading of diabetic retinopathy in retinal fundus images using deep learning," in Proceedings of 2019 IEEE International Conference on Signal and Image Processing Applications (ICSIPA), Kuala Lumpur, Malaysia, 2019, pp. 73-77.
  13. P. W. Sudarmadji, P. D. Pakan, and R. Y. Dillak, "Diabetic retinopathy stages classification using improved deep learning," in Proceedings of 2020 International Conference on Informatics, Multimedia, Cyber and Information System (ICIMCIS), Jakarta, Indonesia, 2020, pp. 104-109.
  14. G. Saxena, D. K. Verma, A. Paraye, A. Rajan, and A. Rawat, "Improved and robust deep learning agent for preliminary detection of diabetic retinopathy using public datasets," Intelligence-Based Medicine, vol. 3, article no. 100022, 2020. https://doi.org/10.1016/j.ibmed.2020.100022
  15. D. K. Elswah, A. A. Elnakib, and H. E. D. Moustafa, "Automated diabetic retinopathy grading using ResNet," in Proceedings of 2020 37th National Radio Science Conference (NRSC), Cairo, Egypt, 2020, pp. 248-254.
  16. G. Ghan, S. Chavan, and A. Chaudhari, "Diabetic retinopathy classification using deep learning," in Proceedings of 2020 4th International Conference on Inventive Systems and Control (ICISC), Coimbatore, India, 2020, pp. 761-765.
  17. M. Kolla and T. Venugopal, "Efficient classification of diabetic retinopathy using binary CNN," in Proceedings of 2021 International Conference on Computational Intelligence and Knowledge Economy (ICCIKE), Dubai, United Arab Emirates, 2021, pp. 244-247.
  18. S. Valarmathi and R. Vijayabhanu, "A survey on diabetic retinopathy disease detection and classification using deep learning techniques," in Proceedings of 2021 7th International Conference on Bio Signals, Images, and Instrumentation (ICBSII), Chennai, India, 2021, pp. 1-4.
  19. S. Sooraj and M. Bedeeuzzaman, "Automatic classification of diabetic retinopathy based on deep learning: a review," in Proceedings of 2020 International Conference on Futuristic Technologies in Control Systems & Renewable Energy (ICFCR), Malappuram, India, 2020, pp. 1-5.
  20. M. Z. Atwany, A. H. Sahyoun, and M. Yaqub, "Deep learning techniques for diabetic retinopathy classification: a survey," IEEE Access, vol. 10, pp. 28642-28655, 2022. https://doi.org/10.1109/ACCESS.2022.3157632
  21. N. Tsiknakis, D. Theodoropoulos, G. Manikis, E. Ktistakis, O. Boutsora, A. Berto, et al., "Deep learning for diabetic retinopathy detection and classification based on fundus images: a review," Computers in Biology and Medicine, vol. 135, article no. 104599, 2021. https://doi.org/10.1016/j.compbiomed.2021.104599
  22. S. Ren, K. He, R. Girshick, and J. Sun, "Faster R-CNN: towards real-time object detection with region proposal networks," Advances in Neural Information Processing Systems, vol. 28, pp. 91-99, 2015.
  23. W. Cao, N. Czarnek, J. Shan, and L. Li, "Microaneurysm detection using principal component analysis and machine learning methods," IEEE Transactions on Nanobioscience, vol. 17, no. 3, pp. 191-198, 2018. https://doi.org/10.1109/tnb.2018.2840084
  24. C. Szegedy, S. Ioffe, V. Vanhoucke, and A. A. Alemi, "Inception-v4, Inception-ResNet and the impact of residual connections on learning," in Proceedings of the 21st AAAI Conference on Artificial Intelligence (AAAI), San Francisco, CA, 2017, pp. 4278-4284.