DOI QR코드

DOI QR Code

Development of Retina Healthcare Service System Using Smart Phone

  • 투고 : 2019.05.10
  • 심사 : 2019.05.27
  • 발행 : 2019.06.30

초록

In this paper, we have developed a Retina Healthcare Service System through which the patient himself/herself can manage his/her retina health. In the case of conventional portable ophthalmic cameras, patients cannot check their eye health on their own because most of them are used by doctor in environments where ophthalmography cannot be performed properly. This system consists of web, app and camera modules, and when a patient mounts a camera module for fundus photography on his / her smart phone and then photographs his / her fundus through the app, the image is transmitted to a server, and the transmitted image reads the fundus the patient's fundus image status in the fundus image reading model learned using deep learning. When the doctor expresses his/her opinions about the patient 's eye condition based on the reading result and the fundus photograph, the patient can check through the app and judge whether to receive ophthalmologic treatment.

키워드

E1GMBY_2019_v7n2_227_f0001.png 이미지

Figure 1. Increase Trends of Glaucoma and Diabetic Retinopathy by 2050

E1GMBY_2019_v7n2_227_f0002.png 이미지

Figure 2. System Configuration Diagram

E1GMBY_2019_v7n2_227_f0003.png 이미지

Figure 3. IR LED Lighting

E1GMBY_2019_v7n2_227_f0004.png 이미지

Figure 4. Before Assembling The Camera Module

E1GMBY_2019_v7n2_227_f0005.png 이미지

Figure 6. App Configuration Diagram

E1GMBY_2019_v7n2_227_f0006.png 이미지

Figure 7. Main Screen

E1GMBY_2019_v7n2_227_f0007.png 이미지

Figure 10. Funds List Taken

E1GMBY_2019_v7n2_227_f0008.png 이미지

Figure 11. Image Selection and Comments(Doctor’s Opinion)

E1GMBY_2019_v7n2_227_f0009.png 이미지

Figure 12. Web Configuration Diagram

E1GMBY_2019_v7n2_227_f0010.png 이미지

Figure 13. Main Screen

E1GMBY_2019_v7n2_227_f0011.png 이미지

Figure 14. Login Screen

E1GMBY_2019_v7n2_227_f0012.png 이미지

Figure 15. List of Member Fundus photos

E1GMBY_2019_v7n2_227_f0013.png 이미지

Figure 17. Configuration of learning System application system

E1GMBY_2019_v7n2_227_f0014.png 이미지

Figure 16. Fundus Examination andComments

E1GMBY_2019_v7n2_227_f0015.png 이미지

Figure 18. Main function processes

E1GMBY_2019_v7n2_227_f0016.png 이미지

Figure 19. Mounting The Camera Module(1)

E1GMBY_2019_v7n2_227_f0017.png 이미지

Figure 21. App Login Screen

E1GMBY_2019_v7n2_227_f0018.png 이미지

Figure 24. Fundus Photographing

E1GMBY_2019_v7n2_227_f0019.png 이미지

Figure 25. Saving the shot Picture

E1GMBY_2019_v7n2_227_f0020.png 이미지

Figure 26. Web page – Patient management Menu on the main screen

E1GMBY_2019_v7n2_227_f0021.png 이미지

Figure 28. Fundus Image determined as Normal and writing A doctor’s opinion (Comment)

E1GMBY_2019_v7n2_227_f0022.png 이미지

Figure 30. App ExaminationRecord screen

E1GMBY_2019_v7n2_227_f0023.png 이미지

Figure 31. App Doctor’sComment screen

E1GMBY_2019_v7n2_227_f0024.png 이미지

Figure 5. After Assembling The Camera Module

E1GMBY_2019_v7n2_227_f0025.png 이미지

Figure 8. Fundus Examination Screen

E1GMBY_2019_v7n2_227_f0026.png 이미지

Figure 9. Fundus Photographing

E1GMBY_2019_v7n2_227_f0027.png 이미지

Figure 20. Mounting The Camera Module(2)

E1GMBY_2019_v7n2_227_f0028.png 이미지

Figure 22. App Menu Screen

E1GMBY_2019_v7n2_227_f0029.png 이미지

Figure 23. App Fundus Examination Screen

E1GMBY_2019_v7n2_227_f0030.png 이미지

Figure 27. List of fundus images taken By the patient

E1GMBY_2019_v7n2_227_f0031.png 이미지

Figure 29. Fundus Image determined as Abnormal and writing A doctor’s opinion (Comment)

Table 1. Results of learning model test (Excluding images)

E1GMBY_2019_v7n2_227_t0001.png 이미지

참고문헌

  1. The trend of increase of 3 major ophthalmologic diseases. Healthcare Big Data Development System, http://opendata.hira.or.kr/op/opc/olapMfrnIntrsIlnsInfo.do
  2. T. Walter, J-C. Klein, P. Massin and A. Erginay, "A contribution of image processing to the diagnosis of diabetic retinopathy-detection of exudates in color fundus images of the human retina." IEEE transactions on medical imaging, Vol 21, No.10, pp. 1236-1243, Oct. 2002. https://doi.org/10.1109/TMI.2002.806290
  3. V. Gulsham, L. Peng, M. Coram, MC. Stumpe, D. Wu, A. Narayanaswamy, S. Venugopalan, K. Widner, T. Madams, J. Cuadros, R. Kim, R. Raman, PC. Nelson, JL. Mega, DR. Webster, "Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs." JAMA, Vol 316, pp. 2402-2410, December. 2016. doi:10.1001/jama.2016.17216.
  4. C .Szegedy, V. Vanhoucke, S. Ioffe, J. Shlens and Z. Wojna, "Rethinking the inception architecture for computer vision", Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2818-2826, Dec. 2016.
  5. MD. Abràmoff, JC. Folk, DP. Han, JD. Walker, DF. Williams, SR. Russell, P. Massin, B. Cochener, P. Gain, L. Tang, M. Lamard, DC. Moga, G. Quellec, M. Niemeijer, "Automated analysis of retinal images for detection of referable diabetic retinopathy", JAMA Ophthalmol. Vol 131, No.3, pp. 351-357, March. 2013. doi:10.1001/jamaophthalmol.2013.1743.
  6. K. Nam, H. Jeon, "The training of convolution neural network for advanced driver assistant system", International Journal of Advanced Culture Technology (IJACT). Vol 4, No.4, pp. 23-29, Dec. 2016 https://doi.org/10.17703/IJACT2016.4.4.23
  7. JW. Kim, PK. Rhee. "Image Recognition based on Adaptive Deep Learning", The Journal of The Institute of Internet, Broadcasting and Communication (JIIBC), Vol. 18, No. 1, pp. 113-117, Feb. 2018, doi:10.7236/JIIBC.2018.18.1.113.
  8. SH. Kim, KW. Lee and YH. Lee. "A study on implementation of standard protocol for communication of health signals in mobile environment ", The Journal of The Institute of Internet, Broadcasting and Communication (JIIBC). Vol. 16, No. 5, pp. 125-129, 2016, doi:10.7236/JIIBC.2016.16.5.125
  9. YD. Joo. "Implementation of Facility Maintenance Management System using Smart Phones", The Journal of The Institute of Internet, Broadcasting and Communication (JIIBC). Vol. 13, No. 1, pp. 191-197, 2013, doi:10.7236/JIIBC.2013.13.1.191
  10. GS. Choi, JJ. Park, JJ. Kang, WJ. Kim. "A Study on Effective Information Transfer Technique between Personal Computer and Portable Equipment", The Journal of The Institute of Internet, Broadcasting and Communication (JIIBC). Vol. 13, No. 2, pp. 261-267, 2013, doi: 10.7236/JIIBC.2013.13.2.261