Journal of Korea Multimedia Society (한국멀티미디어학회논문지)

Korea Multimedia Society (한국멀티미디어학회)
권호 표지
DOI QR코드

DOI QR Code

EOG-based User-independent Gaze Recognition using Wavelet Coefficients and Dynamic Positional Warping

웨이블릿 계수와 Dynamic Positional Warping을 통한 EOG기반의 사용자 독립적 시선인식

  • Chang, Won-Du (School of Electronic and Biomedical Engineering, Tongmyung University) ;
  • Im, Chang-Hwan (Department of Biomedical Engineering, Hanyang University)
  • Received : 2018.07.25
  • Accepted : 2018.09.04
  • Published : 2018.09.30
Download PDF
⟨ Previous Next ⟩

Abstract

Writing letters or patterns on a virtual space by moving a person's gaze is called "eye writing," which is a promising tool for various human-computer interface applications. This paper investigates the use of conventional eye writing recognition algorithms for the purpose of user-independent recognition of eye-written characters. Two algorithms are presented to build the user-independent system: eye-written region extraction using wavelet coefficients and template generation. The experimental results of the proposed system demonstrated that with dynamic positional warping, an F1 score of 79.61% was achieved for 12 eye-written patterns, thereby indicating the possibility of user-independent use of eye writing.

Keywords

References

  1. Bioelectromagnetism-Principles and Applications of Bioelectric and Biomagnetic Fields, http://www.bem.fi/book (accessed Apr., 12, 2018).
  2. W.-D. Chang, J.-H. Lim, and C.-H. Im, "An Unsupervised Eye Blink Artifact Detection Method for Real-time Electroencephalogram Processing," Physiological Measurement, Vol. 37, No. 3, pp. 401-417, 2016. https://doi.org/10.1088/0967-3334/37/3/401
  3. W.-D. Chang, H.-S Cha, K. Kim, and C.-H. Im, "Detection of Eye Blink Artifacts from Single Prefrontal Channel Electroencephalogram," Computer Methods and Programs in Biomedicine, Vol. 124, pp. 19-30, 2016. https://doi.org/10.1016/j.cmpb.2015.10.011
  4. S. Zhang, J. McIntosh, S.M. Shadli, P.S. Neo, Z. Huang, and N. McNaughton, "Removing Eye Blink Artefacts from EEG-A Single-channel Physiology-based Method," Journal of Neuroscience Methods, Vol. 291, pp. 213-220, 2017. https://doi.org/10.1016/j.jneumeth.2017.08.031
  5. R. Schleicher, N. Galley, S. Briest, and L. Galley, "Blinks and Saccades as Indicators of Fatigue in Sleepiness Warnings: Looking Tired?," Ergonomics, Vol. 51, No. 7, pp. 982-1010, 2008. https://doi.org/10.1080/00140130701817062
  6. S.K. Kim and S.K. Yo, "Multimodal Bio-signal Measurement System for Sleep Analysis," Journal of Korea Multimedia Society, Vol. 21, No. 5, pp. 609-616, 2018. https://doi.org/10.9717/KMMS.2018.21.5.609
  7. B.D. Yetton, M. Niknazar, K.A. Duggan, E.A. McDevitt, L.N. Whitehurst, N. Sattari, and S.C. Mednick, "Automatic Detection of Rapid Eye Movements (REMs): A Machine Learning Approach," Journal of Neuroscience Methods, Vol. 259, pp. 72-82, 2015.
  8. A. Bulling, J.A. Ward, H. Gellersen, and G. Troster, "Eye Movement Analysis for Activity Recognition Using Electrooculography," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 33, No. 4, pp. 741-753, 2011. https://doi.org/10.1109/TPAMI.2010.86
  9. R. Barea, L. Boquete, M. Mazo, and E. Lopez, "Wheelchair Guidance Strategies using EOG," Journal of Intelligent and Robotic Systems: Theory and Applications, Vol. 34, No. 3, pp. 279-299, 2002. https://doi.org/10.1023/A:1016359503796
  10. M. Yan, H. Tamura, and K. Tanno, "A Study on Gaze Estimation System Using Cross-Channels Electrooculogram Signals," Proceeding of International Multiconference on Engineering Computer Science, Vol. I, pp. 112-116, 2014.
  11. J.-Z. Tsai and T.-S. Chen, "Eye-writing Communication for Patients with Amyotrophic Lateral Sclerosis," Proceeding of SIGACCESS Conference on Computers and Accessibility, pp. 239-240, 2009.
  12. J. Hori, K. Sakano, and Y. Saitoh, "Development of Communication Supporting Device Controlled by Eye Movements and Voluntary Eye Blink," Proceeding of the 26th International Conference of the IEEE Engineering in Medicine and Biology Society, Vol. 6, pp. 4302-4305, 2004.
  13. M.R. Kim and G. Yoon, "Control Signal from EOG Analysis and Its Application," International Journal of Electrical, Computer, Electronics and Communication Engineering, Vol. 7, No. 10, pp. 864-867, 2013.
  14. A. Bulling, D. Roggen, and G. Troster, "Wearable EOG Goggles: Seamless Sensing and Context-Awareness in Everyday Environments," Journal of Ambient Intelligence and Smart Environments, Vol. 1, No. 2, pp. 157-171, 2009.
  15. R.T. Ngomba, I. Santolini, T.E. Salt, F. Ferraguti, G. Battaglia, F. Nicoletti, and G. van Luijtelaar, "Metabotropic Glutamate Receptors in The Thalamocortical Network: Strategic Targets for The Treatment of Absence Epilepsy," Epilepsia, Vol. 52, No. 7, pp. 1211-1222, 2011. https://doi.org/10.1111/j.1528-1167.2011.03082.x
  16. K. Lee, W. Chang, S. Kim, and C. Im, "Real-time 'Eye-writing' Recognition Using Electrooculogram (EOG)," IEEE Transactions on Neural Systems and Rehabilitation Engineering, Vol. 25, No.1, pp. 37-48, 2017. https://doi.org/10.1109/TNSRE.2016.2542524
  17. F. Fang and T.Shinozaki, "Electrooculography Based Continuous Eye-writing Recognition System for Efficient Assistive Communication Systems," Plos One, Vol. 13, No.2, pp. 1-20, 2018.
  18. W.-D. Chang, H.-S. Cha, D.Y. Kim, S.H. Kim, and C.-H. Im, "Development of an Electrooculogram-based Eye-computer Interface for Communication of Individuals with Amyotrophic Lateral Sclerosis," Journal of Neuro Engineering and Rehabilitation, Vol. 14, No. 1, Article ID 89, 2017.
  19. A.E. Hramov, A.A. Koronovskii, V.A. Makarov, A.N. Pavlov, and E. Sitnikova, Wavelets in Neuroscience, Springer Heidelberg, New York, 2015.
  20. W.-D. Chang and J. Shin, "Dynamic Positional Warping: Dynamic Time Warping for Online Handwriting," International Journal of Pattern Recognition and Artificial Intelligence, Vol. 23, No. 5, pp. 967-986, 2009. https://doi.org/10.1142/S0218001409007454
  21. W.-D. Chang and J. Shin, "DPW Approach for Random Forgery Problem in Online Handwritten Signature Verification," Proceedings of 4th International Conference on Networked Computing and Advanced Information Management, Vol. 1, pp.347-352, 2008.
  22. W.-D. Chang, H. Cha, C. Lee, H.-C. Kang, and C.-H. Im, "Automatic Identification of Interictal Epileptiform Discharges in Secondary Generalized Epilepsy," Computational and Mathematical Methods in Medicine, Vol. 2016, Article ID 8701973, 2016.

Cited by

  1. 3차원 쉐어렛 변환과 심층 잔류 신경망을 이용한 무참조 스포츠 비디오 화질 평가 vol.23, pp.12, 2018, https://doi.org/10.9717/kmms.2020.23.12.1447