Journal of Sensor Science and Technology (센서학회지)

The Korean Sensors Society (한국센서학회)
권호 표지
DOI QR코드

DOI QR Code

Prediction of Head Movements Using Neck EMG for VR

근전도 신호를 이용한 헤드-트래킹 지연율 감소 방안 연구

  • Jung, Jun-Young (Department of Mechanical and Automotive Engineering, Seoul National Unversity of Science and Technology) ;
  • Na, Jung-Seok (Department of Mechanical and Automotive Engineering, Seoul National Unversity of Science and Technology) ;
  • Lee, Chae-Woo (Department of Mechanical and Automotive Engineering, Seoul National Unversity of Science and Technology) ;
  • Lee, Gihyeon (Department of Mechanical and Automotive Engineering, Seoul National Unversity of Science and Technology) ;
  • Kim, Jinhyun (Department of Mechanical and Automotive Engineering, Seoul National Unversity of Science and Technology)
  • 정준영 (서울과학기술대학교 기계자동차공학과) ;
  • 나정석 (서울과학기술대학교 기계자동차공학과) ;
  • 이채우 (서울과학기술대학교 기계자동차공학과) ;
  • 이기현 (서울과학기술대학교 기계자동차공학과) ;
  • 김진현 (서울과학기술대학교 기계자동차공학과)
  • Received : 2016.09.26
  • Accepted : 2016.09.30
  • Published : 2016.09.30
Download PDF
⟨ Previous Next ⟩

Abstract

The study about VR (Virtual Reality) has been done from the 1960s, but technical limits and high cost made VR hard to commercialize. However, in recent, high resolution display, computing power and 3D sensing have developed and hardware has become affordable. Therefore, normal users can get high quality of immersion and interaction. However, HMD devices which offer VR environment have high latency, so it disrupts the VR environment. People are usually sensitive to relative latency over 20ms. In this paper, as adding the Electromyogram (EMG) sensors to typical IMU sensor only system, the latency reduction method is proposed. By changing software and hardware components, some cases the latency was reduced significantly. Hence, this study covers the possibility and the experimental verification about EMG sensors for reducing the latency.

Keywords

References

  1. R. Azuma, Y. Baillot, R. Behringer, S. Feiner, S. Julier, and B. MacIntyre, "Recent advances in augmented reality", IEEE Comput. Grap. Appl., Vol. 21, No. 6, pp. 34-47, 2001. https://doi.org/10.1109/38.963459
  2. O. Cakmakci, J. Rolland, "Head-worn displays: a review", J. Display Technol., Vol. 2, No. 3, pp. 199-216, 2006. https://doi.org/10.1109/JDT.2006.879846
  3. C. R. Spitzer and C. Spitzer, Digital Avionics Handbook, CRC Press, 2000.
  4. J. Han, G. Lee, "VR Tourism Content Using the HMD Device", J. the Korea Contents Assoc., Vol. 15, No. 3, pp. 40-47, 2015.
  5. J. P. Rolland, H. Hua, Head-mounted display systems, Encyclopedia of optical engineering, pp. 1-13, 2005.
  6. J. P. Rolland, L. Davis and Y. Baillot, A survey of tracking technology for virtual environments, Fundamentals of wearable computers and augmented reality, pp. 67-112, 2001.
  7. Y. Akatsuka and G. A. Bekey, "Compensation for end to end delays in a VR system", Proc. of IEEE Conf. on Virtual Reality Annual International Symposium, pp. 156-159, 1998.
  8. L. Chai, K. Nguyen, B. Hoff and T. Vincent, "An adaptive estimator for registration in augmented reality", Augmented Reality, 1999.(IWAR'99) Proceedings. 2nd IEEE and ACM International Workshop on. IEEE, pp. 23-32, 1999.
  9. M. C. Jacobs and M. A. Livingston, "Managing latency in complex augmented reality systems", Proceedings of the 1997 symposium on Interactive 3D graphics. ACM, pp. 49- 54, 1997.
  10. M. J. Regan, G. S. Miller, S. M. Rubin and C. Kogelnik, "A real-time low-latency hardware light-field renderer", Proceedings of the 26th annual conference on Computer graphics and interactive techniques. ACM Press/Addison-Wesley Publishing Co., pp. 287-290, 1999.
  11. R. Kijima, E. Yamada and T. Ojika, "A development of reflex HMD-HMD with time delay compensation capability", Proc. 2nd Int'l Symp. Mixed Reality., pp. 40-47, 2001.
  12. M. R. Mine, "Characterization of end-to-end delays in head-mounted display systems", The University of North Carolina at Chapel Hill, TR93-001, 1993.
  13. K. I. Morishige, T. Kurokawa, M. Kinoshita, H. Takano and T. Hirahara, "Prediction of head-rotation movements using neck EMG signals for auditory tele-existence robot "Tele- Head", In Robot and Human Interactive Communication, RO-MAN 2009. The 18th IEEE International Symposium, pp. 1080-1086, 2009.
  14. S. Guo, M. Pang, B. Gao, H. Hirata and H. Ishihara, "Comparison of sEMG-Based Feature Extraction and Motion Classification Methods for Upper-Limb Movement", Sens., Vol. 15, No. 4, pp. 9022-9038, 2015. https://doi.org/10.3390/s150409022
  15. http://www.snuh.org (retrieved on Oct. 20, 2015)
  16. F. Farshadmanesh, P. Byrne, G. P. Keith, H. Wang, B. D. Corneil and J. D. Crawford, "Cross-validated models of the relationships between neck muscle electromyography and three-dimensional head kinematics during gaze behavior", J. Neurophysiol., Vol. 107, No. 2, pp. 573-590, 2012. https://doi.org/10.1152/jn.00315.2011
  17. M. R. Williams and R. F. Kirsch, "Evaluation of head orientation and neck muscle EMG signals as three-dimensional command sources", J. Neuroeng. Rehabil., Vol. 12, No. 1, 2015.
  18. M. Kim, J. Lee, H. Ko and K. Kim, "A preliminary analysis of analysis window size and voting size with a time delay for a robust real-time sEMG pattern recognition", Ubiquitous Robots and Ambient Intelligence (URAI), 2014 11th International Conference on. IEEE, pp. 121-126, 2014.
  19. T. Zhang, L. Li and H. Yan, "The HCI method for upper limb disabilities based on EMG and gyros", Advanced Motion Control (AMC), 2014 IEEE 13th International Workshop on. IEEE, pp. 434-439, 2014.
  20. A. Martinez-Coll, C. Papacosta and H. Nguyen, "Surface electromyography (sEMG) of the sternocleidomastoid (SCM) muscle for variable control using head movement technology", Engineering in Medicine and Biology Society, 2003. Proceedings of the 25th Annual International Conference of the IEEE. Vol. 2, pp. 1598-1601, 2003.