Upper Limb Motion Detection Including Fingers Using Flex Sensors and Inertial Sensors

휘어짐센서와 관성센서를 이용한 손가락을 포함한 상지 운동 검출

  • Kim, Yeon-Jun (Department of Electronic and Electrical Engineering, Hankyong National University) ;
  • Yoo, Jae-Ha (Department of Electronic and Electrical Engineering, Hankyong National University) ;
  • Kim, Dong-Yon (Department of Electronic and Electrical Engineering, Hankyong National University) ;
  • Kim, Soo-Chan (Department of Electronic and Electrical Engineering, Hankyong National University)
  • 김연준 (한경대학교 전자전기공학부) ;
  • 유재하 (한경대학교 전자전기공학부) ;
  • 김동연 (한경대학교 전자전기공학부) ;
  • 김수찬 (한경대학교 전자전기공학부)
  • Received : 2020.06.03
  • Accepted : 2020.08.20
  • Published : 2020.09.30

Abstract

The utilization of virtual reality is increasing not only in games but also in medical care such as rehabilitation. Due to the convenience, the motion of the upper limb is detected using a non-contact method using video or a handheld type mouse, etc. In this paper, we implemented a glove which can measure finger movements and upper limb movements by using flex sensors whose resistance value changes according to the degree of folding and inertial sensors which can obtain direction information in space. We showed the upper arm movements including finger movements with signals obtained from the implemented glove on the open software platform, Processing. The sensitivity of each finger movement was 0.5deg, and the sensitivity of the upper limb motion was 0.6deg.

가상현실의 활용도는 게임뿐만 아니라 재활 치료와 같은 의료에서도 높아지고 있다. 편리성으로 인하여 비디오를 활용한 비접촉 방식과 핸드 헬드 타입의 마우스 등을 사용하여 상지 움직임을 감지한다. 본 논문에서는 접힌 정도에 따라 저항값이 변화되는 휘어짐센서와 공간에서의 방향 정보를 얻을 수 있는 관성센서를 사용하여 손가락 움직임과 함께 상지 동작도 획득할 수 있는 장갑을 구현하였다. 구현된 장갑에서 얻은 신호로 오픈 소스 플랫폼인 Processing을 사용하여 손가락 움직임을 포함한 상지 동작을 실시간으로 표현하였다. 각 손가락 움직임의 감도는 0.5deg, 상지 동작 감도는 0.6deg였다.

Keywords

References

  1. J. H. Lee, "VR system environment technologies and user input elements," J of the Kor. Soc. of Des. Cul., pp.585-596, 2018.
  2. Y. C. Jang, J. S. Im, J. H. Kim, "Industry trends of VR/AR," J. of the KICS, vol. 36, no. 1, pp.35-41, 2018.
  3. Comparison of virtual reality headsets, 2020. https://en.wikipedia.org/wiki/Comparison_of_virtual_reality_headsets
  4. S. C. Kim, M. J. Park, "Evaluation of a head-mouse combined with Gyro- and Opto-sensors," J. of Adv. Info. Tech. and Conv., vol. 9, no. 6, pp. 97-104, 2011
  5. Processing, 2020. https://processing.org.
  6. FS7954, 2020. https://www.sparkfun.com/datasheets/Sensors/Flex/flex22.pdf.
  7. MPU-9150, 2020. https://invensense.tdk.com/wp-content/uploads/2015/02/MPU-9150-Datasheet.pdf
  8. Teensy USB Development Board, 2018. https://www.pjrc.com/store/teensy32.html.
  9. HC-06, 2020. https://www.olimex.com/Products/Components/RF/BLUETOOTH-SERIAL-HC-06/resources/hc06.pdf
  10. Gimbal lock, 2020. https://en.wikipedia.org/wiki/Gimbal_lock.