Journal of the Korea Computer Graphics Society (한국컴퓨터그래픽스학회논문지)

Korea Computer Graphics Society (한국컴퓨터그래픽스학회)
권호 표지
DOI QR코드

DOI QR Code

A Study on the Interaction with Virtual Objects through XR Hands

XR Hands를 통한 가상 객체들과의 상호 작용에 관한 연구

  • BeomJun Jo (Department of Game Design and Development, Sangmyung University) ;
  • SeongKi Kim (Department of Computer Engineering, Chosun University)
  • Received : 2024.06.15
  • Accepted : 2024.07.05
  • Published : 2024.07.25
Download PDF
⟨ Previous Next ⟩

Abstract

Hand tracking is currently one of the most promising technologies in XR with the release of extended reality (XR) devices, in which hand tracking is used as the main manipulation. Hand tracking offers advantages in terms of immersion and realism, and as a result, it is being employed in a range of fields, including education, business, and medical care. The archery movement requires using both hands at the same time, but requires sophistication to hit the target and is a movement that has cultural and sports significance in the past. This study aimed to implement this archery movement. Therefore, this paper used the XR Hands package provided by Unity to recognize hand movements, explored the underlying OpenXR, and finally implemented the archery movement and tested it in Meta Quest 2.

핸드트래킹이 주된 조작이 되는 기기가 출시됨에 따라 현재 확장현실 분야의 관심사 중 하나는 핸드트래킹이다. 핸드트래킹은 사용자에게 몰입감 및 현실감 측면에서 장점이 있으며 그에 따라 교육, 엔터테인먼트, 의료 등 다양한 분야에서 활용되고 있다. 활쏘는 동작은 양손을 동시에 써야하는 동시에 표적을 맞추기 위해서는 정교함을 요하는 과거 문화적 스포츠적 의의를 가지는 동작이다. 본 연구는 이러한 활쏘는 동작을 구현하는 것을 목표로 했다. 따라서 본 논문은 유니티가 제공하는 XR Hands 패키지를 활용하여 손동작을 인식하도록 했으며 기반이 되는 OpenXR 에 대한 탐구했다. 최종적으로는 활 쏘는 동작을 구현했고 메타 퀘스트 2 에서 테스트했다.

Keywords

Acknowledgement

This study was supported by research fund from Chosun University, 2024.

References

  1. Apple, Apple Vision Pro, Apple Vision Pro Overview, available: https://www.apple.com/apple-vision-pro/ 
  2. The Khronos Group, OpenXR, available: https://www.khronos.org/openxr/ 
  3. Valve, OpenVR, Steamworks Documentation, available: https://partner.steamgames.com/doc/features/steamvr/openvr 
  4. S.Li, Notification System for Unity OpenXR, dissertion, California Polytechnic State University, 2023
  5. M.Huzaifa et al., ILLIXR: An Open Testbed to Enable Extended Reality Systems Research, IEEE Micro, 42(4):97-106, 2024  https://doi.org/10.1109/MM.2022.3161018
  6. C.Runde, XR Standardization. A Global Overview, EuroXR 2023 Conference, 2023 
  7. W3C, WebXR Device API, W3C Candidate Recommendation Draft, available: https://www.w3.org/TR/webxr/ 
  8. K.Jinkyu, OpenXR and WebXR in virtual augmented reality, Broadcast and Media, 26(1):12-18, 2021 
  9. V.Juranek, Virtual reality toolkit for the Unity game engine, dissertation, Masaryk University, 2021 
  10. American Society for Surgury of the Hand, Joints - finger joints, Handcare available: https://www.assh.org/handcare/safety/joints 
  11. M.Tavakoli, R.Batista, and L.Sgrigna, The UC Softhand: Light Weight Adaptive Bionic Hand with a Compact Twisted String Actuation System, actuators, 5(1), 2015 
  12. The Khronos Group, Conventions of hand joints, The OpenXR specification, available: https://registry.khronos.org/OpenXR/specs/1.0/html/xrspec.html#XR_EXT_hand_tracking 
  13. Unity, Hand data model, Unity Manual, available: https://docs.unity3d.com/Packages/com.unity.xr.hands@1.1/manual/hand-data/xr-hand-data-model.html 
  14. Unity, Finger shape, Unity Manual, available: https://docs.unity3d.com/Packages/com.unity.xr.hands@1.4/manual/gestures/finger-shapes.html 
  15. Unity, Hand orientation, Unity Manual, available: https://docs.unity3d.com/Packages/com.unity.xr.hands@1.4/manual/gestures/hand-orientation.html