Journal of the Korean Society for Computer Game (한국컴퓨터게임학회논문지)

Korean Society for Computer Game (한국컴퓨터게임학회)
권호 표지

A Study on the VR Payment System using Hand Gesture Recognition

손 제스쳐 인식을 활용한 VR 결제 시스템 연구

  • Received : 2018.12.12
  • Accepted : 2018.12.22
  • Published : 2018.12.31
⟨ Previous Next ⟩

Abstract

Electronic signatures, QR codes, and bar codes are used in payment systems used in real life. Research has begun on the payment system implemented in the VR environment. This paper proposes a VR electronic sign system that uses hand gesture recognition to implement an existing payment system in a VR environment. In a VR system, you can not hit the keyboard or touch the mouse. There can be several ways to configure a payment system with a VR controller. Electronic signage using hand gesture recognition is one of them, and hand gesture recognition can be classified by the Warping Methods, Statistical Methods, and Template Matching methods. In this paper, the payment system was configured in VR using the $p algorithm belonging to the Template Matching method. To create a VR environment, we implemented a paypal system where actual payment is made using Unity3D and Vive equipment.

실생활에서 사용되는 결제 시스템에는 전자 사인, QR 코드, 바코드들이 사용된다. VR 환경 내에서 구현되어 있는 결제 시스템은 점점 연구가 시작되고 있다. 본 논문은 기존의 결제 시스템을 VR 환경에서 구현하기 위해 손 제스쳐 인식을 이용한 VR 전자사인 시스템을 제안한다. VR 시스템에서는 키보드를 두드리거나 마우스를 건드릴 수 없는 상황이다. VR 컨트롤러를 가지고 결제 시스템을 구성하기 위한 방법에는 여러 가지가 있을 수 있다. 손 제스처 인식을 이용한 전자사인이 그 중 하나인데, 손 제스쳐 인식에는 크게 Warping Methods, Statistical Methods, Template Matching 방법으로 분류할 수 있다. 본 논문에서는 Template Matching 방법에 속한 $p 알고리즘을 이용하여, VR에서 결제 시스템을 구성하였다. 그리고, VR 환경을 조성하기 위해서 Unity3D와 Vive 장비를 이용해서 실제 결제가 이루어지는 paypal 시스템을 구현하였다.

Keywords

Acknowledgement

Supported by : National Research Foundation of Korea

References

  1. Sezgin, T. M., and Davis, R., "HMM-based efficient sketch recognition" Proceedings of the 10th International Conference: Intelligent User Interfaces, pp.281-283, 2005.
  2. Rubine, D., "Specifying gestures by example" SIGGRAPH, pp.329-337, 1991.
  3. Willems, D., Niels, R., Gerven, M. v., and Vuurpijl, L., "Iconic and multi-stroke gesture recognition" Pattern Recognition ELSEVIER, Vol. 42, pp.3303-3312, 2009. https://doi.org/10.1016/j.patcog.2009.01.030
  4. Levent, B., Thomas, F., "Hierarchical parsing and recognition of hand-sketched diagrams" SIGGRAPH ELSEVIER, Vol. 42, pp.3303-3312, 2007.
  5. Radu-Daniel, V., Lisa, A., and Jacob, O. "Gestures as point clouds: a $P recognizer for user interface prototypes" The 14th ACM international conference on Multimodal intraction, pp.273-280, 2012.
  6. Cao, L., Liu, X., Zhou, T., Zhang, Z and Liu, O., "A Data Stream Outlier Delection Algorithm Based on Reverse K Nearest Neighbors" The 2010 International Symposium on Computational Intelligence and Design, 2010.
  7. Eamonn Keogh, Chotirat, A., " Exact indexing of dynamic time warping" Knowledge and Information, Vol. 7, pp.358-386, 2005. https://doi.org/10.1007/s10115-004-0154-9
  8. Hiroyuki, I., Tomokazu, T., Ichiro, I., Hiroshi, M., "A Hilbert warping method for handwriting gesture recognition" Pattern Recognition Elsevier, Vol. 43, pp.2799-2806, 2010. https://doi.org/10.1016/j.patcog.2010.02.021
  9. Sharad, V., Lei, L., Stuart, R.," Handwriting and Gestures in the Air, Recognizing on the Fly" Proceedings of the CHI, 2013.
  10. Rung, H., Ming, O., "A real-time continuous gesture recognition system for sign language" Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition, 1998.
  11. Kim, Byung-Hee, Chang, Byung-Tak, " Hangul Handwriting Recognition using Recurrent Neural Networks " KIISE Transactions on Computing Practices, Vol. 5, pp.316-321, 2017.
  12. Hur,Won-Suk, Lee,Sang-Jin , "Research on Secure Card-Payment System of Social Commerce" Korea Institute of Information Security & Cryptology, Vol. 22, No. 6, pp.1337-1344, 2012
  13. Hyeon Woo Nam, "A Study on the Structural Change and Competitiveness Enhancement Strategy of the Korean VR Theme Park Industry Focusing on the USA and China" Korea Society For Computer Game, , Vol. 31, No. 2, pp.81-90, 2016.
  14. Chang-Jo LEE, " Design and Implementation of User Interface for Welfare Oriented Cyber Certificates" Korea Society For Computer Game, No. 11, pp.79-86, 2007.
  15. Heejune Ahn, " Image-based Virtual Try-On System:Full Automatic System Design and its Performance" Korea Society For Computer Game, , Vol. 31, No. 3, pp.37-45, 2016
  16. LG VR,"LG Display", http://blog.lgdisplay.com/ September, 2018
  17. CGTN, "Alibaba reveals world's first VR payment system," https://www.youtube.com/watch?v=eptEqanhVdA, June, 2016.
  18. http://www.newscj.com/news/articleView.html?idxno=562158, December, 2018.