Journal of the Korea Computer Graphics Society (한국컴퓨터그래픽스학회논문지)

Korea Computer Graphics Society (한국컴퓨터그래픽스학회)
권호 표지
DOI QR코드

DOI QR Code

3D Surface Painting in VR using Force Feedback

포스 피드백을 이용한 가상현실에서의 3차원 표면 페인팅

  • Kim, Minyoung (Dept. of Computer Science and Engineering, Ewha Womans University) ;
  • Kim, Young J. (Dept. of Computer Science and Engineering, Ewha Womans University)
  • 김민영 (이화여자대학교 컴퓨터공학과) ;
  • 김영준 (이화여자대학교 컴퓨터공학과)
  • Received : 2020.01.06
  • Accepted : 2020.03.20
  • Published : 2020.06.01
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper, we propose haptic interfaces based on force feedback to provide a physical painting experience to virtual reality users. Through this system, the user can create surface-based painting holding a haptic stylus, while utilizing both visual feedback from the worn HMD and haptic feedback during painting. In particular, the haptic interfaces simulate the physical interaction between painting brush and painting, which can help to improve the spatial perception of users and compensate for visual feedback. This can reduce laborious drawing works to repeatedly paint strokes and therefore yield a better painting performance. As a result, users can experience more effective and realistic VR painting with this system.

본 연구에서는 가상 공간(VR) 사용자에게 반응형 페인팅 경험을 제공하기 위한 포스 피드백 기반 햅틱 페인팅 인터페이스를 제안한다. 제안하는 시스템에서는 헤드 마운트 디스플레이(HMD)를 착용한 사용자가 스타일러스 타입의 햅틱 장비를 이용하여 시각적 피드백과 햅틱 인터페이스의 촉각적 피드백을 동시에 활용하며 가상 공간에서의 표면기반 3차원 페인팅을 생성해낼 수 있다. 특히 햅틱 인터페이스는 가상 공간 상에서 페인팅 브러시와 페인팅과의 물리적 상호작용을 구현하여 VR 페인팅의 반응형 피드백을 제공한다. 이는 가상 공간에서 사용자의 공간적 인지력 향상에 도움을 주고 부족한 시각적 피드백을 보완할 수 있다. 이를 통해 사용자는 불필요한 반복적 페인팅 작업을 줄여 페인팅 작업의 효율을 높이고 페인팅의 결과물을 향상시킬 수 있으며 결과적으로 보다 실감나는 VR 페인팅을 경험할 수 있다.

Keywords

References

  1. Google, "Tilt brush by google," https://www.tiltbrush.com/, 2016.
  2. Facebook, "Quill by Facebook," https://quill.fb.com/, 2016.
  3. Y. Kim, B. Kim, and Y. J. Kim, "Dynamic deep octree for high-resolution volumetric painting in virtual reality," in Computer Graphics Forum, vol. 37, no. 7, 2018, pp. 179-190. https://doi.org/10.1111/cgf.13558
  4. R. Arora, R. H. Kazi, F. Anderson, T. Grossman, K. Singh, and G. Fitzmaurice, "Experimental Evaluation of Sketching on Surfaces in VR," Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems - CHI'17, pp. 5643-5654, 2017.
  5. D. R. Lampton, D. P. McDonald, M. Singer, and J. P. Bliss, "Distance estimation in virtual environments," in Proceedings of the human factors and ergonomics society annual meeting, vol. 39, no. 20. SAGE Publications Sage CA: Los Angeles, CA, 1995, pp. 1268-1272.
  6. L. Bouguila, M. Ishii, and M. Sato, "Effect of coupling haptics and stereopsis on depth perception in virtual environment," in Proc. of the 1st Workshop on Haptic Human Computer Interaction, 2000, pp. 54-62.
  7. E.-L. Sallnas, K. Rassmus-Grohn, and C. Sjostrom, "Supporting presence in collaborative environments by haptic force feedback," ACM Transactions on Computer-Human Interaction (TOCHI), vol. 7, no. 4, pp. 461-476, 2000. https://doi.org/10.1145/365058.365086
  8. E. Sachs, A. Roberts, and D. Stoops, "3-draw: A tool for designing 3d shapes," IEEE Computer Graphics and Applications, no. 6, pp. 18-26, 1991.
  9. S. Snibbe, S. Anderson, and B. Verplank, "Springs and constraints for 3d drawing," in Proceedings of the Third Phantom Users Group Workshop, 1998.
  10. D. Keefe, R. Zeleznik, and D. Laidlaw, "Drawing on air: Input techniques for controlled 3d line illustration," IEEE Transactions on Visualization and Computer Graphics, vol. 13, no. 5, pp. 1067-1081, 2007. https://doi.org/10.1109/TVCG.2007.1060
  11. B. Baxter, V. Scheib, M. C. Lin, and D. Manocha, "Dab: interactive haptic painting with 3d virtual brushes," in Proceedings of the 28th annual conference on Computer graphics and interactive techniques. ACM, 2001, pp. 461-468.
  12. D. F. Keefe, D. A. Feliz, T. Moscovich, D. H. Laidlaw, and J. J. LaViola Jr, "Cavepainting: a fully immersive 3d artistic medium and interactive experience," in Proceedings of the 2001 symposium on Interactive 3D graphics. Citeseer, 2001, pp. 85-93.
  13. S. Schkolne, M. Pruett, and P. Schroder, "Surface drawing: creating organic 3d shapes with the hand and tangible tools," in Proceedings of the SIGCHI conference on Human factors in computing systems. ACM, 2001, pp. 261-268.
  14. G. Wesche and H.-P. Seidel, "Freedrawer: a free-form sketching system on the responsive workbench," in Proceedings of the ACM symposium on Virtual reality software and technology. ACM, 2001, pp. 167-174.
  15. B. G. Witmer and P. B. Kline, "Judging perceived and traversed distance in virtual environments," Presence, vol. 7, no. 2, pp. 144-167, 1998. https://doi.org/10.1162/105474698565640
  16. R. Schmidt, A. Khan, G. Kurtenbach, and K. Singh, "On expert performance in 3d curve-drawing tasks," in Proceedings of the 6th eurographics symposium on sketch-based interfaces and modeling. ACM, 2009, pp. 133-140.
  17. M. D. B. Machuca, P. Asente, W. Stuerzlinger, J. Lu, and B. Kim, "Multiplanes: Assisted freehand vr sketching," in Proceedings of the Symposium on Spatial User Interaction. ACM, 2018, pp. 36-47.
  18. M. Kim and Y. J. Kim, "Haptic interfaces for tangible digital painting in VR (extended abstract)," in Proceedings of the Korea Computer Graphics Society, 2019, pp. 20-22.
  19. Mozilla, "A-Painter," https://aframe.io/a-painter/, 2019.
  20. 3DSystems, "Touch Haptic Device," https://3dsystems.com/haptics-devices/touch, 2019.
  21. M. O. Rudel, J. Ganser, R. Weller, and G. Zachmann, "Unrealhaptics: A plugin-system for high fidelity haptic rendering in the unreal engine," in International Conference on Virtual Reality and Augmented Reality. Springer, 2018, pp. 128-147.
  22. B. Laugwitz, T. Held, and M. Schrepp, "Construction and evaluation of a user experience questionnaire," in Symposium of the Austrian HCI and Usability Engineering Group. Springer, 2008, pp. 63-76.
  23. B. G. Witmer and M. J. Singer, "Measuring presence in virtual environments: A presence questionnaire," Presence, vol. 7, no. 3, pp. 225-240, 1998. https://doi.org/10.1162/105474698565686