Korean Journal of Computational Design and Engineering (한국CDE학회논문집)

Society for Computational Design and Engineering (한국CDE학회)
권호 표지

Hand Gesture based Manipulation of Meeting Data in Teleconference

핸드제스처를 이용한 원격미팅 자료 인터페이스

  • 송제훈 (광주과학기술원 정보기전공학부) ;
  • 최기호 (광주과학기술원 정보기전공학부) ;
  • 김종원 (광주과학기술원 정보기전공학부) ;
  • 이용구 (광주과학기술원 정보기전공학부)
  • Published : 2007.04.30
Download PDF
⟨ Previous Next ⟩

Abstract

Teleconferences have been used in business sectors to reduce traveling costs. Traditionally, specialized telephones that enabled multiparty conversations were used. With the introduction of high speed networks, we now have high definition videos that add more realism in the presence of counterparts who could be thousands of miles away. This paper presents a new technology that adds even more realism by telecommunicating with hand gestures. This technology is part of a teleconference system named SMS (Smart Meeting Space). In SMS, a person can use hand gestures to manipulate meeting data that could be in the form of text, audio, video or 3D shapes. Fer detecting hand gestures, a machine learning algorithm called SVM (Support Vector Machine) has been used. For the prototype system, a 3D interaction environment has been implemented with $OpenGL^{TM}$, where a 3D human skull model can be grasped and moved in 6-DOF during a remote conversation between distant persons.

Keywords

References

  1. Wise, Samuel A., Rosen, Joseph, Fisher, Scott, Glass, Karen, Wong, Yunko, 'Initial Experience with the Data Glove, a Semi-automated System for Quantification of Hand Function', RESNA '87, Meet the Challenge, Proc. of the 10th Annu Conf on Rehabil Technol, pp. 259-260, 1987
  2. Kim, Y. S., Soh, B. S. and Lee, S.-G., 'A New Wearable Input Device: SCURRY', IEEE Transactions on Industrial Electronics, Vol. 52, No.6, pp. 1490-1499, 2005 https://doi.org/10.1109/TIE.2005.858736
  3. Weissmann, John, Salomon, Ralf, 'Gesture Recognition for Virtual Reality Applications Using Data Gloves and Neural Networks', Proceedings of the International Joint Conference on Neural Networks, Vol. 3, pp. 2043-2046, 1999
  4. Wang, H., Leu, M.C., and Oz, C., 'American Sign Language Recognition Using Multi-dimensional Hidden Markov Models', Journal of Information Science and Engineering, Vol. 22, No.5, pp. 1109-1123, 2006
  5. Wan, H., Luo, Y, Gao, S. and Peng, Q., 'Realistic Virtual Hand Modeling with Applications for Virtual Grasping', Proceedings VRCAI 2004 - ACM SIGGRAPH International Conference on Virtual Reality Continuum and Its Applications in Industry, pp. 8187, 2004
  6. Renambot, L., Rao, A., Singh, R., Jeong, B., Krishnaprasad, N., Vishwanath, V., Chandrasekhar, V., Schwarz, N., Spale, A., Zhang, C., Goldman, G, Leigh, J. and Johnson, A., 'SAGE: The Scalable Adaptive Graphics Environment', Proceedings of WACE 2004, 2004
  7. 최기호, 김재윤, Dao Le Hai, 김종운, '다자간 협엽 관경에서 다중 고해상도 비디오와 그래픽스 가시화를 위한 Tiled-display 시스템 구현', 한국통신학회(KICS) 하계종합학술발표회, Vol. 33, pp. 282-285, 2006
  8. Toomey, Lori, Adams, Lia, Churchill, Elizabeth, 'Meetings in a Virtual Space: Creating a Digital Document', Proceedings of the Hawaii International Conference on System Sciences, Vol. 2, pp. 236-244, 1998
  9. Zhang, L., Shi, Y., Chen, J., 'Drag and Drop by Laser Pointer: Seamless Interaction with Multiple Large Displays', Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 4159 LNCS, pp. 12-20, 2006
  10. Bi, X., Shi, Y and Chen, X., 'uPen: A Smart Penliked Device for Facilitating Interaction on Large Displays', Proceedings of the First IEEE International Workshop on Horizontal Interactive HumanComputer Systems, TABLETOP'06, art. no. 1579208, pp. 160- 166, 2006
  11. Yoshimi, B. H. and Pingali, G S., 'A Multimodal Speaker Detection and Tracking System for Teleconferencing', Proceedings of the ACM International Multimedia Conference and Exhibition, pp. 427-428, 2002
  12. Osowski, S., Siwek, K. and Markiewicz, T., 'MLP and SVM Networks - A Comparative Study', Report - Helsinki University of Technology, Signal Processing Laboratory, No. 46, pp. 37-40, 2004
  13. Collobert, R. and Bengio, S., 'SVMTorch: Support Vector Machines for Large-scale Regression Problems', Journal of Machine Learning Research, Vol. 1, No.2, pp. 143-160, 2001 https://doi.org/10.1162/15324430152733142
  14. Yu Hen Hu and Jenq-Neng Hwang, 'Handbook of Neural Network Signal Processing', CRC Press, 2002
  15. 'Virtual Hand$^{\circledR}$ User's Guide V2.7', Immersion Corp, 2001