Haptic Media Broadcasting

촉각방송

  • Published : 2006.12.11

Abstract

With rapid development in ultra fast communication and digital multimedia, the realistic broadcasting technology, that can stimulate five human senses beyond the conventional audio-visual service is emerging as a new generation broadcasting technology. In this paper, we introduce a haptic broadcasting system and related core system and component techniques by which we can 'touch and feel' objects in an audio-visual scene. The system is composed of haptic media acquisition and creation, contents authoring, in the haptic broadcasting, the haptic media can be 3-D geometry, dynamic properties, haptic surface properties, movement, tactile information to enable active touch and manipulation and passive movement following and tactile effects. In the proposed system, active haptic exploration and manipulation of a 3-D mesh, active haptic exploration of depth video, passive kinesthetic interaction, and passive tactile interaction can be provided as potential haptic interaction scenarios and a home shopping, a movie with tactile effects, and conducting education scenarios are produced to show the feasibility of the proposed system.

최근 초고속 인터넷과 디지털미디어의 획기적인 발전으로 전통적인 시청각미디어의 한계를 뛰어넘어 인간의 오감을 자극할 수 있는 실감방송이 차세대 방송기술로 등장하고 있다. 본 논문은 인간의 오감 중 촉각을 중심으로 하여 시청자들이 시청각미디어를 만지고 느낄 수 이는 촉각방송시스템은 전체적으로 촉가미디어의 획득 및 생성하는 단계 다양한 촉각미디어를 한 화면에 편집하고 저작하는 단계, 저작된 콘텐츠를 압축 및 전송하는 단계, 전송된 콘텐츠를 단말장치를 통해 재현하는 단계로 이루어진다. 촉각방송에서 촉각미디어는 시청자가 미디어를 능동적으로 만지고 조작하거나 미디어에서 제공하는 움직임을 따라하거나 촉감을 피부로 느낄 수 있도록 3차원 현상, 조작기능(버튼, 슬라이더, 조이스틱 등), 촉각 표면 특성(딱딱함, 정적 마찰계수, 동적 마찰계수, 거칠기 등), 움직임(위치, 속도, 가속도 등), 촉감 정보 등을 포함한 매체로 정의한다. 제안한 촉각방송 시스템에서는 3차원 객체 만지고 조작하기, 3차원 영상 만지기, 역감 재생, 촉감 재생 등의 네 가지 촉각 상호작용이 가능하며 적용례로써 홈쇼핑, 촉감효과가 가미된 영화, 지휘 교육 시나리오를 제시하였다.

Keywords

References

  1. G. Riva, F. Davide, and W. IJsselstejin, "Being There: Concepts, Effects and Measurement of User Presence in Synthetic Environments," IOS Press, 2003
  2. F. Isgro, E. Trucco, P. Kauff, and O. Schreer, "Three-Dimensional Image Processing in the Future of Immersive Media", IEEE Transactions on Circuits and Systems for Video Technology, Vol. 14, No. 3, pp288-303, March 2004 https://doi.org/10.1109/TCSVT.2004.823389
  3. L. Meesters, W. IJsselstejin, and P. Seuntiens, " A Survey of Perceptual Evaluations and Requirements of Three-Dimensional TV", IEEE Transactions on Circuits and Systems for Video Technology, Vol. 14, No. 3, pp381-391, March 2004 https://doi.org/10.1109/TCSVT.2004.823398
  4. B. Witmer and M. Singer, "Measuring Presence in Virtual Environments: A Presence Questionnaire", Presence: Teleoperators and Virtual Environments, Vol. 7, No. 3, pp225-240, June 1998 https://doi.org/10.1162/105474698565686
  5. A. Smolic and P. Kauff, "Interactive 3-D Video Representation and Coding Technologies," Proc. IEEE, Vol. 93, No. 1, pp. 98-110, Jan. 2005 https://doi.org/10.1109/JPROC.2004.839608
  6. M. Reiner, "The Role of Haptics in Immersive Telecommunication environments" IEEE Transactions on Circuits and Systems for Video Technology, Vol. 14, No. 3, pp392-401, March 2004 https://doi.org/10.1109/TCSVT.2004.823399
  7. Ministry of Science and Technology in Korea, National Technology Roadmap, 20003
  8. G. C. Burdea, "Force and Touch Feedback for Virtual Reality," John Wiley & Sons. Inc., 1996
  9. 류제하, "실감형미디처 : 촉감기술", 정보처리학회지, 제10권, 제1호, pp40-47, Jan. 2003
  10. S. O'Modhrain and I. Oakley, "Touch TV: Adding Feeling to Broadcast Media", Proc. 1st European Conference of Interactive Television: from Viewers to Actors, pp41-47, Dec. 2003
  11. S. O'Modharain and I. Oakley, "Adding Interactivity: Active Touch in Broadcast Media", Proc. 12th Int. Symp. Haptic Interfaces for Virtual Environment and Teleoperator Systems (HAPTICS'04), pp293-294, Nov. 2004
  12. ISO/IEC 14496-1:2001, Coding of Audio-Visual Objects-Part 1: Systems, 2nd Edition, 20001
  13. 차종은, 류제하, "촉각방송과 촉각미디어," 한국멀티미디어학회지, 제10권, 제2호, pp. 63-72, June 2006
  14. J. Cha, J. Ryu, S. Kim, S. Eom, and B. Ahn, "Haptic Interaction in Realistic Multimedia Broadcasting", Lecture Notes in Computer Science, LNCS 333, pp482-490, 2004
  15. 3DV Systems Ltd., http://www.3dvsystems.com
  16. S-M Kim, J. Cha, Jeha Ryu, and K. H. Lee, "Depth Video Enhancement for Haptic Interaction using a Smooth Surface Reconstruction", IEICE Transactions on Information and Systems, Special Section on Artificial Reality and Telexistence, Vol. E89-D, No. 1, pp. 37-44, Jan. 2006
  17. J. Cha, S-M Kim, S-Y Kim, S. Kim, S-U Yoon, I. Oakley, J. Ryu, K. H. Lee, W. Woo, and Y-S. Ho, "Client System for Realistic Broadcasting : A First Prototype", Lecture Notes in Computer Science, LNCS 3768, pp. 176-186, Nov. 2005
  18. SenSable Technolgies, Inc., http://www.sensable.com
  19. http://www.chai3d.org
  20. J. Cha. S-Y Kim, Y-S Ho, and J. Ryu, "3D Video Player System with Haptic Interaction based on Depth Image-Based Representation", IEEE Transactions on Consumer Electornics, Vol. 52, No. 2, pp. 477-484, May 2006 https://doi.org/10.1109/TCE.2006.1649668