• Title/Summary/Keyword: Virtual speaker

Search Result 29, Processing Time 0.024 seconds

Proposal for a Sensory Integration Self-system based on an Artificial Intelligence Speaker for Children with Developmental Disabilities: Pilot Study

  • YeJin Wee;OnSeok Lee
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.17 no.4
    • /
    • pp.1216-1233
    • /
    • 2023
  • Conventional occupational therapy (OT) is conducted under the observation of an occupational therapist, and there are limitations in measuring and analyzing details such as degree of hand tremor and movement tendency, so this important information may be lost. It is therefore difficult to identify quantitative performance indicators, and the presence of observers during performance sometimes makes the subjects feel that they have to achieve good results. In this study, by using the Unity3D and artificial intelligence (AI) speaker, we propose a system that allows the subjects to steadily use it by themselves and helps the occupational therapist objectively evaluate through quantitative data. This system is based on the OT of the sensory integration approach. And the purpose of this system is to improve children's activities of daily living by providing various feedback to induce sensory integration, which allows them to develop the ability to effectively use their bodies. A dynamic OT cognitive assessment tool for children used in clinical practice was implemented in Unity3D to create an OT environment of virtual space. The Leap Motion Controller allows users to track and record hand motion data in real time. Occupational therapists can control the user's performance environment remotely by connecting Unity3D and AI speaker. The experiment with the conventional OT tool and the system we proposed was conducted. As a result, it was found that when the system was performed without an observer, users can perform spontaneously and several times feeling ease and active mind.

Virtual Sound Localization algorithm for Surround Sound Systems (서라운드시스템을 위한 가상 음상정위 알고리즘)

  • Lee Sin-Lyul;Han Ki-Young;Lee Seung-Rae;Sung Koeng-Mo
    • Proceedings of the Acoustical Society of Korea Conference
    • /
    • spring
    • /
    • pp.81-84
    • /
    • 2004
  • In this paper, we propose a virtual sound localization algorithm which improves the sound localization accuracy and sound color preservation for two channel and multi-channel surround speaker layouts. In conventional CPP laws, the sound direction is different from the panning angle and the sound color is different from real sound source especially when the speakers are spread out widely. To overcome this drawback, we design a virtual sound localization algorithm using directional psychoacoustic criteria (DPC) and sound color compensator (SCC). The analysis results show that in the case of the proposed system, the sound direction is the same as the panning angle in the audible frequency range and the sound color is less deviated from a real sound source than the conventional CPP law. In addition, its performance is verified by means of subjective tests using a real sound source.

  • PDF

Environment Adaptive Sound Localization for Multi-Channel Surround Sound System

  • Lee, Yoon Bae;Mariappan, Vinayagam;Cho, Juphil;Lee, Seon Hee
    • International journal of advanced smart convergence
    • /
    • v.5 no.4
    • /
    • pp.21-25
    • /
    • 2016
  • Recent development in multi-channel surround is emerging in various formats to provide better stereoscopic and sound effects to consumers in recent broadcasting. The ability sound localize the sound sources in space is most considerable design factor on multi-channel surround system for human earing perception model. However, this paper propose the change of the sound localization according to the spacing of the speakers, which is not covered in the existing research focus on sound system design. Presently the sound system uses the position and number of the speakers to localize the sound. In the multi-channel surround environment, the proposed design uses the sound localization is caused by the directional characteristics of the speaker, the distance between the speakers and the distance between the listener and the speaker according to the directivity is required. The proposed design is simulated using virtual measurement with MATLAB simulation environment and performances are measured.

Invisible Messenger: A System to Whisper in a Person′s Ear Remotely by integrating Visual Tracking and Speaker Array

  • Mizoguchi, Hiroshi;Kanamori, Tomohiko;Okabe, Kosuke;Hiraoka, Kazuyuki;Tanaka, Masaru;Shigehara, Takaomi;Mishima, Taketoshi
    • Proceedings of the IEEK Conference
    • /
    • 2002.07c
    • /
    • pp.1897-1900
    • /
    • 2002
  • This paper proposes a novel computer-human interface, named invisible Messenger. It integrates face detection and tracking, and speaker array signal processing. By speaker array it is possible to form acoustic focus at the arbitrary location that is measured by the face tracking. Thus the proposed system can whisper in a person's ear as if an invisible virtual messenger were standing by the person. Not only speculative discussion, the authors have implemented a working prototype system based upon the proposed idea. This paper also describes about this prototype. In order to confirm effectiveness of the proposed idea, the authors conduct experiments using the implemented system. Experimental results demonstrate the effectivenss of the proposed idea.

  • PDF

Smart Virtual Sound Rendering System for Digital TV (지능형 입체음향 TV)

  • Kim, Sun-Min;Kong, Dong-Geon
    • Proceedings of the Korean Society for Noise and Vibration Engineering Conference
    • /
    • 2008.04a
    • /
    • pp.939-946
    • /
    • 2008
  • 본 논문은 시청자의 위치에 최적화된 입체음향을 제공하는 TV 개발에 관한 것으로 2 개의 TV 스피커만으로 5.1 채널 스피커가 주는 입체음향 효과를 제공해준다. 기존의 Speaker Virtualizer 기술은 시청자가 특정 위치(Sweet Spot)를 벗어나면 입체음향 성능이 현저히 저하된다. 반면, 본 논문에서 제안하는 Adaptive Virtualizer 기술은 초음파가 장착된 리모콘을 사용하여 시청자의 위치를 인식하고 인식된 시청자의 위치 정보를 활용하여 청취위치에 해당하는 HRTF로부터 설계된 Filter를 Update 하고 두 스피커의 출력레벨 및 시간지연 값을 보정함으로써 최적의 입체음향을 재현한다. 본 논문에서는 실시간 구현을 위해 Speaker Virtualizer의 계산량을 최소화하는 기술을 제안하고 다양한 청취 위치에 해당하는 Filter를 설계하고 설계된 Filter를 효율적으로 Update 하는 Adaptive Virtualizer 기술을 제안한다. 또한, 초음파를 이용한 시청자 위치 인식 기술 및 전체 시스템 통합 기술을 제시한다.

  • PDF

Voice Verification System for m-Commerce on CDMA Network

  • Kyung, Youn-Jeong
    • The Journal of the Acoustical Society of Korea
    • /
    • v.22 no.4E
    • /
    • pp.176-182
    • /
    • 2003
  • As the needs for wireless Internet service is increasing, the needs for secure m-commerce is also increasing. Conventional security techniques are reinforced by biometric security technique. This paper utilized the voice as biometric security techniques. We developed speaker verification system for m-commerce (mobile commerce) via wireless internet and wireless application protocol (WAP). We named this system the mVprotek. We implemented the system as client-server architecture. The clients are mobile phone simulator and personal digital assistant (PDA). The verification results are obtained by integrating the mVprotek system with SK Telecom's code dimension multiple access (CDMA) system. Utilizing f-ratio weighting and virtual cohort model normalization showed much better performance than conventional background model normalization technique.

Real-Time 3D Sound Rendering System Implementation for Virtual Reality Environment (VR 환경을 위한 실시간 음장 재현 시스템 구현)

  • Chae, Soo-Bok;Bhang, Seung-Beum;Hwang, Shin;Ko, Hee-Dong;Kim, Soon-Hyob
    • Proceedings of the Korean Society for Emotion and Sensibility Conference
    • /
    • 2000.11a
    • /
    • pp.222-227
    • /
    • 2000
  • 본 논문은 VR시스템에서 실시간으로 3D Sound를 Rendering하기 위한 음장재현 시스템구현에 관한 것이다. 2개의 Speaker 또는 헤드폰을 사용하여 음장을 제어할 수 있다. 음장 제어는 레이 트레이싱(Ray Tracing)기법을 이용하여 음장을 시뮬레이션하고 가상 공간의 음장 파라미터를 추출하여 음원에 적용하면서 실시간으로 음장효과를 렌더링한다. 이 시스템은 펜티엄-II 333MHz, 128M RAM, SoundBlaster SoundCard를 사용한 시스템에서 구현하였다. 최종적으로 청취자는 2개의 스피커 또는 헤드폰을 이용하여 3D 음장을 경험하게 된다.

  • PDF

Effective layout of loudspeakers in a multichannel sound system for real time virtual sound reproduction (실시간 가상음장재현을 위한 멀티채널 시스템의 효과적인 스피커 배치)

  • Lee, Chan-Joo;Park, Young-Jin
    • Proceedings of the Korean Society for Noise and Vibration Engineering Conference
    • /
    • 2000.11a
    • /
    • pp.455-461
    • /
    • 2000
  • A multichannel signal processing algorithm for generating real time virtual sound field was proposed. Evaluation of the system performance was done by an objective function that minimizes the difference between the real and generated signals at each control point. Since impulse responses at the surface of a rigid sphere show characteristics similar to those of real HRTF, a rigid sphere model was adequate to simulate the multichannel sound system. A two-channel system and two four-channel systems were studied with various combinations of source locations and speaker positions. The results show that a two-channel system has its best configuration when the angle spanned by the loudspeakers is less than $60^{\circ}$. In the case of four-channel systems, the overall performance was highly improved with one pair of speakers fixed at an optimal position. Left/right symmetry was a reasonable choice, but the additional front/back symmetry degraded the performance of system.

  • PDF

The Analysis and Implementation of Realistic Sound using Doppler Effect (도플러 효과를 이용한 실감 음향 분석 및 구현)

  • Yim, Yong-Min;Lim, Heung-Jun;Heo, Jun-Seok;Park, Jun-Young;Do, Yun-Hyung;Lee, Kangwhan
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2017.05a
    • /
    • pp.523-526
    • /
    • 2017
  • In modern recently technology, 3D-Audio is used to enhance immersion in Virtual Reality. This includes interest of people about VR and AR, which related to the field of computer graphics. In fact, a lot of research has been carried out in recent years into a 3D sound field. However, the existing 3D generator device used for virtual reality does not contain Doppler effect occurred by the sound comes to or leave from a listener, while an angle from the listener and the altitude of the source sound are applied. Therefore, this paper present 3D real sound utilizing Doppler effect with spatial-rotation-speaker. We map the source sound in 3D-space into a real space where a user stays and present 3D real sound by manipulating with rotation angle, phase difference, sound output volume of the sound in 3D-space, according to the location of a virtual source sound. Utilizing both natural Doppler effect of rotating sound that is occurring by spatial-rotation-speaker and artificial Doppler effect generated by frequency-modulation of sound quality could improving the virtual reality for sound condition for perspective listening.

  • PDF

A Study on Real-Time 3D Sound Rendering for Virtual Reality Environment (VR환경에 알맞은 실시간 음장구현에 관한 연구)

  • Chae, Soo-Bok;Bhang, Seung-Beum;Shin, Hwang;Ko, Hee-Dong;Kim, Soon-Hyob
    • Proceedings of the IEEK Conference
    • /
    • 2000.09a
    • /
    • pp.197-200
    • /
    • 2000
  • 본 논문은 VR시스템에 사용되는 실시간 음향제시를 위한 시스템 구현에 관한 것이다. 2개의 Speaker 또는 헤드폰을 사용하여 음상제어, 음장제어의 두 부분으로 구성되어 있다. 음상제어 부분은 각각의 음원의 위치를 정위하고, 음장제어 부분은 레이 트레이싱(Ray Tracing)기법을 이용하여 음장을 시뮬레이션하고 가상 공간의 음장 파라미터를 추출하여 음원에 적용하면서 실시간으로 음장효과를 렌더링 한다. 이 시스템은 펜티엄-Ⅱ333MHz 시스템에서 구현하였다. 최종적으로 청취자는 2개의 스피커 또는 헤드폰을 이용하여 3D음장을 경험하게 된다.

  • PDF