• International journal of advanced smart convergence
• /
• v.11 no.2
• /
• pp.88-94
• /
• 2022

The relationship between sound and vision was experimentally confirmed by physicist Ernst Florens Friedrich Chladni as early as the 18th century and formally entered into systematic research. With the development of emerging media technology, sound reactive type visual content is not limited to a single visual interaction based on the vibration of sound, and its visual content shows a diversified and scalable development trend according to different purposes in many fields. This study analyzes the development and changes of sound visual art contents from early stage to modernization, and analyzes the development characteristic of sound visual art content in different fields and scene environments influence by interactive media, new media technologies and devices by means of case analysis. Through this research, it is expected that the sound reactive type visual art content can continue to develop and extend in the existing fields, while explore the scalability of the application of sound reactive type visual art content in more fields.

• Transactions of the Korean Society for Noise and Vibration Engineering
• /
• v.21 no.7
• /
• pp.629-636
• /
• 2011

In this study, survey experiment and EEG test was carried out to know the effect of visual images on EEG for evaluating words of soundscape sound source with 18 subjects. Analysis on the EEG were executed to know the difference according to with and without visual images. Followings are results of this study. 1) There is no big difference with visual images in soundscape sound evaluating adjectives such as "Full", "Clear", "Enjoyable" whereas there is a big difference in soundscape sound evaluating adjectives such as "Pleasant", "Comfortable", "Gentle", "Sonorous". 2) There is a tendency that soundscape sound source which is consist of single sound source shows + 1 above increase in survey test when visual image is suggested whereas soundscape sound source which is consist of one more sound source shows - 1 below decrease in survey test. 3) Statistical analysis was used to know considerable probability. ${\alpha}$-wave has a considerable probability and Maximum level difference occurring brain spots were number 1 and 2.

• International journal of advanced smart convergence
• /
• v.9 no.4
• /
• pp.101-105
• /
• 2020

In this study, we are going to discuss the role of sound, which exists as the background of a movie scene, and the relationship between seeing and hearing. In order to analyze the form in which the scene and sound are matched, the visual content of the image must be analyzed first. In this study, we analyzed Stanley Kubrick's film . Generally, there are both visual and auditory features in the scene of the movie. In some cases, the sound is emphasized more than the scene, and the scene is emphasized more than the sound. In particular, the sound in movies enables a wider imagination and a three-dimensional experience. Images and sounds will have different meanings and effects depending on the purpose of use. By analyzing the correlation between visual scene and auditory sound based on the role sound plays in the film in this study, we would like to confirm that sound is one essential element that has the role of equivalent and independent expression, not the role of assisting images.

• Journal of Audiology & Otology
• /
• v.24 no.4
• /
• pp.174-179
• /
• 2020

Background and Objectives: The integration of auditory-visual speech information improves speech perception; however, if the auditory system input is disrupted due to hearing loss, auditory and visual inputs cannot be fully integrated. Additionally, temporal coincidence of auditory and visual input is a significantly important factor in integrating the input of these two senses. Time delayed acoustic pathway caused by the signal passing through digital signal processing. Therefore, this study aimed to investigate the effects of hearing loss and hearing aid digital delay circuit on sound-induced flash illusion. Subjects and Methods: A total of 13 adults with normal hearing, 13 with mild to moderate hearing loss, and 13 with moderate to severe hearing loss were enrolled in this study. Subsequently, the sound-induced flash illusion test was conducted, and the results were analyzed. Results: The results showed that hearing aid digital delay and hearing loss had no detrimental effect on sound-induced flash illusion. Conclusions: Transmission velocity and neural transduction rate of the auditory inputs decreased in patients with hearing loss. Hence, the integrating auditory and visual sensory cannot be combined completely. Although the transmission rate of the auditory sense input was approximately normal when the hearing aid was prescribed. Thus, it can be concluded that the processing delay in the hearing aid circuit is insufficient to disrupt the integration of auditory and visual information.

• Proceedings of the IEEK Conference
• /
• 2002.07a
• /
• pp.702-705
• /
• 2002

This paper describes effects of visual information influencing sound localization in the peripheral visual Held under dynamic conditions. Presentation experiments of an audio-visual stimulus were carried out using a movie of a moving patrol car and its siren sound. The tallowing results were obtained: first, the sound image on the timing at the beginning of the presentation was more strongly captured by the visual image than that at the end, i.e., the "beginning effect" was occurred; second, in the peripheral regions, the "beginning effect" was strongly appeared in near the fixation point of eyes.

• Proceedings of the Korea Society of Design Studies Conference
• /
• 2002.05b
• /
• pp.80-81
• /
• 2002

• Journal of Biomedical Engineering Research
• /
• v.15 no.1
• /
• pp.77-82
• /
• 1994

We investigated the characteristic of the sensory motor coordination by measuring the hand point ins and the gaze movement to the visual and sound stimulation. Our results showed that the gaze vol ocity to sound stimulation did not depend on stimulation direction, but lagged behind 0.2 sec toward the pheriperal direction to the visual stimulation. Our data showed that to both visual and sound stimulation, the error of hand pointing value increased with an increasement of eccentricity.

• The KIPS Transactions:PartB
• /
• v.14B no.4
• /
• pp.273-280
• /
• 2007

This paper presents a new 3D sound toolkit called $EVE-Sound^{TM}$ that consists of pre-processing tool for environment simplification preserving sound effect and 3D sound API for real-time rendering. It is designed so that it can allow users to interact with complex 3D virtual environments by audio-visual modalities. $EVE-Sound^{TM}$ toolkit would serve two different types of users: high-level programmers who need an easy-to-use sound API for developing realistic 3D audio-visually rendered applications, and the researchers in 3D sound field who need to experiment with or develop new algorithms while not wanting to re-write all the required code from scratch. An interactive virtual environment application is created with the sound engine constructed using $EVE-Sound^{TM}$ toolkit, and it shows the real-time audio-visual rendering performance and the applicability of proposed $EVE-Sound^{TM}$ for building interactive applications with complex 3D environments.

• Proceedings of the Korea Society of Design Studies Conference
• /
• 2003.05a
• /
• pp.6-7
• /
• 2003

• Proceedings of the KOSOMBE Conference
• /
• v.1997 no.11
• /
• pp.71-74
• /
• 1997

MR acoustic sound or noise due to gradient pulsings has been one of the problems in MRI, both in patient scanning as well as in many areas of psychiatric and neuroscience research, such as brain fMRI. Especially in brain fMRI, sound noise is one of the serious noise sources which obscures the small signals obtainable from the subtle changes occurring in oxygenation status in the cortex and blood capillaries. Therefore, we have studied the effects of acoustic or sound noise arising in fMR imaging of the auditory, motor and visual cortices. The results show that the acoustical noise effects on motor and visual responses are opposite. That is, for the motor activity, it shows an increased total motor activation while for the visual stimulation, corresponding (visual) cortical activity has diminished substantially when the subject is exposed to a loud acoustic sound. Although the current observations are preliminary and require more experimental confirmation, it appears that the observed acoustic-noise effects on brain unctions, such as in the motor and visual cortices, are new observations and could have significant consequences in data observation and interpretation in future fMRI studies.