• Korean Journal of Cognitive Science
• /
• v.20 no.2
• /
• pp.109-124
• /
• 2009

When visual and auditory information is presented simultaneously, we perceive visual information dominantly over auditory information. This effect is called the visual dominance effect. This study was to examine the influence of semantic congruence of visual and auditory information on the visual dominance effect. The semantic congruence of visual and auditory information was manipulated. The results showed that the visual dominance effect obtained in error rates was not modulated by semantic congruence, whereas the effect in RT was. It is suggested that this modulation of the influence of semantic congruence on the visual dominance effect would be due to the task type.

• Journal of the Korean Society for Precision Engineering
• /
• v.24 no.1 s.190
• /
• pp.101-109
• /
• 2007

In situations of spatio-temporal perception about visuo-auditory stimulus, researches propose optimal integration hypothesis that perceptual process is optimized to the interaction of the senses for the precision of perception. So, when the visual information considered generally dominant over any other sense is ambiguous, the information of the other sense like auditory stimulus influences the perceptual process in interaction with visual information. Thus, we performed two different experiments to certain the conditions of the interacting senses and influence of the condition. We consider the interaction of the visuo-auditory stimulation in the free space, the color of visual stimulus and sex difference of testee with normal people. In first experiment, 12 participants were asked to judge the change in the frequency of audio-visual stimulation using a visual flicker and auditory flutter stimulation in the free space. When auditory temporal cues were presented, the change in the frequency of the visual stimulation was associated with a perceived change in the frequency of the auditory stimulation as the results of the previous studies using headphone. In second experiment, 30 male and 30 female were asked to judge the change in the frequency of audio-visual stimulation using a color of visual flicker and auditory flutter stimulation. In the color condition using red and green. Both male and female testees showed same perceptual tendency. male and female testees showed same perceptual tendency however, in case of female, the standard deviation is larger than that of male. This results implies that audio-visual asymmetry effects are influenced by the cues of visual and auditory information, such as the orientation between auditory and visual stimulus, the color of visual stimulus.

• Journal of Audiology & Otology
• /
• v.24 no.4
• /
• pp.174-179
• /
• 2020

Background and Objectives: The integration of auditory-visual speech information improves speech perception; however, if the auditory system input is disrupted due to hearing loss, auditory and visual inputs cannot be fully integrated. Additionally, temporal coincidence of auditory and visual input is a significantly important factor in integrating the input of these two senses. Time delayed acoustic pathway caused by the signal passing through digital signal processing. Therefore, this study aimed to investigate the effects of hearing loss and hearing aid digital delay circuit on sound-induced flash illusion. Subjects and Methods: A total of 13 adults with normal hearing, 13 with mild to moderate hearing loss, and 13 with moderate to severe hearing loss were enrolled in this study. Subsequently, the sound-induced flash illusion test was conducted, and the results were analyzed. Results: The results showed that hearing aid digital delay and hearing loss had no detrimental effect on sound-induced flash illusion. Conclusions: Transmission velocity and neural transduction rate of the auditory inputs decreased in patients with hearing loss. Hence, the integrating auditory and visual sensory cannot be combined completely. Although the transmission rate of the auditory sense input was approximately normal when the hearing aid was prescribed. Thus, it can be concluded that the processing delay in the hearing aid circuit is insufficient to disrupt the integration of auditory and visual information.

• Proceedings of the Korean Society for Noise and Vibration Engineering Conference
• /
• 2006.11a
• /
• pp.41-47
• /
• 2006

In this study, the influences of environmentally friendly visual and auditory information on traffic noise perception were surveyed by the using electroencephalogram Green rural region image and CBD image in urban city were used as visual informations. And traffic noise, signal and environmental music were used to detect the impact on electroencephalogram variance. It was revealed that green rural region image caused a-wave ratio increase about 10% and environmental music increased $\alpha$-wave ratio approximately $40{\sim}50%$. The results of this study improved that environmentally friendly visual and auditory information had an effect on decreasing traffic noise loudness to some extents.

• Transactions of the Korean Society for Noise and Vibration Engineering
• /
• v.17 no.2 s.119
• /
• pp.160-167
• /
• 2007

In this study, the influences of environmentally friendly visual and auditory information on traffic noise perception were surveyed by the using electroencephalogram. Green rural region image and CBD (central business district) image in urban city were used as visual informations. And traffic noise, signal and environmental music were used to detect the impact on electroencephalogram variance. It was revealed that green rural region image caused ${\alpha}-wave$ ratio increase about 10% and environmental music increased ${\alpha}-wave$ ratio approximately $40{\sim}50%$. The results of this study improved that environmentally friendly visual and auditory information had an effect on decreasing traffic noise loudness to some extents.

• International Journal of Advanced Culture Technology
• /
• v.4 no.4
• /
• pp.64-69
• /
• 2016

Currently on the school education site, various multimedia contents are used to effectively deliver knowledge to the students and increase interest in class. The majority of the multimedia contents currently used in classes are composed of visual and auditory information. This paper intends to maximize actuality and immersion in the content by adding olfactory information to the existing visual and auditory data. Tangible contents were developed based on the details of aromatic plants learned in the fifth grade of elementary school. The shape and explanation of the aromatic plants are displayed with visual and auditory information, and an aroma spraying application is used to allow the students to smell the aromatic plants. After conducting the class using the developed contents, the students' satisfaction of the class, as well as their overall academic understanding, were investigated. Upon doing so, it was discovered that the students' academic understanding and satisfaction increased in comparison to classes comprised of only visual and auditory contents.

• Korean Journal of Audiology
• /
• v.24 no.4
• /
• pp.174-179
• /
• 2020

Background and Objectives: The integration of auditory-visual speech information improves speech perception; however, if the auditory system input is disrupted due to hearing loss, auditory and visual inputs cannot be fully integrated. Additionally, temporal coincidence of auditory and visual input is a significantly important factor in integrating the input of these two senses. Time delayed acoustic pathway caused by the signal passing through digital signal processing. Therefore, this study aimed to investigate the effects of hearing loss and hearing aid digital delay circuit on sound-induced flash illusion. Subjects and Methods: A total of 13 adults with normal hearing, 13 with mild to moderate hearing loss, and 13 with moderate to severe hearing loss were enrolled in this study. Subsequently, the sound-induced flash illusion test was conducted, and the results were analyzed. Results: The results showed that hearing aid digital delay and hearing loss had no detrimental effect on sound-induced flash illusion. Conclusions: Transmission velocity and neural transduction rate of the auditory inputs decreased in patients with hearing loss. Hence, the integrating auditory and visual sensory cannot be combined completely. Although the transmission rate of the auditory sense input was approximately normal when the hearing aid was prescribed. Thus, it can be concluded that the processing delay in the hearing aid circuit is insufficient to disrupt the integration of auditory and visual information.

• Journal of Science of Art and Design
• /
• v.1
• /
• pp.95-123
• /
• 1999

The goal of this research is a visual and auditory tool development enabling designers to have the same emotional value with users in the process of user centered design. Through the research, we intend to show the aid measure for making cognitive gaps narrow between users and designer in the process of transforming and understanding the emotional needs as a verbal image. because In the business practice of design, most of tools and techniques for assessment and analysis of emotional needs are those used usually in the marketing fields. So the information generated and transformed from users to designers have a form of physical words. When the designer's understanding of the emotional needs is considered as a product mediated communication process, the morphologic and cognitive information gaps become obvious. This difference could be a false basis in designing with emotional user needs. So the alternative needs assessment sub-tools of visual and auditory information form was embodied mainly for designer's cognitive gaps and inter-cultural emotional needs assessment. As the method of embodiment, Firstly, adjectives related to emotion were classified in their cognitive dimension. Secondly, visual and auditory data were extracted, and then the relativity verified. Finally, the practicality and effectiveness were tested through the database generation. In view of the results so far achieved, 1. We could find being of the big information cognitive gaps in the verbal assessment of emotional needs between designers and users. 2. With the visual and auditory assessment tool, we could make the big cognitive gaps narrower than we expected. 3. Also, we could find the chance that the fidelity, recognition, and friendliness of design for emotional user needs would become better.

• Smart Media Journal
• /
• v.10 no.1
• /
• pp.70-78
• /
• 2021

The auditory information is used for urgent notification or warning in vehicle because it is not restricted by the direction compared to the visual. However, since the hearing impaired drivers cannot recognize sound signal, various methods of visualizing the auditory information have been attempted to replace it. When visualizing auditory information, only important information should be selected and provided to prevent cognitive overload concentrated on the vision. For this purpose, analysis of the type of auditory information in vehicle should be given in advance. In this study, the types of auditory information in vehicle were analyzed based on the user experience of hearing impaired drivers. Through the observation of the driving behavior of hearing impaired drivers, 33 auditory informations experienced in vehicle were collected. The collected auditory informations were classified into 12 groups through open card sorting by an expert group, and the types of auditory information in vehicle consisting of four levels were presented through a relative comparison of importance between groups. The presented type of auditory information in vehicle can be used as a guideline for selecting important information when the auditory information is converted into visual or tactile. This study is meaningful in that the user experience analysis was conducted by observing actual driving in daily life of hearing impaired drivers.

• Proceedings of the Korean Society for Noise and Vibration Engineering Conference
• /
• 2006.05a
• /
• pp.970-973
• /
• 2006

The effects of the additional visual and auditory stimuli on the loudness evaluation of road traffic noise was investigated by the method of magnitude estimation. As a result, it was shown that additional visual stimulus of noise barrier can influence on the loudness perception of road traffic noise. Also, additional auditory stimuli such as green music or sound of flowing water can influence on the loudness perception of road traffic noise. approximately $5{\sim}10%$ lower than the absence of stimuli. But this effect was disappeared in the range of over 65dB(A).