• Journal of Audiology & Otology
• /
• v.24 no.4
• /
• pp.174-179
• /
• 2020

Background and Objectives: The integration of auditory-visual speech information improves speech perception; however, if the auditory system input is disrupted due to hearing loss, auditory and visual inputs cannot be fully integrated. Additionally, temporal coincidence of auditory and visual input is a significantly important factor in integrating the input of these two senses. Time delayed acoustic pathway caused by the signal passing through digital signal processing. Therefore, this study aimed to investigate the effects of hearing loss and hearing aid digital delay circuit on sound-induced flash illusion. Subjects and Methods: A total of 13 adults with normal hearing, 13 with mild to moderate hearing loss, and 13 with moderate to severe hearing loss were enrolled in this study. Subsequently, the sound-induced flash illusion test was conducted, and the results were analyzed. Results: The results showed that hearing aid digital delay and hearing loss had no detrimental effect on sound-induced flash illusion. Conclusions: Transmission velocity and neural transduction rate of the auditory inputs decreased in patients with hearing loss. Hence, the integrating auditory and visual sensory cannot be combined completely. Although the transmission rate of the auditory sense input was approximately normal when the hearing aid was prescribed. Thus, it can be concluded that the processing delay in the hearing aid circuit is insufficient to disrupt the integration of auditory and visual information.

• Korean Journal of Audiology
• /
• v.24 no.4
• /
• pp.174-179
• /
• 2020

Background and Objectives: The integration of auditory-visual speech information improves speech perception; however, if the auditory system input is disrupted due to hearing loss, auditory and visual inputs cannot be fully integrated. Additionally, temporal coincidence of auditory and visual input is a significantly important factor in integrating the input of these two senses. Time delayed acoustic pathway caused by the signal passing through digital signal processing. Therefore, this study aimed to investigate the effects of hearing loss and hearing aid digital delay circuit on sound-induced flash illusion. Subjects and Methods: A total of 13 adults with normal hearing, 13 with mild to moderate hearing loss, and 13 with moderate to severe hearing loss were enrolled in this study. Subsequently, the sound-induced flash illusion test was conducted, and the results were analyzed. Results: The results showed that hearing aid digital delay and hearing loss had no detrimental effect on sound-induced flash illusion. Conclusions: Transmission velocity and neural transduction rate of the auditory inputs decreased in patients with hearing loss. Hence, the integrating auditory and visual sensory cannot be combined completely. Although the transmission rate of the auditory sense input was approximately normal when the hearing aid was prescribed. Thus, it can be concluded that the processing delay in the hearing aid circuit is insufficient to disrupt the integration of auditory and visual information.

• Science of Emotion and Sensibility
• /
• v.13 no.3
• /
• pp.475-484
• /
• 2010

This study examined the influence of the SOA(stimulus onset asynchrony) between visual and auditory stimuli on the integration phenomenon of audio-visual senses. Within the stimulus integration phenomenon, the redundant target effect (the faster and more accurate response to the target stimulus when the target stimulus is presented with more than two modalities) and the visual dominance effect (the faster and more accurate response to a visual stimulus compared to an auditory stimulus) were examined as we composed a visual and auditory unimodal target condition and a multimodal target condition and then observed the response time and accuracy. Consequently, despite the change between visual and auditory stimuli SOA, there was no redundant target effect present. The auditory dominance effect appeared when the SOA between the two stimuli was over 100ms. Theses results imply that the redundant target effect is continuously maintained even when the SOA between two modal stimuli is altered, and also suggests that the behavioral results of superior information processing can only be deducted when the time difference between the onset of the auditory stimuli and the visual stimuli is approximately over 100ms.

• Journal of the Korean Society for Precision Engineering
• /
• v.24 no.1 s.190
• /
• pp.101-109
• /
• 2007

In situations of spatio-temporal perception about visuo-auditory stimulus, researches propose optimal integration hypothesis that perceptual process is optimized to the interaction of the senses for the precision of perception. So, when the visual information considered generally dominant over any other sense is ambiguous, the information of the other sense like auditory stimulus influences the perceptual process in interaction with visual information. Thus, we performed two different experiments to certain the conditions of the interacting senses and influence of the condition. We consider the interaction of the visuo-auditory stimulation in the free space, the color of visual stimulus and sex difference of testee with normal people. In first experiment, 12 participants were asked to judge the change in the frequency of audio-visual stimulation using a visual flicker and auditory flutter stimulation in the free space. When auditory temporal cues were presented, the change in the frequency of the visual stimulation was associated with a perceived change in the frequency of the auditory stimulation as the results of the previous studies using headphone. In second experiment, 30 male and 30 female were asked to judge the change in the frequency of audio-visual stimulation using a color of visual flicker and auditory flutter stimulation. In the color condition using red and green. Both male and female testees showed same perceptual tendency. male and female testees showed same perceptual tendency however, in case of female, the standard deviation is larger than that of male. This results implies that audio-visual asymmetry effects are influenced by the cues of visual and auditory information, such as the orientation between auditory and visual stimulus, the color of visual stimulus.

• Journal of Audiology & Otology
• /
• v.23 no.1
• /
• pp.39-48
• /
• 2019

Background and Objectives: The influence of visual stimulus on the auditory component in the perception of auditory-visual (AV) consonant-vowel syllables has been demonstrated in different languages. Inherent properties of unimodal stimuli are known to modulate AV integration. The present study investigated how the amount of McGurk effect (an outcome of AV integration) varies across three different consonant combinations in Kannada language. The importance of unimodal syllable identification on the amount of McGurk effect was also seen. Subjects and Methods: Twenty-eight individuals performed an AV identification task with ba/ga, pa/ka and ma/ṇa consonant combinations in AV congruent, AV incongruent (McGurk combination), audio alone and visual alone condition. Cluster analysis was performed using the identification scores for the incongruent stimuli, to classify the individuals into two groups; one with high and the other with low McGurk scores. The differences in the audio alone and visual alone scores between these groups were compared. Results: The results showed significantly higher McGurk scores for ma/ṇa compared to ba/ga and pa/ka combinations in both high and low McGurk score groups. No significant difference was noted between ba/ga and pa/ka combinations in either group. Identification of /ṇa/ presented in the visual alone condition correlated negatively with the higher McGurk scores. Conclusions: The results suggest that the final percept following the AV integration is not exclusively explained by the unimodal identification of the syllables. But there are other factors which may also contribute to making inferences about the final percept.

• Korean Journal of Audiology
• /
• v.23 no.1
• /
• pp.39-48
• /
• 2019

Background and Objectives: The influence of visual stimulus on the auditory component in the perception of auditory-visual (AV) consonant-vowel syllables has been demonstrated in different languages. Inherent properties of unimodal stimuli are known to modulate AV integration. The present study investigated how the amount of McGurk effect (an outcome of AV integration) varies across three different consonant combinations in Kannada language. The importance of unimodal syllable identification on the amount of McGurk effect was also seen. Subjects and Methods: Twenty-eight individuals performed an AV identification task with ba/ga, pa/ka and ma/ṇa consonant combinations in AV congruent, AV incongruent (McGurk combination), audio alone and visual alone condition. Cluster analysis was performed using the identification scores for the incongruent stimuli, to classify the individuals into two groups; one with high and the other with low McGurk scores. The differences in the audio alone and visual alone scores between these groups were compared. Results: The results showed significantly higher McGurk scores for ma/ṇa compared to ba/ga and pa/ka combinations in both high and low McGurk score groups. No significant difference was noted between ba/ga and pa/ka combinations in either group. Identification of /ṇa/ presented in the visual alone condition correlated negatively with the higher McGurk scores. Conclusions: The results suggest that the final percept following the AV integration is not exclusively explained by the unimodal identification of the syllables. But there are other factors which may also contribute to making inferences about the final percept.

• The Journal of Korean Academy of Sensory Integration
• /
• v.15 no.2
• /
• pp.66-79
• /
• 2017

Objective : The purpose of this study is investigate the effects of sensory integration combined with auditory treatment on the sensory processing, visual perception and attention ability of children with developmental delay. Methods : A combined treatment of auditory training and sensory integration therapy was implemented to 3 children aged 4 to 7 and diagnosed with developmental delay during 9 weeks period from December 2016 to January 2017. ABA' design which is one of single subject research designs was used in this study. Baseline A had 4 sessions, intervention B had 15 sessions, and baseline A' had 4 sessions, so 23 sessions were applied in total. During the baseline A and A 'periods, visual perception ability was measured by K-DTVP-2 (Korea Developmental Test Visual Perception-2) and sensory processing ability was evaluated by sensory profile. The maintenance time of attention was measured with the absence of intervention for the baseline period, and for the intervention period, it was measured at 10 minutes break time which was provided after the intervention. The children's attention time during a fine motor task provided were measured using video recorder with the interval recording method, and the interval for the evaluation was 30 seconds. Results : No statistically significant difference were found in the visual perception function and sensory processing scores before and after treatment. Attention of participant A enhanced significantly while that of participant B and C did not improve significantly. Conclusion : It is hard to conclude that sensory integration therapy combined with auditory perception training has positive effects on visual perception function and attention of children with developmental delays. However, there were significant increase in attention and improvements in behavior related to sensory processing for some cases in this study. In further study, longer intervention periods and valid measurement need to be applied in order to get better results. And it is proposed that more studies need to be done to enhance evidence of auditory perception training as a mean to facilitate attention and to prepare learning.

• Proceedings of the Korean Society for Emotion and Sensibility Conference
• /
• 2003.05a
• /
• pp.94-100
• /
• 2003

Patients with schizophrenia have thinking disorders such as delusion or hallucination, because they have a deficit in the ability which to systematize and integrate information. Therefore, they cannot integrate or systemize visual, auditory and tactile stimuli. In this study we suggest a virtual reality system for the assessment of cognitive ability of schizophrenia patients, based on the brain multimodal integration model. The virtual reality system provides multimodal stimuli, such as visual and auditory stimuli, to the patient, and can evaluate the patient's multimodal integration and working memory integration abilities by making the patient interpret and react to multimodal stimuli, which must be remembered for a given period of time. The clinical study showed that the virtual reality program developed is comparable to those of the WCST and the SPM.

• Proceedings of the Korean Society for Noise and Vibration Engineering Conference
• /
• 2007.11a
• /
• pp.1177-1182
• /
• 2007

This study aims at identifying the effect of preferred visual and auditory stimuli on the road traffic noise perception through the series of psychoacoustic experiments. The first experiment was designed to find the addition effect of a sound reproducing system in a square where lay adjacent to roads with road traffic noise, provide appropriate music corresponding to the varying conditions of weather in the given space. In result, it was found that the rating around the square improved toward more positive adjectives. The second experiment was designed to assess the visual effect of twelve roadsides with different landscapes on the road traffic noise perception. As a result, approx. 3 to 5 dB(A) of psychological reduction was seen in places where natural landscape was preferred, compared to the others, although the noise levels were similar. The third experiment was designed to evaluate the effect of visual screen from adjacent roads on road traffic noise perception by means of ME method in a laboratory. In result, the effect of psychological reduction was observed at 65dB(A) or lower. Especially, complete screening from adjacent roads led to 5 to 10% of loudness reduction effect, compared to non-screening cases. Finally, the fourth experiment was designed to evaluate the effect of visual and auditory information with ME method and 7-point SD rating scale in a laboratory. In result, up to 10% of loudness reduction and about 2dB(A) of noise perceptional reduction were seen at 65dB(A) or lower.

• Investigative Magnetic Resonance Imaging
• /
• v.19 no.1
• /
• pp.1-9
• /
• 2015

Purpose: Several morphometric studies have been performed to investigate brain abnormalities in congenitally deaf people. But no report exists concerning structural brain abnormalities in congenitally deaf adolescents. We evaluated the regional volume changes in gray matter (GM) using voxel-based morphometry (VBM) in congenitally deaf adolescents. Materials and Methods: A VBM8 methodology was applied to the T1-weighted magnetic resonance imaging (MRI) scans of eight congenitally deaf adolescents (mean age, 15.6 years) and nine adolescents with normal hearing. All MRI scans were normalized to a template and then segmented, modulated, and smoothed. Smoothed GM data were tested statistically using analysis of covariance (controlled for age, gender, and intracranial cavity volume). Results: The mean values of age, gender, total volumes of GM, and total intracranial volume did not differ between the two groups. In the auditory centers, the left anterior Heschl's gyrus and both inferior colliculi showed decreased regional GM volume in the congenitally deaf adolescents. The GM volumes of the lingual gyri, nuclei accumbens, and left posterior thalamic reticular nucleus in the midbrain were also decreased. Conclusions: The results of the present study suggest that early deprivation of auditory stimulation in congenitally deaf adolescents might have caused significant underdevelopment of the auditory cortex (left Heschl's gyrus), subcortical auditory structures (inferior colliculi), auditory gain controllers (nucleus accumbens and thalamic reticular nucleus), and multisensory integration areas (inferior colliculi and lingual gyri). These defects might be related to the absence of general auditory perception, the auditory gating system of thalamocortical transmission, and failure in the maturation of the auditory-to-limbic connection and the auditorysomatosensory-visual interconnection.