• Journal of the Korean Society for Precision Engineering
• /
• v.24 no.1 s.190
• /
• pp.101-109
• /
• 2007

In situations of spatio-temporal perception about visuo-auditory stimulus, researches propose optimal integration hypothesis that perceptual process is optimized to the interaction of the senses for the precision of perception. So, when the visual information considered generally dominant over any other sense is ambiguous, the information of the other sense like auditory stimulus influences the perceptual process in interaction with visual information. Thus, we performed two different experiments to certain the conditions of the interacting senses and influence of the condition. We consider the interaction of the visuo-auditory stimulation in the free space, the color of visual stimulus and sex difference of testee with normal people. In first experiment, 12 participants were asked to judge the change in the frequency of audio-visual stimulation using a visual flicker and auditory flutter stimulation in the free space. When auditory temporal cues were presented, the change in the frequency of the visual stimulation was associated with a perceived change in the frequency of the auditory stimulation as the results of the previous studies using headphone. In second experiment, 30 male and 30 female were asked to judge the change in the frequency of audio-visual stimulation using a color of visual flicker and auditory flutter stimulation. In the color condition using red and green. Both male and female testees showed same perceptual tendency. male and female testees showed same perceptual tendency however, in case of female, the standard deviation is larger than that of male. This results implies that audio-visual asymmetry effects are influenced by the cues of visual and auditory information, such as the orientation between auditory and visual stimulus, the color of visual stimulus.

• The Journal of the Korea Contents Association
• /
• v.13 no.5
• /
• pp.1-8
• /
• 2013

Focused on the fact that sound is one of the important sensory cues delivering situations such as impact, this paper proposes an auditory interaction design approach for virtual environment. Based on a few sampling of basic material sound for various materials such as steel, rubber, and glass, the proposed method enables design transformations of the basic sound by allowing modification of mode gains that characterize natural sound for the material. In real-time virtual environment, it also provides simulation of modified sound according to the change of impact situation's perceptual properties such as colliding objects' size, hardness, contacting area, and speed. The test results on cognition experiment for discriminating objects' materials and impact situation by sound showed the feasibility of proposed auditory interaction design method.

• PNF and Movement
• /
• v.14 no.2
• /
• pp.121-130
• /
• 2016

Purpose: The purpose of this study was to investigate the effects of visual and auditory stimulation on the ability to perform exercise. Methods: One hundred twenty subjects were randomly divided into four groups (Green light and Fast tempo music, GF; Green light and Slow tempo music, GS; Red light and Fast tempo music, RF; and Red light and Slow tempo music, RS). One of either two visual stimuli or one of two auditory stimuli were applied to each group. The experiment was conducted randomly twice in two environments: one had visual and auditory stimuli and one had no stimulation. Muscle strength, grip, endurance, quickness, agility, concentration, and balance were measured to determine the ability to perform exercise. Results: Significant differences were found in the muscle strength of the participants who were exposed to the auditory factor and the interaction of visual and auditory factors. In endurance, significant differences were found in all of the factors: visual, auditory, and the interaction of visual and auditory. In quickness, agility, and balance ability there were significant differences in the visual factor. In concentration, there was a significant difference in the auditory factor. Conclusion: Visual stimuli, auditory stimuli, and their interaction influenced the ability to perform exercise. These facts imply that providing the proper environmental stimulation is important to increase the ability to perform during exercise.

• International Journal of Contents
• /
• v.9 no.3
• /
• pp.29-34
• /
• 2013

This study attempted to compare usability of auditory interfaces, which is a comprehensive concept that includes safety, utility, effectiveness, and efficiency, in personal computing environments: verbal messages (speech sounds), earcons (musical sounds), and auditory icons (natural sounds). This study hypothesized that verbal messages would offer higher usability than earcons and auditory icons, since the verbal messages are easy to interpret and understand based on semiotic process. In this study, usability was measured by a set of seven items: ability to inform what the program is doing, relevance to visual interfaces, degree of stimulation, degree of understandability, perceived time pressure, clearness of sound outputs, and degrees of satisfaction. Through the experimental research, the results showed that verbal messages provided the highest level of usability. On the contrary, auditory icons showed the lowest level of usability, as they require users to establish new coding schemes, and thus demand more mental effort from users.

• The Journal of the Acoustical Society of Korea
• /
• v.26 no.7
• /
• pp.306-316
• /
• 2007

Based on a concept of soundscape, this study aims to investigate Koreans' preference for auditory elements, features, and impressions depending upon the season, and examine how these auditory factors of soundstape and seasons interact with each other and attempt to discover their influence on people's auditory preferences. According to an environmental psychological approach called the caption evaluation method, 45 college students examined the soundscape of Namwon City while racing the streets in four seasons. In order to analyze the interactions between seasons and such auditory factors as elements, features, and impressions, it was conducted the GLM univariate analysis and the NPAR tests for independent samples. The results of the analyses show that there are interactive effects between seasons and auditory factors like elements, features, and impressions and that the auditory factors have an effect on auditory preference. Moreover, as for seasonal preference for auditory elements, it was found that people prefer natural sound in spring, summer, and fall while they prefer social sound in winter. Concerning seasonal preference for auditory features, people place a focus on the behaviors in spring, summer, and winter while they stress the surroundings in autumn, as for seasonal preference for auditory impressions, they make much of sound characteristics in spring and winter but they value the atmosphere of streets in summer and fall. The results of this study can he utilized as useful data in determining which auditory factors among elements, features, and impressions to take into consideration in a soundscape design.

• The Journal of the Korea Contents Association
• /
• v.18 no.8
• /
• pp.92-101
• /
• 2018

As the interactive AI speaker becomes popular, voice recognition is regarded as an important vehicle-driver interaction method in case of autonomous driving situation. The purpose of this study is to confirm whether multimodal interaction in which feedback is transmitted by auditory and visual mode of AI characters on screen is more effective in user experience optimization than auditory mode only. We performed the interaction tasks for the music selection and adjustment through the AI speaker while driving to the experiment participant and measured the information and system quality, presence, the perceived usefulness and ease of use, and the continuance intention. As a result of analysis, the multimodal effect of visual characters was not shown in most user experience factors, and the effect was not shown in the intention of continuous use. Rather, it was found that auditory single mode was more effective than multimodal in information quality factor. In the semi-autonomous driving stage, which requires driver 's cognitive effort, multimodal interaction is not effective in optimizing user experience as compared to single mode interaction.

• Journal of Electrical Engineering and Technology
• /
• v.12 no.6
• /
• pp.2378-2387
• /
• 2017

Violinists learn to make better sounds by hearing and evaluating their own playing though numerous practice. This study proposes a new method of auditory feedback, which mimics this violinists' step and verifies its efficiency using experiments. Making the desired sound quality of a violin is difficult without auditory feedback even though an expert violinist plays. An algorithm for controlling a robot arm of violin playing robot is determined based on correlations with bowing speed, bowing force, and sound point that determine the sound quality of a violin. The bowing speed is estimated by the control command of the robot arm, where the bowing force and the sound point are recognized by using a two-axis load cell and a photo interrupter, respectively. To improve the sound quality of a violin playing robot, the sounds information is obtained by auditory feedback system applied Short Time Fourier Transform (STFT) to the sounds from a violin. This study suggests Gaussian-Harmonic-Quality (GHQ) uses sounds' clarity, accuracy, and harmonic structure in order to decide sound quality, objectively. Through the experiments, the auditory feedback system improved the performance quality by the robot accordingly, changing the bowing speed, bowing force, and sound point and determining the quality of robot sounds by GHQ sound quality evaluation system.

• Journal of rehabilitation welfare engineering & assistive technology
• /
• v.8 no.2
• /
• pp.95-99
• /
• 2014

Binaural interaction can recognize the same intensity sound by stimulating two ears alternatively, and it can be record auditory brainstem responses (ABR). However, We needs to be researched about binaural interaction in asymmetric binaural acoustic stimulation. 17 normal young hearing university students were participated. Clicks were presented at the intensity of 90 dB nHL to one ear and the click intensity was increased from 0 to 90 dB nHL with a separation of 10 dB to another ear, simultaneous. BI waveform was obtained by subtracting the sum of the asymmetrically evoked potentials from the binaurally evoked potentials; i.e. BI = B - (L + R). Latency and amplitude was measured 'peak to following trough' of IV-V complex of BI waveform. Threshold of BIC (t-BIC) was obtained using amplitude depend on stimulus intensities (paired sample t-test). Latency shifted in 4.65, 4.63, 4.57, 4.58, 4.62, 4.6, 4.48, 4.36, 4.23 ms for peak, 5.57, 5.51, 5.51, 5.59, 5.61, 5.55, 5.44, 5.28, 5.19 ms for trough, and amplitude shifted in .0.32, -0.3, -0.34, -0.32, -0.42, -0.53, -0.54, -0.61, $-0.67{\mu}V$ from 0 to 90 dB nHL in every 10 dB, respectively. t-BIC was observed 40 dB nHL(p=.001).

• Archives of design research
• /
• v.14 no.3
• /
• pp.49-58
• /
• 2001

The communication designer in the multimedia age should have a consideration that the sound also can be an important expression element to transmit ones thought as well as the visual sense like color, shape and motion. As you already know, someones thought can be better understood when transmitted to others using the visual and auditory senses together than using the visual or auditory sense alone. The meeting of sight and hearing bases on the synesthesia. For example, low sound reminds a person of dark color and high sound usually reminds light color. And a percussion instrument reminds a person a circle and melody reminds a line. The visual and auditory senses In communication of the multimedia age should act as an independent expression element gotten out of the synchronizing that just serves simple sight and related sound at the same time. Interaction between sight and hearing arose a different emotion that cannot be happened just by one element alone. So, the programs of communication design education in this multimedia age should fulfill the requirement that it can develop ones expression ability through the understanding of interaction between sight and hearing. In this study, we suggest the education programs Classified into following categories; audio visual Gestaltung, audio visual moving graphics, audio visual design.

• Journal of the Korean Society of Physical Medicine
• /
• v.9 no.4
• /
• pp.363-373
• /
• 2014

PURPOSE: The purpose of this study was of scale using auditory biofeedback training and kinging training on walking speed and weight bearing ratio in patients hemiplegia with stroke to determine of the effects of such training would be maintained even after stopping the intervention. METHODS: The 30 subject were classified into three groups : 12 times, 3 times a week receiving the control, the experimental group scale using auditory and kicking training for 4 weeks. In addition, all subjects in the control group and experimental groups received the same general exercise treatment 12 times, 3 times a week for 4 weeks, and underwent follow-up tests. The significance of differences between the control group and the experimental groups was analysis by repeated-ANOVA, Interaction time and groups was analysis by repeated-ANOVA. In case where there were differences, post-hot tests were conducted using repeated measure ANOVA. RESULTS: There were significant differences in 10 m walking speed and weight bearing ratio between the control group and experimental group after the performance of the scale using auditory training and kicking training. Scale using auditory biofeedback training 4 weeks was more effective than kicking training. After 8 weeks weight bearing ratio maintained on scale using auditory training. CONCLUSION: These finding suggest that the scale using auditory biofeedback training and kicking training has positive effects on hemiplegia with stroke.