• Journal of the Ergonomics Society of Korea
• /
• v.15 no.2
• /
• pp.185-192
• /
• 1996

EEG(electroencephalogram) is characterized with auditory emotion in this study. Twenty university students participated in this study. The auditory stimulus was the natural sounds such as creek sound, clash, machining noise, and etc. They can cause the positive and negative emotion. EEG characteristics according to positive and negative auditory stimuli is tried to observe statistic difference. The significant difference is shown depending on the localized area. The auditory paraameters of EEG variation is examined for defining human emotion qualitatively. The results shows that the alpha and the beta at temproal area may be thd determinat of human auditory emotion.

• Journal of KIISE
• /
• v.44 no.11
• /
• pp.1149-1155
• /
• 2017

Recently, with the development of communication technology, it has become possible to collect various sensor data that indicate the environmental stimuli within a space. In this paper, we propose a group emotion prediction system using a modular Bayesian network that was designed considering the psychological impact of environmental stimuli. A Bayesian network can compensate for the uncertain and incomplete characteristics of the sensor data by the probabilistic consideration of the evidence for reasoning. Also, modularizing the Bayesian network has enabled flexible response and efficient reasoning of environmental stimulus fluctuations within the space. To verify the performance of the system, we predict public emotion based on the brightness, volume, temperature, humidity, color temperature, sound, smell, and group emotion data collected in a kindergarten. Experimental results show that the accuracy of the proposed method is 85% greater than that of other classification methods. Using quantitative and qualitative analyses, we explore the possibilities and limitations of probabilistic methodology for predicting group emotion.

• Journal of the Korean Society for Precision Engineering
• /
• v.28 no.5
• /
• pp.638-647
• /
• 2011

Various approaches directly using vibrations of speakers have been suggested to effectively display the aural information such as the music to the hearing-impaired or the deaf. However, in these approaches, the human can't sense the frequency information over the maximum perceivable vibro-tactile frequency (around 1kHz). Therefore, in this study, an approach via spectral modulation of compressing the high frequency audio information into perceivable vibro-tactile frequency domain and outputting the modulated signals through the designated speakers is proposed. Then it is shown, through simulations of using Short-Time Fourier Transform (STFT) with Hanning windows and through preliminary experiments of using the vibro-tactile display testbed which is built and interfaced with a notebook PC, that the modulated signal of a natural sound composing sounds of a frog, a bird, and a water stream could produce the noise-free signal suitable enough for vibro-tactile speakers without causing Significant interfering disturbances, Lastly, for three different combinations of information provided to the subject, that is, i) with only video image, ii) with video image along with the modulated vibro-tactile stimuli as proposed in this study to the forearm of the subject, and iii) with video image along with full audio information, the effects to the human sense of reality and his emotion to given audio-video clips including various sounds and images are investigated and compared. It is shown from results of those experiments that the proposed method of providing modulated vibro-tactile stimuli along with the video images to the human has very high feasibility to transmit pseudo-aural sense to the human.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.20 no.3
• /
• pp.388-393
• /
• 2010

Cultural Content Technology(CT, Culture Technology) for the development of cultural industry and the commercialization of technology, cultural contents, media, mount, pass the value chain process and increase the added value of cultural products that are good for all forms of intangible technology. In the field of Culture Technology, Music by analyzing the characteristics of the development of a variety of applications has been studied. Associated with EEG measures and the results of their research in response to musical stimuli are used to detect and study is getting attention. In this paper, the musical stimuli in EEG signals by amplifying the corresponding reaction to the averaging method, ERP (Event-Related Potentials) experiments based on the process of extracting sound methods for removing noise from the ICA algorithm to extract the tone and noise removal according to the results are applied to analyze the characteristics of EEG.

• Science of Emotion and Sensibility
• /
• v.20 no.3
• /
• pp.61-70
• /
• 2017

Physiological responses have been measured to recognize emotion. Although physiological responses have been interrelated between organs, their connectivities have been less considered for emotion recognizing. The connectivities have been assumed to enhance emotion recognition. Specially, autonomic nervous system is physiologically modulated by the interrelated functioning. Therefore, this study has been tried to analyze connectivities between heart and respiration and to find the significantly connected variables for emotion recognition. The eighteen subjects(10 male, age $24.72{\pm}2.47$) participated in the experiment. The participants were asked to listen to predetermined sound stimuli (arousal, relaxation, negative, positive) for evoking emotion. The bio-signals of heart and respiration were measured according to sound stimuli. HRV (heart rate variability) and BRV (breathing rate variability) spectrum were obtained from spectrum analysis of ECG (electrocardiogram) and RSP (respiration). The synchronization of HRV and BRV spectrum was analyzed according to each emotion. Statistical significance of relationship between them was tested by one-way ANOVA. There were significant relation of synchronization between HRV and BRV spectrum (synchronization of HF: F(3, 68) = 3.605, p = 0.018, ${\eta}^2_p=0.1372$, synchronization of LF: F(3, 68) = 5.075, p = 0.003, ${\eta}^2_p=0.1823$). HF difference of synchronization between ECG and RSP has been able to classify arousal from relaxation (p = 0.008, d = 1.4274) and LF's has negative from positive (p = 0.002, d = 1.7377). Therefore, it was confirmed that the heart and respiration to recognize the dimensional emotion by connectivity.

• KIPS Transactions on Software and Data Engineering
• /
• v.3 no.10
• /
• pp.451-456
• /
• 2014

The correlations between electroencephalographic (EEG) spectral power and emotional responses during affective sound clip listening are important parameters. Hemispheric asymmetry in prefrontal activation have been proposed in two decades ago, as measured by power value, is related to reactivity to affectively pleasure audio stimuli. In this study, we designed an emotional audio stimulus experiment in order to verify frontal EEG asymmetry by analyzing Event-related Spectral Perturbation (ERSP) results. Thirty healthy college male students volunteered the stimulus experiment with the standard IADS(International Affective Digital Sounds) clips. These affective sound clips are classified in three emotion states, high pleasure-high arousal (happy), middle pleasure-low arousal (neutral) and low pleasure-high arousal (fear). The analysis of the data was performed in both theta (4-8Hz) and alpha (8-13Hz) bands. ERSP maps in the alpha band revealed that there are the stronger power responses of high pleasure (happy) in the right frontal lobe, while the stronger power responses of middle-low pleasure (neutral and fear) in the left frontal lobe. Moreover, ERSP maps in the theta band revealed that there are the stronger power responses of high arousal (fear and happy) in the left pre-frontal lobe, while the stronger responses of low arousal (neutral) in the right pre-frontal lobe. However, the high pleasure emotions (happy) can elicit greater relative right EEG activity, while the low and middle pleasure emotions (fear and neutral) can elicit the greater relative left EEG activity. Additionally, the most differences of theta band have been found out in the medial frontal lobe, which is proved as the frontal midline theta. And there are the strongest responses of happy sounds in the alpha band around the whole frontal regions. These results are well suited for emotion recognition, and provide the evidences that theta and alpha powers may have the more important role in the emotion processing than previously believed.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.35 no.2C
• /
• pp.246-253
• /
• 2010

In this paper, a method of removing the space skew and cross-talk cancellation is proposed where the self-generated signals from the subject are used to obtain the subject's location. In the proposed method, the good spatial sound image is maintained even when the listener moves from the sweet spot. Two major parts of the proposed method are as follows: listener position tracking using the stimuli from the subject and removal of the space skew and cross-talk signals. Listener position tracking is achieved by estimation of the time difference of arrival (TDoA). The position of the listener is then computed using the Talyer-series estimation method. The head-related transfer functions (HRTF) are used to remove the space skew and cross-talk signals, where the direction of the HRTF is given by the one estimated from the listener position tracking. The performance evaluation is carried out on the signals from the 100 subjects that are composed of the 50 female and 50 male subjects. The positioning accuracy is achieved by 70%~90%, under the condition that the mean squared positioning error is less than $0.07m^2$. The subjective listening test is also conducted where the 27 out of the 30 subjects are participated. According to the results, 70% of the subjects indicates that the overall quality of the reproduced sound from the proposed method are improved, regardless of the subject's position.

• Science of Emotion and Sensibility
• /
• v.11 no.4
• /
• pp.589-598
• /
• 2008

The purpose of this study was to compare the emotional responses of people with visual disability with those of normal people and to understand their similarity or differences in order to apply the new understandings into the future research on Web Accessibility Guidelines. For this purpose, a Web survey system was developed using 15 auditorial stimuli prepared based on the Media Taxonomy and 11 emotion measuring criteria selected from the literature review. After developing the system, emotional responses of 31 people with visual disability and 53 normal people were collected through the Web. The results of the survey showed that the emotional responses of people with visual disability were similar to those of normal people, although there were some exceptional cases. Therefore, it is clear that emotional needs of people with disability should be taken count of in the Web accessibility discussions and further in-depth studies on the emotional characteristics of people with disability are necessary.

• Journal of Fisheries and Marine Sciences Education
• /
• v.25 no.6
• /
• pp.1381-1388
• /
• 2013

In order to improve the availability of underwater sound by the fundamental data on the hearing ability, the auditory thresholds for the bambooleaf wrasse pseudolabrus japonicus were determined at 80Hz, 100Hz, 200Hz, 300Hz, 500Hz and 800Hz by heartbeat conditioning method using pure tones coupled with a delayed electric shock. The audible range of the bambooleaf wrasse extended from 80Hz to 800Hz with the best sensitivity around 100Hz and 200Hz. In addition, the auditory thresholds over 300Hz increased rapidly. The mean auditory thresholds of the bambooleaf wrasse at the test frequencies, 80Hz, 100Hz, 200Hz, 300Hz, 500Hz and 800Hz were 100dB, 95.1dB, 94.8dB, 109dB, 121dB and 125dB, respectively. Auditory critical ratios for the bambooleaf wrasse were measured using masking stimuli with the spectrum level range of about 70, 74, 78dB (0dB re $1{\mu}Pa/\sqrt{Hz}$). According to white noise level, the auditory thresholds increased as compared with thresholds in a quiet background noise. The Auditory masking by the white noise spectrum level was stared over about 60dB within 80~300Hz. Critical ratios to be measured at frequencies from 80Hz to 300Hz were minimum 33dB and maximum 39dB.

• Journal of Biomedical Engineering Research
• /
• v.25 no.2
• /
• pp.145-150
• /
• 2004

In this study for the prosthesis of the spatial and directional sensation for the blind, an ultrasonic scale system and an electronic compass system were developed. The ultrasonic scale utilizes 40 ㎑ sound for the detection of distance to the barrier and the spatial information is transferred to the blind by various sound interval, which is proportional to the distance. The electronic compass utilizes a magnetoresistor bridge for the detection of the magnetic field strength of earth in horizontal plane. The information for the direction of the earth's north is transferred by tactile stimuli by a vibrating motor band around upper head. Detection distance of the ultrasonic scale is ranged from 0.065 to 3.26 meters, and the detection angle resolution of the electronic compass is about 22.5 degrees. The integrated system of the ultrasonic scale and the electronic compass was developed. Distance information is converted to the location of the tactile stimulation along the clockwise direction by a vibrating motor according to the distance installed around upper head of the blind. The intent of this article is to provide an practical prosthetic tool of spatial and directional sensation for the blind. Daily practice of this system will improve the usefulness of this system.