• Journal of the Ergonomics Society of Korea
• /
• v.30 no.1
• /
• pp.195-202
• /
• 2011

Objective: The aim of this study is to investigate and review the previous researches about objective measuring fatigue caused by visual stimuli. Also, we analyze possibility of alternative visual fatigue measurement methods using facial expression recognition and gesture recognition. Background: In most previous researches, visual fatigue is commonly measured by survey or interview based subjective method. However, the subjective evaluation methods can be affected by individual feeling's variation or other kinds of stimuli. To solve these problems, signal and image processing based visual fatigue measurement methods have been widely researched. Method: To analyze the signal and image processing based methods, we categorized previous works into three groups such as bio-signal, brainwave, and eye image based methods. Also, the possibility of adopting facial expression or gesture recognition to measure visual fatigue is analyzed. Results: Bio-signal and brainwave based methods have problems because they can be degraded by not only visual stimuli but also the other kinds of external stimuli caused by other sense organs. In eye image based methods, using only single feature such as blink frequency or pupil size also has problem because the single feature can be easily degraded by other kinds of emotions. Conclusion: Multi-modal measurement method is required by fusing several features which are extracted from the bio-signal and image. Also, alternative method using facial expression or gesture recognition can be considered. Application: The objective visual fatigue measurement method can be applied into the fields of quantitative and comparative measurement of visual fatigue of next generation display devices in terms of human factor.

• Journal of Broadcast Engineering
• /
• v.23 no.2
• /
• pp.206-217
• /
• 2018

We develop the signal processing method for adaptive implementing direction of signal and the frequency sensitivity of human visual system(HVS). Existing multiband energy scaling method makes ringing artifact because it does not consider signal direction. To solve this problem, we use block gradient for signal direction in addition to existing method. And we use the fact that frequency component of signal is more sensitive than value of signal over human eyes. we enhance the signal according to contrast sensitivity function(CSF) which is the model of frequency sensitivity of human eye. Compared that the existing analysis models only improve the efficiencies in the existing systems, the developed method can process the image signals to be more desirable and suitable to HVS.

• The Journal of the Acoustical Society of Korea
• /
• v.28 no.8
• /
• pp.832-842
• /
• 2009

Automatic speech recognition (ASR) has been successfully applied to many real human computer interaction (HCI) applications; however, its performance tends to be significantly decreased under noisy environments. The invention of audio visual speech recognition (AVSR) using an acoustic signal and lip motion has recently attracted more attention due to its noise-robustness characteristic. In this paper, we describe our novel integration scheme for AVSR based on a late integration approach. Firstly, we introduce the robust reliability measurement for audio and visual modalities using model based information and signal based information. The model based sources measure the confusability of vocabulary while the signal is used to estimate the noise level. Secondly, the output probabilities of audio and visual speech recognizers are normalized respectively before applying the final integration step using normalized output space and estimated weights. We evaluate the performance of our proposed method via Korean isolated word recognition system. The experimental results demonstrate the effectiveness and feasibility of our proposed system compared to the conventional systems.

• Journal of the Institute of Convergence Signal Processing
• /
• v.14 no.4
• /
• pp.212-216
• /
• 2013

As virtual reality technologies are advanced rapidly, how to render 3D objects across modalities is becoming an important issue. This study is therefore aimed to investigate human discriminability on the curvature of 3D polygonal surfaces with focusing on the vision and touch senses because they are most dominant when explore 3D shapes. For the study, we designed a psychophysical experiment using signal detection theory to determine curvature discrimination for three conditions: haptic only, visual only, and both haptic and visual. The results show that there is no statistically significant difference among the conditions although the threshold in the haptic condition is the lowest. The results also indicate that rendering using both visual and haptic channels could degrade the performance of discrimination on a 3D global shape. These results must be considered when a multimodal rendering system is designed in near future.

• Proceedings of the ESK Conference
• /
• 1996.10a
• /
• pp.206-215
• /
• 1996

Recently, proportion of the aged becomes greater in Korea like the advanced country as time passed away, and this is treated as one of major social problems. Therfore, we investigated visual/auditory signal detection performance to evaluate vocational aptitude of the middle-and old-aged workers in this study. It was shown that signal detection performance decreased as workers became older, and there was large individual difference in signal detection performance. Since signal detection performance in visual task decreased rapidly and more than that in auditory task, the middle-and old-aged workers can not carry out properly visual inspection and precision task was related with that in auditory task. It can be expected that the parameters used in this study are in good use for evaluating a worker's aptitude.

• Journal of the Institute of Convergence Signal Processing
• /
• v.16 no.2
• /
• pp.35-39
• /
• 2015

Auditory and visual stimuli presented in the peripheral visual field were perceived as spatially coincident when the auditory stimulus was presented five to seven degrees outwards from the direction of the visual stimulus. Furthermore, judgments of the perceived distance between auditory and visual stimuli presented in the periphery did not increase when an auditory stimulus was presented in the peripheral side of the visual stimulus. As to the origin of this phenomenon, there would seem to be two possibilities. One is that the participants could not perceptually distinguish the distance on the peripheral side because of the limitation of accuracy perception. The other is that the participants could distinguish the distances, but could not evaluate them because of the insufficient experimental setup of auditory stimuli. In order to confirm which of these two alternative explanations is valid, we conducted an experiment similar to that of our previous study using a sufficient number of loudspeakers for the presentation of auditory stimuli. Results revealed that judgments of perceived distance increased on the peripheral side. This indicates that we can perceive discrimination between audio and visual stimuli on the peripheral side.

• Journal of Institute of Control, Robotics and Systems
• /
• v.13 no.8
• /
• pp.719-725
• /
• 2007

In this paper, we present an audio-visual speech recognition system for noise-robust human-computer interaction. Unlike usual speech recognition systems, our system utilizes the visual signal containing speakers' lip movements along with the acoustic signal to obtain robust speech recognition performance against environmental noise. The procedures of acoustic speech processing, visual speech processing, and audio-visual integration are described in detail. Experimental results demonstrate the constructed system significantly enhances the recognition performance in noisy circumstances compared to acoustic-only recognition by using the complementary nature of the two signals.

• Journal of Broadcast Engineering
• /
• v.20 no.2
• /
• pp.238-247
• /
• 2015

We develop the signal processing method for adaptive implementing direction of signal and the frequency sensitivity of human visual system(HVS). Existing multibnad energy scaling method makes ringing artifact because it does not consider signal direction. To solve this problem, we use block gradient for signal direction in addition to existing method. And we use the fact that frequency component of signal is more sensitive than value of signal over human eyes. we enhance the signal according to contrast sensitivity function(CSF) which is the model of frequency sensitivity of human eye. Compared that the existing analysis models only improve the efficiencies in the existing systems, the developed method can process the image signals to be more desirable and suitable to HVS.

• The Journal of the Korea Contents Association
• /
• v.11 no.1
• /
• pp.1-8
• /
• 2011

With the development of next IT convergence technology and the construction of infrastructure for personalized services, the importance of services based on user's sensibility status and vital signal is being spotlighted. It is the most crucial factor for the strategy of sensibility engineering to investigate student's vital signal according to the sensibility. In this paper, we proposed the vital signal monitoring simulation system by the various visual stimulus. The proposed method obtained the student's vital signal by the various visual stimulus. And the power spectrum analysis using the fast fourier transform is evaluated the activity level between the sympathetic and the parasympathetic. The analyzed result is monitoring the sensibility by displaying the heath signal light. To evaluate the sensibility between the high school's students and the university's students, we conducted SD profile and paired T-tests so as to verify usefulness. This evaluation found that the difference of sensibility activity by positive and negative stimulus was statistically meaningful. Ultimately, this paper suggests empirical application to verify the adequacy and the validity.

• Proceedings of the Korean Society of Medical Physics Conference
• /
• 2004.11a
• /
• pp.140-143
• /
• 2004

To appropriately control or compensate breathing motion of targets in thorax or abdomen during radiotherapy is still demanding. Our idea is that a visual signal may help regulate patient's breathing pattern, by controlling its amplitude and cycle. The system involving breathing control with a visual signal for aperture maneuver with controlled breath (AMC) has been developed. A thermocouple is used to detect the temperature change due to patient's breathing. The system also consists of a mask, in which the thermocouple is installed, an operational amplifier, a converter, etc. Patients were instructed to control their respiration by breathing following the visuals signal, as watching a display that shows both patients' current breathing pattern and the signal. The patterns of patients' controlled breathing and the signals coincided well. Therefore, when AMC technique is applied, a target moves in the range that is 60 % less than the range of free breathing motion with the help of the system and so target margins can be reduced significantly. This study reveals that a visual signal is not only useful to control patient's breathing but also clinically effective.