• 대한인간공학회지
• /
• 제30권1호
• /
• pp.195-202
• /
• 2011

Objective: The aim of this study is to investigate and review the previous researches about objective measuring fatigue caused by visual stimuli. Also, we analyze possibility of alternative visual fatigue measurement methods using facial expression recognition and gesture recognition. Background: In most previous researches, visual fatigue is commonly measured by survey or interview based subjective method. However, the subjective evaluation methods can be affected by individual feeling's variation or other kinds of stimuli. To solve these problems, signal and image processing based visual fatigue measurement methods have been widely researched. Method: To analyze the signal and image processing based methods, we categorized previous works into three groups such as bio-signal, brainwave, and eye image based methods. Also, the possibility of adopting facial expression or gesture recognition to measure visual fatigue is analyzed. Results: Bio-signal and brainwave based methods have problems because they can be degraded by not only visual stimuli but also the other kinds of external stimuli caused by other sense organs. In eye image based methods, using only single feature such as blink frequency or pupil size also has problem because the single feature can be easily degraded by other kinds of emotions. Conclusion: Multi-modal measurement method is required by fusing several features which are extracted from the bio-signal and image. Also, alternative method using facial expression or gesture recognition can be considered. Application: The objective visual fatigue measurement method can be applied into the fields of quantitative and comparative measurement of visual fatigue of next generation display devices in terms of human factor.

• 방송공학회논문지
• /
• 제23권2호
• /
• pp.206-217
• /
• 2018

본 논문은 영상 신호의 방향을 고려하여 기존의 multiband energy scaling 방법의 문제점을 보완하면서 human visual system(HVS)에 적합한 영상 local contrast 향상 방법을 개발하였다. 기존의 multiband energy scaling 방법은 신호 방향에 대한 고려 없이 화질을 향상시켜 ringing artifact가 발생하였으나 본 논문에서는 block gradient를 사용하여 신호의 방향을 측정하고 측정된 신호 방향에 따라 주파수 신호를 향상시켜 ringing artifact의 발생 없이 화질을 향상시켰다. 또한 본 논문은 human visual system(HVS)은 각 신호의 값 하나하나 보다는 각 신호가 가지는 주파수에 성분에 민감하게 반응한다는 것을 이용하여 주파수 성분에 대한 인간 시각의 민감도를 모델링한 contrast sensitivity function(CSF)에 따라 영상의 화질을 향상시켰다. 결국 본 논문에서 제안하는 방법은 신호의 특성과 인간 시각의 특성을 모두 고려하여 영상의 화질을 향상시키기 때문에 기존의 화질 향상 방법들에 비해 영상 신호와 인간 시각 특성에 더욱 적합하게 화질을 향상시킬 수 있다.

• 한국음향학회지
• /
• 제28권8호
• /
• pp.832-842
• /
• 2009

Automatic speech recognition (ASR) has been successfully applied to many real human computer interaction (HCI) applications; however, its performance tends to be significantly decreased under noisy environments. The invention of audio visual speech recognition (AVSR) using an acoustic signal and lip motion has recently attracted more attention due to its noise-robustness characteristic. In this paper, we describe our novel integration scheme for AVSR based on a late integration approach. Firstly, we introduce the robust reliability measurement for audio and visual modalities using model based information and signal based information. The model based sources measure the confusability of vocabulary while the signal is used to estimate the noise level. Secondly, the output probabilities of audio and visual speech recognizers are normalized respectively before applying the final integration step using normalized output space and estimated weights. We evaluate the performance of our proposed method via Korean isolated word recognition system. The experimental results demonstrate the effectiveness and feasibility of our proposed system compared to the conventional systems.

• 융합신호처리학회논문지
• /
• 제14권4호
• /
• pp.212-216
• /
• 2013

As virtual reality technologies are advanced rapidly, how to render 3D objects across modalities is becoming an important issue. This study is therefore aimed to investigate human discriminability on the curvature of 3D polygonal surfaces with focusing on the vision and touch senses because they are most dominant when explore 3D shapes. For the study, we designed a psychophysical experiment using signal detection theory to determine curvature discrimination for three conditions: haptic only, visual only, and both haptic and visual. The results show that there is no statistically significant difference among the conditions although the threshold in the haptic condition is the lowest. The results also indicate that rendering using both visual and haptic channels could degrade the performance of discrimination on a 3D global shape. These results must be considered when a multimodal rendering system is designed in near future.

• 대한인간공학회:학술대회논문집
• /
• 대한인간공학회 1996년도 추계학술대회논문집
• /
• pp.206-215
• /
• 1996

Recently, proportion of the aged becomes greater in Korea like the advanced country as time passed away, and this is treated as one of major social problems. Therfore, we investigated visual/auditory signal detection performance to evaluate vocational aptitude of the middle-and old-aged workers in this study. It was shown that signal detection performance decreased as workers became older, and there was large individual difference in signal detection performance. Since signal detection performance in visual task decreased rapidly and more than that in auditory task, the middle-and old-aged workers can not carry out properly visual inspection and precision task was related with that in auditory task. It can be expected that the parameters used in this study are in good use for evaluating a worker's aptitude.

• 융합신호처리학회논문지
• /
• 제16권2호
• /
• pp.35-39
• /
• 2015

Auditory and visual stimuli presented in the peripheral visual field were perceived as spatially coincident when the auditory stimulus was presented five to seven degrees outwards from the direction of the visual stimulus. Furthermore, judgments of the perceived distance between auditory and visual stimuli presented in the periphery did not increase when an auditory stimulus was presented in the peripheral side of the visual stimulus. As to the origin of this phenomenon, there would seem to be two possibilities. One is that the participants could not perceptually distinguish the distance on the peripheral side because of the limitation of accuracy perception. The other is that the participants could distinguish the distances, but could not evaluate them because of the insufficient experimental setup of auditory stimuli. In order to confirm which of these two alternative explanations is valid, we conducted an experiment similar to that of our previous study using a sufficient number of loudspeakers for the presentation of auditory stimuli. Results revealed that judgments of perceived distance increased on the peripheral side. This indicates that we can perceive discrimination between audio and visual stimuli on the peripheral side.

• 제어로봇시스템학회논문지
• /
• 제13권8호
• /
• pp.719-725
• /
• 2007

In this paper, we present an audio-visual speech recognition system for noise-robust human-computer interaction. Unlike usual speech recognition systems, our system utilizes the visual signal containing speakers' lip movements along with the acoustic signal to obtain robust speech recognition performance against environmental noise. The procedures of acoustic speech processing, visual speech processing, and audio-visual integration are described in detail. Experimental results demonstrate the constructed system significantly enhances the recognition performance in noisy circumstances compared to acoustic-only recognition by using the complementary nature of the two signals.

• 방송공학회논문지
• /
• 제20권2호
• /
• pp.238-247
• /
• 2015

본 논문은 영상 신호의 방향을 고려하여 기존의 multiband energy scaling 방법의 문제점을 보완하면서 human visual system(HVS)에 적합한 영상 local contrast 향상 방법을 개발하였다. 기존의 multiband energy scaling 방법은 신호 방향에 대한 고려 없이 화질을 향상시켜 ringing artifact가 발생하였으나 본 논문에서는 block gradient를 사용하여 신호의 방향을 측정하고 측정된 신호 방향에 따라 주파수 신호를 향상시켜 ringing artifact의 발생 없이 화질을 향상시켰다. 또한 본 논문은 human visual system(HVS)은 각 신호의 값 하나하나 보다는 각 신호가 가지는 주파수에 성분에 민감하게 반응한다는 것을 이용하여 주파수 성분에 대한 인간 시각의 민감도를 모델링한 contrast sensitivity function(CSF)에 따라 영상의 화질을 향상시켰다. 결국 본 논문에서 제안하는 방법은 신호의 특성과 인간 시각의 특성을 모두 고려하여 영상의 화질을 향상시키기 때문에 기존의 화질 향상 방법들에 비해 영상 신호와 인간 시각 특성에 더욱 적합하게 화질을 향상시킬 수 있다.

• 한국콘텐츠학회논문지
• /
• 제11권1호
• /
• pp.1-8
• /
• 2011

차세대 IT융합 기술의 발전에 따라 개인화 서비스를 위한 인프라스트럭처가 구축되면서, 사용자의 감성 상태와 생체신호 기반 서비스의 중요성이 부각되고 있다. 또한 감성에 따른 학생의 생체신호를 파악하는 것은 감성공학 전략의 중요한 성공요소가 되고 있다. 본 논문에서는 다양한 시각자극에 따른 생체신호 모니터링 시뮬레이션 시스템을 제안하였다. 다양한 시각자극에 의한 학생의 생체신호를 측정하여 수집한다. 고속 퓨리에 변환을 이용한 파워 스펙트럼을 분석하여 교감신경과 부교감신경의 활성 정도를 파악한다. 분석된 결과를 건강신호등에 표시하여 감성을 모니터링 한다. 고등학생과 대학생간의 감성의 평가를 하기 위해 SD 프로필과 대응표본 T-검정을 실시하여 유용성을 검증하였다. 평가결과, 긍정과 부정 자극에 대한 감성 활성화에 대한 차이가 통계적으로 의미가 있음을 증명하였다. 이를 체험형 시뮬레이션 시스템의 논리적 타당성과 유효성을 검증하기 위해 실험적인 적용을 시도하고자 한다.

• 한국의학물리학회:학술대회논문집
• /
• 한국의학물리학회 2004년도 제29회 추계학술대회 발표논문집
• /
• pp.140-143
• /
• 2004

To appropriately control or compensate breathing motion of targets in thorax or abdomen during radiotherapy is still demanding. Our idea is that a visual signal may help regulate patient's breathing pattern, by controlling its amplitude and cycle. The system involving breathing control with a visual signal for aperture maneuver with controlled breath (AMC) has been developed. A thermocouple is used to detect the temperature change due to patient's breathing. The system also consists of a mask, in which the thermocouple is installed, an operational amplifier, a converter, etc. Patients were instructed to control their respiration by breathing following the visuals signal, as watching a display that shows both patients' current breathing pattern and the signal. The patterns of patients' controlled breathing and the signals coincided well. Therefore, when AMC technique is applied, a target moves in the range that is 60 % less than the range of free breathing motion with the help of the system and so target margins can be reduced significantly. This study reveals that a visual signal is not only useful to control patient's breathing but also clinically effective.