• 한국멀티미디어학회논문지
• /
• 제23권12호
• /
• pp.1454-1463
• /
• 2020

An important factor in eye-tracking PC interface for general paralyzed patients is the implementation of the mouse interface, for manipulating the GUI. With a successfully implemented mouse interface, users can generate mouse events exactly at the point of their choosing. However, it is difficult to define this interaction in the eye-tracking interface. This problem has been defined as the Midas touch problem and has been a major focus of eye-tracking research. There have been many attempts to solve this problem using blink, voice input, etc. However, it was not suitable for general paralyzed patients because some of them cannot wink or speak. In this paper, we propose a mouth-pop-up, eye-tracking mouse interface that solves the Midas touch problem as well as becoming a suitable interface for general paralyzed patients using a common RGB camera. The interface presented in this paper implements a mouse interface that detects the opening and closing of the mouth to activate a pop-up menu that the user can select the mouse event. After implementation, a performance experiment was conducted. As a result, we found that the number of malfunctions and the time to perform tasks were reduced compared to the existing method.

• 대한인간공학회지
• /
• 제31권4호
• /
• pp.601-607
• /
• 2012

Objective: The aim of this study is to classify between intentional and natural blinks in vision based eye tracking system. Through implementing the classification method, we expect that the great eye tracking method will be designed which will perform well both navigation and selection interactions. Background: Currently, eye tracking is widely used in order to increase immersion and interest of user by supporting natural user interface. Even though conventional eye tracking system is well focused on navigation interaction by tracking pupil movement, there is no breakthrough selection interaction method. Method: To determine classification threshold between intentional and natural blinks, we performed experiment by capturing eye images including intentional and natural blinks from 12 subjects. By analyzing successive eye images, two features such as eye closed duration and pupil size variation after eye open were collected. Then, the classification threshold was determined by performing SVM(Support Vector Machine) training. Results: Experimental results showed that the average detection accuracy of intentional blinks was 97.4% in wearable eye tracking system environments. Also, the detecting accuracy in non-wearable camera environment was 92.9% on the basis of the above used SVM classifier. Conclusion: By combining two features using SVM, we could implement the accurate selection interaction method in vision based eye tracking system. Application: The results of this research might help to improve efficiency and usability of vision based eye tracking method by supporting reliable selection interaction scheme.

• International journal of advanced smart convergence
• /
• 제13권3호
• /
• pp.191-198
• /
• 2024

This paper presents an alternative solution for applying MetaHuman facial animations using MediaPipe, providing a versatile option to the Live Link iPhone system. Our approach involves capturing facial expressions with various camera devices, including webcams, laptop cameras, and Android phones, processing the data for landmark detection, and applying these landmarks in Unreal Engine Blueprint to animate MetaHuman characters in real-time. Techniques such as the Eye Aspect Ratio (EAR) for blink detection and the One Euro Filter for data smoothing ensure accurate and responsive animations. Experimental results demonstrate that our system provides a cost-effective and flexible alternative for iPhone non-users, enhancing the accessibility of advanced facial capture technology for applications in digital media and interactive environments. This research offers a practical and adaptable method for real-time facial animation, with future improvements aimed at integrating more sophisticated emotion detection features.

• 한국정보처리학회:학술대회논문집
• /
• 한국정보처리학회 2019년도 춘계학술발표대회
• /
• pp.693-696
• /
• 2019

IT 기술은 끊임없는 발전을 거듭하고 있으며 현 인류는 기계와 더불어 살고 있다. Desktop, 스마트폰, 노트북 및 태블릿PC는 물론이고, 스마트 워치와 같은 '웨어러블 디바이스(Wearable Device)'의 등장으로 기계 속 세상에 그들과 함께 살고 있다하여도 과언이 아니다. 단연 잦은 기기 사용으로 인해 가장 영향을 크게 받는 인간의 신체 부위는 '눈'이다. 휴대용 기기(Portable Device)는 휴대에 용이해야 한다는 특징 때문에 그 크기가 점차 작아지고 있다. 따라서 작은 기기에 부착된 화면 역시 크기가 감소하였다. 장시간 작은 화면을 집중하여 보게 되면 눈의 피로가 금방 쌓이게 된다. 이로 인해 안구 건조 증 및 시력 저하 발생률이 증가하게 되는데, 영상처리 기술을 이용하여 안구의 깜박임을 감지하고 일정 수치 이하로 깜박임 횟수가 미달될 경우에 안구 운동을 권장하는 프로그램을 개발 하였다.

• 대한의용생체공학회:학술대회논문집
• /
• 대한의용생체공학회 1996년도 추계학술대회
• /
• pp.90-94
• /
• 1996

We studied the problem of driver's low vigilance state which is related to the one reason of traffic accidents. In this paper, we developed the drowsiness warning system for a drowsy driver. To extract the eyes and mouth from the driver's facial image in real time, a computer vision method was used. The eye blink duration and yawning were used as measurement parameters of drowsiness detection. When the drowsy state of a driver was detected, the driver was refreshed by the scent generator and the alarm. Also, the driver's bio-signal was acquired and analyzed to measure the vigilance state.

• 감성과학
• /
• 제5권2호
• /
• pp.29-34
• /
• 2002

이전 연구에서 가상현실에 몰입하는 동안 넓은 시야(field of view : 150˚)와 빠른 운행속도(70km/sec)가 사이버 멀미를 심화시킨다는 결과를 얻었다. 피험자의 90%가 좁은 시야(50˚)와 느린 운행속도(30km/sec)에서 사이버멀미 증상이 적었다. 본 실험에서는 피험자가 생리적인 동요를 경험할 때마다 바이오피드백 방법을 사용하여 사이버 멀미 감소 가상환경(cybersickness alleviating virtual environment ; CAVE)을 제시한 후, 그 효과를 관찰하였다. 피부전도도, 말초체온, 말초 혈류량, 심박률, 눈 깜박임, 뇌전위의 변수들을 입력하는 인공 신경망으로 구성된 실시간 멀미 탐지 시스템과 CAVE-제시 피드백 시스템을 구축하였다 이 시스템들은 생리적 측정치들이 사이버 멀미의 출현을 신호할 때마다 피드백 출력으로 좁은 화면과 감소된 운행속도를 일시적으로 제공하였다. 36명의 피험자를 대상으로 SSQ(simulator sickness questionnaire)와 자기보고를 이용하여 사이버 멀미의 빈도와 심각도를 조사하였다. 모든 피험자는 한달 간격으로 CAW 조건과 non-CAYE 조건에서 두 번 가상현실을 경험하였다. 사이버멀미의 빈도와 심각도는 non-CAVE 조건보다 CAVE 조건에서 유의미하게 감소하였다. 즉, 전기 생리학적 특징들에 기반한 인공 신경망에 의해 제공된 좁은 시야와 느린 운행의 가상환경은 사이버 멀미 증상들을 감소시켰다 이러한 결과들은 생체신호 피드백 시스템을 이용하여 인간 친화적 가상환경을 구축할 수 있는 가능성을 보인 것이다.