• 한국멀티미디어학회논문지
• /
• 제23권12호
• /
• pp.1454-1463
• /
• 2020

An important factor in eye-tracking PC interface for general paralyzed patients is the implementation of the mouse interface, for manipulating the GUI. With a successfully implemented mouse interface, users can generate mouse events exactly at the point of their choosing. However, it is difficult to define this interaction in the eye-tracking interface. This problem has been defined as the Midas touch problem and has been a major focus of eye-tracking research. There have been many attempts to solve this problem using blink, voice input, etc. However, it was not suitable for general paralyzed patients because some of them cannot wink or speak. In this paper, we propose a mouth-pop-up, eye-tracking mouse interface that solves the Midas touch problem as well as becoming a suitable interface for general paralyzed patients using a common RGB camera. The interface presented in this paper implements a mouse interface that detects the opening and closing of the mouth to activate a pop-up menu that the user can select the mouse event. After implementation, a performance experiment was conducted. As a result, we found that the number of malfunctions and the time to perform tasks were reduced compared to the existing method.

• 한국컴퓨터그래픽스학회논문지
• /
• 제24권4호
• /
• pp.21-27
• /
• 2018

본 논문은 모바일 디바이스에서 사용자의 입 바람을 통해 실시간으로 인터랙션 할 수 있는 기법을 제시한다. 모바일과 가상현실 분야에서 사용자의 인터랙션 기술이 중요함에도 불구하고 여전히 사용자 인터페이스 기술의 다양성이 부족하며 대부분 손을 이용한 스크린의 터치나 동작 인식이다. 본 연구에서는 사용자의 입 바람을 이용하여 실시간으로 상호작용할 수 있는 새로운 인터페이스 기술을 제안한다. 사용자와 모바일 디바이스 간의 각도와 위치를 이용하여 바람의 방향을 결정하며 사용자의 입 바람과 가중치 함수를 기반으로 바람의 크기를 계산한다. 제안하는 기술의 우수성을 보여주기 위해 입 바람 외력을 유체 방정식에 적용하여 실시간으로 벡터장의 흐름을 시각화하는 결과를 보여준다. 우리는 제안하는 방법의 결과를 모바일 디바이스 환경에서 보여주지만 인터페이스 기술을 요구하는 가상현실과 증강현실 분야에 응용할 수 있다.

• International Journal of Fuzzy Logic and Intelligent Systems
• /
• 제6권4호
• /
• pp.304-313
• /
• 2006

This paper describes a novel way of applying capacitive sensing technology to a mobile user interface. The key idea is to use grip-pattern, which is naturally produced when a user tries to use the mobile device, as a clue to determine an application to be launched. To this end, a capacitive touch sensing system is carefully designed and installed underneath the housing of the mobile device to capture the information of the user's grip-pattern. The captured data is then recognized by dedicated recognition algorithms. The feasibility of the proposed user interface system is thoroughly evaluated with various recognition tests.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• 제7권4호
• /
• pp.834-848
• /
• 2013

To effectively use these functions many kinds of human-phone interface are used such as touch, voice, and gesture. However, the most important touch interface cannot be used in case of hand disabled person or busy both hands. Although eye tracking is a superb human-computer interface method, it has not been applied to smartphones because of the small screen size, the frequently changing geometric position between the user's face and phone screen, and the low resolution of the frontal cameras. In this paper, a new eye tracking method is proposed to act as a smartphone user interface. To maximize eye image resolution, a zoom lens and three infrared LEDs are adopted. Our proposed method has following novelties. Firstly, appropriate camera specification and image resolution are analyzed in order to smartphone based gaze tracking method. Secondly, facial movement is allowable in case of one eye region is included in image. Thirdly, the proposed method can be operated in case of both landscape and portrait screen modes. Fourthly, only two LED reflective positions are used in order to calculate gaze position on the basis of 2D geometric relation between reflective rectangle and screen. Fifthly, a prototype mock-up design module is made in order to confirm feasibility for applying to actual smart-phone. Experimental results showed that the gaze estimation error was about 31 pixels at a screen resolution of $480{\times}800$ and the average hit ratio of a $5{\times}4$ icon grid was 94.6%.

• 대한산업공학회지
• /
• 제36권1호
• /
• pp.52-58
• /
• 2010

The level of competition has reached the limits in cellular phone market and the cellular phone manufacture companies started to focus their solution in user interface. Design issues with controllability led the development and renovation of such products to the use of the touch-screen phone. Depending upon the readability, technical advances, portability and controllability, user satisfaction of touch-screen phones could vary significantly. In this research, the controllability was dealt in regard to various grip postures, in order to improve menu layout which fits for using the thumbs of both hands and a thumbs of single hand. Regression models are found to the suggest the location of buttons on the screen by redesigning the menu layout, it is expected to improve both controllability and satisfaction of the user. This result can be applicable not only to mobile phone design, but also to the design of various hand-held devices using a touch screen.

• 디지털산업정보학회논문지
• /
• 제11권4호
• /
• pp.113-127
• /
• 2015

An interface in smart device environment is changing to TUI(touch user interface) environment where a system is being controlled by physical touch, differently from a system controlled through conventional mouse and keyboard. What is more important than anything else in this TUI environment is to implement interface in consideration of learn ability and cognitive constructivism according to user's experience. Therefore, now is the time when it is necessary to carry out various studies on smart content design process going a step farther together with discussing the details of user's experience factor. Hence, this study was intended to look into what effect a user's experiential traits had on the production of contents for the purpose of measures for improving TUI user satisfaction in order to effectively realize contents in smart environment. Results were yielded by using a statistical empirical analysis such as cross-tabulation analysis according to important variable and user, paired t-test, multiple response analysis, and preference frequency analysis of user preference on the basis of a survey. As a result, a system was presented for implementing DFSS(Design For Six Sigma) process. TUI experience factor can be divided into direct habitual experience, direct learning experience, indirect habitual experience, and indirect learning experience. And in the results of study, it was possible to find that the important variables of this study had a positive effect on the improvement of use satisfaction with contents on the whole according to the user convenience of smart contents. This study is expected to have a positive effect on efficient smart device-based contents production by providing objective information according to empirical analysis to smart media-based developer and designer and presenting a model for improving the changed TUI usability.

• 대한전기학회:학술대회논문집
• /
• 대한전기학회 2005년도 심포지엄 논문집 정보 및 제어부문
• /
• pp.203-205
• /
• 2005

A reactor protection system (RPS) plays the roles of generating the reactor trip signal and the engineered safety features (ESF) actuation signal when the monitored plant processes reach predefined limits. A Korean project group is developing a new digitalized RPS and the Cabinet Operator Module (COM) of the RPS which is used for the RPS integrity testing and monitoring by an equipment operator. A flat panel display (FPD) with a touch screen capability is provided as a main user interface for the RPS operation. To support the RPS COM user interface design, actually the FPD screen design, we developed a user interface style guide because the system designer could not properly deal with the many general human factors design guidelines. To develop the user interface style guide, various design guideline gatherings, a walk-though with a video recorder, guideline selection with respect to user interface design elements, determination of the properties of the design elements, discussion with the system designers, and a conversion of the properties into a screen design were carried out. This paper describes the process in detail and the findings in the course of the style guide development.

• 디지털융복합연구
• /
• 제13권11호
• /
• pp.337-348
• /
• 2015

터치 인터페이스 입력방식에서 메뉴를 마우스를 이용하여 입력하는 것 보다 터치입력 방식이 의도하지 않는 터치와 입력의 어려움이 증가하고 있다. 본 연구에서는 버튼메뉴의 최소 형상버튼을 기준으로 형태와 크기변화에 따라서 사용성 평가를 분석하고자 한다. 적용방법으로는 터치 입력방식의 인터페이스 디자인에서 활용 할 수 있도록 회귀 모형식과 인터페이스 인간 수행 평가방법의 대표적인 모형인 피츠의 법칙(Fitts' Law)의 비교분석을 통해서 더욱 효과적인 정량적 수행예측 평가 모형식 적용을 통해서 가능성을 확인하고자 했다. 따라서 터치 환경에서 적용할 수 있는 버튼의 형상과 크기변화에 따른 사용자의 사용시간을 고려한 수행예측시간을 디자인에 반영할 수 있다.

• 정보처리학회논문지B
• /
• 제18B권3호
• /
• pp.109-116
• /
• 2011

본 논문에서는 기계적인 조작 장치 없이 손동작만으로 컴퓨터를 조작할 수 있는 차세대 인터페이스인 에어 인터페이스를 구현하였다. 에어 인터페이스 시스템 구현을 위해 먼저 적외선의 전반사 원리를 이용하였으며, 이후 획득된 적외선 영상에서 손 영역을 분할한다. 매 프레임에서 분할된 손 영역은 이벤트 처리를 위한 손동작 인식부의 입력으로 사용되고, 최종적으로 개별 제어 이벤트에 맵핑된 손동작 인식을 통하여 일반적인 제어를 수행하게 된다. 본 연구에서는 손영역 검출과 추적, 손동작 인식과정을 위해 구현되어진 영상처리 및 인식 기법들이 소개되며, 개발된 에어 인터페이스 시스템은 길거리 광고, 프레젠테이션, 키오스크 등의 그 활용성이 매우 클 것으로 기대된다.

• 정보처리학회논문지A
• /
• 제18A권2호
• /
• pp.53-60
• /
• 2011

스마트 폰에서 데이터를 입력하기 위해서는 터치스크린이 기본적인 입력 장치로 널리 사용되고 있다. 하지만, 스마트 폰에서 터치스크린은 텍스트 데이터를 입력하는 정도의 간단한 입력 장치로 활용이 되고 있다. 왜냐하면, 화면의 넓이가 협소하여 그림을 그리는 것과 같은 작업을 수행하는 멀티미디어용 입력 장치로 사용하기에는 어렵기 때문이다. 본 연구에서는 적외선 방식을 이용한 스마트 폰의 입력 인터페이스 시스템 방식을 제안하고 있으며 이를 통하여 기존의 약점을 보완하고자 한다. 이 방식은 입력 공간의 제약이 없이 정확하고 빠르게 동작할 수 있다. 본 논문에서는 적외선 포인팅 방식의 사용자 인터페이스의 설계 및 구현에 대해서 기술하였다. 실험 결과를 통하여 기존의 스마트 폰의 터치스크린 방식보다 본 논문의 방식이 더욱 편리하고 효율적인 입력도구로 사용될 수 있음을 보였다.