• Proceedings of the IEEK Conference
• /
• 2000.07a
• /
• pp.249-252
• /
• 2000

An experimental multimodal system combining natural input modes such as speech, lip movement, and gaze is proposed in this paper. It benefits from novel human-compute. interaction (HCI) modalities and from multimodal integration for tackling the problem of the HCI bottleneck. This system allows the user to select menu items on the screen by employing speech recognition, lip reading, and gaze tracking components in parallel. Face tracking is a supplementary component to gaze tracking and lip movement analysis. These key components are reviewed and preliminary results are shown with multimodal integration and user testing on the prototype system. It is noteworthy that the system equipped with gaze tracking and lip reading is very effective in noisy environment, where the speech recognition rate is low, moreover, not stable. Our long term interest is to build a user interface embedded in a commercial car navigation system (CNS).

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.5 no.7
• /
• pp.1354-1360
• /
• 2001

Calculated velocity distribution was used to visual information by image that is obtained from camera. The visual velocity of object that is obtained from this visual information were fused and experimented. That is, need motion of eye that motion of head that happen by external disturbance or move of camera itself to get stable image in environment that receive external disturbance can be compensated. In this treatise, algorithm that control gaze which vision and sense of equilibrium are fused in environment with external disturbance proposed, and thing that compare with that it controls gaze only that control gaze which vision and sense of equilibrium are fused in the experiment result and position deflection is few confirmed. This was because action of camera prop is effect that record conclusion error of the speed because the appearance speed is decreased being compensated by angular velocity sensor.

• Journal of Korea Multimedia Society
• /
• v.24 no.7
• /
• pp.903-912
• /
• 2021

Eye tracking research for upper limb disabilities is showing an effect in the aspect of device control. However, the reality is that it is not enough to perform web interaction with only eye tracking technology. In the Eye-Voice interface, a previous study, in order to solve the problem that the existing gaze tracking interfaces cause a malfunction of pointer execution, a gaze tracking interface supplemented with a voice command was proposed. In addition, the reduction of the malfunction rate of the pointer was confirmed through a comparison experiment with the existing interface. In this process, the difficulty of pointing due to the small size of the execution object in the web environment was identified as another important problem of malfunction. In this study, we propose an auto-magnification interface of objects so that people with upper extremities can freely click web contents by improving the problem that it was difficult to point and execute due to the high density of execution objects and their arrangements in web pages.

• Journal of Korea Multimedia Society
• /
• v.23 no.4
• /
• pp.566-573
• /
• 2020

Computers are the most common tool when using the Internet and utilizing a mouse to select and execute objects. Eye tracking technology is welcomed as an alternative technology to help control computers for users who cannot use their hands due to their disabilities. However, the pointer execution method of the existing eye tracking technique causes many malfunctions. Therefore, in this paper, we developed a gaze tracking interface that combines voice commands to solve the malfunction problem when the upper limb disabled uses the existing gaze tracking technology to execute computer menus and objects. Usability verification was conducted through comparative experiments regarding the improvements of the malfunction. The upper limb disabled who are hand-impaired use eye tracking technology to move the pointer and utilize the voice commands, such as, "okay" while browsing the computer screen for instant clicks. As a result of the comparative experiments on the reduction of the malfunction of pointer execution with the existing gaze interfaces, we verified that our system, Eye-Voice, reduced the malfunction rate of pointer execution and is effective for the upper limb disabled to use.

• The Transactions of the Korean Institute of Electrical Engineers A
• /
• v.48 no.10
• /
• pp.1356-1363
• /
• 1999

In this paper, a new method for controlling the pointing device using EOG(electrooculogram) signal generated from eye movement was suggested. The basic idea of the method is to control the direction of pointer, as using the results of measuring each component of the horizontal EOG and the vertical EOG by angle of eye-gaze. As a practical example, pointing device controlling the personal computer's pointer is manufactured. The designed pointing device consists of pre-amplifier, A/D converter, serial transmission device and PC program. That is, first, the EOG is amplified by pre-amplifier. Secondly, the amplified EOG is digitized and transmitted to personal computer by PIC16C74A. Finally, the software for controlling the pointer on personal computer is programed. As the result, the measured horizontal EOG and vertical EOG by eye-gaze angle had high linearity; the correlation coefficients of the regression line were 0.998 and 0.996 respectively. And the developed pointing device is able to control the personal computer's pointer, and the average of the errors between the objective value and the observed value had 3.77% for horizontal axis and 5.85% for vertical axis. The pointing device developed in this study is able to control personal computer's pointer by subject's eye movement, that is, the user's intention. Furthermore, the algorithm of this study is applicable for many field, such as a new method remote control, a new wheelchair control and so forth.

• Korean Journal of Child Studies
• /
• v.38 no.1
• /
• pp.205-215
• /
• 2017

Objective: The current study examined whether providing both an actor's eye gaze and emotional expressions can help 10-month-olds interpret a change in the actor's words as a signal to a change in the actor's goal object. Methods: Sixteen 10-month-olds participated in an experiment using the violation-of-expectation paradigm and were compared to 16 10-month-olds in a control condition. The infants in the experimental condition were familiarized to an event in which an actor looks at one of two novel objects, excitingly utters a sentence, "Wow, here's a modi!", and grasps the object. The procedure in the control condition was identical to that of the experimental condition except that the infants heard the sentence without any emotional excitement and the eye gaze of the agent was hidden by a visor. In the following test trial, the infants in both conditions heard the agent changing her word (from modi to papu) and watched her grasping either the same object as before (old-goal event) or the new object (new-goal event). Results: The infants in the experimental condition looked at the old-goal event longer than at the new-goal event, suggesting that they expected the agent to change her goal object when the actor changed her word. However, the infants in the control condition looked at the two events about equally. Conclusion: When both eye gaze and emotional cues were provided, 10-month-olds were able to exploit the agent's verbal information when reasoning about whether the agent would pursue the same goal object as before.

• Physical Therapy Korea
• /
• v.13 no.4
• /
• pp.23-29
• /
• 2006

The purpose of the present study was to examine gaze effects on spatial and kinematic characteristics during a pointing task. Subjects were asked to watch and point to an aimed target (2 mm in diameter) displayed on a vertically mounted board. Four gaze conditions were developed as combinations of "seeing-aiming" in terms of the eye movements: Focal-Focal (F-F), Focal-Fixing (F-X), Fixing-Focal (X-F), and Fixing-Fixing (X-X). Both the home target and an aimed target were presented for 1 second and then were disappeared in F-F and X-F. In X-F and X-X, only an aimed target disappeared after 1 second. Subjects were asked to point (with index finger tip) to an aimed target accurately as soon as the aimed target was removed. A significant main effect of gaze was found (p<.01) for normalized movement time. Peripheral retina targets had significantly larger absolute error compared to central retina targets on the x (medio-lateral) and z (superior-inferior) axes (p<.01). A significant undershooting to peripheral retina targets on the x axis was found (p<.01). F-F and X-F had larger peak velocities compared to F-X and X-X (p<.01). F-F and X-F were characterized by more time spent in the deceleration phase compared to F-X and X-X (p<.01). The present study demonstrates that central vision utilizes a form of on-line visual processing to reach to an object, and thus increases spatial accuracy. However, peripheral vision utilizes a relatively off-line visual processing with a dependency on proprioceptive information.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2022.11a
• /
• pp.812-814
• /
• 2022

제어할 사물을 선택하기 위해 여러 단계를 거쳐야 하는 기존 '스마트 홈'의 단점을 보완하고자 본 논문에서는 사용자의 시선 방향을 추정하여 사용자가 바라보는 방향에 있는 사물을 제어할 수 있는 시스템을 제안한다. 일반 RGB 카메라를 통해 Pose Estimation으로 추출한 Landmark들의 좌표 값을 이용하여 시선 방향을 추정하는 알고리즘을 구현하였으며, 이는 근적외선 카메라와 Gaze Tracking 모델링을 통해 이루어지던 기존의 시선 추적 기술에 비해 가벼운 데이터를 산출하고 사용자와 센서간의 위치 제약이 적으며 별도의 장비를 필요로 하지 않는다. 해당 알고리즘으로 산출한 시선 추적의 정확도가 실제 주거환경에서 사용하기에 실효성이 있음을 실험을 통해 입증하였으며, 최종적으로 이 알고리즘을 적용하여 적외선 기기와 Google Home 제품에 사용할 수 있는 시선 방향 사물 제어 시스템을 구현하였다.

• Proceedings of the Korean Institute of Intelligent Systems Conference
• /
• 1998.06a
• /
• pp.176-180
• /
• 1998

We may gaze at some peculiar scenes of flocking of birds and fishes. This paper demonstrates that multiple agent mobile robots show complex behaviors from efficient and strategic rules. The simulated flock are realized by a distributed behavioral model and each mobile robot decides its own motion as an individual which moves constantly by sensing the dynamic environment.

• Cartoon and Animation Studies
• /
• s.26
• /
• pp.79-108
• /
• 2012

This thesis is on the purpose of seeking for the possibility of a mechanism in interpreting, analyzing and criticizing cartoons which are applied to the concept of "the gaze" based on "the otherness of vision", which states a pluralistic visual world. It proves that cartoons are in line with other art works that are the subject to "lack and desire"; the gaze, greets reality and acts as an important criterion of analyzing and criticizing the trend in contemporary art, in which the cartoon expresses the gaze in harmony within its work of art. In this thesis, the artist, Kang Doh-ha structuralized ambiguous and difficult forms of art as he has cumulated experimental minds by working in an indie cartoon plane for a long period of time. Among his works of art, he identified the "invisible world" through his piece "Kubrik". Therefore, he represented: a metaphor and a metonymy, an ambiguously situational expression, an intentional and emotional error, the structure of individuality and integration, and finally tension beyond its meaning through use of 'the gaze' that is both the cause and the subject of a desire in the visible world which Lacan academized when he interpreted and analyzed "Kubrik". The concept of the gaze can be used in a variety of ways to display one another's presence in relation each character, revealing a spot of lack by staring back at readers or audiences and furthermore, to analyze and criticize the hidden side of the art piece by critics. The most important details are the artist's gaze, which is seen in the eyes of the analysis and also his or her criticism of the cartoon, which functions as a metaphoric screen in which the subject himself or herself betrays the law of desires thus enabling the violent and cruel reality to be masked and indulged in plays. This will serve as an element that will lead into an art as well as control the degradation to just a piece of enjoyment with the cartoon remaining only within the visual world.