• Title/Summary/Keyword: eye-tracking system

Search Result 172, Processing Time 0.023 seconds

Remote Control through Tracking of Pupil on Mobile Device (모바일 기기에서 눈동자 추적을 통한 원격 제어)

  • Kim, Su-Sun;Kang, Seok-Hoon;Kim, Seon-Woon
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.13 no.4
    • /
    • pp.1849-1856
    • /
    • 2012
  • This paper proposes a method to track the center of pupil and perform the remote control for interface based on the substituted commands according to movements of pupil under smart phone environment. The proposed method, which is a remote control through the movement of eyes, may be helpful for the handicapped people or users who want a more convenient input method. A method based on webcam, which is representative one among the previous methods to track pupil of user, has a few limitations on distance and angle between location of user and webcam. However, this paper uses smart phone that is convenient to carry. The proposed method can perform the remote control through tracking of pupil using wireless network without any restriction on the location of users. Thus, the method is effectively applied for controlling the smart TV that should be controlled on the distance as well as the remote control for PC.

Presbyopic Spectacle and Monovision for Reading Performance Before Adaptation (노안안경과 모노비젼 콘택트렌즈 착용 후 적응 전 읽기 능력 평가)

  • Chu, Byoung Sun;Hwang, Jeong Hee
    • Journal of Korean Ophthalmic Optics Society
    • /
    • v.15 no.3
    • /
    • pp.263-268
    • /
    • 2010
  • Purpose: Eye movements and fixation ability are an important procedure to obtain external information and essential means of clear vision. The purpose of this study was to determine the reading performance such as reading time and number of fixations when random text was viewed at varying distances. Methods: Twenty two presbyopes were participated. All subjects were screened for their suitability to participate in the study by clinical examination, and none of the participants had previously worn contact lenses and no previous experience of wearing any types of presbyopic vision correction except single vision. The reading time and number of fixations were recorded using eye tracker while each subjects was waring four vision corrections which included single vision for distance (SV), bifocal spectacle lenses (BIF), progressive addition lenses (PAL), and monovision (MV). The reading material was presented at distance and near distance. Results: Reading time and number of fixations for near stimulus were significantly different among vision correction used in this study (p<0.001). In particular, wearing SV required longer reading time and produced longer fixation duration for near text. However, reading distance text was similarity performed across vision corrections tested and there was no statistical difference found for either reading time and number of fixations. Conclusions: Wearing presbyopic vision correction is advantageous for reading task of near stimuli, but not having near correction such as wearing SV could result in longer reading time and higher number of fixation due to lacks of accommodative ability for near task. For the future studies, it would be interesting to examine the performance of reading both at adapted and unadapted stages as examining only unadapted wearers was limitation of this study.

Analysis of Teaching Behavior and Visual Attention according to Teacher's Career in Elementary Science Inquire-based Class on Respiration (탐구형 초등과학수업 '호흡' 차시에서 교사의 경력에 따른 교수행동 및 시각적 주의 분석)

  • Kim, Jang-Hwan;Shin, Won-Sub;Shin, Dong-Hoon
    • Journal of Korean Elementary Science Education
    • /
    • v.37 no.2
    • /
    • pp.206-218
    • /
    • 2018
  • The purpose of this study is to analyze the teaching behaviors and visual attention according to teacher's career in Elementary Science Inquire-based Class. Participants were four elementary school teachers in Seoul. They were all in grade 5 and taught science. According to the experience of elementary science education, two novice teachers and two expert teachers were identified. Participants taught Respiration in the 'Structure and Function of our Body' in the elementary science fifth grade. The mobile eye tracker used in this study is SMI's ETG 2w, which is a binocular tracking system. In addition, a video camera was installed behind the classroom to record the entire class. We recorded all the contents of the recorded video and analyzed the results. In this study, the actual practice time, participant's visual attention, and decentralized attention ability were analyzed by class phase. The results of the study are as follows. First, there was a difference between planned class time and actual practice time. The novice teachers were having difficulty in reconstructing the contents of education, and the expert teachers were reconstructing the curriculum and interacting with the students with high understanding and application of the curriculum. There were many differences between the novice teachers and the expert teachers in the tour guidance to confirm student activities. Second, if we look at the visual attention on the area related to teaching and learning by class phase, the novice teacher concentrates all the steps in a specific area, expert teachers showed an equal visual attention to meaningful areas of teaching and learning activities. Third, there was a statistically significant difference in activities 1-1, 1-2, 2-1, and 2-2 when the participants' decentralized attention ability. Expert teachers frequently checked students' understanding and interests. There was a lot of interaction with students. It is also shown through the decentralized attention ability that the novice teachers concentrate on a specific area, and the expert teachers have a high degree of decentralized attention ability and visual attention evenly.

Human-in-the-loop experiments design for workload effectiveness verification of multiple-UAV operators (복수무인기 운용자의 임무과부하지표 효용성 검증을 위한 human-in-the-loop 실험 설계 및 구현)

  • Lim, Hyung-Jin;Choi, Seong-Hwan;Shin, Eun-Chul;Oh, Jang-Jin;Kim, Byoung Soo;Kim, Seungkeun;Yang, Ji Hyun
    • Journal of the Korean Society for Aeronautical & Space Sciences
    • /
    • v.45 no.4
    • /
    • pp.284-291
    • /
    • 2017
  • There is no doubt that advances in UAV technology have improved military performance. However, these advances require humans to adapt to new and complex operational systems. UAV has been rapidly expanding to a variety of fields such as reconnaissance, transportation, communication and aerial photographing recently. Also, with the development of UAV automation technology, one operator is able to supervisory-control multiple-UAVs. However, as the number of assigned UAV increases, the amount of information increases and this results in the workload of the operator increasing and deterioration in controlling performance. Accordingly, there is a need for a model to determine the level of overload an operator may encounter with regard to multiple-UAV but nationally this kind of research is currently lacking. Therefore, this paper provides an experimental platform for evaluating workload index effectiveness integrating multiple-UAV operational environments, GCS, and eye-tracking system followed by a limited survey of domestic and international studies of multi-UAV overload studies.

System Development for Measuring Group Engagement in the Art Center (공연장에서 다중 몰입도 측정을 위한 시스템 개발)

  • Ryu, Joon Mo;Choi, Il Young;Choi, Lee Kwon;Kim, Jae Kyeong
    • Journal of Intelligence and Information Systems
    • /
    • v.20 no.3
    • /
    • pp.45-58
    • /
    • 2014
  • The Korean Culture Contents spread out to Worldwide, because the Korean wave is sweeping in the world. The contents stand in the middle of the Korean wave that we are used it. Each country is ongoing to keep their Culture industry improve the national brand and High added value. Performing contents is important factor of arousal in the enterprise industry. To improve high arousal confidence of product and positive attitude by populace is one of important factor by advertiser. Culture contents is the same situation. If culture contents have trusted by everyone, they will give information their around to spread word-of-mouth. So, many researcher study to measure for person's arousal analysis by statistical survey, physiological response, body movement and facial expression. First, Statistical survey has a problem that it is not possible to measure each person's arousal real time and we cannot get good survey result after they watched contents. Second, physiological response should be checked with surround because experimenter sets sensors up their chair or space by each of them. Additionally it is difficult to handle provided amount of information with real time from their sensor. Third, body movement is easy to get their movement from camera but it difficult to set up experimental condition, to measure their body language and to get the meaning. Lastly, many researcher study facial expression. They measures facial expression, eye tracking and face posed. Most of previous studies about arousal and interest are mostly limited to reaction of just one person and they have problems with application multi audiences. They have a particular method, for example they need room light surround, but set limits only one person and special environment condition in the laboratory. Also, we need to measure arousal in the contents, but is difficult to define also it is not easy to collect reaction by audiences immediately. Many audience in the theater watch performance. We suggest the system to measure multi-audience's reaction with real-time during performance. We use difference image analysis method for multi-audience but it weaks a dark field. To overcome dark environment during recoding IR camera can get the photo from dark area. In addition we present Multi-Audience Engagement Index (MAEI) to calculate algorithm which sources from sound, audience' movement and eye tracking value. Algorithm calculates audience arousal from the mobile survey, sound value, audience' reaction and audience eye's tracking. It improves accuracy of Multi-Audience Engagement Index, we compare Multi-Audience Engagement Index with mobile survey. And then it send the result to reporting system and proposal an interested persons. Mobile surveys are easy, fast, and visitors' discomfort can be minimized. Also additional information can be provided mobile advantage. Mobile application to communicate with the database, real-time information on visitors' attitudes focused on the content stored. Database can provide different survey every time based on provided information. The example shown in the survey are as follows: Impressive scene, Satisfied, Touched, Interested, Didn't pay attention and so on. The suggested system is combine as 3 parts. The system consist of three parts, External Device, Server and Internal Device. External Device can record multi-Audience in the dark field with IR camera and sound signal. Also we use survey with mobile application and send the data to ERD Server DB. The Server part's contain contents' data, such as each scene's weights value, group audience weights index, camera control program, algorithm and calculate Multi-Audience Engagement Index. Internal Device presents Multi-Audience Engagement Index with Web UI, print and display field monitor. Our system is test-operated by the Mogencelab in the DMC display exhibition hall which is located in the Sangam Dong, Mapo Gu, Seoul. We have still gotten from visitor daily. If we find this system audience arousal factor with this will be very useful to create contents.

Investigation of Eye Movement on the Observation of Elementary School Students with Different Motivation System on Science Learning (관찰 상황에서 초등학생들의 과학학습 동기체계에 따른 시선이동 분석)

  • Lim, Sungman;Park, Seojung;Yang, Ilho
    • Journal of The Korean Association For Science Education
    • /
    • v.33 no.6
    • /
    • pp.1154-1169
    • /
    • 2013
  • The present work was performed to find behavioral characteristics of elementary school students corresponding to the motivation system on science learning (SL-BIS/BAS; Behavioral Inhibition/Activation System about Science Learning) in the observation situation. Eye-tracking was used for this study, which is one of the neurophysiological methods. The findings of present study were as follows: First, students who have sensitive motivation system to SL-BIS (SL-BIS group) showed meaningfully shorter fixation duration the whole time during an observation task than students who have sensitive motivation system to SL-BAS (SL-BAS group) (p<.05). Total fixation counts of SL-BIS group were significantly larger than SL-BAS group and it indicates that SL-BIS group often generated new fixations. Therefore, fixation duration per count of SL-BAS group was longer than that of SLBIS group. Second, we studied fixations in situations with movement corresponding to the motivation system on science learning. SL-BIS group and SL-BAS group exhibited similar fixation duration in the study task segment with movement, which is one of the stimulus attracting students. However, for the study task segment when the movement was finished, total fixation duration and fixation duration per count of SL-BAS group were meaningfully longer than those of SL-BIS group. Third, comparing fixation targets classified by factors of study task, SL-BIS group showed fixation on the target that is not important for the study task. But SL-BAS group concentrated on the target-related factor of the study task. The present work could be helpful in understanding students' characteristics corresponding to the motivation system on science learning in observation situation and for making a learning & teaching plan that is suitable to the feature of students.

Autostereoscopic Display based on Dual Layer Parallax Barrier (이중 계층 패렐랙스 배리어 기반의 무안경식 3D 디스플레이)

  • Lee, Hyun;Lee, Eung-Don;Um, Gi-Mun;Cheong, Won-Sik;Lee, Sung-Jung
    • Journal of the Institute of Electronics Engineers of Korea SP
    • /
    • v.48 no.6
    • /
    • pp.68-76
    • /
    • 2011
  • We introduce a parallax barrier type autostereoscopic display in order to overcome the limited viewing angle of the conventional parallax barrier type displays. The proposed method adopts a special structure of double pairs of ITO that have a common TN-LC at the core of the conventional parallax barrier. Compared with the conventional parallax barrier type displays, the proposed display uses moving parallax barriers and eye tracking system to make stereoscopic view images adapted to the movement of viewer. We implemented a prototype of the proposed dual layer parallax barrier system, and verified that the proposed autostereoscopic display maintains seamless 3D views even when a viewer's head is moving.

Real-time pupil motion recognition and efficient character selection system using FPGA and OpenCV (FPGA와 OpenCV를 이용한 실시간 눈동자 모션인식과 효율적인 문자 선택 시스템)

  • Lee, Hee Bin;Heo, Seung Won;Lee, Seung Jun;Yu, Yun Seop
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2018.10a
    • /
    • pp.393-394
    • /
    • 2018
  • In this paper, the new system which improve the previously reported "Implementation to human-computer interface system with motion tracking using OpenCV and FPGA" is introduced and in this system, a character selection system for the physically uncomfortable patients is proposed. Using OpenCV, the eye area is detected, the pupil position is determined, and then the results are sent to the FPGA, and the character is selected finally. The method to minimize the pupil movement of the patient is used to output the character according to the user's intention. Using OpenCV, various computer vision algorithms can be easily applied, and using programmable FPGA, a pupil motion recognition and character selection system are implemented with a low cost.

  • PDF

Mega Irises: Per-Pixel Projection Illumination Compensation for the moving participant in projector-based visual system (Mega Irises: 프로젝터 기반의 영상 시스템상에서 이동하는 체험자를 위한 화소 단위의 스크린 투사 밝기 보정)

  • Jin, Jong-Wook;Wohn, Kwang-Yun
    • Journal of the Korea Computer Graphics Society
    • /
    • v.17 no.4
    • /
    • pp.31-40
    • /
    • 2011
  • Projector-based visual systems are widely used for VR and experience display applications. But the illumination irregularity on the screen surface due to the screen material and its light reflection properties sometimes deteriorates the user experience. This phenomenon is particularly troublesome when the participants of the head tracking VR system such as CAVE or the motion generation experience system continually move around the system. One of reason to illumination irregularity is projector-screen specular reflection component to participant's eye's position and it's analysis needs high computation complexity. Similar to calculate specular lighting term using GPU's programmable shader, Our research adjusts every pixel's brightness in runtime with given 3D screen space model to reduce illumination irregularity. For doing that, Angle-based brightness compensate function are considered for specific screen installation and modified it for GPU-friendly compute and access. Two aspects are implemented, One is function access transformation from angular form to product and the other is piecewise linear interpolate approximation.

A Study on Real Time Gaze Discrimination System using GRNN (GRNN을 이용한 실시간 시선 식별 시스템에 관한 연구)

  • Lee Young-Sik;Bae Cheol-Soo
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.9 no.2
    • /
    • pp.322-329
    • /
    • 2005
  • This paper describes a computer vision system based on active IR illumination for real-time gaze discrimination system. Unlike most of the existing gaze discrimination techniques, which often require assuming a static head to work well and require a cumbersome calibration process for each person, our gaze discrimination system can perform robust and accurate gaze estimation without calibration and under rather significant head movement. This is made possible by a new gaze calibration procedure that identifies the mapping from pupil parameters to screen coordinates using generalized regression neural networks (GRNNS). With GRNNS, the mapping does not have to be an analytical function and head movement is explicitly accounted for by the gaze mapping function. furthermore, the mapping function can generalize to other individuals not used in the training. To further improve the gaze estimation accuracy, we employ a reclassification scheme that deals with the classes that tend to be misclassified. This leads to a 10$\%$ improvement in classification error. The angular gaze accuracy is about $5^{circ}$horizontally and $8^{circ}$vertically. The effectiveness of our gaze tracker is demonstrated by experiments that involve gaze-contingent interactive graphic display.