• 제목/요약/키워드: gaze control

검색결과 62건 처리시간 0.025초

Real-time Multi-device Control System Implementation for Natural User Interactive Platform

  • 김명진;황태민;채승훈;김민준;문연국;김승준
    • 인터넷정보학회논문지
    • /
    • 제23권1호
    • /
    • pp.19-29
    • /
    • 2022
  • Natural user interface (NUI) is used for the natural motion interface without using a specific device or tool like a mouse, keyboards, and pens. Recently, as non-contact sensor-based interaction technologies for recognizing human motion, gestures, voice, and gaze have been actively studied, an environment has been prepared that can provide more diverse contents based on various interaction methods compared to existing methods. However, as the number of sensors device is rapidly increasing, the system using a lot of sensors can suffer from a lack of computational resources. To address this problem, we proposed a real-time multi-device control system for natural interactive platform. In the proposed system, we classified two types of devices as the HC devices such as high-end commercial sensor and the LC devices such astraditional monitoring sensor with low-cost. we adopt each device manager to control efficiently. we demonstrate a proposed system works properly with user behavior such as gestures, motions, gazes, and voices.

Improved Feature Extraction of Hand Movement EEG Signals based on Independent Component Analysis and Spatial Filter

  • 응웬탄하;박승민;고광은;심귀보
    • 한국지능시스템학회논문지
    • /
    • 제22권4호
    • /
    • pp.515-520
    • /
    • 2012
  • In brain computer interface (BCI) system, the most important part is classification of human thoughts in order to translate into commands. The more accuracy result in classification the system gets, the more effective BCI system is. To increase the quality of BCI system, we proposed to reduce noise and artifact from the recording data to analyzing data. We used auditory stimuli instead of visual ones to eliminate the eye movement, unwanted visual activation, gaze control. We applied independent component analysis (ICA) algorithm to purify the sources which constructed the raw signals. One of the most famous spatial filter in BCI context is common spatial patterns (CSP), which maximize one class while minimize the other by using covariance matrix. ICA and CSP also do the filter job, as a raw filter and refinement, which increase the classification result of linear discriminant analysis (LDA).

The Development of Human-mobile communication system (E-mobile system) Using EOG (ElectroOculoGraphy)

  • K., Youngmin;D., Nakju;Y., Youngil;C., Wankyun
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 제어로봇시스템학회 2000년도 제15차 학술회의논문집
    • /
    • pp.266-266
    • /
    • 2000
  • This paper relates to develop the human-mobile interface system using saccadic eye movements as an aid to the disabled. EOG(ElectroOculoGraphy) method is used to measure the potentials of rapid eye movements because the method is not expensive and the device is simple. But because the resolution and accuracy of this signal are not good, the algorithm to remove the drifting, using ideal velocity shape, is applied to process the signals. The mobile robot (POSTUR-II) used in this system was developed in Robot & Bio-mechatronics laboratory in POSTECH and has the tele-operation system for the tele-communication with a main computer. Our Research is to help the physically disabled except his eye movements to operate some works with the mobile. Our Results about the system's possibility will be showed by some experimental tests giving the point information to the mobile by eye-gaze.

  • PDF

Measuring Visual Attention Processing of Virtual Environment Using Eye-Fixation Information

  • Kim, Jong Ha;Kim, Ju Yeon
    • Architectural research
    • /
    • 제22권4호
    • /
    • pp.155-162
    • /
    • 2020
  • Numerous scholars have explored the modeling, control, and optimization of energy systems in buildings, offering new insights about technology and environments that can advance industry innovation. Eye trackers deliver objective eye-gaze data about visual and attentional processes. Due to its flexibility, accuracy, and efficiency in research, eye tracking has a control scheme that makes measuring rapid eye movement in three-dimensional space possible (e.g., virtual reality, augmented reality). Because eye movement is an effective modality for digital interaction with a virtual environment, tracking how users scan a visual field and fix on various digital objects can help designers optimize building environments and materials. Although several scholars have conducted Virtual Reality studies in three-dimensional space, scholars have not agreed on a consistent way to analyze eye tracking data. We conducted eye tracking experiments using objects in three-dimensional space to find an objective way to process quantitative visual data. By applying a 12 × 12 grid framework for eye tracking analysis, we investigated how people gazed at objects in a virtual space wearing a headmounted display. The findings provide an empirical base for a standardized protocol for analyzing eye tracking data in the context of virtual environments.

자율주행차량 운전자 모니터링에 대한 동향 및 시사점 (Trends and Implications for Driver Status Monitoring in Autonomous Vehicles)

  • 장미;강도욱;장은혜;김우진;윤대섭;최정단
    • 전자통신동향분석
    • /
    • 제38권6호
    • /
    • pp.31-40
    • /
    • 2023
  • Given recent accidents involving autonomous vehicles, driver monitoring technology related to the transition of control in autonomous vehicles is gaining prominence. Driver status monitoring systems recognize the driver's level of alertness and identify possible impairments in the driving ability owing to conditions including drowsiness and distraction. In autonomous vehicles, predictive factors for the transition to manual driving should also be included. During traditional human driving, monitoring the driver's status is relatively straightforward owing to the consistency of crucial cues, such as the driver's location, head orientation, gaze direction, and hand placement. However, monitoring becomes more challenging during autonomous driving because of the absence of direct manual control and the driver's engagement in other activities, which may obscure the accurate assessment of the driver's readiness to intervene. Hence, safety-ensuring technology must be balanced with user experience in autonomous driving. We explore relevant global and domestic regulations, the new car assessment program, and related standards to extract requirements for driver status monitoring. This kind of monitoring can both enhance the autonomous driving performance and contribute to the overall safety of autonomous vehicles on the road.

사람과 로봇간 원격작동을 위한 몰입형 사용자 인터페이스 (Immersive user interfaces for visual telepresence in human-robot interaction)

  • 장수형
    • 한국HCI학회:학술대회논문집
    • /
    • 한국HCI학회 2009년도 학술대회
    • /
    • pp.406-410
    • /
    • 2009
  • 사람과 로봇간 인터페이스 연구가 활발히 진행되어감에 따라 원격으로 로봇을 조종하고 그 로봇을 통해 환경정보를 제공받는 텔레프레전스 시스템에 관심이 증가하고 있다. 로봇이 움직임 따라 자연스러운 텔레프레전스 서비스를 제공하기 위해서는 사용자 행동인식이 매우 중요하다. 이전에 제안되었던 텔레프레전스의 사용자의 이동 인식 시스템은 개발이 어려우며 많은 비용이 요구되고 사용자와 로봇간의 상호작용에 많은 한계를 보여왔다. 본논문에서는 닌텐도의 게임기 WII 의 적외선 리모콘을 이용하여 사용자의 이동 및 시선을 파악하고 그 정보를 바탕으로 원거리의 로봇(Sony 의 AIBO)을 움직여 사용자가 원하는 정보를 HMD를 통해 수신할 수 있는 시스템을 제안한다.

  • PDF

2007·2009 개정 초등 과학 교과서 '우리 몸의 구조와 기능' 단원의 편집디자인에 따른 초등학생들의 시각적 주의 분석 (Analysis of Elementary School Students' Visual Attention on the Editorial Design of 'Structure and Function of Our Body' in the 2007·2009 Revised Elementary Science Textbook)

  • 신원섭
    • 한국초등과학교육학회지:초등과학교육
    • /
    • 제36권4호
    • /
    • pp.428-438
    • /
    • 2017
  • The purpose of this study is to analyze the visual attention of elementary school students according to the editorial design of the 2007 2009 revised elementary science textbook 'Structure and function of our body'. For this purpose, eye movements were collected while elementary school students were watching real textbooks wearing mobile eye tracker. The BeGaze 3.7 program of SMI company was used analyzing eye movements. Twenty-six elementary school students participated voluntarily in mobile tracking research. Elementary students learned the contents of textbook related to 'digestive organ' and 'respiratory organ' by using double reading learning strategy. The results of this study are as follows. First, as a result of pre- and post-knowledge tests, there was no statistically significant difference in learning effect between 2007 revised and 2009 revised textbook editing design. Second, elementary school students tended to give more visual attention to text than textbook illustrations. Third, the selective attention and persistent attention of elementary students showed a very strong positive correlation (.940), but the selective attention and self-control showed a strong positive correlation (.499). Fourth, students with high level of attention and low level showed high visual occupancy in text than in illustrations. Fifth, elementary school students preferred the 2009 revised science textbook to the 2007 revised.

화자의 긍정·부정 의도를 전달하는 실용적 텔레프레즌스 로봇 시스템의 개발 (Development of a Cost-Effective Tele-Robot System Delivering Speaker's Affirmative and Negative Intentions)

  • 진용규;유수정;조혜경
    • 로봇학회논문지
    • /
    • 제10권3호
    • /
    • pp.171-177
    • /
    • 2015
  • A telerobot offers a more engaging and enjoyable interaction with people at a distance by communicating via audio, video, expressive gestures, body pose and proxemics. To provide its potential benefits at a reasonable cost, this paper presents a telepresence robot system for video communication which can deliver speaker's head motion through its display stanchion. Head gestures such as nodding and head-shaking can give crucial information during conversation. We also can assume a speaker's eye-gaze, which is known as one of the key non-verbal signals for interaction, from his/her head pose. In order to develop an efficient head tracking method, a 3D cylinder-like head model is employed and the Harris corner detector is combined with the Lucas-Kanade optical flow that is known to be suitable for extracting 3D motion information of the model. Especially, a skin color-based face detection algorithm is proposed to achieve robust performance upon variant directions while maintaining reasonable computational cost. The performance of the proposed head tracking algorithm is verified through the experiments using BU's standard data sets. A design of robot platform is also described as well as the design of supporting systems such as video transmission and robot control interfaces.

한글을 읽는 시선 이동: 가로와 세로 읽기의 비교 (Gaze control during horizontal and vertical reading)

  • 서효정;이춘길
    • 한국정보과학회 언어공학연구회:학술대회논문집(한글 및 한국어 정보처리)
    • /
    • 한국정보과학회언어공학연구회 1998년도 제10회 한글 및 한국어 정보처리 학술대회
    • /
    • pp.177-185
    • /
    • 1998
  • 한글의 가로쓰기와 세로쓰기 체계의 상대적 효율성을, 글을 읽을 때 관찰되는 시선 이동을 측정하여 비교하였다. 실험 1에서는 동일한 글을 가로와 세로 방향으로 제시하고, 글을 읽는 동안 시선 운동(머리 운동과 안구 운동의 합)을 공막탐지코일법(scleral search coil method)으로 측정하였다. 가로글 읽기의 경우, 시선도약(saccade)의 크기가 더 컸으며, 동일한 크기의 도약운동을 비교할 때, 세로글 읽기에 비해 상대적으로 도약운동의 속도가 높았다. 평균 고정기간(fixation duration)은 글의 읽기 방향에 따른 유의미한 차이를 보이지 않았다. 시선 도약크기와 도약운동 속도에서의 차이는 가로글을 읽는 속도를 높여 글을 읽는 시선 이동의 효율성이 가로글에서 상대적으로 높았다. 실험 2에서는 팔의 읽기 방향에 따른 시선 이동 변수에서의 차이가 글자극의 독특한 자극 특성에 기인한 것인지 혹은 시각 및 안구 운동 체계에서의 차이를 반영하는 것인지를 결정하고자 하였는데, 의미정보가 없는 점자극을 수평과 수직방향으로 제시하고, 방향에 따른 시선 이동의 차이가 글자극을 사용한 경우와 동일하게 나타나는지를 보았다. 점자극에서도 수평 방향의 시선도 약 운동이 보다 크고 정확한 경향성이 있었다. 이 결과는 사람의 시각 운동 체계가 수평 방향의 시선 이동에 대해 선호성을 보이고 있으며, 이러한 시각 및 안구 운동 체계에서의 차이가 글을 읽는 행동에도 반영되고 있음을 보여준다.

  • PDF

WII 컨트롤러를 이용한 사람과 로봇간 원격작동 사용자 인터페이스 (User Interfaces for Visual Telepresence in Human-Robot Interaction Using Wii Controller)

  • 장수형;윤종원;조성배
    • 한국HCI학회논문지
    • /
    • 제3권1호
    • /
    • pp.27-32
    • /
    • 2008
  • 사람과 로봇간 인터페이스 연구가 활발히 진행되어감에 따라 원격으로 로봇을 조종하고 그 로봇을 통해 환경 정보를 제공받는 텔레프레전스 시스템에 관심이 증가하고 있다. 로봇이 움직임 따라 자연스러운 텔레프레전스 서비스를 제공하기 위해서는 사용자 행동인식이 매우 중요하다. 이전에 제안되었던 텔레프레전스의 사용자의 이동 인식시스템은 개발이 어려우며 많은 비용이 요구되고 사용자와 로봇간의 상호작용에 많은 한계를 보여왔다. 본논문에서는 닌텐도의 게임기 WII의 적외선 리모콘을 이용하여 사용자의 이동 및 시선을 파악하고 그 정보를 바탕으로 원거리의 로봇(Sony의 AIBO)을 움직여 사용자가 원하는 정보를 HMD를 통해 수신할 수 있는 시스템을 제안한다.

  • PDF