• Title/Summary/Keyword: Hand tracking

Search Result 351, Processing Time 0.029 seconds

Hand Region Tracking and Fingertip Detection based on Depth Image (깊이 영상 기반 손 영역 추적 및 손 끝점 검출)

  • Joo, Sung-Il;Weon, Sun-Hee;Choi, Hyung-Il
    • Journal of the Korea Society of Computer and Information
    • /
    • v.18 no.8
    • /
    • pp.65-75
    • /
    • 2013
  • This paper proposes a method of tracking the hand region and detecting the fingertip using only depth images. In order to eliminate the influence of lighting conditions and obtain information quickly and stably, this paper proposes a tracking method that relies only on depth information, as well as a method of using region growing to identify errors that can occur during the tracking process and a method of detecting the fingertip that can be applied for the recognition of various gestures. First, the closest point of approach is identified through the process of transferring the center point in order to locate the tracking point, and the region is grown from that point to detect the hand region and boundary line. Next, the ratio of the invalid boundary, obtained by means of region growing, is used to calculate the validity of the tracking region and thereby judge whether the tracking is normal. If tracking is normal, the contour line is extracted from the detected hand region and the curvature and RANSAC and Convex-Hull are used to detect the fingertip. Lastly, quantitative and qualitative analyses are performed to verify the performance in various situations and prove the efficiency of the proposed algorithm for tracking and detecting the fingertip.

A Long-Range Touch Interface for Interaction with Smart TVs

  • Lee, Jaeyeon;Kim, DoHyung;Kim, Jaehong;Cho, Jae-Il;Sohn, Joochan
    • ETRI Journal
    • /
    • v.34 no.6
    • /
    • pp.932-941
    • /
    • 2012
  • A powerful interaction mechanism is one of the key elements for the success of smart TVs, which demand far more complex interactions than traditional TVs. This paper proposes a novel interface based on the famous touch interaction model but utilizes long-range bare hand tracking to emulate touch actions. To satisfy the essential requirements of high accuracy and immediate response, the proposed hand tracking algorithm adopts a fast color-based tracker but with modifications to avoid the problems inherent to those algorithms. By using online modeling and motion information, the sensitivity to the environment can be greatly decreased. Furthermore, several ideas to solve the problems often encountered by users interacting with smart TVs are proposed, resulting in a very robust hand tracking algorithm that works superbly, even for users with sleeveless clothing. In addition, the proposed algorithm runs at a very high speed of 82.73 Hz. The proposed interface is confirmed to comfortably support most touch operations, such as clicks, swipes, and drags, at a distance of three meters, which makes the proposed interface a good candidate for interaction with smart TVs.

Relationship Between GPS Code and Carrier Tracking Performance for GPS Receivers (GPS 수신기에서 코드 추적 성능와 반송파 추적 성능의 관계)

  • 임영재;박찬식
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2000.10a
    • /
    • pp.56-56
    • /
    • 2000
  • In this paper, the relationship between GPS code and carrier tracking performance is given. Through the error analysis and experiments, the performance of code tracking loop can be improved using narrow correlation. The performance of code tracking loop can be also improved if the better carrier tracking loop is used. On the other hand, the performance of carrier tracking loop is independent of that of code tracking loop.

  • PDF

Markless System of Using Hand Tracking (핸드 트레킹을 이용한 Markerless 시스템)

  • Ban, Kyeong-Jin;Kim, Jong-Chan;Kim, Kyeong-Og;Kim, Eung-Kon
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2010.05a
    • /
    • pp.683-685
    • /
    • 2010
  • Augmented reality is a technology for showing virtual objects overlapped with the real world as seen from the eyes of users. Studies are being conducted on effective communication methods using hand movements in augmented reality. Hand movements are an important means of human communication along with writing and voice. Space arrangement technology and hand tracking technology using markers to acquire virtual information in augmented reality have many limitations. This paper proposes tracking hand area for augmented object. The augmented objects change viewpoints by hand positions which improves the sense of three dimensions and immersion.

  • PDF

A Study on the Interaction with Virtual Objects through XR Hands (XR Hands를 통한 가상 객체들과의 상호 작용에 관한 연구)

  • BeomJun Jo;SeongKi Kim
    • Journal of the Korea Computer Graphics Society
    • /
    • v.30 no.3
    • /
    • pp.43-49
    • /
    • 2024
  • Hand tracking is currently one of the most promising technologies in XR with the release of extended reality (XR) devices, in which hand tracking is used as the main manipulation. Hand tracking offers advantages in terms of immersion and realism, and as a result, it is being employed in a range of fields, including education, business, and medical care. The archery movement requires using both hands at the same time, but requires sophistication to hit the target and is a movement that has cultural and sports significance in the past. This study aimed to implement this archery movement. Therefore, this paper used the XR Hands package provided by Unity to recognize hand movements, explored the underlying OpenXR, and finally implemented the archery movement and tested it in Meta Quest 2.

The Effects of Age, Gender, and Target Force Level on Controlled Force Exertion Tasks

  • Kong, Yong-Ku;Lee, Sung Yong;Kim, Dae-Min;Choi, Kyeong-Hee
    • Journal of the Ergonomics Society of Korea
    • /
    • v.36 no.1
    • /
    • pp.53-67
    • /
    • 2017
  • Objective: The purpose of this study is to build basic data to systematically develop a hand function evaluation tool by determining the effects of age, gender and target force level on the difference in hand function according to the target force level. Background: Precise and objective evaluation of hand functionality is a very important factor in quantifying treatment progress in patients or elderly people, and in verifying treatment effects. However, most hand function evaluations lack objectivity and accuracy, and therefore it is difficult to properly treat patients according to the given situation. Method: Sixteen healthy subjects (eight elderly and eight young people) participated in this study to evaluate the effects of age, gender, and target force level on tracking performance through rRMSE in terms of the tracking force and actual exerted force, by carrying out a task of maintaining six different target force levels for 20 seconds. Results: The result of this experiment indicated that elderly people and women had a lower ability to maintain a certain level of force than young people and men by 16% and 10%, respectively. The target force level results showed that the tracking error of the lowest force level (5% MVC) was significantly higher than that of 15% MVC, which in turn showed a higher tracking error than that of the higher target force levels. Conclusion: The results of this study can thus be utilized to develop a rehabilitation program for elderly people or other patients. Application: The authors expect that the results of the present study will be valuable to develop a rehabilitation program and hand function evaluation tool.

Mobile Robot Control using Hand Shape Recognition (손 모양 인식을 이용한 모바일 로봇제어)

  • Kim, Young-Rae;Kim, Eun-Yi;Chang, Jae-Sik;Park, Se-Hyun
    • Journal of the Institute of Electronics Engineers of Korea CI
    • /
    • v.45 no.4
    • /
    • pp.34-40
    • /
    • 2008
  • This paper presents a vision based walking robot control system using hand shape recognition. To recognize hand shapes, the accurate hand boundary needs to be tracked in image obtained from moving camera. For this, we use an active contour model-based tracking approach with mean shift which reduces dependency of the active contour model to location of initial curve. The proposed system is composed of four modules: a hand detector, a hand tracker, a hand shape recognizer and a robot controller. The hand detector detects a skin color region, which has a specific shape, as hand in an image. Then, the hand tracking is performed using an active contour model with mean shift. Thereafter the hand shape recognition is performed using Hue moments. To assess the validity of the proposed system we tested the proposed system to a walking robot, RCB-1. The experimental results show the effectiveness of the proposed system.

Enhanced Sign Language Transcription System via Hand Tracking and Pose Estimation

  • Kim, Jung-Ho;Kim, Najoung;Park, Hancheol;Park, Jong C.
    • Journal of Computing Science and Engineering
    • /
    • v.10 no.3
    • /
    • pp.95-101
    • /
    • 2016
  • In this study, we propose a new system for constructing parallel corpora for sign languages, which are generally under-resourced in comparison to spoken languages. In order to achieve scalability and accessibility regarding data collection and corpus construction, our system utilizes deep learning-based techniques and predicts depth information to perform pose estimation on hand information obtainable from video recordings by a single RGB camera. These estimated poses are then transcribed into expressions in SignWriting. We evaluate the accuracy of hand tracking and hand pose estimation modules of our system quantitatively, using the American Sign Language Image Dataset and the American Sign Language Lexicon Video Dataset. The evaluation results show that our transcription system has a high potential to be successfully employed in constructing a sizable sign language corpus using various types of video resources.

Real-time Hand Region Detection and Tracking using Depth Information (깊이정보를 이용한 실시간 손 영역 검출 및 추적)

  • Joo, SungIl;Weon, SunHee;Choi, HyungIl
    • KIPS Transactions on Software and Data Engineering
    • /
    • v.1 no.3
    • /
    • pp.177-186
    • /
    • 2012
  • In this paper, we propose a real-time approach for detecting and tracking a hand region by analyzing depth images. We build a hand model in advance. The model has the shape information of a hand. The detecting process extracts out moving areas in an image, which are possibly caused by moving a hand in front of a camera. The moving areas can be identified by analyzing accumulated difference images and applying the region growing technique. The extracted moving areas are compared against a hand model to get justified as a hand region. The tracking process keeps the track of center points of hand regions of successive frames. For this purpose, it involves three steps. The first step is to determine a seed point that is the closest point to the center point of a previous frame. The second step is to perform region growing to form a candidate region of a hand. The third step is to determine the center point of a hand to be tracked. This point is searched by the mean-shift algorithm within a confined area whose size varies adaptively according to the depth information. To verify the effectiveness of our approach, we have evaluated the performance of our approach while changing the shape and position of a hand as well as the velocity of hand movement.

Development of Hand-Tracking Interaction System (핸드 트랙킹 인터랙션 시스템 개발)

  • Park, Seong-Su;Gue, Ja-Young;Hong, Jin-Ju;Rho, Young J.;Seo, Dae-Young
    • Annual Conference of KIPS
    • /
    • 2010.11a
    • /
    • pp.824-826
    • /
    • 2010
  • 컴퓨터의 활용도가 높아지면서 자연스럽게 컴퓨터에 따른 입력 장치도 사용이 잦아지고 있는 추세이다. 본 논문에서 다루고 있는 핸드 트랙킹 인터랙션 시스템(Hand-Tracking Interaction System)이란 캠에 사람의 손을 인식시켜 손의 모션에 기능을 부여하는 또 다른 차세대 입력 장치이다. 본 논문에서는 현재 사용하고 있는 마우스와 키보드 같은 입력 장치의 공간 제약성 이라는 단점을 보완하기 위해 핸드 트랙킹 인터랙션 시스템 (Hand-Tracking Interaction System) 을 개발하였고, 빛과 그림자의 영향을 쉽게 받아 손 인식률이 낮아지는 단점을 해결하기 위해 캠 대신 적외선카메라를 이용하여 인식률을 높임에 힘썼다. 또 핸드 트랙킹 인터랙션 시스템을 효율적으로 사용할 수 있는 새로운 어플리케이션을 함께 개발하였다.