• Title/Summary/Keyword: hands tracking

Search Result 53, Processing Time 0.025 seconds

Real-Time Human Tracking Using Skin Area and Modified Multi-CAMShift Algorithm (피부색과 변형된 다중 CAMShift 알고리즘을 이용한 실시간 휴먼 트래킹)

  • Min, Jae-Hong;Kim, In-Gyu;Baek, Joong-Hwan
    • Journal of Advanced Navigation Technology
    • /
    • v.15 no.6
    • /
    • pp.1132-1137
    • /
    • 2011
  • In this paper, we propose Modified Multi CAMShift Algorithm(Modified Multi Continuously Adaptive Mean Shift Algorithm) that extracts skin color area and tracks several human body parts for real-time human tracking system. Skin color area is extracted by filtering input image in predefined RGB value range. These areas are initial search windows of hands and face for tracking. Gaussian background model prevents search window expending because it restricts skin color area. Also when occluding between these areas, we give more weights in occlusion area and move mass center of target area in color probability distribution image. As result, the proposed algorithm performs better than the original CAMShift approach in multiple object tracking and even when occluding of objects with similar colors.

Hand Tracking and Calibration Algorithm Using the EPIC Sensors (EPIC 센서를 이용한 Hand Tracking 및 Calibration 알고리즘)

  • Jo, Jung Jae;Kim, Young Chul
    • Smart Media Journal
    • /
    • v.2 no.1
    • /
    • pp.27-30
    • /
    • 2013
  • In this paper, we research the hand tracking and calibration algorithm using the EPIC sensor. We analyze the characteristics of EPIC sensor to be more sensitive in the around E-filed, and then we implement the 2-dimensional axis-transformation using the difference of detected amplitude between EPIC sensors. In addition, we implement the calibration algorithm considering the characteristics of EPIC sensor, and then we apply the Kalman filter to efficiently track a target. Thus, we implement the environment of window applications for verification and analysis the implemented algorithm. In turn, we use the DAQ API to extract the analog data. The DAQ hardware has the function of measuring and generating an electrical signal. Moreover, we confirm the movement of mouse cursor by detecting the potential difference depending on the movement of the user's hands.

  • PDF

Sign Language Recognition Using ART2 Algorithm (ART2 알고리즘을 이용한 수화 인식)

  • Kim, Kwang-Baek;Woo, Young-Woon
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.12 no.5
    • /
    • pp.937-941
    • /
    • 2008
  • People who have hearing difficulties use sign language as the most important communication method, and they can broaden personal relations and manage their everyday lives without inconvenience through sign language. But they suffer from absence of interpolation between normal people and people who have hearing difficulties in increasing video chatting or video communication services by recent growth of internet communication. In this paper, we proposed a sign language recognition method in order to solve such a problem. In the proposed method, regions of two hands are extracted by tracking of two hands using RGB, YUV and HSI color information from a sign language image acquired from a video camera and by removing noise in the segmented images. The extracted regions of two hands are teamed and recognized by ART2 algorithm that is robust for noise and damage. In the experiment by the proposed method and images of finger number from 1 to 10, we verified the proposed method recognize the numbers efficiently.

Human Body Tracking and Pose Estimation Using CamShift Based on Kalman Filter and Weighted Search Windows (칼만 필터와 가중탐색영역 CAMShift를 이용한 휴먼 바디 트래킹 및 자세추정)

  • Min, Jae-Hong;Kim, In-Gyu;Hwang, Seung-Jun;Baek, Joong-Hwan
    • Journal of Advanced Navigation Technology
    • /
    • v.16 no.3
    • /
    • pp.545-552
    • /
    • 2012
  • In this paper, we propose Modified Multi CAMShift Algorithm based on Kalman filter and Weighted Search Windows(KWMCAMShift) that extracts skin color area and tracks several human body parts for real-time human tracking system. We propose modified CAMShift algorithm that generates background model, extracts skin area of hands and head, and tracks the body parts. Kalman filter stabilizes tracking search window of skin area due to changing skin area in consecutive frames. Each occlusion areas is avoided by using weighted window of non-search areas and main-search area. And shadows are eliminated from background model and intensity of shadow. The proposed KWMCAMShift algorithm can estimate human pose in real-time and achieves 96.82% accuracy even in the case of occlusions.

Interactive Interface Design Through VR Hand Tracking (VR 핸드트레킹을 통한 상호작용 인터페이스 설계)

  • Ju-Sang Lee;Hyo-Seung Lee;Woo-Jun Choi
    • The Journal of the Korea institute of electronic communication sciences
    • /
    • v.18 no.1
    • /
    • pp.213-218
    • /
    • 2023
  • In order to use the VR HMD, operation through separate controllers in both hands is required. Methods for text input in VR include a method of selecting virtual keyboard keys on the screen one by one using a controller, a method of inputting through a keyboard that is a resource of a computer by connecting a computer and VR, or a method of inputting through a keyboard that is a resource of a computer by purchasing a wireless keyboard in VR and wireless keyboard connection method. As such, the text input method in current VR equipment causes inconvenience and additional costs to users. For these reasons, most of the VR-related contents are limited to simple functions such as games or viewers, and there is a risk that VR equipment will be recognized as a simple game machine. Therefore, in this study, a multi-input interface using hand tracking provided by the Oculus Quest2 device is designed and partially implemented. Through this, it is expected that various tasks such as document work and business processing as well as games can be conveniently used using VR equipment.

Technology Development for Non-Contact Interface of Multi-Region Classifier based on Context-Aware (상황 인식 기반 다중 영역 분류기 비접촉 인터페이스기술 개발)

  • Jin, Songguo;Rhee, Phill-Kyu
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.20 no.6
    • /
    • pp.175-182
    • /
    • 2020
  • The non-contact eye tracking is a nonintrusive human-computer interface providing hands-free communications for people with severe disabilities. Recently. it is expected to do an important role in non-contact systems due to the recent coronavirus COVID-19, etc. This paper proposes a novel approach for an eye mouse using an eye tracking method based on a context-aware based AdaBoost multi-region classifier and ASSL algorithm. The conventional AdaBoost algorithm, however, cannot provide sufficiently reliable performance in face tracking for eye cursor pointing estimation, because it cannot take advantage of the spatial context relations among facial features. Therefore, we propose the eye-region context based AdaBoost multiple classifier for the efficient non-contact gaze tracking and mouse implementation. The proposed method detects, tracks, and aggregates various eye features to evaluate the gaze and adjusts active and semi-supervised learning based on the on-screen cursor. The proposed system has been successfully employed in eye location, and it can also be used to detect and track eye features. This system controls the computer cursor along the user's gaze and it was postprocessing by applying Gaussian modeling to prevent shaking during the real-time tracking using Kalman filter. In this system, target objects were randomly generated and the eye tracking performance was analyzed according to the Fits law in real time. It is expected that the utilization of non-contact interfaces.

The Study of Experiential Exhibition for Considering of Natural history Museum Visitor's behavior (자연사박물관의 이용행태를 고려한 체험형 전시연출방법에 관한 연구)

  • Bae, Sun-Hwa;Choi, Jun-Hyuck;Park, Jong-Rae;Lim, Che-Zinn
    • Proceedings of the Korean Institute of Interior Design Conference
    • /
    • 2004.05a
    • /
    • pp.131-135
    • /
    • 2004
  • The purpose of this research is to improve exhibition effectiveness by implementing hands-on exhibition technique that best provides adults with cultural resting place and children with outdoor education which simply supports school curriculum. By completing this research, the museum of natural history will become defined innovatively as a place that enables people actively develop creativity. Seodaemun museum of natural history was selected for this research and itinerary tracking method of Robinson and Melton was adopted to find out adults' and children's particular movements in the museum. At the same time, observation method was used to get information on each room's visiting and viewing rate. In order to understand adults' and children's movements, their behavior was encoded.

  • PDF

Tangible AR interaction based on fingertip touch using small-sized non-square markers

  • Park, Hyungjun;Jung, Ho-Kyun;Park, Sang-Jin
    • Journal of Computational Design and Engineering
    • /
    • v.1 no.4
    • /
    • pp.289-297
    • /
    • 2014
  • Although big-sized markers are good for accurate marker recognition and tracking, they are easily occluded by other objects and deteriorate natural visualization and level of immersion during user interaction in AR environments. In this paper, we propose an approach to exploiting the use of rectangular markers to support tangible AR interaction based on fingertip touch using small-sized markers. It basically adjusts the length, width, and interior area of rectangular markers to make them more suitably fit to longish objects like fingers. It also utilizes convex polygons to resolve the partial occlusion of a marker and properly enlarges the pattern area of a marker while adjusting its size without deteriorating the quality of marker detection. We obtained encouraging results from users that the approach can provide better natural visualization and higher level of immersion, and be accurate and tangible enough to support a pseudo feeling of touching virtual products with human hands or fingertips during design evaluation of digital handheld products.

Development of a computer mouse by tracking head movements and eyeblink (머리 움직임과 눈 깜박임을 이용한 컴퓨터 마우스 개발)

  • Park, Min-Je;Kang, Shin-Wook;Kim, Soo-Chan
    • Proceedings of the IEEK Conference
    • /
    • 2008.06a
    • /
    • pp.1107-1108
    • /
    • 2008
  • The purpose of this study is to develope a computer mouse using the head movements and eye blink in order to help the disability persons who can't move the hands or foot because of car accident or cerebral apoplexy. The mouse is composed of two gyro-sensors and photo sensor. The gryo-sensors detect the head horizontal and vertical angular velocities, respectively. The photo sensor detect the eye blink to perform click, double click, and to reset the head position. In the results, we could control the mouse points in real time using the proposed system.

  • PDF

A Study on Hand Gesture Recognition with Low-Resolution Hand Images (저해상도 손 제스처 영상 인식에 대한 연구)

  • Ahn, Jung-Ho
    • Journal of Satellite, Information and Communications
    • /
    • v.9 no.1
    • /
    • pp.57-64
    • /
    • 2014
  • Recently, many human-friendly communication methods have been studied for human-machine interface(HMI) without using any physical devices. One of them is the vision-based gesture recognition that this paper deals with. In this paper, we define some gestures for interaction with objects in a predefined virtual world, and propose an efficient method to recognize them. For preprocessing, we detect and track the both hands, and extract their silhouettes from the low-resolution hand images captured by a webcam. We modeled skin color by two Gaussian distributions in RGB color space and use blob-matching method to detect and track the hands. Applying the foodfill algorithm we extracted hand silhouettes and recognize the hand shapes of Thumb-Up, Palm and Cross by detecting and analyzing their modes. Then, with analyzing the context of hand movement, we recognized five predefined one-hand or both-hand gestures. Assuming that one main user shows up for accurate hand detection, the proposed gesture recognition method has been proved its efficiency and accuracy in many real-time demos.