• 한국멀티미디어학회논문지
• /
• 제19권8호
• /
• pp.1225-1235
• /
• 2016

This paper presents a method for computer-assisted slide presentation using vision-based gesture recognition. The proposed method consists of a sequence of steps, first detecting a hand in the scene of projector beam, then estimating the smooth trajectory of a hand or a pointing finger using Kalman Filter, and finally interfacing to an application system. Additional slide navigation control includes moving back and forth the pages of the presentation. The proposed method is to help speakers for an effective presentation with natural improved interaction with the computer. In particular, the proposed method of using finger pointing is believed to be more effective than using a laser pointer since the hand, the pointing or finger are more visible and thus can better grab the attention of the audience.

• 한국생산제조학회지
• /
• 제24권6호
• /
• pp.703-709
• /
• 2015

In this work, a robot aimed at grapping and delivering an object by using a simple finger-pointing command from a hand- or arm-handicapped person is introduced. In this robot system, a Leap Motion sensor is utilized to obtain the finger-motion data of the user. In addition, a Kinect sensor is also used to measure the 3D (Three Dimensional)-position information of the desired object. Once the object is pointed at through the finger pointing of the handicapped user, the exact 3D information of the object is determined using an image processing technique and a coordinate transformation between the Leap Motion and Kinect sensors. It was found that the information obtained is transmitted to the robot controller, and that the robot eventually grabs the target and delivers it to the handicapped person successfully.

• International Journal of Contents
• /
• 제6권4호
• /
• pp.49-56
• /
• 2010

In this paper we present a system that enables the user to interact with large display system even without touching the screen. With two infrared sensitive cameras mounted on the bottom left and bottom right of the display system pointing upwards, the user fingertip position on the selected region of interest of each camera view is found using vertical intensity profile of the background subtracted image. The position of the finger in two images of left and right camera is mapped to the display screen coordinate by using pre-determined matrices, which are calculated by interpolating samples of user finger position on the images taken by pointing finger over some known coordinate position of the display system. The screen is then manipulated according to the calculated position and depth of the fingertip with respect to the display system. Experimental results demonstrate an efficient, robust and stable human computer interaction.

• 한국지능시스템학회논문지
• /
• 제11권6호
• /
• pp.487-490
• /
• 2001

본 논문은 영상 해석 알고리즘의 하나인 원형 패턴벡터 알고리즘을 이용하여 손가락으로 커서를 제어하는 시스템을 구현하였다. 이 알고리즘을 적용하기위하여 영상에서 손 영역에만 해당하는 최대 원을 여러개 그린후 가장 큰 원의 중심점을 무게 중심점으로 사용하였으며, 무게 중심점에서 손의 외곽까지의거리를 구하여 가리키는 손가락을 찾도록 하였다. 화면상의 커서의 수평방향은 가리키는 손가락방향을 이용하여 평면 좌표로 해석하여 제어하였고, 수직방향은 모니터 중앙상단에 한대의 카메라를 사용하였기 때문에 손가락 길이를 이용하여 불연속적으로 상-중-하의 세 영역으로 제어하였다. 수직 방향의 커서이동이 불연속적이기때문에, 구축한 인터페이스 화면의 범위를 축소한 후 축소된 범위를 전체 화면으로 확대해 나감으로써 사용자가 원하는 목표지점으로 커서를 이동시킬수 있다.

• 한국정보통신학회논문지
• /
• 제12권8호
• /
• pp.1481-1487
• /
• 2008

본 논문에서는3D환경에서의 사용을 위한 새로운 형태의 인터렉티브 3D 플로팅 영상 포인팅 장치를 제안한다. 이 장치는 플로팅 렌즈 배열을 사용한3D플로팅 영상 재생 시스템과 실시간 손가락 검출 기반의 버턴형 인터페이스로 구성된다. 제안하는 장치에서는 사용자가 손가락을 이용하여 3D 공간에 플로팅 된 영상 배열에서 원하는 영역을 지시하고, 2대의 카메라를 이용하여 사용자의 손가락 인식하여 원하는 이벤트를 발생하는 인터렉션 기능을 효과적으로 수행한다. 제안하는 시스템의 유용함을 보이기 위해서, 실험적인 장치 구현을 수행하고 기초적인 실험 결과를 보고한다.

• ETRI Journal
• /
• 제33권3호
• /
• pp.415-422
• /
• 2011

In this paper, we present a novel vision-based method of recognizing finger actions for use in electronic appliance interfaces. Human skin is first detected by color and consecutive motion information. Then, fingertips are detected by a novel scale-invariant angle detection based on a variable k-cosine. Fingertip tracking is implemented by detected region-based tracking. By analyzing the contour of the tracked fingertip, fingertip parameters, such as position, thickness, and direction, are calculated. Finger actions, such as moving, clicking, and pointing, are recognized by analyzing these fingertip parameters. Experimental results show that the proposed angle detection can correctly detect fingertips, and that the recognized actions can be used for the interface with electronic appliances.

• 정보처리학회논문지:소프트웨어 및 데이터공학
• /
• 제4권2호
• /
• pp.91-96
• /
• 2015

본 논문에서는 원격디스플레이를 제어하기 위하여 공중에서 섬세한 손동작을 인식할 수 있는 핸드 헬드형 포인팅 디바이스인 AirPincher를 제안한다. AirPincher는 현재 존재하고 있는 손동작 인식 기술 중 장갑을 이용한 기술과 디스플레이 근처에 설치하는 카메라를 이용한 기술의 단점을 극복하기 위해 고안되었다. 장갑을 이용한 기술은 사용 시 매번 탈착을 해야 하는 불편함이 존재하고 설치형 카메라를 이용한 기술은 사용자와 원격 디스플레이 간의 거리에 따라 제스처 인식 효율이 상이한 단점이 있다. 이러한 단점을 극복하기 위하여 AirPincher는 사용자가 한 손으로 디바이스를 잡고 사용하도록 설계되었다. 손가락 동작은 AirPincher에 탑재되어있는 근접한 센서들에 의해 인식되어 섬세한 손가락 움직임을 인식할 수 있다. 본 논문에서는 AirPincher를 사용하는 두 가지 포인팅 방법을 제안하고 이들의 성능을 분석하기 위한 실험을 진행하였다. 실험은 AirPincher를 사용하기 위한 공중에서의 효율적인 가상 입력공간의 크기를 찾는 실험과 AirPincher를 사용한 연속 포인팅 방법과 불연속 포인팅 방법을 비교하는 실험으로 구성되었다.

• 로봇학회논문지
• /
• 제15권3호
• /
• pp.240-247
• /
• 2020

This paper presents a novel knitted data glove system for pattern classification of hand posture. Several experiments were conducted to confirm the performance of the knitted data glove. To find better sensor materials, the knitted data glove was fabricated with stainless-steel yarn and silver-plated yarn as representative conductive yarns, respectively. The result showed that the signal of the knitted data glove made of silver-plated yarn was more stable than that of stainless-steel yarn according as the measurement distance becomes longer. Also, the pattern classification was conducted for the performance verification of the data glove knitted using the silver-plated yarn. The average classification reached at 100% except for the pointing finger posture, and the overall classification accuracy of the knitted data glove was 98.3%. With these results, we expect that the knitted data glove is applied to various robot fields including the human-machine interface.

• ETRI Journal
• /
• 제29권3호
• /
• pp.305-310
• /
• 2007

If a virtual object in a virtual environment represented by a stereo vision system could be touched by a user with some tactile feeling on his/her fingertip, the sense of reality would be heightened. To create a visual impression as if the user were directly pointing to a desired point on a virtual object with his/her own finger, we need to align virtual space coordinates and physical space coordinates. Also, if there is no tactile feeling when the user touches a virtual object, the virtual object would seem to be a ghost. Therefore, a haptic interface device is required to give some tactile sensation to the user. We have constructed such a human-computer interaction system in the form of a simple virtual reality game using a stereo vision system, a vibro-tactile device module, and two position/orientation sensors.

• 방송공학회논문지
• /
• 제9권2호
• /
• pp.102-109
• /
• 2004

We have proposed an Object-linked Broadcasting Service that displays various data related to the object onscreen. In thls paper, we describe the structure of the Object-linked Broadcasting System that will enable our proposal to be realized, and report new techniques that we have developed to create the system. We have carried out the experiment to confirm the system performance as well as execution of each technology assembling the system. We have confirmed that the performance of the system we developed satisfies the proposed specification based on user requirements and current technology.