Hands-free Robot Control System Using Mouth Tracking

입 추적을 이용한 로봇 원격 제어 시스템

In this paper, we propose a robot remote control system based on mouth tracking. The main idea behind the work is to help disabled people who cannot operate a joystick or keyboard to control a robot with their hands. The mouth detection method in this paper is mainly based on the Adaboost feature detection approach. By using the proposed new Haar-like features for detecting the corner of mouth, the speed and accuracy of detection are improved. Combined with the Kalman filter, a continuous and accurate mouth tracking has been achieved. Meanwhile, the gripping commands of the robot manipulator were also achieved by the recognition of the user.s mouth shape, such as 'pout mouth' or 'grin mouth'. To assess the validity of the method, a mouth detection experiment and a robot cargo transport experiment were applied. The result indicated that the system can realize a quick and accurate mouse tracking; and the operation of the robot worked successfully in moving and bringing back items.