• The Transactions of the Korean Institute of Electrical Engineers A
• /
• v.48 no.3
• /
• pp.294-303
• /
• 1999

To improve the visual servoing performance, several strategies were proposed in the past such as redundant feature points, using a point with different height and weighted selection of image features. The performance of these visual servoing methods depends on the configuration between the camera and object. And redundant feature points require much computation efforts. This paper proposes the visual servoing method based on the disturbance obsever, which compensates the upper off-diagonal component of image feature jacobian to be the null. The performance indices such as sensitivity for a measure of richness, sensitivity of the control to noise, and comtrollability are shown to be improved when the image feature Jacobian is given as a block diagonal matrix. Computer simulations are carried out for a UUMA560 robot and show some results to verify the effectiveness of the proposed method.

• Journal of Institute of Control, Robotics and Systems
• /
• v.18 no.1
• /
• pp.42-46
• /
• 2012

A simple and accurate depth estimation algorithm for an IBVS (Image-Based Visual Servoing) is presented. Specifically, this algorithm is useful for under-actuated systems such as visual-guided quadrotor UAVs (Unmanned Aerial Vehicles). Since the image of a marker changes with changing pitch and roll angles of quadrotor, it is difficult to estimate depth. The proposed algorithm compensates a shape of the marker, so that the system acquire more accurate depth information without complicated processes. Also, the roll and pitch channels are decoupled so that the IBVS algorithm can be used in an under-actuated quadrotor system.

• 제어로봇시스템학회:학술대회논문집
• /
• 2005.06a
• /
• pp.610-615
• /
• 2005

Visual servoing is the fusion of results from many elemental areas including high-speed image processing, kinematics, dynamics, control theory, and real-time computing. It has much in common with research into active vision and structure from motion, but is quite different from the often described use of vision in hierarchical task-level robot control systems. We present a new approach to visual feedback control using image-based visual servoing with the stereo vision in this paper. In order to control the position and orientation of a robot with respect to an object, a new technique is proposed using a binocular stereo vision. The stereo vision enables us to calculate an exact image Jacobian not only at around a desired location but also at the other locations. The suggested technique can guide a robot manipulator to the desired location without giving such priori knowledge as the relative distance to the desired location or the model of an object even if the initial positioning error is large. This paper describes a model of stereo vision and how to generate feedback commands. The performance of the proposed visual servoing system is illustrated by the simulation and experimental results and compared with the case of conventional method for dual-arm robot made in Samsung Electronics Co., Ltd.

• Journal of Institute of Control, Robotics and Systems
• /
• v.6 no.6
• /
• pp.462-470
• /
• 2000

This paper proposes a visual servoing method based on QR decomposition and disturbance observer. The QR decomposition factors the image feature Jacobian into a unitary matrix and an upper triangular matrix. And it is shown that several performance indices such as measurement sensitivity of visual features, sensitivity of the control to noise and controllability can be improved for any general image feature Jacobian by QR decomposition and disturbance observer. To show the validity of the proposed approach, visual servoing with stereo vision is carried out for a Samsung FARAMAN 6-axis industrial robot manipulator.

• Proceedings of the KIEE Conference
• /
• 1999.07g
• /
• pp.3077-3079
• /
• 1999

A visual servoing method has been proposed based on disturbance observer to eliminate the effect of the off-diagonal component of image feature Jacobian, since performance indices such as measurement sensitivity of visual features, sensitivity of the control to noise and controllability could be improved when an image feature Jacobian was given as a block diagonal matrix. In this paper, experimental results of disturbance observer-based visual servoing are discussed where Samsung FARAMAN-ASl 6-axis industrial robot manipulator is employed. Also, the feature saturator is proposed to stabilized the disturbance observer loop by saturating the differential changes of the image features.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.16 no.4
• /
• pp.454-459
• /
• 2006

The research and development for autonomous mobile robots has widely been reported. This paper describes a fuzzy logic based visual servoing system for an autonomous mobile robot. An existing system always needs to keep a moving object in overall image. This makes difficult to move the autonomous mobile robot spontaneously. In this paper we first explain an autonomous mobile robot and fuzzy logic system. And then we design a fuzzy logic based visual servoing system. We extract some features of the object from an overall image and then design a fuzzy logic system for controlling the visual servoing system to an exact position. We here introduce a shooting robot that can track an object and hit it. We show that the proposed system presents a desirable performance by a computer simulation and some experiments.

• The Transactions of The Korean Institute of Electrical Engineers
• /
• v.58 no.12
• /
• pp.2498-2504
• /
• 2009

The fundamental research for the mobile robot navigation using the numerical optimization method is presented. We propose an image-based visual servo navigation algorithm for a wheeled mobile robot utilizing a ceiling mounted camera. For the image-based visual servoing, we define the composite image Jacobian which represents the relationship between the speed of wheels of a mobile robot and the robot's overall speed in the image plane. The rotational speed of wheels of a mobile robot can be directly related to the overall speed of a mobile robot in the image plane using the composite image Jacobian. We define the mobile robot navigation problem as an unconstrained optimization problem to minimize the cost function with the image error between the goal position and the position of a mobile robot. In order to avoid the obstacle, the modified cost function is proposed which is composed of the image error between the position of a mobile robot and the goal position and the distance between the position of a mobile robot and the position of the obstacle. The performance was evaluated using the simulation.

• Journal of Institute of Control, Robotics and Systems
• /
• v.12 no.3
• /
• pp.248-254
• /
• 2006

It is necessary to improve the exactness and adaptation of the working environment for the intelligent robot system. The vision sensor have been studied for a long time at this points. However, it has many processes and difficulties for the real usages. This paper proposes a visual servoing in the virtual environment to support OLP(Off-Line-Programming) path compensation and supplement the problem of complexity of the old kinematical calibration. Initial robot path could be compensated by pixel differences between real and virtual image. This method removes the varies calibrations and 3D reconstruction process in real working space. To show the validity of the proposed approach, virtual space servoing with stereo camera is carried out with WTK and openGL library for a KUKA-6R manipulator and updated real robot path.

• Journal of Power System Engineering
• /
• v.6 no.1
• /
• pp.96-101
• /
• 2002

In this paper, we address the problem of controlling an end-effector to track and grab a moving target using the visual servoing technique. A visual servo mechanism based on the image-based servoing principle, is proposed by using visual feedback to control an end-effector without calibrated robot and camera models. Firstly, we consider the control problem as a nonlinear least squares optimization and update the joint angles through the Taylor Series Expansion. And to track a moving target in real time, the Jacobian estimation scheme(Dynamic Broyden's Method) is used to estimate the combined robot and image Jacobian. Using this algorithm, we can drive the objective function value to a neighborhood of zero. To show the effectiveness of the proposed algorithm, simulation results for a six degree of freedom robot are presented.

• The Transactions of the Korean Institute of Electrical Engineers
• /
• v.43 no.6
• /
• pp.1010-1019
• /
• 1994

It is shown that there exists a nonlinear mapping which transforms image features and their changes to the desired camera motion without measuring of the relative distance between the camera and the object. This nonlinear mapping can eliminate several difficulties occurring in computing the inverse of the feature Jacobian as in the usual feature-based visual feedback control methods. Instead of analytically deriving the closed form of this mapping, a Fuzzy Membership Function-based Neural Network (FMFNN) incorporating a Fuzzy-Neural Interpolating Network is used to approximate the nonlinear mapping. Several FMFNN's are trained to be capable of tracking a moving object in the whole workspace along the line of sight. For an effective implementation of the proposed FMF network, an image feature selection process is investigated. Finally, several numerical examples are presented to show the validity of the proposed visual servoing method.