• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.9 no.8
• /
• pp.3136-3150
• /
• 2015

A vision-based 3D tracking of articulated human hand is one of the major issues in the applications of human computer interactions and understanding the control of robot hand. This paper presents an improved approach for tracking and recovering the 3D position and orientation of a human hand using the Kinect sensor. The basic idea of the proposed method is to solve an optimization problem that minimizes the discrepancy in 3D shape between an actual hand observed by Kinect and a hypothesized 3D hand model. Since each of the 3D hand pose has 23 degrees of freedom, the hand articulation tracking needs computational excessive burden in minimizing the 3D shape discrepancy between an observed hand and a 3D hand model. For this, we first created a 3D hand model which represents the hand with 17 different parts. Secondly, Random Forest classifier was trained on the synthetic depth images generated by animating the developed 3D hand model, which was then used for Haar-like feature-based classification rather than performing per-pixel classification. Classification results were used for estimating the joint positions for the hand skeleton. Through the experiment, we were able to prove that the proposed method showed improvement rates in hand part recognition and a performance of 20-30 fps. The results confirmed its practical use in classifying hand area and successfully tracked and recovered the 3D hand pose in a real time fashion.

• Journal of Institute of Control, Robotics and Systems
• /
• v.22 no.1
• /
• pp.8-16
• /
• 2016

In the field of computer vision and robotics, bin picking is an important application area in which object pose estimation is necessary. Different approaches, such as 2D feature tracking and 3D surface reconstruction, have been introduced to estimate the object pose accurately. We propose a new approach where we can use both 2D image features and 3D surface information to identify the target object and estimate its pose accurately. First, we introduce a label detection technique using Maximally Stable Extremal Regions (MSERs) where the label detection results are used to identify the target objects separately. Then, the 2D image features on the detected label areas are utilized to generate 3D surface information. Finally, we calculate the 3D position and the orientation of the target objects using the information of the 3D surface.

• Journal of Institute of Control, Robotics and Systems
• /
• v.6 no.7
• /
• pp.559-567
• /
• 2000

This paper proposes simple and practical methods in order to overcome complex formulation and heavy computational burden of the forward kinematics of 6 앨 3-6 type parallel manipulators. Three ap-proaches for the forward kinematics are presented : one extra sensor a modified structure and novel numerical method. The proposed methods are applied to the forward kinematics of a new 6 앨 parallel manipulator with special geometry that has three internal links three external links and a moving platform of a cone shape. The proposed methods use three tetrahedrons for finding the position and orientation vector of the moving platform. The main advantages of the appraches using tetrahedrons are to abbreviate the formulation to easily find so-lutions of the forward kinematics and to be able to practically control of the manipulator in real time.

• 제어로봇시스템학회:학술대회논문집
• /
• 2003.10a
• /
• pp.2435-2440
• /
• 2003

Manipulation of the nano/micro scale object has been a key technology in biology as the sizes of DNA, chromosome, nucleus, cell and embryo are within such order. For instance, for embryo cell manipulation, the cell injection is performed manually. The operator often spends over a year to carry out a cell manipulation project. Since the typical success rate of such operation is extremely low, automation of such biological cell manipulation has been asked. As the operator spends most of his time in finding the position of cell in the Petri dish and in injecting bio-material to the cell from the best orientation. In this paper, we propose a new strategy and a vision system, by which one can find, recognize and track nucleus, polar body, and zona pellucida of the embryo cell for automatic biomanipulation. The deformable template matching algorithm has been used in recognizing the nucleus and polar body of each cell. Result suggests that it outperforms the conventional methods.

• Journal of Ocean Engineering and Technology
• /
• v.32 no.2
• /
• pp.131-137
• /
• 2018

In this paper, we propose an adaptive backstepping controller to control the exact position and orientation of a remotely operated underwater vehicle with parametric model uncertainty. To further improve the angular velocity control precision of each thruster, a phase locked loop (PLL) controller has been added to the backstepping controller. A comparison of two backstepping controllers with and without the PLL control loop has been performed using simulations and experiments. The test results showed that the tracking performance could be improved by using the PLL control loop in the proposed adaptive backstepping controller.

• Journal of Institute of Control, Robotics and Systems
• /
• v.15 no.11
• /
• pp.1122-1129
• /
• 2009

Recently taping robot with smart recognition function have been studied in the coil manufacturing field. Due to the difficulty of 3D surface processing from the complicated working environment, it is not easy to accomplish smart tape attachment motion with non-contact sensor. To solve these problems the applicable surface recognition algorithm and a flexible sensing device has been recommended. In this research, the fusion method between 1D displacement and 3D laser scanner is applied for robust tape attachment about cold rolled coil. With these sensors we develop a two-step exploration and the smart algorithm for the awareness of non-aligned coil's information. In the proposed robot system for tape attachment, the problem is reduced to coil's radius searching with laser displacement sensor at first, and then position and orientation detection with 3D laser scanner. To get the movement at the robot's base frame, the hand-eye compensation between robot's end effector and sensing device should be also carried out respectively. In this paper, we examine the auto-coordinate transformation method in the calibration step for the real environment usage. From the experimental results, it was shown that the taping motion of robot had a robust under the non-aligned cold rolled coil.

• Smart Structures and Systems
• /
• v.7 no.2
• /
• pp.103-116
• /
• 2011

This paper is concerned with the trajectory tracking and vibration suppression of a single-link flexible arm by using piezoelectric materials. The dynamics of a single flexible arm with PZT patches as sensor and actuator is derived using extended Hamilton's principle. Resulting equations show that the coupled beam dynamics including beam vibration and its rigid in-plane rotation takes place in two different time scales. By using singular perturbation theory, the system dynamics is divided into two subsystems. Then, a composite control scheme is elaborated that makes the orientation of the arm track a desired trajectory while suppressing its vibration. The proposed controller has two parts: one is a tracking controller designed for the slow (rigid) subsystem, and the other one is a stabilizing controller for the fast (flexible) subsystem. The outputs considered for the system are angular position of the hub and voltage of the sensor mounted on the structure. To avoid requiring further measurements of beam vibration and also angular velocity of the hub for the fast and slow control laws, respectively, two sliding mode observers for estimating the unknown states are also designed.

• Proceedings of the Korean Institute of Intelligent Systems Conference
• /
• 2006.05a
• /
• pp.56-58
• /
• 2006

Camera calibration in machine vision is the process of determining the intrinsic cameara parameters and the three-dimensional (3D) position and orientation of the camera frame relative to a certain world coordinate system. On the other hand, Takagi-Sugeno-Kang (TSK) fuzzy system is a very popular fuzzy system and approximates any nonlinear function to arbitrary accuracy with only a small number of fuzzy rules. It demonstrates not only nonlinear behavior but also transparent structure. In this paper, we present a novel and simple technique for camera calibration for machine vision using TSK fuzzy model. The proposed method divides the world into some regions according to camera view and uses the clustered 3D geometric knowledge. TSK fuzzy system is employed to estimate the camera parameters by combining partial information into complete 3D information. The experiments are performed to verify the proposed camera calibration.

• Journal of Mechanical Science and Technology
• /
• v.19 no.spc1
• /
• pp.265-271
• /
• 2005

Randomness exists in engineering. Tolerance, assemble-error, environment temperature and wear make the parameters of a mechanical system uncertain. So the behavior or response of the mechanical system is uncertain. In this paper, the uncertain parameters are treated as random variables. So if the probability distribution of a random parameter is known, the simulation of mechanical multibody dynamics can be made by Monte-Carlo method. Thus multibody dynamics simulation results can be obtained in statistics. A new concept called functional reliability is put forward in this paper, which can be defined as the probability of the dynamic parameters(such as position, orientation, velocity, acceleration etc.) of the key parts of a mechanical multibody system belong to their tolerance values. A flexible mechanical arm with random parameters is studied in this paper. The length, width, thickness and density of the flexible arm are treated as random variables and Gaussian distribution is used with given mean and variance. Computer code is developed based on the dynamic model and Monte-Carlo method to simulate the dynamic behavior of the flexible arm. At the same time the end effector's locating reliability is calculated with circular tolerance area. The theory and method presented in this paper are applicable on the dynamics modeling of general multibody systems.

• Journal of Institute of Control, Robotics and Systems
• /
• v.22 no.8
• /
• pp.579-584
• /
• 2016

When surgical instruments are tracked in an image-guided surgical navigation system, a stereo vision system with high accuracy is generally used, which is called optical tracker. However, this optical tracker has the disadvantage that a line-of-sight between the tracker and surgical instrument must be maintained. Therefore, to complement the disadvantage of optical tracking systems, an internal vision sensor is attached to a surgical instrument in this paper. Monitoring the target marker pattern attached on patient with this vision sensor, this surgical instrument is possible to be tracked even when the line-of-sight of the optical tracker is occluded. To verify the system's effectiveness, a series of basic experiments is carried out. Lastly, an integration experiment is conducted. The experimental results show that rotational error is bounded to max $1.32^{\circ}$ and mean $0.35^{\circ}$, and translation error is in max 1.72mm and mean 0.58mm. Finally, it is confirmed that the proposed tool tracking method using an internal vision sensor is useful and effective to overcome the occlusion problem of the optical tracker.