• Journal of the Korean Society for Precision Engineering
• /
• v.21 no.11
• /
• pp.83-90
• /
• 2004

In this paper we present a new real-time visual servoing unit for laparoscopic surgery This unit can automatically control laparoscope manipulator through visual tracking of laparoscopic surgical tool. For the tracking, we present two-stage adaptive CONDENSATION(conditional density propagation) algorithm to extract the accurate position of the surgical tool tip from a surgical image sequence in real-time. This algorithm can be adaptable to abrupt change of laparoscope illumination. For the control, we present virtual damper system to control a laparoscope manipulator safely and stably. This system causes the laparoscope to move under constraint of the virtual dampers which are linked to the four sides of image. The visual servoing unit operates the manipulator in real-time with locating the surgical tool in the center of image. The experimental results show that the proposed visual tracking algorithm is highly robust and the controlled manipulator can present stable view with safe.

• Journal of the Korean Society for Precision Engineering
• /
• v.15 no.7
• /
• pp.175-181
• /
• 1998

This paper describes realtime visual tracking system of moving object for three dimensional target using EKF(Extended Kalman Filter). We present a new realtime visual tracking using EKF algorithm and image prediction algorithm. We demonstrate the performance of these tracking algorithm through real experiment. The experimental results show the effectiveness of the EKF algorithm and image prediction algorithm for realtime tracking and estimated state value of filter, predicting the position of moving object to minimize an image processing area, and by reducing the effect by quantization noise of image.

• Proceedings of the Korean Society of Precision Engineering Conference
• /
• 1997.04a
• /
• pp.25-29
• /
• 1997

In this thesis, we construct the microrobot succor system and navigate the real-time path planning and visual tracking of each robot. The system consists robots, vision system and a host computer. Because the robots are free-ranging mobile robot, it is needed to make and gallow the path. The path is planned and controlled by a host computer, ie. Supervisory control system. In path planning, we suggest a cost function which consists of three terms. One is the smoothness of the path, another is the total distance or time, and the last one is to avoid obstacles. To minimize the cost function, we choose the parametric cubic spline and update the coefficients in real time. We perform the simulation for the path planing and obstacle avoidance and real experiment for visual tracking

• Journal of Institute of Control, Robotics and Systems
• /
• v.9 no.12
• /
• pp.1033-1041
• /
• 2003

A new visual tracking scheme is proposed for a mobile robot that tracks a moving object in 3D space in real time. Visual tracking is to control a mobile robot to keep a moving target at the center of input image at all time. We made it possible by simplifying the relationship between the 2D image frame captured by a single camera and the 3D workspace frame. To precisely calculate the input vector (orientation and distance) of the mobile robot, the speed vector of the target is determined by eliminating the speed component caused by the camera motion from the speed vector appeared in the input image. The problem of temporary disappearance of the target form the input image is solved by selecting the searching area based on the linear prediction of target motion. The experimental results have shown that the proposed scheme can make a mobile robot successfully follow a moving target in real time.

• 제어로봇시스템학회:학술대회논문집
• /
• 2001.10a
• /
• pp.70.1-70
• /
• 2001

Recently, research of visual control is getting more essential in robotic application, and acquiring 3D informations from the 2D images is becoming more important with development of vision system. For this application, we propose the effective way of controlling stereo vision tracking system for target tracking and calculating distance between target and camera. In this paper we address improved controller using dual-loop visual servo which is more effective compared with using single-loop visual servo for stereo vision tracking system. The speed and the accuracy for realizing a real time tracking are important. However, the vision processing speed is too slow to track object in real time by using only vision feedback data. So we use another feedback data from controller parts which offer state feedback ...

• Proceedings of the KIEE Conference
• /
• 1999.07g
• /
• pp.2995-2997
• /
• 1999

Recently, real-time visual tracking control for a robot manipulator is performed by using a vision feedback sensor information. In this paper, the optical flow is computed based on the eye-in-hand robot configuration. The image jacobian is employed to calculate the rotation and translation velocity of a 3D moving object. LQG visual controller generates the real-time visual trajectory. In order to improving the visual tracking performance. VSC controller is employed to control the robot manipulator. Simulation results show a better visual tracking performance than other method.

• Journal of Digital Convergence
• /
• v.20 no.5
• /
• pp.733-739
• /
• 2022

The study investigated the users' functional requirement, degree of acceptance and preference of game broadcast real-time review .Secondly it comparatively analyzed the types and locations of game broadcast real-time review through eye tracking tech. The results show that users have high functional requirements and high acceptance for game broadcast real-time review but their preference has no significant correlation with the feature. Among the types of game broadcast real-time review the type with translucent text bubble took the highest visual attention. The above shows that the users' visual behavior has the tendency of special style. The visual attention analysis results of different types and locations of game broadcast real-time review in the study can play a guiding role in the interface design of real-time review feature in the future.

• Transactions of the Korean Society of Automotive Engineers
• /
• v.24 no.2
• /
• pp.127-136
• /
• 2016

The camera based object detection systems should satisfy the recognition performance as well as real-time constraints. Particularly, in safety-critical systems such as Autonomous Emergency Braking (AEB), the real-time constraints significantly affects the system performance. Recently, multi-core processors and system-on-chip technologies are widely used to accelerate the object detection algorithm by distributing computational loads. However, due to the advanced hardware, the complexity of system architecture is increased even though additional hardwares improve the real-time performance. The increased complexity also cause difficulty in migration of existing algorithms and development of new algorithms. In this paper, to improve real-time performance and design complexity, a task scheduling strategy is proposed for visual object tracking systems. The real-time performance of the vision algorithm is increased by applying pipelining to task scheduling in a multi-core processor. Finally, the proposed task scheduling algorithm is applied to crosswalk detection and tracking system to prove the effectiveness of the proposed strategy.

• Journal of the Korean Society for Precision Engineering
• /
• v.15 no.6
• /
• pp.175-182
• /
• 1998

An advanced visual tracking and stable grasping algorithm for a moving object is proposed. The stable grasping points for a moving 2D polygonal object are obtained through the visual tracking system with the Kalman filter and image prediction technique. The accuracy and efficiency are improved more than any other prediction algorithms for the tracking of an object. In the processing of a visual tracking. the shape predictors construct the parameterized family and grasp planner find the grasping points of unknown object through the geometric properties of the parameterized family. This algorithm conducts a process of ‘stable grasping and real time tracking’.

• Journal of the Korean Society for Precision Engineering
• /
• v.24 no.10
• /
• pp.64-74
• /
• 2007

Because of the size and environment in the shipbuilding process, the portable type robot is required for the automatic seam tracking. For this reason, the structure of laser sensor should be considered in the initial design step and the coordinate transformation between welding robot and laser sensor, which is joint finder, must be identified exactly and the real time tracking algorithm based on these consideration could be developed. In this research, laser displacement sensor in which its structure is laser beam's vertical projection, is developed to recognize the location of weld joint. In practical applications, however, images of weld joints are often degraded because of the surface specularity or spatter. To overcome the problem, the constrained joint finding algorithm is proposed. In the approach of coordinate conversion rule for the visual feedback control among welding torch, robot body and laser sensor is applied by the same reference point method. In the real time seam tracking algorithms we propose constrained sampling method which uses look ahead distance. The RLS(Recursive Least Square) filter is applied to obtain the smooth tracking path from the sensitive edge data. From the experimental results, we could see the possibility that the developed laser sensor with proposed processing algorithm and real time seam tracking method can be used as a welding under the shipbuilding condition.