• Title/Summary/Keyword: visual servoing system

Search Result 73, Processing Time 0.024 seconds

An Image-Based Stereo visual Servoing Algorithm Robust to the Camera Extrinsic Parameters (카메라 외적 파라메터에 대하여 강인성을 갖는 스테레오 시각 제어 알고리즘)

  • Dong Min Kim
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.4 no.6
    • /
    • pp.753-758
    • /
    • 1998
  • 본 논문은 카메라 파라메터의 측정오차에 대하여 강인성을 보이는 새로운 로봇의 스테레오 시각 위치제어 알고리즘을 제시한다. 제시된 알고리즘은 카메라로부터 측정된 영상 데이터만을 이용함으로써, 특히 파라메터 측정오차에 대하여 매우 민감함을 보이는 영상 데이터로부터 작업 공간에서의 위치로의 변환, 즉 역변환 추정장치의 필요성을 제거하였다. 이러한 특징이 기존 개발된 시각 제어기와의 큰 차이를 두고 있다. 그럼에도 불구하고 제시된 제어기는 전 작업 영역 내에서 시스템 안정성을 갖는다. 또한 카메라의 위치 측정 오차에 대하여 전혀 영향을 받지 않음이 증명되어지고 방향 폭정 오류에 대해서도 기존 제어기보다 강인함을 시뮬레이션을 통하여 보여진다.

  • PDF

An Intelligent Visual Servoing Method using Vanishing Point Features

  • Lee, Joon-Soo;Suh, Il-Hong
    • Journal of Electrical Engineering and information Science
    • /
    • v.2 no.6
    • /
    • pp.177-182
    • /
    • 1997
  • A visual servoing method is proposed for a robot with a camera in hand. Specifically, vanishing point features are suggested by employing a viewing model of perspective projection to calculate the relative rolling, pitching and yawing angles between the object and the camera. To compensate dynamic characteristics of the robot, desired feature trajectories for the learning of visually guided line-of-sight robot motion are obtained by measuring features by the camera in hand not in the entire workspace, but on a single linear path along which the robot moves under the control of a commercially provided function of linear motion. And then, control actions of the camera are approximately found by fuzzy-neural networks to follow such desired feature trajectories. To show the validity of proposed algorithm, some experimental results are illustrated, where a four axis SCARA robot with a B/W CCD camera is used.

  • PDF

Object Recognition and Pose Estimation Based on Deep Learning for Visual Servoing (비주얼 서보잉을 위한 딥러닝 기반 물체 인식 및 자세 추정)

  • Cho, Jaemin;Kang, Sang Seung;Kim, Kye Kyung
    • The Journal of Korea Robotics Society
    • /
    • v.14 no.1
    • /
    • pp.1-7
    • /
    • 2019
  • Recently, smart factories have attracted much attention as a result of the 4th Industrial Revolution. Existing factory automation technologies are generally designed for simple repetition without using vision sensors. Even small object assemblies are still dependent on manual work. To satisfy the needs for replacing the existing system with new technology such as bin picking and visual servoing, precision and real-time application should be core. Therefore in our work we focused on the core elements by using deep learning algorithm to detect and classify the target object for real-time and analyzing the object features. We chose YOLO CNN which is capable of real-time working and combining the two tasks as mentioned above though there are lots of good deep learning algorithms such as Mask R-CNN and Fast R-CNN. Then through the line and inside features extracted from target object, we can obtain final outline and estimate object posture.

Intelligent Balancing Control of Inverted Pendulum on a ROBOKER Arm Using Visual Information (영상 정보를 이용한 ROBOKER 팔 위의 역진자 시스템의 지능 밸런싱 제어 구현)

  • Kim, Jeong-Seop;Jung, Seul
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.21 no.5
    • /
    • pp.595-601
    • /
    • 2011
  • This paper presents balancing control of inverted pendulum on the ROBOKER arm using visual information. The angle of the inverted pendulum placed on the robot arm is detected by a stereo camera and the detected angle is used as a feedback and tracking error for the controller. Thus, the overall closed loop forms a visual servoing control task. To improve control performance, neural network is introduced to compensate for uncertainties. The learning algorithm of radial basis function(RBF) network is performed by the digital signal controller which is designed to calculate floating format data and embedded on a field programmable gate array(FPGA) chip. Experimental studies are conducted to confirm the performance of the overall system implementation.

Visual-Servoing Control of Robot Manipulator (로봇 매니퓰레이터의 시각구동제어)

  • 신행봉;정동연;한성현
    • Proceedings of the Korean Society of Machine Tool Engineers Conference
    • /
    • 2003.10a
    • /
    • pp.213-218
    • /
    • 2003
  • The equipment of industrial robot in manufacturing and assembly lines has rapidly increased. In order to achieve high productivity and flexibility, it becomes very important to develop the visual feedback control system with Off-Line Programming System(OLPS). We can save much efforts and time in adjusting robots to newly defined workcells by using OLPS. A proposed visual calibration scheme is based on position-based visual feedback. The calibration program firstly generates predicted images of objects in an assumed end-effector position. The process to generate predicted images consists of projection to screen-coordinates, visible range test and construction of simple silhouette figures. Then camera images acquired are compared with predicted ones for updating position and orientation data. Computation of error is very simple because the scheme is based on perspective projection which can be also expanded to experimental results. Computation time can be extremely reduced because the proposed method does not require the precise calculation of tree-dimensional object data and image Jacobian.

  • PDF

Control of mobile robots based on a linear optic-flow algorithm (선형 Optic flow 알고리듬을 이용한 이동 로봇 제어)

  • 최대일;한웅기;국태용
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1996.10b
    • /
    • pp.1149-1152
    • /
    • 1996
  • Recently visual servo control is an important feature of an intelligent robot system. In this paper, we presents a Kalman filter approach for estimation of the linear optic flow model which is utilized in the visual servoing of a mobile robot. The proposed method is also compared with the conventional least mean square method via computer simulation.

  • PDF

Voting based Cue Integration for Visual Servoing

  • Cho, Che-Seung;Chung, Byeong-Mook
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2003.10a
    • /
    • pp.798-802
    • /
    • 2003
  • The robustness and reliability of vision algorithms is the key issue in robotic research and industrial applications. In this paper, the robust real time visual tracking in complex scene is considered. A common approach to increase robustness of a tracking system is to use different models (CAD model etc.) known a priori. Also fusion of multiple features facilitates robust detection and tracking of objects in scenes of realistic complexity. Because voting is a very simple or no model is needed for fusion, voting-based fusion of cues is applied. The approach for this algorithm is tested in a 3D Cartesian robot which tracks a toy vehicle moving along 3D rail, and the Kalman filter is used to estimate the motion parameters, namely the system state vector of moving object with unknown dynamics. Experimental results show that fusion of cues and motion estimation in a tracking system has a robust performance.

  • PDF

A Fast Seam Tracking Algorithm for Laser Welding (레이져 용접을 위한 고속 용접선 추적 알고리즘)

  • 배재욱
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1997.10a
    • /
    • pp.52-55
    • /
    • 1997
  • This paper discusses an automatic visual-servoing system, in which a laser and a CCD camera are used for imaging the pattern of joint groove. The algorithm used here is simple and robust to find out the gap width and gap center. As a consequence, the speed of algorithm is very fast and optimized. A feature of this system is that it processes only by summing the vertical line and horizontal line of screen without any image preprocessing in order to get the energy information of lines alternatively. It is practical and useful for the system requiring a fast process time of vision.

  • PDF

Visual Servoing Control of a Docking System for an Autonomous Underwater Vehicle (AUV)

  • Lee, Pan-Mook;Jeon, Bong-Hwan;Lee, Chong-Moo;Hong, Young-Hwa;Oh, Jun-Ho
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2002.10a
    • /
    • pp.109.5-109
    • /
    • 2002
  • Autonomous underwater vehicles (AUVs) are unmanned underwater vessels to investigate sea environments, oceanography and deep-sea resources autonomously. Docking systems are required to increase the capability of the AUVs to recharge the batteries and to transmit data in real time in underwater. This paper presents a visual servo control system for an AUV to dock into an underwater station with a camera. To make the visual servo control system , this paper derives an optical flow model of a camera mounted on an AUV, where a CCD camera is installed at the nose center of the AUV to monitor the docking condition. This paper combines the optical flow equation of the camera with the AUV's equation o...

  • PDF

Visual servo control of robots using fuzzy-neural-network (퍼지신경망을 이용한 로보트의 비쥬얼서보제어)

  • 서은택;정진현
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1994.10a
    • /
    • pp.566-571
    • /
    • 1994
  • This paper presents in image-based visual servo control scheme for tracking a workpiece with a hand-eye coordinated robotic system using the fuzzy-neural-network. The goal is to control the relative position and orientation between the end-effector and a moving workpiece using a single camera mounted on the end-effector of robot manipulator. We developed a fuzzy-neural-network that consists of a network-model fuzzy system and supervised learning rules. Fuzzy-neural-network is applied to approximate the nonlinear mapping which transforms the features and theire change into the desired camera motion. In addition a control strategy for real-time relative motion control based on this approximation is presented. Computer simulation results are illustrated to show the effectiveness of the fuzzy-neural-network method for visual servoing of robot manipulator.

  • PDF