• Proceedings of the KIEE Conference
• /
• 2007.04a
• /
• pp.231-233
• /
• 2007

In this paper we present a new visual approach for the robust bin-picking in a two-step concept for a vision driven automatic handling robot. The technology described here is based on two types of sensors: 3D laser scanner and CCD video camera. The geometry and pose(position and orientation) information of bin contents was reconstructed from the camera and laser sensor. these information can be employed to guide the robotic arm. A new thinning algorithm and constrained hough transform method is also explained in this paper. Consequently, the developed bin-picking demonstrate the successful operation with 3D hole object.

• Journal of the Korean Society of Manufacturing Technology Engineers
• /
• v.26 no.2
• /
• pp.223-229
• /
• 2017

Recently, robotic bin-picking tasks have drawn considerable attention, because flexibility is required in robotic assembly tasks. Generally, stereo camera systems have been used widely for robotic bin-picking, but these have two limitations: First, computational burden for solving correspondence problem on stereo images increases calculation time. Second, errors in image processing and camera calibration reduce accuracy. Moreover, the errors in robot kinematic parameters directly affect robot gripping. In this paper, we propose a method of correcting the bin-picking error by using trinocular vision system which consists of two stereo cameras andone hand-eye camera. First, the two stereo cameras, with wide viewing angle, measure object's pose roughly. Then, the 3rd hand-eye camera approaches the object, and corrects the previous measurement of the stereo camera system. Experimental results show usefulness of the proposed method.

• Journal of the Semiconductor & Display Technology
• /
• v.22 no.1
• /
• pp.72-77
• /
• 2023

In many manufacturing settings, including the semiconductor industry, products are completed by producing and assembling various components. Sorting out from randomly mixed parts and classification operations takes a lot of time and labor. Recently, many efforts have been made to select and assemble correct parts from mixed parts using robots. Automating the sorting and classification of randomly mixed components is difficult since various objects and the positions and attitudes of robots and cameras in 3D space need to be known. Previously, only objects in specific positions were grasped by robots or people sorting items directly. To enable robots to pick up random objects in 3D space, bin picking technology is required. To realize bin picking technology, it is essential to understand the coordinate system information between the robot, the grasping target object, and the camera. Calibration work to understand the coordinate system information between them is necessary to grasp the object recognized by the camera. It is difficult to restore the depth value of 2D images when 3D restoration is performed, which is necessary for bin picking technology. In this paper, we propose to use depth information of RGB-D camera for Z value in rotation and movement conversion used in calibration. Proceed with camera calibration for accurate coordinate system conversion of objects in 2D images, and proceed with calibration of robot and camera. We proved the effectiveness of the proposed method through accuracy evaluations for camera calibration and calibration between robots and cameras.

• Journal of Institute of Control, Robotics and Systems
• /
• v.22 no.10
• /
• pp.839-846
• /
• 2016

Bin picking is a task of picking a small object from a bin. For accurate bin picking, the 3D pose information, position, and orientation of a small object is required because the object is mixed with other objects of the same type in the bin. Using this 3D pose information, a robotic gripper can pick an object using exact distance and orientation measurements. In this paper, we propose a 3D vision technique for accurate measurement of 3D position and orientation of small objects, on which a paper label is stuck to the surface. We use a maximally stable extremal regions (MSERs) algorithm to detect the label areas in a left bin image acquired from a stereo camera. In each label area, image features are detected and their correlation with a right image is determined by a stereo vision technique. Then, the 3D position and orientation of the objects are measured accurately using a transformation from the camera coordinate system to the new label coordinate system. For stable measurement during a bin picking task, the pose information is filtered by averaging at fixed time intervals. Our experimental results indicate that the proposed technique yields pose accuracy between 0.4~0.5mm in positional measurements and $0.2-0.6^{\circ}$ in angle measurements.

• Journal of the Korean Society of Manufacturing Technology Engineers
• /
• v.25 no.6
• /
• pp.522-531
• /
• 2016

In this study, we propose an object identification method for bin-picking developed for industrial robots. We identify the grasp posture and the associated geometric parameters of grasp objects using the joint data of a robotic gripper. Prior to grasp identification, we analyze the grasping motion in a low-dimensional space using principle component analysis (PCA) to reduce the dimensions. We collected the joint data from a human hand to demonstrate the grasp-identification algorithm. For data acquisition of the human grasp data, we conducted additional research on the motion characteristics of a human hand. We explain the method for using the algorithm of grasp identification for bin-picking. Finally, we present a subject for future research using our proposed algorithm of grasp model and identification.

• Bulletin of the Korean Chemical Society
• /
• v.30 no.11
• /
• pp.2665-2668
• /
• 2009

A new algorithm for determining noise level is proposed for more reliability in interpreting spectral data for complex Fourier transform ion cyclotron resonance (FTICR) mass spectra of petroleum. In the new algorithm, a moving window with a fixed number of data points was adopted, instead of a fixed m/z width. In the analysis of petroleum, it was found that a moving window of 50,000 or more data points was optimal. This optimized automated peak picking performed well even with frequency-dependant noise in the mass spectrum. Additionally, this fast, automated peak picking algorithm was suitable for the analysis of a large set of samples.

• The Journal of Korea Robotics Society
• /
• v.14 no.1
• /
• pp.1-7
• /
• 2019

Recently, smart factories have attracted much attention as a result of the 4th Industrial Revolution. Existing factory automation technologies are generally designed for simple repetition without using vision sensors. Even small object assemblies are still dependent on manual work. To satisfy the needs for replacing the existing system with new technology such as bin picking and visual servoing, precision and real-time application should be core. Therefore in our work we focused on the core elements by using deep learning algorithm to detect and classify the target object for real-time and analyzing the object features. We chose YOLO CNN which is capable of real-time working and combining the two tasks as mentioned above though there are lots of good deep learning algorithms such as Mask R-CNN and Fast R-CNN. Then through the line and inside features extracted from target object, we can obtain final outline and estimate object posture.

• Steel and Composite Structures
• /
• v.41 no.5
• /
• pp.761-773
• /
• 2021

This study presents a 3D non-linear finite element (FE) assessment of dynamic soil-structure interaction (SSI). The numerical investigation has been performed on the time domain through a Finite Element (FE) system, while considering the nonlinear behavior of soil and the multi-directional nature of genuine seismic events. Later, the FE outcomes are analyzed to the recorded in-situ free-field and structural movements, emphasizing the numerical model's great result in duplicating the observed response. In this work, the soil response is simulated using an isotropic hardening elastic-plastic hysteretic model utilizing HSsmall. It is feasible to define the non-linear cycle response from small to large strain amplitudes through this model as well as for the shift in beginning stiffness with depth that happens during cyclic loading. One of the most difficult and unexpected tasks in resolving soil-structure interaction concerns is picking an appropriate ground motion predicted across an earthquake or assessing the geometrical abnormalities in the soil waves. Furthermore, an artificial neural network (ANN) has been utilized to properly forecast the non-linear behavior of soil and its multi-directional character, which demonstrated the accuracy of the ANN based on the RMSE and R² values. The total result of this research demonstrates that complicated dynamic soil-structure interaction processes may be addressed directly by passing the significant simplifications of well-established substructure techniques.