• The Transactions of the Korean Institute of Electrical Engineers D
• /
• v.53 no.2
• /
• pp.127-134
• /
• 2004

In this paper, human motor behaving model based sensory motor coordination(SMC) algorithm is implemented on robotic grasping task. Compare to conventional SMC models which connect sensor to motor directly, the proposed method used biologically inspired human behaving system in conjunction with SMC algorithm for fast grasping force control of robot arm. To characterize various grasping objects, pressure sensors on hand gripper were used. Measured sensory data are simultaneously transferred to perceptual mechanism(PM) and long term memory(LTM), and then the sensory information is forwarded to the fastest channel among several information-processing flows in human motor system. In this model, two motor learning routes are proposed. One of the route uses PM and the other uses short term memory(STM) and LTM structure. Through motor learning procedure, successful information is transferred from STM to LTM. Also, LTM data are used for next moor plan as reference information. STM is designed to single layered perception neural network to generate fast motor plan and receive required data which comes from LTM. Experimental results showed that proposed method can control of the grasping force adaptable to various shapes and types of greasing objects, and also it showed quicker grasping-behavior lumining time compare to simple feedback system.

• Proceedings of the Korean Institute of Electrical and Electronic Material Engineers Conference
• /
• 2007.06a
• /
• pp.517-518
• /
• 2007

A method to recognize unpaved road region using a 3D depth measurement system is proposed for mobile robots. For autonomous maneuvering of mobile robots, recognition of obstacles or recognition of road region is the essential task. In this paper, the 3D depth measurement system which is composed of a rotating mirror, a line laser and mono-camera is employed to detect depth, where the laser light is reflected by the mirror and projected to the scene objects whose locations are to be determined. The obtained depth information is converted into an image. Such depth images of the road region represent even and plane while that of off-road region is irregular or textured. Therefore, the problem falls into a texture identification problem. Road region is detected employing a simple spatial differentiation technique to detect the plain textured area. Identification results of the diverse situation of Nonlinear trail are included in this paper.

• Transactions of the Korean Society of Mechanical Engineers
• /
• v.18 no.1
• /
• pp.1-11
• /
• 1994

This paper presents an intelligent robotic control method for chamferless parts mating by integrating fuzzy control and neural network. The successful assembly task requires an extremely high position accuracy and a good knowledge of mating parts. However, conventional assembly method alone makes it difficult to achieve satisfactory assembly performance because of the complexity and the uncertainties of the process and its environments such as not only the limitation of the devices performing the assembly but also imperfect knowledge of the parts being assembled. To cope with these problems, an intelligent robotic assembly method is proposed, which is composed of fuzzy controller and learning mechanism based upon neural net. In this method, fuzzy controller copes with the complexity and the uncertainties of the assembly process, while neural network enhances the assembly scheme so as to learn fuzzy rules from experience and adapt to changes in environment of uncertainty and imprecision. The performance of the proposed assembly scheme is evaluted through a series of experiments using SCARA robot. The results show that the proposed control method can be effectively applied to chamferless precision parts mating.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.16 no.6
• /
• pp.2044-2059
• /
• 2022

Recent works have shown that the geometric constraint can be harnessed to boost the performance of CNN-based camera localization. However, the existing strategies are limited to imposing image-level constraint between pose pairs, which is weak and coarse-gained. In this paper, we introduce a pixel-level epipolar geometry constraint to vanilla localization framework without the ground-truth 3D information. Dubbed EpiLoc, our method establishes the geometric relationship between pixels in different images by utilizing the epipolar geometry thus forcing the network to regress more accurate poses. We also propose a variant called EpiSingle to cope with non-sequential training images, which can construct the epipolar geometry constraint based on a single image in a self-supervised manner. Extensive experiments on the public indoor 7Scenes and outdoor RobotCar datasets show that the proposed pixel-level constraint is valuable, and helps our EpiLoc achieve state-of-the-art results in the end-to-end camera localization task.

• The Journal of Korea Robotics Society
• /
• v.17 no.4
• /
• pp.407-416
• /
• 2022

Multiple AMRs have been proved to be effective in improving warehouse productivity by eliminating workers' wasteful walking time. Although Multi-agent Path Finding (MAPF)-based solution is an optimal approach for this task, its deployment in practice is challenging mainly due to its imperfect plan-execution capabilities and insufficient computing resources for high-density environments. In this paper, we present a MAPF-based fleet management system architecture that robustly manages multiple robots by re-computing their paths whenever it is necessary. To achieve this, we defined four events that trigger our MAPF solver framework to generate new paths. These paths are then delivered to each AMR through ROS2 message topic. We also optimized a graph structure that effectively captures spatial information of the warehouse. By using this graph structure we can reduce computational burden while keeping its rescheduling functionality. With proposed MAPF-based fleet management system, we can control AMRs without collision or deadlock. We applied our fleet management system to the real logistics warehouse with 10 AMRs and observed that it works without a problem. We also present the usage statistic of adopting AMRs with proposed fleet management system to the warehouse. We show that it is useful over 25% of daily working time.

• The Journal of Korea Robotics Society
• /
• v.17 no.4
• /
• pp.417-424
• /
• 2022

In this paper, the developed trunk cargo unloading automation system is introduced, and the RGB-D sensor-based box loading situation recognition method and unloading plan applied to this system are suggested. First of all, it is necessary to recognize the position of the box in a truck. To do this, we first apply CNN-based YOLO, which can recognize objects in RGB images in real-time. Then, the normal vector of the center of the box is obtained using the depth image to reduce misrecognition in parts other than the box, and the inner wall of the truck in an image is removed. And a method of classifying the layers of the boxes according to the distance using the recognized depth information of the boxes is suggested. Given the coordinates of the boxes on the nearest layer, a method of generating the optimal path to take out the boxes the fastest using this information is introduced. In addition, kinematic analysis is performed to move the conveyor to the position of the box to be taken out of the truck, and kinematic analysis is also performed to control the robot arm that takes out the boxes. Finally, the effectiveness of the developed system and algorithm through a test bed is proved.

• Journal of the Korean Society for Precision Engineering
• /
• v.11 no.1
• /
• pp.80-88
• /
• 1994

In the automation of rigid parts mating process with the intelligent robots, Peg-In-Hole is the most available task since inserting is some analytic and needs suitable range of forces that can be controlled by induatrial manipulators. In this Peg-In-Hole process, it is very important to identify the contact state between tow parts, peg and hole, to build the strategies for robot motion that leads to avoid the jamming condition occurs during insertion process. In this paper, we adpopted 3 parameters for identification, lFzl, lFxy/Fzl, and lMxy/Fxyl, derived from axes value of Whitney's jamming diagram. Also, we defined the fuzzy membership functions for these parameters and developed the identification algorithm based on fuzzy inference method of max-product. As an experimental result, we obtained about 96% of identification ratio that could be raised up to industrial requirements by further research.

• Journal of Information Processing Systems
• /
• v.19 no.6
• /
• pp.730-744
• /
• 2023

The topic of this paper is the recognition of human activities using egocentric vision, particularly captured by body-worn cameras, which could be helpful for video surveillance, automatic search and video indexing. This being the case, it could also be helpful in assistance to elderly and frail persons for revolutionizing and improving their lives. The process throws up the task of human activities recognition remaining problematic, because of the important variations, where it is realized through the use of an external device, similar to a robot, as a personal assistant. The inferred information is used both online to assist the person, and offline to support the personal assistant. With our proposed method being robust against the various factors of variability problem in action executions, the major purpose of this paper is to perform an efficient and simple recognition method from egocentric camera data only using convolutional neural network and deep learning. In terms of accuracy improvement, simulation results outperform the current state of the art by a significant margin of 61% when using egocentric camera data only, more than 44% when using egocentric camera and several stationary cameras data and more than 12% when using both inertial measurement unit (IMU) and egocentric camera data.

• IEMEK Journal of Embedded Systems and Applications
• /
• v.19 no.1
• /
• pp.1-8
• /
• 2024

Robotic arms have been widely utilized in various labor-intensive industries such as manufacturing, agriculture, and food services, contributing to increasing productivity. In the development of industrial robotic arms, camera sensors have many advantages due to their cost-effectiveness and small sizes. However, estimating object positions is a challenging problem, and it critically affects to the robustness of object manipulation functions. This paper proposes a method for estimating the 3D positions of objects, and it is applied to a pick-and-place task. A deep learning model is utilized to detect 2D bounding boxes in the image plane, and the pinhole camera model is employed to compute the object positions. To improve the robustness of measuring the 3D positions of objects, we analyze the effect of lens distortion and introduce a false positive filtering process. Experiments were conducted on a real-world scenario for moving medicine bottles by using a camera-based manipulator. Experimental results demonstrated that the distortion removal and false positive filtering are effective to improve the position estimation precision and the manipulation success rate.

• Journal of Korea Society of Industrial Information Systems
• /
• v.19 no.5
• /
• pp.15-24
• /
• 2014

In 2005, there was a partial revision of the Act on the Promotion of Education for the Handicapped people, so that students with health impairments would be able to receive special education support. Since the amendment of the bill, to support them classified into weak people in education, education support systems have been proposed and settled so that they may receive the support for free. According to the pre-study, after the amendment of this bill, there has been many studies on the form of educational service to support them, and recently, there have been a lot of researches to investigate their satisfaction with the current services and draw its problems. And yet these studies have been carried out by the preceeding researchers at the drawing of problems, but have a limitation to present fundamental countermeasures to the problems. Therefore, this study attempted to understand the meaning of health impairment through the pre-study and investigate the forms of the services currently supporting them and analyze the problem of each service. In addition, to solve the identified problems, a new support system was proposed. In order to confirm the performance of the system, we design the user satisfaction survey composed of a Likert 5-point scale per each question, and to make the task, comparing stories and clapping for increasing quality of their subjective evaluation about the image and voice transmission when the user uses it. As a result, in the overall evaluation of the robot system, the average score of each question was recorded to 4.31 points, and through the two tasks, it was found that there were effective data transmission of image and voice.