• Title/Summary/Keyword: learning with a robot

Search Result 492, Processing Time 0.036 seconds

Robot locomotion via IRPO based Actor-Critic Learning Method (IRPO 기반 Actor-Critic 학습 기법을 이용한 로봇이동)

  • Kim, Jong-Ho;Kang, Dae-Sung;Park, Joo-Young
    • Proceedings of the KIEE Conference
    • /
    • 2005.07d
    • /
    • pp.2933-2935
    • /
    • 2005
  • The IRPO(Intensive Randomized Policy Optimizer) algorithm is a recently developed tool in the area of reinforcement leaming. And it has been shown to be very successful in several application problems. To compare with a general RL method, IRPO has some difference in that policy utilizes the entire history of agent -environment interaction. The policy is derived from the history directly, not through any kind of a model of the environment. In this paper, we consider a robot-control problem utilizing a IRPO algorithm. We also developed a MATLAH-based animation program, by which the effectiveness of the training algorithms were observed.

  • PDF

A Research to realize a smart logistics warehouse system using 5G-based Logistics Automation Robot (5G 기반 물류 자동화 로봇을 활용한 스마트 물류 창고 시스템 구현을 위한 연구)

  • Park, Tae-uk;Yoon, Mahn-Suk
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2022.05a
    • /
    • pp.532-534
    • /
    • 2022
  • At a time when the 5G era is advancing beyond commercialization, places that used to handle simple logistics warehouse tasks are transforming into smart logistics warehouses by combining IT convergence technology and platforms. Smart logistics warehouses can accurately predict demand and inventory of products with AI, deep learning, and robot technologies based on 5G, and provide information on warehousing and warehousing status in real time. As the e-commerce market grows, the smart logistics sector is also growing rapidly. This paper implements a smart logistics warehouse system and studies and proposes a method of establishing a fast and accurate logistics system by utilizing 5G-based Logistics Automation Robot.

  • PDF

Dynamic tracking control of robot manipulators using vision system (비전 시스템을 이용한 로봇 머니퓰레이터의 동력학 추적 제어)

  • 한웅기;국태용
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1997.10a
    • /
    • pp.1816-1819
    • /
    • 1997
  • Using the vision system, robotic tasks in unstructured environments can be accompished, which reduces greatly the cost and steup time for the robotic system to fit to he well-defined and structured working environments. This paper proposes a dynamic control scheme for robot manipulator with eye-in-hand camera configuration. To perfom the tasks defined in the image plane, the camera motion Jacobian (image Jacobian) matrix is used to transform the camera motion to the objection position change. In addition, the dynamic learning controller is designed to improve the tracking performance of robotic system. the proposed control scheme is implemented for tasks of tracking moving objects and shown to outperform the conventional visual servo system in convergence and robustness to parameter uncertainty, disturbances, low sampling rate, etc.

  • PDF

An inverse dynamic torque control of a six-jointed robot arm using neural networks (신경회로를 이용한 6축 로보트의 역동력학적 토크 제어)

  • 조문증;오세영
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1990.10a
    • /
    • pp.1-6
    • /
    • 1990
  • Neural network is a computational model of ft biological nervous system developed ID exploit its intelligence and parallelism. Applying neural networks so robots creates many advantages over conventional control methods such as learning, real-time control, and continuous performance improvement through training and adaptation. In this paper, dynamic control of a six-link robot will be presented using neural networks. The neural network model used in this paper is the backpropagation network. Simulated control of the PUMA 560 am shows that it can move a high speed as well as adapt to unforseen load changes and sensor noise. The results are compared with the conventional PD control scheme.

  • PDF

Machine Classification in Ship Engine Rooms Using Transfer Learning (전이 학습을 이용한 선박 기관실 기기의 분류에 관한 연구)

  • Park, Kyung-Min
    • Journal of the Korean Society of Marine Environment & Safety
    • /
    • v.27 no.2
    • /
    • pp.363-368
    • /
    • 2021
  • Ship engine rooms have improved automation systems owing to the advancement of technology. However, there are many variables at sea, such as wind, waves, vibration, and equipment aging, which cause loosening, cutting, and leakage, which are not measured by automated systems. There are cases in which only one engineer is available for patrolling. This entails many risk factors in the engine room, where rotating equipment is operating at high temperature and high pressure. When the engineer patrols, he uses his five senses, with particular high dependence on vision. We hereby present a preliminary study to implement an engine-room patrol robot that detects and informs the machine room while a robot patrols the engine room. Images of ship engine-room equipment were classified using a convolutional neural network (CNN). After constructing the image dataset of the ship engine room, the network was trained with a pre-trained CNN model. Classification performance of the trained model showed high reproducibility. Images were visualized with a class activation map. Although it cannot be generalized because the amount of data was limited, it is thought that if the data of each ship were learned through transfer learning, a model suitable for the characteristics of each ship could be constructed with little time and cost expenditure.

Use of Support Vector Regression in Stable Trajectory Generation for Walking Humanoid Robots

  • Kim, Dong-Won;Seo, Sam-Jun;De Silva, Clarence W.;Park, Gwi-Tae
    • ETRI Journal
    • /
    • v.31 no.5
    • /
    • pp.565-575
    • /
    • 2009
  • This paper concerns the use of support vector regression (SVR), which is based on the kernel method for learning from examples, in identification of walking robots. To handle complex dynamics in humanoid robot and realize stable walking, this paper develops and implements two types of reference natural motions for a humanoid, namely, walking trajectories on a flat floor and on an ascending slope. Next, SVR is applied to model stable walking motions by considering these actual motions. Three kinds of kernels, namely, linear, polynomial, and radial basis function (RBF), are considered, and the results from these kernels are compared and evaluated. The results show that the SVR approach works well, and SVR with the RBF kernel function provides the best performance. Plus, it can be effectively applied to model and control a practical biped walking robot.

Evolvable Neural Networks Based on Developmental Models for Mobile Robot Navigation

  • Lee, Dong-Wook;Seo, Sang-Wook;Sim, Kwee-Bo
    • International Journal of Fuzzy Logic and Intelligent Systems
    • /
    • v.7 no.3
    • /
    • pp.176-181
    • /
    • 2007
  • This paper presents evolvable neural networks based on a developmental model for navigation control of autonomous mobile robots in dynamic operating environments. Bio-inspired mechanisms have been applied to autonomous design of artificial neural networks for solving practical problems. The proposed neural network architecture is grown from an initial developmental model by a set of production rules of the L-system that are represented by the DNA coding. The L-system is based on parallel rewriting mechanism motivated by the growth models of plants. DNA coding gives an effective method of expressing general production rules. Experiments show that the evolvable neural network designed by the production rules of the L-system develops into a controller for mobile robot navigation to avoid collisions with the obstacles.

A Robot Soccer Strategy and Tactic Using Fuzzy Logic (퍼지 로직을 적용한 로봇축구 전략 및 전술)

  • Lee, Jeong-Jun;Ji, Dong-Min;Lee, Won-Chang;Kang, Geun-Taek;Joo, Moon G.
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.16 no.1
    • /
    • pp.79-85
    • /
    • 2006
  • This paper presents a strategy and tactic for robot soccer using furry logic mediator that determines robot action depending on the positions and the roles of adjacent two robots. Conventional Q-learning algorithm, where the number of states increases exponentially with the number of robots, is not suitable for a robot soccer system, because it needs so much calculation that processing cannot be accomplished in real time. A modular Q-teaming algorithm reduces a number of states by partitioning the concerned area, where mediator algorithm for cooperation of robots is used additionally. The proposed scheme implements the mediator algorithm among robots by fuzzy logic system, where simple fuzzy rules make the calculation easy and hence proper for robot soccer system. The simulation of MiroSot shows the feasibility of the proposed scheme.

Key-point detection of fruit for automatic harvesting of oriental melon (참외 자동 수확을 위한 과일 주요 지점 검출)

  • Seung-Woo Kang;Jung-Hoon Yun;Yong-Sik Jeong;Kyung-Chul Kim;Dae-Hyun Lee
    • Journal of Drive and Control
    • /
    • v.21 no.2
    • /
    • pp.65-71
    • /
    • 2024
  • In this study, we suggested a key-point detection method for robot harvesting of oriental melon. Our suggested method could be used to detect the detachment part and major composition of oriental melon. We defined four points (harvesting point, calyx, center, bottom) based on tomato with characteristics similar to those of oriental melon. The evaluation of estimated key-points was conducted by pixel error and PDK (percentage of detected key-point) index. Results showed that the average pixel error was 18.26 ± 16.62 for the x coordinate and 17.74 ± 18.07 for the y coordinate. Considering the resolution of raw images, these pixel errors were not expected to have a serious impact. The PDK score was found to be 89.5% PDK@0.5 on average. It was possible to estimate oriental melon specific key-point. As a result of this research, we believe that the proposed method can contribute to the application of harvesting robot system.

Direct Learning Control for a Class of Multi-Input Multi-Output Nonlinear Systems (다입력 다출력 비선형시스템에 대한 직접학습제어)

  • 안현식
    • Journal of the Institute of Electronics Engineers of Korea SC
    • /
    • v.40 no.2
    • /
    • pp.19-25
    • /
    • 2003
  • For a class of multi-input multi-output nonlinear systems which perform a given task repetitively, an extended type of a direct leaning control (DLC) is proposed using the information on the (vector) relative degree of a multi-input multi-output system. Existing DLC methods are observed to be applied to a limited class of systems with the relative degree one and a new DLC law is suggested which can be applied to systems having higher relative degree. Using the proposed control law, the control input corresponding to the new desired output trajectory is synthesized directly based on the control inputs obtained from the learning process for other output trajectories. To show the validity and the performance of the proposed DLC, simulations are performed for trajectory tracking control of a two-axis SCARA robot.