• 제목/요약/키워드: area-based action making

검색결과 23건 처리시간 0.03초

Object tracking algorithm of Swarm Robot System for using Polygon based Q-learning and parallel SVM

  • Seo, Snag-Wook;Yang, Hyun-Chang;Sim, Kwee-Bo
    • International Journal of Fuzzy Logic and Intelligent Systems
    • /
    • 제8권3호
    • /
    • pp.220-224
    • /
    • 2008
  • This paper presents the polygon-based Q-leaning and Parallel SVM algorithm for object search with multiple robots. We organized an experimental environment with one hundred mobile robots, two hundred obstacles, and ten objects. Then we sent the robots to a hallway, where some obstacles were lying about, to search for a hidden object. In experiment, we used four different control methods: a random search, a fusion model with Distance-based action making (DBAM) and Area-based action making (ABAM) process to determine the next action of the robots, and hexagon-based Q-learning, and dodecagon-based Q-learning and parallel SVM algorithm to enhance the fusion model with Distance-based action making (DBAM) and Area-based action making (ABAM) process. In this paper, the result show that dodecagon-based Q-learning and parallel SVM algorithm is better than the other algorithm to tracking for object.

다수 로봇의 목표물 탐색을 위한 Area-Based Q-learning 알고리즘 (Area-Based Q-learning Algorithm to Search Target Object of Multiple Robots)

  • 윤한얼;심귀보
    • 한국지능시스템학회논문지
    • /
    • 제15권4호
    • /
    • pp.406-411
    • /
    • 2005
  • 본 논문에서는 다수 로봇의 목표물 탐색을 위한 area-based Q-learning 알고리즘에 대해 논한다. 선험적 정보가 없는 공간내의 목표물을 탐색하기 위해, 로봇들은 주위의 환경을 인식하고 스스로 다음 행동에 대한 결정을 내릴 수 있어야 한다. Area-based Q-learning에서, 먼저 각 로봇은 정육각형을 이루도록 배치된 6개의 적외선 센서를 통해 자신과 주변 환경 사이의 거리를 구한다. 다음으로 이 거리데이터들로부터 6방향의 면적(area)을 계산하여, 보다 넓은 행동반경을 보장해주는 영역으로 이동(action)한다. 이동 후 다시 6방향의 면적을 계산, 이전 상태에서의 이동에 대한 Q-value를 업데이트 한다. 본 논문의 실험에서는 5대의 로봇을 이용하여 선험적 지식이 없고, 장애물이 놓여 있는 공간에서의 목표물 탐색을 시도하였다. 결론에서는 3개의 제어 알고리즘-랜덤 탐색, area-based action making (ABAM), hexagonal area-based Q-learning - 을 이용하여 목표물 탐색을 시도한 결과를 보인다.

Hexagon-Based Q-Learning Algorithm and Applications

  • Yang, Hyun-Chang;Kim, Ho-Duck;Yoon, Han-Ul;Jang, In-Hun;Sim, Kwee-Bo
    • International Journal of Control, Automation, and Systems
    • /
    • 제5권5호
    • /
    • pp.570-576
    • /
    • 2007
  • This paper presents a hexagon-based Q-leaning algorithm to find a hidden targer object with multiple robots. An experimental environment was designed with five small mobile robots, obstacles, and a target object. Robots went in search of a target object while navigating in a hallway where obstacles were strategically placed. This experiment employed two control algorithms: an area-based action making (ABAM) process to determine the next action of the robots and hexagon-based Q-learning to enhance the area-based action making process.

Strategy of Object Search for Distributed Autonomous Robotic Systems

  • Kim Ho-Duck;Yoon Han-Ul;Sim Kwee-Bo
    • International Journal of Fuzzy Logic and Intelligent Systems
    • /
    • 제6권3호
    • /
    • pp.264-269
    • /
    • 2006
  • This paper presents the strategy for searching a hidden object in an unknown area for using by multiple distributed autonomous robotic systems (DARS). To search the target in Markovian space, DARS should recognize th ε ir surrounding at where they are located and generate some rules to act upon by themselves. First of all, DARS obtain 6-distances from itself to environment by infrared sensor which are hexagonally allocated around itself. Second, it calculates 6-areas with those distances then take an action, i.e., turn and move toward where the widest space will be guaranteed. After the action is taken, the value of Q will be updated by relative formula at the state. We set up an experimental environment with five small mobile robots, obstacles, and a target object, and tried to research for a target object while navigating in a un known hallway where some obstacles were placed. In the end of this paper, we present the results of three algorithms - a random search, an area-based action making process to determine the next action of the robot and hexagon-based Q-learning to enhance the area-based action making process.

The Hidden Object Searching Method for Distributed Autonomous Robotic Systems

  • Yoon, Han-Ul;Lee, Dong-Hoon;Sim, Kwee-Bo
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 제어로봇시스템학회 2005년도 ICCAS
    • /
    • pp.1044-1047
    • /
    • 2005
  • In this paper, we present the strategy of object search for distributed autonomous robotic systems (DARS). The DARS are the systems that consist of multiple autonomous robotic agents to whom required functions are distributed. For instance, the agents should recognize their surrounding at where they are located and generate some rules to act upon by themselves. In this paper, we introduce the strategy for multiple DARS robots to search a hidden object at the unknown area. First, we present an area-based action making process to determine the direction change of the robots during their maneuvers. Second, we also present Q learning adaptation to enhance the area-based action making process. Third, we introduce the coordinate system to represent a robot's current location. In the end of this paper, we show experimental results using hexagon-based Q learning to find the hidden object.

  • PDF

12각형 기반의 Q-learning과 SVM을 이용한 군집로봇의 목표물 추적 알고리즘 (Object tracking algorithm of Swarm Robot System for using SVM and Dodecagon based Q-learning)

  • 서상욱;양현창;심귀보
    • 한국지능시스템학회논문지
    • /
    • 제18권3호
    • /
    • pp.291-296
    • /
    • 2008
  • 본 논문에서는 군집로봇시스템에서 목표물 추적을 위하여 SVM을 이용한 12각형 기반의 Q-learning 알고리즘을 제안한다. 제안한 알고리즘의 유효성을 보이기 위해 본 논문에서는 여러 대의 로봇과 장애물 그리고 하나의 목표물로 정하고, 각각의 로봇이 숨겨진 목표물을 찾아내는 실험을 가정하여 무작위, DBAM과 AMAB의 융합 모델, 마지막으로는 본 논문에서 제안한 SVM과 12각형 기반의 Q-learning 알고리즘을 이용하여 실험을 수행하고, 이 3가지 방법을 비교하여 본 논문의 유효성을 검증하였다.

다각형 기반의 Q-Learning과 Cascade SVM을 이용한 군집로봇의 목표물 추적 알고리즘 (Object Tracking Algorithm of Swarm Robot System for using Polygon Based Q-Learning and Cascade SVM)

  • 서상욱;양현창;심귀보
    • 대한임베디드공학회논문지
    • /
    • 제3권2호
    • /
    • pp.119-125
    • /
    • 2008
  • This paper presents the polygon-based Q-leaning and Cascade Support Vector Machine algorithm for object search with multiple robots. We organized an experimental environment with ten mobile robots, twenty five obstacles, and an object, and then we sent the robots to a hallway, where some obstacles were lying about, to search for a hidden object. In experiment, we used four different control methods: a random search, a fusion model with Distance-based action making (DBAM) and Area-based action making (ABAM) process to determine the next action of the robots, and hexagon-based Q-learning and dodecagon-based Q-learning and Cascade SVM to enhance the fusion model with DBAM and ABAM process.

  • PDF

유비쿼터스 지능형 공간에서의 로봇 에이전트 설계 및 응용 (Robotic Agent Design and Application in the Ubiquitous Intelligent Space)

  • 윤한얼;황세희;김대욱;이동훈;심귀보
    • 제어로봇시스템학회논문지
    • /
    • 제11권12호
    • /
    • pp.1039-1044
    • /
    • 2005
  • This paper presents a robotic agent design and application in the ubiquitous intelligent space. We set up an experimental environment with Bluetooth host, Bluetooth client, furniture and home appliance, and robotic agents. First, the agents basically performed patrol guard to detect unexpected penetration, and to keep home safely from gas-leakage, electric leakage, and so on. They were out to patrol fur a robbery while navigating in a living room and a private room. In this task, we used an area-based action making and a hexagon-based Q-learning to control the agents. Second, the agents communicate with Bluetooth host device to access and control a home appliance. The Bluetooth host offers a manual control to person by inquiring a client robot when one would like to check some place especially. In this exercise, we organize asynchronous connection less (ACL) between the host and the client robots and control the robot maneuver by Bluetooth host controller interface (HCI).

시·공간의 환경변화에 따른 행태 결정에 관한 연구 (A Study on the Action decision by Changing of Condition of Time-Space)

  • 김보라;홍일태
    • 한국실내디자인학회논문집
    • /
    • 제22권6호
    • /
    • pp.98-107
    • /
    • 2013
  • Space evolves from the concept of deterministic static location to a dynamic, connected area through the interference of the user. While this does incorporate physical changes of the space, it also reflects the changes of the program or characteristics of the space through the actions and changes of the user. Therefore, in this study we plan to review the characteristic of time appearing within space, thereby discussing the impact of changing of condition in time-space to the decision making of the user. Further, we plan to analyze the specific causes, and subsequently introduce a new perspective over space. In order to achieve this, we need to first understand the reason why the attribute of time needs to be discussed in space, and perform a fundamental analysis of factors for the changes of the users' actions following changes in space-time condition. This means that space is not limited to merely satisfying its innate objective as an area, but may have a basis for modifying its role to help the decision making of the users caused by changes in space-time conditions. Accordingly, we analyze the factors for change of environment that can appear in space following the flow of time caused by correlation in space-time, as well as psychological factors and variables for decision making by the users. Based on this, we analyze cases to study the influence of condition changes in time-space on the action decision judgment of the users. Through this, we propose that the actions of the users can be determined following changes in time-space conditions, and discuss the need for changes in our perspective of space.

AHP를 이용한 스마트 공급망 구축을 위한 주요 성공요인 분석 (Analysis of Key Success Factors for Building a Smart Supply Chain Using AHP)

  • 박철수
    • Journal of Information Technology Applications and Management
    • /
    • 제30권6호
    • /
    • pp.1-15
    • /
    • 2023
  • With the advent of the Fourth Industrial Revolution, propelled by digital technology, we are transitioning into an era of hyperconnectivity, where everything and objects are becoming interconnected. A smart supply chain refers to a supply chain system where various sensors and RFID tags are attached to objects such as machinery and products used in the manufacturing and transportation of goods. These sensors and tags collect and analyze process data related to the products, providing meaningful information for operational use and decision-making in the supply chain. Before the spread of COVID-19, the fundamental principles of supply chain management were centered around 'cost minimization' and 'high efficiency.' A smart supply chain overcomes the linear delayed action-reaction processes of traditional supply chains by adopting real-time data for better decision-making based on information, providing greater transparency, and enabling enhanced collaboration across the entire supply chain. Therefore, in this study, a hierarchical model for building a smart supply chain was constructed to systematically derive the importance of key factors that should be strategically considered in the construction of a smart supply chain, based on the major factors identified in previous research. We applied AHP (Analytical Hierarchy Process) techniques to identify urgent improvement areas in smart SCM initiatives. The analysis results showed that the external supply chain integration is the most urgent area to be improved in smart SCM initiatives.