Journal of the Korean Institute of Intelligent Systems (한국지능시스템학회논문지)

Korean Institute of Intelligent Systems (한국지능시스템학회)
권호 표지
DOI QR코드

DOI QR Code

Behavior Learning and Evolution of Swarm Robot based on Harmony Search Algorithm

Harmony Search 알고리즘 기반 군집로봇의 행동학습 및 진화

  • 김민경 (중앙대학교 전자전기공학부) ;
  • 고광은 (중앙대학교 전자전기공학부) ;
  • 심귀보 (중앙대학교 전자전기공학부)
  • Received : 2010.04.03
  • Accepted : 2010.05.19
  • Published : 2010.06.25
Download PDF
⟨ Previous Next ⟩

Abstract

Each robot decides and behaviors themselves surrounding circumstances in the swarm robot system. Robots have to conduct tasks allowed through cooperation with other robots. Therefore each robot should have the ability to learn and evolve in order to adapt to a changing environment. In this paper, we proposed learning based on Q-learning algorithm and evolutionary using Harmony Search algorithm and are trying to improve the accuracy using Harmony Search Algorithm, not the Genetic Algorithm. We verify that swarm robot has improved the ability to perform the task.

군집 로봇시스템에서 개개의 로봇은 스스로 주위의 환경과 자신의 상태를 스스로 판단하여 행동하고, 필요에 따라서는 다른 로봇과 협조를 통하여 임의의 주어진 임무를 수행할 수 있어야 한다. 따라서 각 로봇 개체는 동적으로 변화하는 환경에 잘 적응할 수 있도록 하기 위한 학습 및 진화능력을 갖는 것이 필수적이다. 이를 위하여 본 논문에서는 Q-learning 알고리즘을 기반으로 하는 학습과 Harmony Search 알고리즘을 이용한 진화방법을 제안하였으며, 유전 알고리즘이 아닌 Harmony Search 알고리즘을 제안함으로써 정확도를 높이고자 하였다. 그 결과를 이용하여 군집 로봇의 로봇 개체 환경변화에 따른 임무 수행 능력의 향상을 검증한다.

Keywords

References

  1. http://www.robhaz.com, "ROBHAZ"
  2. "위험 작업용 로봇 기술 동향", 한국 과학 기술 정보 연구원, 2004
  3. http://mars.jpl.nasa.gov "Mars Exploration program"
  4. G. Beni, "From Swarm Intelligence to Swarm Robot", Swarm Robotics WS 2004, LNCS 3342, pp. 1-9, 2005.
  5. S. Garnier, J. Gautrais and G. Theraulaz, "The Biological Principals of Swarm Intelligence", Swarm Intelligence, Springer New york, Vol.1, No.1, pp.3-31, 2007. https://doi.org/10.1007/s11721-007-0004-y
  6. 이동욱, 심귀보, “인공면역계 기반의 자율이동로봇군의 협조행동전략 결정,” 대한전자공학회 논문지, 제35권 S편 제 3호, pp. 102-109, 1998. 3.
  7. 심귀보, 이동욱, “군집 로봇의 협조행동을 위한 로봇 개체의 행동학습과 진화”, 퍼지 및 지능시스템학회 논문지 2006, Vol. 16, No. 2, pp. 131-137.
  8. S. Doctor, G. K. Venayagamoorthy and V. G. Gudise, "Optimal PSO for Collective Robotics Search Applications", Proceedings of the 2004 IEEE Congress on Evolutionary Computation, Vol. 2, pp. 1390-1395, 2004.
  9. J. M. Hereford, "A Distributed Particle Swarm Optimization Algorithm for Swarm Robotic Application", Proceedings of the 2006 IEEE Congress on Evolutionary Computation, pp. 1678-1685, 2006.
  10. W, Jatmiko, K. Sekiyama and T. Fukuda, "A PSO-based Mobile Sensor Network for Odor Source Localization in Dynamic Environment: Theory, Simulation and Measurement", Proceedings of the 2006 IEEE Congress on Evolurionary Computation, pp. 1036-1043, 2006.
  11. Geem, Z. W., Kim, J. H., and Loganathan, G. V. “A New Heuristic Optimization Algorithm: Harmony Search.” Simulation, 76(2), pp. 60-68, 2001. https://doi.org/10.1177/003754970107600201
  12. Lee, K.S., Geem, Z.W. “A new meta-heuristic algorithm for continuous engineering optimization” harmony search theory and practice. Computer Methods in Applied Mechanics and engineering 194, pp. 3902-3922, 2005. https://doi.org/10.1016/j.cma.2004.09.007
  13. Lee, K.S., Geem, Z.W. “A new structural optimization method based on the harmony search algorithm.” Computers and Structures 82, pp. 781-798, 2004 https://doi.org/10.1016/j.compstruc.2004.01.002
  14. Geem, Z.W., Kim, J.H., “Loganathan Journal of Modeling and Simulation” 22, pp. 125-133, 2002.
  15. Geem, Z.W. “Harmony search algorithm for solving sudoku.” In: Apolloni, B., Howlett, R.J., Jain, L.(eds.) KES 2007, Part I. LNCS(LNAI), vol.4692, pp. 371-378. Springer, Heidelberg, 2007.
  16. M. Fesanghary a,*, M. Mahdavi b, M. Minary-Jolandan c, Y. Alizadeh a "Hybridizing harmony search algorithm with sequential quadratic programming for engineering optimization problems" https://doi.org/10.1016/j.cma.2008.02.006
  17. K.S. Lee, Z.W. Geem, A new meta-heuristic algorithm for continues engineering optimization: harmony search theory and practice, Computer Methods in Applied Mechanics and engineering 194, pp. 3902–.3933, 2004. https://doi.org/10.1016/j.cma.2004.09.007
  18. Homaifar, A., Qi, C. X. and Lai, S. H. “Constrained Optimization via Genetic Algorithms.” SIMULATION, Vol. 62, No. 4, pp 242-254, 1994. https://doi.org/10.1177/003754979406200405

Cited by

  1. An Advanced Path Planning of Clustered Multiple Robots Based on Flexible Formation vol.29, pp.12, 2012, https://doi.org/10.7736/KSPE.2012.29.12.1321
  2. Evolution of Behavioral Logic of Artificial Individuals Using Cell-level Evolution Framework vol.25, pp.1, 2015, https://doi.org/10.5391/JKIIS.2015.25.1.022