한국컴퓨터그래픽스학회논문지 (Journal of the Korea Computer Graphics Society)

  • 제27권5호
  • /
  • Pages.63-71
  • /
  • 2021
  • /
  • 1975-7883(pISSN)
  • /
  • 2383-529X(eISSN)
한국컴퓨터그래픽스학회 (Korea Computer Graphics Society)
권호 표지
DOI QR코드

DOI QR Code

카메라 기반 강화학습을 이용한 드론 장애물 회피 알고리즘

Drone Obstacle Avoidance Algorithm using Camera-based Reinforcement Learning

  • Jo, Si-hun (Department of Computer Engineering, Seokyeong University) ;
  • Kim, Tae-Young (Department of Computer Engineering, Seokyeong University)
  • 투고 : 2021.11.15
  • 심사 : 2021.11.26
  • 발행 : 2021.12.01
PDF 다운로드
⟨ 이전 논문 다음 논문 ⟩

초록

드론 자율비행 기술 중 장애물 회피는 드론이나 주변 환경의 손상을 방지하고 위험을 예방할 수 있도록 하는 매우 중요한 기술이다. LiDAR 센서 기반 장애물 회피방식은 비교적 높은 정확도를 보여 최근 연구에서 많이 활용되고 있지만, 단가가 높고 시각 정보에 대한 처리 능력이 제한적인 단점이 있다. 따라서 본 논문은 단가가 상대적으로 저렴하고 시각 정보를 이용한 확장성이 높은 카메라 기반 PPO(Proximal Policy Optimization) 강화학습을 이용한 드론의 장애물 회피 알고리즘을 제안한다. 3차원 공간상의 학습환경에서 드론, 장애물, 목표지점 등을 무작위로 위치시키고, 가상 카메라를 이용하여 전면에 설치된 스테레오 카메라를 통해 스테레오 영상정보를 얻은 다음 YOLOv4Tiny 객체검출을 수행한다. 그리고 난 후 스테레오 카메라의 삼각측량법을 통해 드론과 검출된 객체간의 거리를 측정한다. 이 거리를 기반으로 장애물 유무를 판단하고, 만약 장애물이면 패널티를 책정하고 목표지점이면 보상을 부여한다. 본 방법을 실험한 결과 카메라 기반 장애물 회피 알고리즘은 LiDAR 기반 장애물 회피 알고리즘과 비교하여 충분히 비슷한 수준의 높은 정확도와 평균 목표지점 도달시간을 보여 활용 가능성이 높음을 알 수 있었다.

Among drone autonomous flight technologies, obstacle avoidance is a very important technology that can prevent damage to drones or surrounding environments and prevent danger. Although the LiDAR sensor-based obstacle avoidance method shows relatively high accuracy and is widely used in recent studies, it has disadvantages of high unit price and limited processing capacity for visual information. Therefore, this paper proposes an obstacle avoidance algorithm for drones using camera-based PPO(Proximal Policy Optimization) reinforcement learning, which is relatively inexpensive and highly scalable using visual information. Drone, obstacles, target points, etc. are randomly located in a learning environment in the three-dimensional space, stereo images are obtained using a Unity camera, and then YOLov4Tiny object detection is performed. Next, the distance between the drone and the detected object is measured through triangulation of the stereo camera. Based on this distance, the presence or absence of obstacles is determined. Penalties are set if they are obstacles and rewards are given if they are target points. The experimennt of this method shows that a camera-based obstacle avoidance algorithm can be a sufficiently similar level of accuracy and average target point arrival time compared to a LiDAR-based obstacle avoidance algorithm, so it is highly likely to be used.

키워드

과제정보

본 연구는 2020학년도 서경대학교 교내연구비 지원에 의하여 이루어졌음.

참고문헌

  1. Lee, Thomas, Susan Mckeever, and Jane Courtney. "Flying Free: A Research Overview of Deep Learning in Drone Na vigation Autonomy," Drones 5.2 (2021): 52. https://doi.org/10.3390/drones5020052
  2. Jong-Hwan-Cha, "너무 비싼 센서 라이다, 자율주행 업계 '골머리'," 정보통신신문, https://www.koit.co.kr/news/articleView.html?idxno=80662, 2021.
  3. Rui Qian, Divyansh Garg, Yan Wang, Yurong You, Serge Belongie, Bharath Hariharan, Mark Campbell, Kilian Q. Weinberger, Wei-Lun Chao, "End-toEnd Pseudo-LiDAR for Image-Based 3D Object Detection," CVPR 2020, pp.5581-5890, 2020.
  4. Mingyu Ding, Yuqi Huo, Hongwei Yi, Zhe Wang,Jianping Shi, Zhiwu Lu, Ping Luo, "Learning Depth-Guided Convolutions for Monocular 3D Object Detection," CVPR 2020, pp. 1000-1001, 2020.
  5. 김지은, 이정우, "드론 기술 및 시장동향 보고서," 과학기술일자리진흥원 논문지, 2019. 6.
  6. Loquercio, Antonio, et al. "Dronet: Learning to fly by driving," IEEE Robotics and Automation Letters 3.2 (2018): 1088-1095. https://doi.org/10.1109/lra.2018.2795643
  7. Se-Hun-Kim, Ju-Young-Jeong, Min-Ho-Park, Hee-Je-Cho, Gi-Hwan Kwon, Soon-Ho Jung, "GPS 주행 및 초음파센서 회피기동 드론 시스템," 추계학술발표대회 논문집, pp. 1-4, 2020.
  8. Ui-Pil Chong, Woo-Jin An, Yearn-Min Kim, Jung-Chul Lee, "LiDAR 센서를 이용한 드론 자동 충돌방지 시스템," KiCSP, pp. 1-7, 2018.
  9. LiDAR(Light Detection And Ranging)의 원리, https://www.coreray.kr/35/?q=YToxOntzOjEyOiJrZXl3b3JkX3R5cGUiO3M6MzoiYWxsIjt9&bmode=view&idx=6215331&t=board&gclid=Cj0KCQjwssyJBhDXARIsAK98ITReExWCzNajblpKMvVe7ivDvC9EbOdwOxZJa5c2EK_rBn8odkJLgbAaAlieEALw_wcB, 2021.
  10. Edel Cashman, "라이다(LiDAR) 애플리케이션의 dToF 적용사례," Semiconductor Network, pp. 64-99, 2021.
  11. Techzizou, "YOLOv4 vs YOLOv4-tiny," Analytics Vidhya, https://medium.com/analytics-vidhya/yolov4-vs-yolov4-tiny97932b6ec8ec, 2021.
  12. Alexey Bochkovskiy and Chien-Yao Wang, Hong-Yuan Mark Liao, "YOLOv4: Optimal Speed and Accuracy of Object Detection," Institute of Information Science Academia Sinica, Taiwan, pp. 1-13, 2020.
  13. M.K Oh, Y.S Heo, H.S Kang, Y.S Kim, S.K Kim, "A long Distance Measurement Scheme with a Large Aperture Lens Based on Infrared Stereo Vision System for Ship Navigation Safety," Electronics and Telecommunications Trends, pp. 128-129, 2013.
  14. J. Shi, C. Tomasi, "Good features to track," IEEE Comput. Soc. Conf., Computer Vision and Pattern Recognition, pp. 593-600, 1994.
  15. H. Sunyoto, Wannes, and D. M Gavrila. "A Comparative Study of Fast Dense Stereo Vision Algorithms," IEEE Intelligent Vehicles Symposium, London, pp. 319-324, 2004.
  16. Unity, "ML-Agents Toolkit Overview," Unity, https://github.com/Unity-Technologies/ml-agents/blob/main/docs/ML-Agents-Overview.md, 2021.
  17. John Schulman, Filip Wolski, Prafulla Dhariwal, Alec Rad ford, Oleg Klimov, "Proximal Policy Optimization Algorithms," Arxiv, pp. 5, 2017.