Journal of the Korean Society of Marine Environment & Safety (해양환경안전학회지)

The Korean Society of Marine Environment and safety (해양환경안전학회)
권호 표지
DOI QR코드

DOI QR Code

A Study on Image-Based Mobile Robot Driving on Ship Deck

선박 갑판에서 이미지 기반 이동로봇 주행에 관한 연구

  • Seon-Deok Kim (Division of Maritime Engineering, Mokpo National Maritime University) ;
  • Kyung-Min Park (Division of Coast Guard, Mokpo National Maritime University) ;
  • Seung-Yeol Wang (Division of Ocean System Engineering, Mokpo National Maritime University)
  • 김선덕 (목포해양대학교 기관시스템공학부) ;
  • 박경민 (목포해양대학교 해양경찰학부) ;
  • 왕승열 (목포해양대학교 해양시스템공학과)
  • Received : 2022.09.22
  • Accepted : 2022.12.28
  • Published : 2022.12.31
Download PDF
⟨ Previous Next ⟩

Abstract

Ships tend to be larger to increase the efficiency of cargo transportation. Larger ships lead to increased travel time for ship workers, increased work intensity, and reduced work efficiency. Problems such as increased work intensity are reducing the influx of young people into labor, along with the phenomenon of avoidance of high intensity labor by the younger generation. In addition, the rapid aging of the population and decrease in the young labor force aggravate the labor shortage problem in the maritime industry. To overcome this, the maritime industry has recently introduced technologies such as an intelligent production design platform and a smart production operation management system, and a smart autonomous logistics system in one of these technologies. The smart autonomous logistics system is a technology that delivers various goods using intelligent mobile robots, and enables the robot to drive itself by using sensors such as lidar and camera. Therefore, in this paper, it was checked whether the mobile robot could autonomously drive to the stop sign by detecting the passage way of the ship deck. The autonomous driving was performed by detecting the passage way of the ship deck through the camera mounted on the mobile robot based on the data learned through Nvidia's End-to-end learning. The mobile robot was stopped by checking the stop sign using SSD MobileNetV2. The experiment was repeated five times in which the mobile robot autonomously drives to the stop sign without deviation from the ship deck passage way at a distance of about 70m. As a result of the experiment, it was confirmed that the mobile robot was driven without deviation from passage way. If the smart autonomous logistics system to which this result is applied is used in the marine industry, it is thought that the stability, reduction of labor force, and work efficiency will be improved when workers work.

선박은 화물 운송의 효율을 증대시키기 위해 대형화되는 추세이다. 선박 대형화는 선박 작업자의 이동시간 증가, 업무 강도 증가 및 작업 효율 저하 등으로 이어진다. 작업 업무 강도 증가 등의 문제는 젊은 세대의 고강도 노동 기피 현상과 맞물러 젊은 세대의 노동력 유입을 감소시키고 있다. 또한 급속한 인구 노령화도 젊은 세대의 노동력 유입 감소와 복합적으로 작용하면서 해양산업 분야의 인력 부족 문제는 극심해지는 추세이다. 해양산업 분야는 인력 부족 문제를 극복하기 위해 지능형 생산설계 플랫폼, 스마트 생산 운영관리 시스템 등의 기술을 도입하고 있으며, 스마트 자율물류 시스템도 이러한 기술 중의 하나이다. 스마트 자율물류 시스템은 각종 물품들을 지능형 이동로봇을 활용하여 전달하는 기술로서 라이다, 카메라 등의 센서를 활용해 로봇 스스로 주행이 가능하도록 하는 것이다. 이에 본 논문에서는 이동로봇이 선박 갑판의 통행로를 감지하여 stop sign이 있는 곳까지 자율적으로 주행할 수 있는지를 확인하였다. 자율주행은 Nvidia의 End-to-end learning을 통해 학습한 데이터를 기반으로, 이동로봇에 장착된 카메라를 통해 선박 갑판의 통행로를 감지하여 수행하였다. 이동로봇의 정지는 SSD MobileNetV2를 이용하여 stop sign을 확인하여 수행하였다. 실험은 약 70m 거리의 선박 갑판 통행로를 이동로봇이 이탈 없이 주행 후 stop sign을 확인하여 정지하는지를 5회 반복 실험하였으며, 실험 결과 경로이탈 없이 주행하는 결과를 얻을 수 있었다. 이 결과를 적용한 스마트 자율물류 시스템이 산업현장에 적용된다면 작업자가 작업 시 안정성, 노동력 감소, 작업 효율이 향상될 것으로 사료된다.

Keywords

Acknowledgement

이 논문은 2022년도 정부(산업통상자원부)의 재원으로 한국산업기술진흥원의 지원을 받아 수행된 연구임[P0017006, 2022년 산업혁신인재성장지원사업].

References

  1. Baek, T. H., D. G. Oh, Y. G. Jeong, R. R. Lee, and Y. Wo. Gwon(2018), Technology fields and core technologies for smart shipbuilding process in shipyard, The Society of Naval Architects of Korea, Vol. 55, No. 4, pp. 9-15.
  2. Bojarski, M., D. Testa, D. Dworakowski, B. Firner, B. Flepp, P. Goyal, L. Jackel, M. Monfort, U. Muller, J. Zhang, X. Zhang, J. Zhao, and K. Zieba(2016), End to End Learning for Self-Driving Cars, arXiv:1604.07316v1 [cs.CV].
  3. Howard, A. G., M. Zhu, B. Chen, D. Kalenichenko, W. Wang, T. Weyand, M. Andreetto, and H. Adam(2017), MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications, arXiv:1704.04861v1 [cs.CV].
  4. Hwang, S. Y. and K. S. Noh(2019), Robot driving technology for industrial logistics transport, The Korean Society of Mechanical Engineers, Vol. 59, No. 5, pp. 27-31.
  5. Kang, Y.(2020), Research on SSD base network, IOP Conf. Series: Materials Science and Engineering, 2020, 072031, doi:10.1088/1757-899X/768/7/072031
  6. Kim, J. D., K. K. Kwon, and S. J. Lee(2012), Trends and Applications on Lidar Sensor technology, Electronics and Telecommunications Research Institue, Vol. 27, No. 6, pp. 134-143.
  7. Lim, H.(2021), Overview of Image-based Recognition AI technology for Autonomous Vehicles, Journal of the Korea Institute of Information and Communication Engineering, Vol. 25, No. 8, pp. 1117-1123.
  8. Park, K., M. Lee, S. Noh, S. Park, C. Lee, J. Woo, and K. Jung(2019), Object recognition deep learning network and implementation method for autonomous vehicles, Institution of Electronics and Telecommunication Engineers, Vol. 46, No. 1, pp. 18-29.
  9. Park, S. J. and T. K. Yang(2013), A Study on Design of Intelligent Mobile Robot based on Localization Sensor for Unmanned Transport Logistics, Journal of Korean Institute of Information Technology, Vol. 11, No. 9, pp. 7-13.
  10. Sandler, M., A. Howard, M. Zhu, A. Zhmoginov, and L. Chen(2019), MobileNetV2: Inverted Residuals and Linear Bottlenecks, arXiv:1801.04381v4 [cs.CV]
  11. Song, H. S., S. Kim, and S. Park(2019), A Study on E2E Deep Learning based Autonomous Navigation Robot from Virtual Environment to Real Environment using Transfer Leaning, Journal of Institute of Control, Robotics and Systems, Vol. 25, No. 5, pp. 381-387. https://doi.org/10.5302/J.ICROS.2019.19.0018
  12. Wei, L., D. Anguelov, D. Erhan, C. Szegedy, S. Reed, C. Fu, and A. C. Berg(2016), SSD:Single Shot MultiBox Detector, arXiv:1512.02325v8 [cs.CV].
  13. Weon, I. S. and S. G. Lee(2019), Environment Recognition Based on Multi-sensor Fusion for Autonomous Driving Vehicles, Journal of Institute of Control, Robotics and Systems, Vol. 25, No. 2, pp. 125-131. https://doi.org/10.5302/J.ICROS.2019.18.0128
  14. Zou, Z., Z. Shi. Y. Guo, and J. Ye(2019), Object Detection in 20 Years: A Survey, arXiv:1905.05055v2 [cs.CV].