International Journal of Computer Science & Network Security

International Journal of Computer Science & Network Security (국제컴퓨터통신보호논문지학회)
권호 표지
DOI QR코드

DOI QR Code

Classification of Objects using CNN-Based Vision and Lidar Fusion in Autonomous Vehicle Environment

  • G.komali (Department, R.V.R & J.C College of Engineering) ;
  • A.Sri Nagesh (Department, R.V.R & J.C College of Engineering)
  • Received : 2023.11.05
  • Published : 2023.11.30
Download PDF
⟨ Previous Next ⟩

Abstract

In the past decade, Autonomous Vehicle Systems (AVS) have advanced at an exponential rate, particularly due to improvements in artificial intelligence, which have had a significant impact on social as well as road safety and the future of transportation systems. The fusion of light detection and ranging (LiDAR) and camera data in real-time is known to be a crucial process in many applications, such as in autonomous driving, industrial automation and robotics. Especially in the case of autonomous vehicles, the efficient fusion of data from these two types of sensors is important to enabling the depth of objects as well as the classification of objects at short and long distances. This paper presents classification of objects using CNN based vision and Light Detection and Ranging (LIDAR) fusion in autonomous vehicles in the environment. This method is based on convolutional neural network (CNN) and image up sampling theory. By creating a point cloud of LIDAR data up sampling and converting into pixel-level depth information, depth information is connected with Red Green Blue data and fed into a deep CNN. The proposed method can obtain informative feature representation for object classification in autonomous vehicle environment using the integrated vision and LIDAR data. This method is adopted to guarantee both object classification accuracy and minimal loss. Experimental results show the effectiveness and efficiency of presented approach for objects classification.

Keywords

References

  1. Hrag-Harout Jebamikyous, (Member, Ieee), And Rasha Kashef, "Autonomous Vehicles Perception (AVP) Using Deep Learning: Modeling, Assessment, and Challenges", IEEE ACCESS, VOLUME 10, 2022, doi: 10.1109/ACCESS.2022.3144407 
  2. Javier Mendez, Miguel Molina, Noel Rodriguez, Manuel P. Cuellar and Diego P. Morales, "Camera-LiDAR Multi-Level Sensor Fusion for Target Detection at the Network Edge", Sensors 2021, 21, 3992, doi.org/10.3390/s21123992 
  3. Mingyu Park, Hyeonseok Kim and Seongkeun Park, "A Convolutional Neural Network-Based End-to-End Self-Driving Using LiDAR and Camera Fusion: Analysis Perspectives in a Real-World Environment", Electronics 2021, 10, 2608, doi.org/10.3390/electronics10212608 
  4. Yulong Cao, Ningfei Wang, Chaowei Xiao, Dawei Yang, Jin Fangz Ruigang Yangyy Qi Alfred Chen, Mingyan Liux Bo Li, "Invisible for both Camera and LiDAR: Security of Multi-Sensor Fusion based Perception in Autonomous Driving Under Physical-World Attacks", arXiv:2106.09249v1 [cs.CR] 17 Jun 2021 
  5. G Ajay Kumar , Jin Hee Lee, Jongrak Hwang, Jaehyeong Park, Sung Hoon Youn and Soon Kwon , "LiDAR and Camera Fusion Approach for Object Distance Estimation in Self-Driving Vehicles", Symmetry 2020, 12, 324; doi:10.3390/sym12020324 
  6. You Li and Javier Ibanez-Guzman, "Lidar for Autonomous Driving", IEEE SIGNAL PROCESSING MAGAZINE, 1053-5888/20(C)2020IEEE, Digital Object Identifier 10.1109/MSP.2020.2973615 
  7. Ajay Kumar, Jin Hee Lee, Jongrak Hwang, Jaehyeong Park, Sung Hoon Youn and Soon Kwon, "LiDAR and Camera Fusion Approach for Object Distance Estimation in Self-Driving Vehicles", Symmetry 2020, 12, 324; doi:10.3390/sym12020324 
  8. Jian Nie, Jun Yan, Huilin Yin, Lei Ren, and Qian Meng, "A Multimodality Fusion Deep Neural Network and Safety Test Strategy for Intelligent Vehicles", 2020 IEEE Transactions on Intelligent Vehicles 
  9. Yulong Cao, Chaowei Xiao, Benjamin Cyr, Yimeng Zhou, Won Park, Sara Rampazzi, Qi Alfred Chen, Z. Morley Mao, Kevin Fu, "Adversarial Sensor Attack on LiDAR-based Perception in 
  10. Mhafuzul Islam, Mashrur Chowdhury, Hongda Li, and Hongxin Hu, "Vision-Based Navigation of Autonomous