International Journal of Computer Science & Network Security

International Journal of Computer Science & Network Security (국제컴퓨터통신보호논문지학회)
권호 표지
DOI QR코드

DOI QR Code

Traffic Signal Recognition System Based on Color and Time for Visually Impaired

  • P. Kamakshi (Kakatiya Institute of Technology & Science Warangal)
  • Received : 2023.04.05
  • Published : 2023.04.30
Download PDF
⟨ Previous Next ⟩

Abstract

Nowadays, a blind man finds it very difficult to cross the roads. They should be very vigilant with every step they take. To resolve this problem, Convolutional Neural Networks(CNN) is a best method to analyse the data and automate the model without intervention of human being. In this work, a traffic signal recognition system is designed using CNN for the visually impaired. To provide a safe walking environment, a voice message is given according to light state and timer state at that instance. The developed model consists of two phases, in the first phase the CNN model is trained to classify different images captured from traffic signals. Common Objects in Context (COCO) labelled dataset is used, which includes images of different classes like traffic lights, bicycles, cars etc. The traffic light object will be detected using this labelled dataset with help of object detection model. The CNN model detects the color of the traffic light and timer displayed on the traffic image. In the second phase, from the detected color of the light and timer value a text message is generated and sent to the text-to-speech conversion model to make voice guidance for the blind person. The developed traffic light recognition model recognizes traffic light color and countdown timer displayed on the signal for safe signal crossing. The countdown timer displayed on the signal was not considered in existing models which is very useful. The proposed model has given accurate results in different scenarios when compared to other models.

Keywords

References

  1. https://www.who.int/news-room/fact-sheets/detail/blindness-and-visual-impairment 
  2. S. Sankaran et al., "A Survey Report on the Emerging Technologies on Assistive Device for Visually Challenged People for Analyzing Traffic Rules," 2020 International Conference on Communication and Signal Processing (ICCSP), 2020, pp. 0582-0587, doi: 10.1109/ICCSP48568.2020.9182335. 
  3. Park, Huijin, et al. "Implementation of Crosswalk Lights Recognition System for the Blind's Safety." 2019 IEEE Eurasia Conference on IOT, Communication and Engineering (ECICE). IEEE, 2019. 
  4. Ihejimba, Chikadibia, and Rym Z. Wenkstern. "DetectSignal: A Cloud-Based Traffic Signal Notification System for the Blind and Visually Impaired." 2020 IEEE International Smart Cities Conference (ISC2). IEEE, 2020. 
  5. Angin, Pelin, and Bharat K. Bhargava. "Real-time mobile-cloud computing for context-aware blind navigation." International Journal of Next-Generation Computing 2.2 (2011): 405-414. 
  6. Bhargava, Bharat, PelinAngin, and Lian Duan. "A mobile-cloud pedestrian crossing guide for the blind." International Conference on Advances in Computing & Communication. 2011. 
  7. Yu, Yang, et al. "Design and Implementation of Traffic-Light Signal Recognition System at Intersection." 2020 IEEE 3rd International Conference on Computer and Communication Engineering Technology (CCET). IEEE, 2020. 
  8. Cruz, Jerome Paul N., et al. "Object recognition and detection by shape and color pattern recognition utilizing Artificial Neural Networks." 2013 International Conference of Information and Communication Technology (ICoICT). IEEE, 2013. 
  9. Ahmetovic, Dragan, et al. "Zebra crossing spotter: Automatic population of spatial databases for increased safety of blind travelers." Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility. 2015. 
  10. Bai, Jinqiang, et al. "A cloud and vision-based navigation system used for blind people." Proceedings of the 2017 International Conference on Artificial Intelligence, Automation and Control Technologies. 2017. 
  11. Al-Nabulsi, Jamal, AbdelwadoodMesleh, and Adnan Yunis. "Traffic light detection for colorblind individuals." 2017 IEEE Jordan Conference on Applied Electrical Engineering and Computing Technologies (AEECT). IEEE, 2017. 
  12. P. S. Swami and P. Futane, "Traffic Light Detection System for Low Vision or Visually Impaired Person Through Voice," 2018 Fourth International Conference on Computing Communication Control and Automation (ICCUBEA), 2018, pp. 1-5, doi: 10.1109/ICCUBEA.2018.8697805. 
  13. El-Taher, Fatma El-Zahraa, et al. "A systematic review of urban navigation systems for visually impaired people." Sensors 21.9 (2021): 3103. 
  14. Ghilardi, Marcelo C., et al. "Real-time detection of pedestrian traffic lights for visually-impaired people." 2018 International Joint Conference on Neural Networks (IJCNN). IEEE, 2018. 
  15. https://paperswithcode.com/dataset/coco 
  16. Roters, Jan, Xiaoyi Jiang, and Kai Rothaus. "Recognition of traffic lights in live video streams on mobile devices." IEEE Transactions on Circuits and Systems for Video Technology 21.10 (2011): 1497-1511.  https://doi.org/10.1109/TCSVT.2011.2163452
  17. Cheng, Ruiqi, et al. "Real-time pedestrian crossing lights detection algorithm for the visually impaired." Multimedia Tools and Applications 77.16 (2018): 20651-20671. https://doi.org/10.1007/s11042-017-5472-5