Implementation of Image Semantic Segmentation on Android Device using Deep Learning

딥-러닝을 활용한 안드로이드 플랫폼에서의 이미지 시맨틱 분할 구현

  • Lee, Yong-Hwan (Dept. of Digital Contents, Institute of Convergence and Creativity, Wonkwang University) ;
  • Kim, Youngseop (Dept. of Electronics and Electrical Engineering, Dankook University)
  • 이용환 (원광대학교 디지털콘텐츠공학과 융복합창의연구소) ;
  • 김영섭 (단국대학교 전자전기공학부)
  • Received : 2020.06.23
  • Accepted : 2020.06.24
  • Published : 2020.06.30

Abstract

Image segmentation is the task of partitioning an image into multiple sets of pixels based on some characteristics. The objective is to simplify the image into a representation that is more meaningful and easier to analyze. In this paper, we apply deep-learning to pre-train the learning model, and implement an algorithm that performs image segmentation in real time by extracting frames for the stream input from the Android device. Based on the open source of DeepLab-v3+ implemented in Tensorflow, some convolution filters are modified to improve real-time operation on the Android platform.

Keywords

References

  1. Zhong-Qiu Zhao, Peng Zheng, Shou-tao Xu, Xindong Wu, "Object Detection with Deep Learning: A Review", IEEE Transactions on Neural Networks and Learning Systems, 2019.
  2. Li Liu, Wanli Ouyang, Xiaogang Wang, Paul Fieguth, Jie Chen, Xinwang Liu, Matti Peitikainen, "Deep Learning for Generic Object Detection:Asurvey", International Journal of Computer Vision, vol.128, pp.261-318, 2020. https://doi.org/10.1007/s11263-019-01247-4
  3. Yang Peng Zhu, Peng Li, "Survey on the Image Segmentation Algorithms", Proceedings of the International Field Exploration and Developoment Conference, pp.475-488, 2017.
  4. Liang-Chieh Chen, George Papandreou, Iasonas Kokkinos, Kevin Murphy, and Alan L. Yuille, "Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFs", Proceeding of ICLR, 2015.
  5. Liang-Chieh Chen, George Papandreou, Iasonas Kokkinos, Kevin Murphy, and Alan L. Yuille, "Deeplab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs", Computer Vision and Pattern Recognition, 2017.
  6. Liang-Chieh Chen, George Papandreou, Florian Schroff, and Hartwig Adam, "Rethinking Atrous Convolution for Semantic Image Segmentation", arXiv:1706.05587, 2017.
  7. Rahul Basak, Surya Chakraborty, Satarupa Biswas, "Image Segmentation Techniques: A Survey", Computer Science, 2018.
  8. Liang-Chieh Chen, Yukun Zhu, George Papandreou, Florian Schroff, Hartwig Adam, "Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation", ECCV, 2018.
  9. Website, https://github.com/tensorflow/models/tree/master/research/deeplab, available on 2020.
  10. Website, https://www.kaggle.com/jessicali9530/lfw-dataset, available on 2020.