DOI QR코드

DOI QR Code

Object Tracking based on Weight Sharing CNN Structure according to Search Area Setting Method Considering Object Movement

객체의 움직임을 고려한 탐색영역 설정에 따른 가중치를 공유하는 CNN구조 기반의 객체 추적

  • Kim, Jung Uk (School of Electrical Engineering, Korea Advanced Institute of Science and Technology (KAIST)) ;
  • Ro, Yong Man (School of Electrical Engineering, Korea Advanced Institute of Science and Technology (KAIST))
  • Received : 2017.03.31
  • Accepted : 2017.05.29
  • Published : 2017.07.31

Abstract

Object Tracking is a technique for tracking moving objects over time in a video image. Using object tracking technique, many research are conducted such a detecting dangerous situation and recognizing the movement of nearby objects in a smart car. However, it still remains a challenging task such as occlusion, deformation, background clutter, illumination variation, etc. In this paper, we propose a novel deep visual object tracking method that can be operated in robust to many challenging task. For the robust visual object tracking, we proposed a Convolutional Neural Network(CNN) which shares weight of the convolutional layers. Input of the CNN is a three; first frame object image, object image in a previous frame, and current search frame containing the object movement. Also we propose a method to consider the motion of the object when determining the current search area to search for the location of the object. Extensive experimental results on a authorized resource database showed that the proposed method outperformed than the conventional methods.

Keywords

References

  1. A. Dick and M. Brooks, "Issues in Automated Visual Surveillance," Proceeding of International Conference Digital Image Computing: Techniques and Application, pp. 195-204, 2003.
  2. L. Wang, W. Ouyang, X. Wang, and H. Lu, "Visual Tracking with Fully Convolutional Networks," Proceeding of IEEE International Conference Computer Vision, pp. 3119-3127, 2015.
  3. H. Yang, L. Shao, F. Zheng, L. Wang, and Z. Song, “Recent Advances and Trends in Visual Tracking: A Review,” Neurocomputing, Vol. 74, No. 18, pp. 3823-3831, 2011. https://doi.org/10.1016/j.neucom.2011.07.024
  4. D. Comaniciu and P. Meer, “Mean Shift: A Robust Approach Toward Feature Space Analysis,” IEEE Transaction Pattern Analysis and Machine Intelligence, Vol. 24, No. 5, pp. 603-619, 2002. https://doi.org/10.1109/34.1000236
  5. J. Zhang, S. Ma, and S. Sclaroff, "Meem: Robust Tracking via Multiple Experts Using Entropy Minimization," Proceeding of European Conference Computer Vision, pp. 188-203, 2014.
  6. M. Danelljan, G. Hager, F.S. Khan, and M. Felsberg, "Accurate Scale Estimation for Robust Visual Tracking," Proceeding of British Machine Vision Conference, pp. 1-11, 2014.
  7. Z. Han, Q. Ye, and J. Jiao, “Combined Feature Evaluation for Adative Visual Object Tracking,” Computer Vision and Image Understanding, Vol. 115, No. 1, pp. 69-80, 2011. https://doi.org/10.1016/j.cviu.2010.09.004
  8. X. Fen and G. Ming, "Human Detection and Tracking based on HOG and Particle Filter," International Congress on Image and Signal Processing, pp. 1503-1507, 2010.
  9. Y. LeCun, Y. Bengio, and G. Hinton, “Deep Learning,” Nature, Vol. 531, No. 7553, pp. 436-444, 2015.
  10. J. Long, E. Shelhamer, and T. Darrell, "Fully Convolutional Networks for Semantic Segmentation," Proceeding of IEEE Conference Computer Vision and Pattern Recognition, pp. 3431-3440, 2015.
  11. K. Chen and W. Tao, "Once for All: A Two-flow Convolutional Neural Network for Visual Tracking," arXiv:1604.07507, 2016.
  12. D. Held, S. Thrun, and S. Savarese, "Learning to Tracking at 100 FPS with Deep Regression Networks," arXiv:1604.01802, 2016.
  13. S. Zagoruyko and N. Komodakis, "Learning to Compare Image Patches via Convolutional Neural Networks," Proceeding of IEEE Conference Computer Vision and Pattern Recognition, pp. 4353-4361, 2015.
  14. K. Simonyan and A. Zisserman, "Very Deep Convolutional Networks for Image Scale Image Recognition," arXiv:1409.4842, 2015.
  15. F. Chollet, "Keras," https://github.com/fchollet/keras (accessed Feb., 20, 2015).
  16. M. Kristan, J. Matas, A. Leonardis, M. Felsberg, L. Cehovin, and G. Fernandez, et al., "The Visual Object Tracking VOT2015 Challenge Results," Proceeding of IEEE International Conference Computer Vision Workshops, pp. 1-23, 2015.
  17. M. Kristan, R. Pflugfelder, A. Leonardis, J. Matas, F. Poriki, and L. Cehovin, et, al., "The Visual Object Tracking VOT2013 Challenge Results," Proceeding of IEEE International Conference Computer Vision Workshops, pp. 1-14, 2013.
  18. S. Lim, D. Y. Kim, “Object Tracking using Feature Map from Convolutional Neural Network,” Journal of Korea Multimedia Society, Vol. 20, No. 2, pp. 126-133, 2017. https://doi.org/10.9717/kmms.2017.20.2.126