KSII Transactions on Internet and Information Systems (TIIS)

Korean Society for Internet Information (한국인터넷정보학회)
권호 표지
DOI QR코드

DOI QR Code

Saliency Detection based on Global Color Distribution and Active Contour Analysis

  • Hu, Zhengping (School of Information Science and Engineering & Yanshan University) ;
  • Zhang, Zhenbin (School of Information Science and Engineering & Yanshan University) ;
  • Sun, Zhe (School of Information Science and Engineering & Yanshan University) ;
  • Zhao, Shuhuan (School of Information Science and Engineering & Yanshan University)
  • Received : 2016.04.10
  • Accepted : 2016.10.25
  • Published : 2016.12.31
Download PDF
⟨ Previous Next ⟩

Abstract

In computer vision, salient object is important to extract the useful information of foreground. With active contour analysis acting as the core in this paper, we propose a bottom-up saliency detection algorithm combining with the Bayesian model and the global color distribution. Under the supports of active contour model, a more accurate foreground can be obtained as a foundation for the Bayesian model and the global color distribution. Furthermore, we establish a contour-based selection mechanism to optimize the global-color distribution, which is an effective revising approach for the Bayesian model as well. To obtain an excellent object contour, we firstly intensify the object region in the source gray-scale image by a seed-based method. The final saliency map can be detected after weighting the color distribution to the Bayesian saliency map, after both of the two components are available. The contribution of this paper is that, comparing the Harris-based convex hull algorithm, the active contour can extract a more accurate and non-convex foreground. Moreover, the global color distribution can solve the saliency-scattered drawback of Bayesian model, by the mutual complementation. According to the detected results, the final saliency maps generated with considering the global color distribution and active contour are much-improved.

Keywords

References

  1. J. Han, D. Zhang, X. Hu and L. Guo, "Background Prior-Based Salient Object Detection via Deep Reconstruction Residual," IEEE Transactions on Circuits and Systems for Video Technology, vol. 25, no. 8, pp. 1309-1321, Aug. 2015. https://doi.org/10.1109/TCSVT.2014.2381471
  2. J. Han, D. Zhang, X. Hu and L.Guo, "Two-Stage Learning to Predict Human Eye Fixations via SDAEs," IEEE Transactions on Cybernetics, vol. 46, no. 2, pp. 487-498, Feb. 2016. https://doi.org/10.1109/TCYB.2015.2404432
  3. S. Lu, V. Mahadevan and N. Vasconcelos, "Learning Optimal Seeds for Diffusion-Based Salient Object Detection," in Proc. of IEEE Computer Vision and Pattern Recognition, pp. 2790-2797, June 23-28, 2014.
  4. F. Perazzi, P. Krahenbuhl, Y. Pritch and A. Hornung, "Saliency filters: Contrast based filtering for salient region detection," in Proc. of IEEE Computer Vision and Pattern Recognition, pp. 733-740, June 16-21, 2012.
  5. L. Zhang, M. Tong, T. Marks, H. Shan, and G. Cottrell, "Sun: A Bayesian framework for saliency using natural statistics," Journal of Vision, vol. 8, no. 7, pp. 1-20, December, 2008.
  6. Y. Xie and H. Lu, "Visual saliency detection based on Bayesian model," in Proc. of IEEE International Conference on Image Processing, pp. 645-648, Sept 11-14, 2011.
  7. C. Yang, L. Zhang and H. Lu, "Graph-Regularized Saliency Detection With Convex-Hull-Based Center Prior," IEEE Signal Processing Letters, vol. 20, no. 7, pp. 637-640, July, 2013. https://doi.org/10.1109/LSP.2013.2260737
  8. R. Achanta, A. Shaji, K. Smith, A. Lucchi, P. Fua and S. Susstrunk, "Slic superpixels," in Proc. of EPFL, 2010.
  9. J. Sun, H. Lu and X. Liu, "Saliency Region Detection based on Markov Absorption Probabilities," IEEE Transactions on Image Processing, vol. 24, no. 5, pp. 1639-1649, May, 2015. https://doi.org/10.1109/TIP.2015.2403241
  10. J. Wang, H. Lu, X. Li, N. Tong and W. Liu, "Saliency detection via background and foreground seed selection," Neurocomputing, vol. 152, pp. 359-368, October, 2015. https://doi.org/10.1016/j.neucom.2014.10.056
  11. R. Achanta, F. Estrada, P. Wils and S. Susstrunk, "Salient region detection and segmentation," in Proc. of Computer Vision Systems, pp. 66-75, May 12-15, 2008.
  12. J.-S. Kim, J.-Y. Sim and C.-S. Kim, "Multiscale Saliency Detection Using Random Walk With Restart," IEEE Transactions on Circuits and Systems for Video Technology, vol. 24, no. 2, pp. 198-210, Feb. 2014. https://doi.org/10.1109/TCSVT.2013.2270366
  13. B. Jiang, L. Zhang, H. Lu, C. Yang and M.-H. Yang, "Saliency detection via absorbing Markov chain," in Proc. of IEEE Computer Vision, pp.1665-1672, December 1-8, 2013.
  14. H. Ren, Z. Su, C. Lv and F. Zou, "An improved algorithm for active contour extraction based on greedy snake," in Proc. of IEEE Computer and Information Science, pp. 589-592, June 28-July 1, 2015.
  15. S. Osher and J.A. Sethian, "Fronts Propagating with Curvature Dependent Speed: Algorithms Based on Hamilton-Jacobi Formulations," in Proc. of Journal of Computational Physics, vol. 79, no. 1, pp.12-49, 1988. https://doi.org/10.1016/0021-9991(88)90002-2
  16. C. Li, C. Xu, C. Gui and M.D. Fox, "Level Set Evolution Without Re-initialization: A New Variational Formulation," in Proc. of IEEE Computer Vision and Pattern Recognition, pp.430-436, June 20-25, 2005.
  17. D. Zhang, J. Han, C. Li and J. Wang, "Co-saliency detection via looking deep and wide," in Proc. of IEEE Computer Vision and Pattern Recognition, pp. 2994-3002, June 7-12, 2015.
  18. H. Fu, X. Cao and Z. Tu, "Cluster-Based Co-Saliency Detection," IEEE Transactions on Image Processing, vol. 22, no.10, pp. 3766-3778, Oct. 2013. https://doi.org/10.1109/TIP.2013.2260166
  19. D. Zhang, J.Han, J. Han and L. Shao, "Cosaliency Detection Based on Intrasaliency Prior Transfer and Deep Intersaliency Mining," IEEE Transactions on Neural Networks and Learning Systems, vol. 27, no. 6, pp. 1163-1176, June, 2016. https://doi.org/10.1109/TNNLS.2015.2495161
  20. P. Siva, C. Russell, T. Xiang and L. Agapito, "Looking beyond the image: unsupervised learning for object saliency and detection," in Proc. of IEEE Computer Vision and Pattern Recognition, pp.3238-3245, June 23-28, 2013.
  21. J. Han, D. Zhang, G. Cheng and L. Guo, "Object detection in optical remote sensing images based on weakly supervised learning and high-level feature learning," IEEE Transactions on Geoscience and Remote Sensing, vol. 53, no. 6, pp. 3325-3337, June, 2015. https://doi.org/10.1109/TGRS.2014.2374218
  22. M.-M. Cheng, G.-X. Zhang, N.J. Mitra, X. Huang and S.-M. Hu, "Global contrast based salient region detection," in Proc. of IEEE Computer Vision and Pattern Recognition, pp. 569 -582, June 20-25, 2011.
  23. V. Saminadan, P. Aishwarya, M. Manimegalai, M. Nivedhitha and G. Subhapriya, "Efficient image dehazing based on pixel based dark channel prior and guided filter," in Proc. of Communications and Signal Processing, pp.1925-1927, April 2-4, 2015.
  24. Z. Wang and B. Li, "A two-stage approach to saliency detection in images," in Proc. of IEEE Acoustics, Speech and Signal Processing, pp. 965- 968, March 31-April 4, 2008.
  25. Shi, Q. Yan, L. Xu and J. Jia, "Hierarchical Image Saliency Detection on Extended CSSD," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 38, no. 4, pp. 717-729, April, 2015. https://doi.org/10.1109/TPAMI.2015.2465960
  26. Yan, L. Xu, J. Shi and J. Jia, "Hierarchical Saliency Detection," in Proc. of IEEE Computer Vision and Pattern Recognition, pp. 1155-1162, June 23-28, 2013.
  27. A. Borji, M-M. Cheng, H. Jiang and J. Li, "Salient Object Detection: A Benchmark," IEEE Transactions on Image Processing, vol. 24, no. 12, pp. 5706-5722, Dec. 2015. https://doi.org/10.1109/TIP.2015.2487833
  28. X. Shen and Y. Wu, "A unified approach to salient object detection via low rank matrix recovery," in Proc. of IEEE Computer Vision and Pattern Recognition, pp.853-860, June 16-21, 2012.
  29. R. Achanta, S.S. Hemami, F.J. Estrada and S. Susstrunk, "Frequency-tuned salient region detection," in Proc. of IEEE Computer Vision and Pattern Recognition, pp.1597-1604, June 20-25, 2009.
  30. X. Li, H. Lu, L. Zhang, X. Ruan and M-H. Yang, "Saliency Detection via Dense and Sparse Reconstruction," in Proc. of IEEE Computer Vision, pp. 2976-2983, December 1-8, 2013.
  31. X. Hou and L. Zhang, "Saliency detection: a spectral residual approach," in Proc. of IEEE Computer Vision and Pattern Recognition, pp. 1-8, June 17-22, 2007.
  32. H. R. Tavakoli, E. Rahtu, and J. Heikkila, "Fast and efficient saliency detection using sparse sampling and kernel density estimation," in Proc. of Image Analysis-scandinavian Conference, pp. 666-675, May, 2011.
  33. H. J. Seo and P. Milanfar, "Static and space-time visual saliency detection by self-resemblance," Journal of Vision, vol. 9, no. 12 pp. 1-27, November, 2009.
  34. N. Murray, M. Vanrell, X. Otazu, and C. A. Parraga, "Saliency estimation using a non-parametric low-level vision model," in Proc. of IEEE Computer Vision and Pattern Recognition, pp. 433-440, June 20-25, 2011.
  35. M-M Cheng, J. Warrell, W-Y. Lin, S. Zheng, V. Vineet and N. Crook, "Efficient Salient Region Detection with Soft Image Abstraction," in Proc. of IEEE Computer Vision, pp.1529-1536, December 1-8, 2013.
  36. H. Jiang, J. Wang, Z. Yuan, T. Liu, N. Zheng and S. Li, "Automatic salient object segmentation based on context and shape prior," in Proc. of British Machine Vision Conference, pp. 1-12, September, 2011.
  37. E. Rahtu, J. Kannala, M. Salo and J. Heikkila, "Segmenting salient objects from images and videos," in Proc. of European Conference on Computer Vision, pp. 366-379, September 5-11, 2010.
  38. J. Harel, C. Koch and P. Perona, "Graph-based visual saliency," in Proc. of Neural Information Processing Systems, pp. 54-552, 2007.