KSII Transactions on Internet and Information Systems (TIIS)

Korean Society for Internet Information (한국인터넷정보학회)
권호 표지
DOI QR코드

DOI QR Code

An efficient Video Dehazing Algorithm Based on Spectral Clustering

  • Zhao, Fan (Department of Information Science, Xi'an University of Technology) ;
  • Yao, Zao (Department of Information Science, Xi'an University of Technology) ;
  • Song, Xiaofang (Department of Information Science, Xi'an University of Technology) ;
  • Yao, Yi (Department of Information Science, Xi'an University of Technology)
  • Received : 2016.01.18
  • Accepted : 2018.03.14
  • Published : 2018.07.31
Download PDF
⟨ Previous Next ⟩

Abstract

Image and video dehazing is a popular topic in the field of computer vision and digital image processing. A fast, optimized dehazing algorithm was recently proposed that enhances contrast and reduces flickering artifacts in a dehazed video sequence by minimizing a cost function that makes transmission values spatially and temporally coherent. However, its fixed-size block partitioning leads to block effects. The temporal cost function also suffers from the temporal non-coherence of newly appearing objects in a scene. Further, the weak edges in a hazy image are not addressed. Hence, a video dehazing algorithm based on well designed spectral clustering is proposed. To avoid block artifacts, the spectral clustering is customized to segment static scenes to ensure the same target has the same transmission value. Assuming that edge images dehazed with optimized transmission values have richer detail than before restoration, an edge intensity function is added to the spatial consistency cost model. Atmospheric light is estimated using a modified quadtree search. Different temporal transmission models are established for newly appearing objects, static backgrounds, and moving objects. The experimental results demonstrate that the new method provides higher dehazing quality and lower time complexity than the previous technique.

Keywords

References

  1. ZhangNarasimhan S G, Nayar S K, "Vision and the Atmosphere," International Journal of Computer Vision, vol.48, no.3, pp. 233-254, 2002. https://doi.org/10.1023/A:1016328200723
  2. Hautiere N, Tarel J P, Aubert D, "Towards Fog-Free In-Vehicle Vision Systems through Contrast Restoration," in Proc. of IEEE Conference on Computer Vision and Pattern Recognition, pp. 1-8, June, 2007.
  3. S. NarasimhanS, . Nayar, "Contrast restoration of weather degraded images," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 25, no. 6, pp. 713-724, June, 2003. https://doi.org/10.1109/TPAMI.2003.1201821
  4. S. Shwartz, E. Namer, Y. Schechner, "Blind haze separation," in Proc. of IEEE CVPR'06, June, 2006.
  5. Y. Schechner, S. Narasimhan, S. Nayar, "Instant dehazing of images using polarization," in Proc. of IEEE CVPR 2001, pp. 325-332, Dec. 2001.
  6. J. Kopf, B. Neubert, B. Chen, M. Cohen, D. Cohen-Or, O. Deussen, M. Uyttendaele, D. Lischinski, "Deep photo: model-based photograph enhancement and viewing," ACM Trans. Graph, vol. 27, no. 5, pp.1-10, Dec. 2008.
  7. Di Wu, Qionghai Dai, "Data-driven visibility enhancement using multi-camera system," in Proc. of SPIE Enhanced and Synthetic Vision, May, 2010.
  8. Schaul L, Fredembach C, Susstrunk S. "Color Image Dehazing using the Near-Infrared," in Proc. of IEEE International Conference on Image Processing (ICIP), pp. 1629-1632, Nov. 2009.
  9. Ashish V. Vanmali, Samrudha G. Kelkar, Vikram M. Gadre. "A novel approach for image dehazing combining visible-NIR images," in Proc. of 2015 Fifth National Conference on Computer Vision, Pattern Recognition, Image Processing and Graphics (NCVPRIPG), Dec. 2015.
  10. C. Feng, S. Zhuo, X. Zhang, L. Shen, and S. Susstrunk, "Near-infrared guided color image dehazing," in Proc. of Image Processing, ICIP 2013. 20th IEEE International Conference on, pp. 2363-2367, Sep. 2013.
  11. X. Zhang, T. Sim, and X. Miao, "Enhancing photographs with near infrared images," in Proc. of Computer Vision and Pattern Recognition, CVPR 2008. IEEE Conference on, pp. 1-8, June, 2008.
  12. S. Zhuo, X. Zhang, X. Miao, and T. Sim, "Enhancing low light images using near infrared flash images," in Proc. of Image Processing, 2010. ICIP 17th IEEE International Conference on, pp. 2537-2540, Sept. 2010.
  13. Fattal R. "Single image dehazing," ACM Transactions on Graphics, 2008, vol. 27, no. 3, pp. 1-9, Aug. 2008.
  14. Tan R T. "Visibility in bad weather from a single image," in Proc. of IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2008, pp. 1-8, June.2008.
  15. Kratz L, Nishino K. "Factorizing Scene Albedo and Depth from a Single Foggy Image," in Proc. of IEEE 12th International Conference on Computer Vision (ICCV), pp. 1701-1708, 2009.
  16. Tarel J P, Hautiere N. " Fast visibility restoration from a single color or gray level image," in Proc. of IEEE 12th International Conference on Computer Vision (ICCV), pp. 2201-2208, 2009.
  17. He K, Sun J, Tang X. "Single Image Haze Removal Using Dark Channel Prior," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 33, no. 12, pp. 2341-2353, Dec. 2011. https://doi.org/10.1109/TPAMI.2010.168
  18. Xiang X, Cheng Y, Tang J. "A Novel Video Dehazing Method Based on Temporal Visual Coherence," in Proc. of 7th International Conference on Internet Multimedia Computing and Service, Aug. 2015.
  19. Wang J B, He N, Zhang L L, et al. "Single image dehazing with a physical model and dark channel prior," Neuro computing, vol. 149, Part B, pp. 718-728, Feb. 2015.
  20. Yeh C H, Kang L W, Lin C Y, et al. "Efficient image/video dehazing through haze density analysis based on pixel-based dark channel prior," in Proc. of International Conference on Information Security and Intelligence Control (ISIC), pp. 238-241, 2012.
  21. Kumari A, Sahdev S, Sahoo S K. "Improved Single Image and Video Dehazing Using Morphological Operation," in Proc. of International Conference on VLSI Systems, Architecture, Technology and Applications (VLSI-SATA), pp. 1-5, Jan. 2015.
  22. Shin D K, Yong M K, Park K T, et al. "Video dehazing without flicker artifacts using adaptive temporal average," in Proc. of The 18th IEEE International Symposium on Consumer Electronics (ISCE 2014), pp. 1-2, June. 2014.
  23. Zhang J, Li L, Zhang Y, et al. "Video dehazing with spatial and temporal coherence," Visual Computer, vol. 27, no. 6-8, pp. 749-757, June, 2011. https://doi.org/10.1007/s00371-011-0569-8
  24. Kim J H, Jang W D, Sim J Y, et al. "Optimized contrast enhancement for real-time image and video dehazing," Journal of Visual Communication & Image Representation, vol. 24, no. 3, pp. 410-425, April, 2013. https://doi.org/10.1016/j.jvcir.2013.02.004
  25. Goldstein E B. "Sensation and Perception," in Proc. of 31st International Congress of Psychology, pp.24-29, July 2016.
  26. Preetham A J, Shirley P, Smits B. "A practical analytic model for daylight," in Proc. of the 26th annual conference on Computer graphics and interactive techniques. ACM Press/Addison-Wesley Publishing Co., 1999:91-100.
  27. A. Levin, D. Lischinski, and Y. Weiss. "A closed form solution to natural image matting," in Proc. of IEEE Conference on Computer Vision and Pattern Recognition, pp. 1-8, June, 2006.
  28. Lv X, Chen W, Shen I F. "Real-Time Dehazing for Image and Video," in Proc. of IEEE Computer Society Conference on Computer Graphics & Applications, pp. 62-69, Sept. 2010.
  29. Gujral A, Gupta S, Bhushan B. "A Novel Defogging Technique for Dehazing Images," International Journal of Hybrid Information Technology, vol. 7, no. 4, pp. 235-248, July. 2014. https://doi.org/10.14257/ijhit.2014.7.4.20
  30. J. Oakley, H. Bu, "Correction of simple contrast loss in color images," IEEE Trans. Image Process, vol. 16, no. 2, pp. 511-522, Feb. 2007. https://doi.org/10.1109/TIP.2006.887736
  31. K. He, J. Sun, X. Tang, "Guided image filtering," in Proc. of ECCV, 2010, Part 1, LNCS 6311, pp. 1-14, 2010.
  32. Ulrike von Luxburg. "A tutorial on spectral clustering," Statist. Comput., vol. 17, issue. 4, pp 395-416, Dec. 2007. https://doi.org/10.1007/s11222-007-9033-z
  33. Ming Qin, Yao Lu, Huijun Di, and Wei Huang. "A Background Basis Selection-Based Foreground Detection Method," IEEE Transactions on Multimedia, vol. 18, no. 7, pp. 1283-1296, July, 2016. https://doi.org/10.1109/TMM.2016.2557729
  34. Shi J, Malik J. "Normalized cuts and image segmentation," IEEE Transactions on Pattern Analysis & Machine Intelligence, vol. 22, issue. 8, pp. 888-905, Aug.2000. https://doi.org/10.1109/34.868688