Current Optics and Photonics

Optical Society of Korea (한국광학회)
권호 표지
DOI QR코드

DOI QR Code

A Non-uniform Correction Algorithm Based on Scene Nonlinear Filtering Residual Estimation

  • Hongfei Song (School of Optoelectronic Engineering, Changchun University of Science and Technology) ;
  • Kehang Zhang (School of Optoelectronic Engineering, Changchun University of Science and Technology) ;
  • Wen Tan (School of Optoelectronic Engineering, Changchun University of Science and Technology) ;
  • Fei Guo (School of Optoelectronic Engineering, Changchun University of Science and Technology) ;
  • Xinren Zhang (School of Optoelectronic Engineering, Changchun University of Science and Technology) ;
  • Wenxiao Cao (School of Optoelectronic Engineering, Changchun University of Science and Technology)
  • Received : 2023.01.13
  • Accepted : 2023.06.13
  • Published : 2023.08.25
Download PDF
⟨ Previous Next ⟩

Abstract

Due to the technological limitations of infrared thermography, infrared focal plane array (IFPA) imaging exhibits stripe non-uniformity, which is typically fixed pattern noise that changes over time and temperature on top of existing non-uniformities. This paper proposes a stripe non-uniformity correction algorithm based on scene-adaptive nonlinear filtering. The algorithm first uses a nonlinear filter to remove single-column non-uniformities and calculates the actual residual with respect to the original image. Then, the current residual is obtained by using the predicted residual from the previous frame and the actual residual. Finally, we adaptively calculate the gain and bias coefficients according to global motion parameters to reduce artifacts. Experimental results show that the proposed algorithm protects image edges to a certain extent, converges fast, has high quality, and effectively removes column stripes and non-uniform random noise compared to other adaptive correction algorithms.

Keywords

Acknowledgement

Science and Technology Development Program of Jilin Province under Grant (20200401066GX).

References

  1. L. Song and H. Huang, "Spatial and temporal adaptive nonuniformity correction for infrared focal plane arrays," Opt. Express 30, 44681-44700 (2022). https://doi.org/10.1364/OE.471825
  2. Y. Tendero, J. Gilles, S. Landeau, and J. M. Morel, "Efficient single image non-uniformity correction algorithm," Proc. SPIE 7834, 96-107 (2010).
  3. L. Li, Q. Li, H. Feng, Z. Xu, and Y. Chen, "A novel infrared focal plane non-uniformity correction method based on co-occurrence filter and adaptive learning rate," IEEE Access 7, 40941-40950 (2019). https://doi.org/10.1109/ACCESS.2019.2907813
  4. X. Mou, T. Zhu, and X. Zhou, "Visible-image-assisted nonuniformity correction of infrared images using the GAN with SEBlock," Sensors 23, 3282 (2023).
  5. Y. JunLu, "Nonuniformity correction design and implementation for infrared image based on FPGA and artificial neural networks," J. Phys.: Conf. Ser. 1693, 012177 (2020).
  6. P. M. Narendra and N. A. Foss, "Shutterless fixed pattern noise correction for infrared imaging arrays," Proc. SPIE 282, 44-51 (1981). https://doi.org/10.1117/12.931970
  7. J. Yan, Y. Kang, Y. Ni, Y. Zhang, J. Fan, and X. Hu, "Nonuniformity correction method of remote sensing images based on adaptive moving window moment matching," J. Imaging Sci. Technol 66, 50502 (2022).
  8. W. Qian, Q. Chen, and G. Gu, "Space low-pass and temporal high-pass nonuniformity correction algorithm," Opt. Rev. 17, 24-29 (2010). https://doi.org/10.1007/s10043-010-0005-8
  9. T. Guillemot and J. Delon, "Implementation of the midway image equalization," Image Process. Line. 6, 114-129 (2016). https://doi.org/10.5201/ipol.2016.140
  10. Y. Tendero, S. Landeau, and J. Gilles, "Non-uniformity correction of infrared images by midway equalization," Image Process. Line 2, 134-146 (2012). https://doi.org/10.5201/ipol.2012.glmt-mire
  11. S. Yang, H. Qin, X. Yan, S. Yuan, and Q. Zeng, "Mid-wave infrared snapshot compressive spectral imager with deep infrared denoising prior," Remote Sens. 15, 280 (2023).
  12. Y. Cao, M. Y. Yang, and C.-L. Tisse, "Effective strip noise removal for low-textured infrared images based on 1-D guided filtering," IEEE Trans. Cir. Syst. Video Technol. 26, 2176-2188 (2015).
  13. N. Liu and J. Xie, "Interframe phase-correlated registration scene-based nonuniformity correction technology," Infrar. Phys. Technol. 69, 198-205 (2015). https://doi.org/10.1016/j.infrared.2015.01.004
  14. B. Lv, S. Tong, Q. Liu, and H. Sun, "Statistical scene-based non-uniformity correction method with interframe registration," Sensors 19, 5395 (2019).
  15. C. H. Lu, "Stripe non-uniformity correction of infrared images using parameter estimation," Infrar. Phys. Technol. 107, 103313 (2020).
  16. R. C. Calik, E. Tunali, B. Ercan, and S. Oz, "A study on calibration methods for infrared focal plane array cameras," in Proc. 13th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (Funchal, Madeira, Portugal, Jan. 27-29, 2018), pp. 219-226.
  17. Y. Zhang, X. Li, X. Zheng, and Q. Wu, "Adaptive temporal high-pass infrared non-uniformity correction algorithm based on guided filter," in Proc. 7th International Conference on Computing and Artificial Intelligence (Tianjin, China, Apr. 23-26, 2021), pp. 459-464.
  18. G. Ness, A. Oved, and I. Kakon, "Derivative based focal plane array nonuniformity correction," arXiv:1702.06118 (2017).
  19. Y. Sheng, X. Dun,W. Jin, F. Zhou, X. Wang, F. Mi, and S. Xiao, "The on-orbit non-uniformity correction method with modulated internal calibration sources for infrared remote sensing systems," Remote Sens. 10, 830 (2018).
  20. L. Geng, Q. Chen, W. Qian, and Y. Zhang, "Scene-based nonuniformity correction algorithm based on temporal median filter," J. Opt. Soc. Korea 17, 255-261 (2013). https://doi.org/10.3807/JOSK.2013.17.3.255
  21. W. Qian, Q. Chen, and G. Gu, "Minimum mean square error method for stripe nonuniformity correction," Chn. Opt. Lett. 9, 051003 (2011).
  22. T. Orzanowski, "Nonuniformity correction algorithm with efficient pixel offset estimation for infrared focal plane arrays," SpringerPlus 5, 1831 (2016).
  23. T. Li, Y. Zhao, Y. Li, and G. Zhou, "Non-uniformity correction of infrared images based on improved CNN with long-short connections," IEEE Photonics J. 13, 7800213 (2021).
  24. B. Gutschwager and J. Hollandt, "Nonuniformity correction of infrared cameras by reading radiance temperatures with a spatially nonhomogeneous radiation source," Meas. Sci. Technol. 28, 015401 (2016).