Current Optics and Photonics

Optical Society of Korea (한국광학회)
권호 표지
DOI QR코드

DOI QR Code

A Double-channel Four-band True Color Night Vision System

  • Jiang, Yunfeng (Department of Electronics and Optical Engineering, Army Engineering University of PLA) ;
  • Wu, Dongsheng (Department of Electronics and Optical Engineering, Army Engineering University of PLA) ;
  • Liu, Jie (Department of Electronics and Optical Engineering, Army Engineering University of PLA) ;
  • Tian, Kuo (Department of Electronics and Optical Engineering, Army Engineering University of PLA) ;
  • Wang, Dan (Department of Electronics and Optical Engineering, Army Engineering University of PLA)
  • Received : 2022.08.19
  • Accepted : 2022.11.02
  • Published : 2022.12.25
Download PDF
⟨ Previous Next ⟩

Abstract

By analyzing the signal-to-noise ratio (SNR) theory of the conventional true color night vision system, we found that the output image SNR is limited by the wavelength range of the system response λ1 and λ2. Therefore, we built a double-channel four-band true color night vision system to expand the system response to improve the output image SNR. In the meantime, we proposed an image fusion method based on principal component analysis (PCA) and nonsubsampled shearlet transform (NSST) to obtain the true color night vision images. Through experiments, a method based on edge extraction of the targets and spatial dimension decorrelation was proposed to calculate the SNR of the obtained images and we calculated the correlation coefficient (CC) between the edge graphs of obtained and reference images. The results showed that the SNR of the images of four scenes obtained by our system were 125.0%, 145.8%, 86.0% and 51.8% higher, respectively, than that of the conventional tri-band system and CC was also higher, which demonstrated that our system can get true color images with better quality.

Keywords

Acknowledgement

Dongsheng Wu thanks the National Natural Science Foundation for help in identifying collaborators for this work.

References

  1. D. Li, L. Deng, B. B. Gupta, H. Wang, and C. Choi, "A novel CNN based security guaranteed image watermarking generation scenario for smart city applications," Inform. Sci. 479, 432-447 (2019). https://doi.org/10.1016/j.ins.2018.02.060
  2. H. Naeem, F. Ullah, M. R. Naeem, S. Khalid, D. Vasan, S. Jabbar, and S. J. A. H. N. Saeed, "Malware detection in industrial internet of things based on hybrid image visualization and deep learning model," Ad Hoc Networks 105, 102154 (2020). https://doi.org/10.1016/j.adhoc.2020.102154
  3. M. Zhang, M. Zhu, and X. Zhao, "Recognition of high-risk scenarios in building construction based on image semantics," J. Comput. Civ. Eng. 34, 04020019 (2020). https://doi.org/10.1061/(asce)cp.1943-5487.0000900
  4. Y. Yang, W. Zhang, W. He, Q. Chen, and G. Gu, "Research and implementation of color night vision imaging system based on FPGA and CMOS," SPIE 11434, 114340U (2020).
  5. J.-B. Yang Sr, Y. Lu, L. Wang, K. Zhao, C. Yang, Y. Liu, and X.-H. Chai, "Research on starlight level broad spectrum full color imaging technology," SPIE 11338, 113381V (2019).
  6. A. Toet and M. A. Hogervorst, "Progress in color night vision," Opt. Eng. 51, 010901 (2012). https://doi.org/10.1117/1.OE.51.1.010901
  7. B. Ren, G. Jiao, Y. Li, Z. Zheng Jr, K. Qiao, Y. Yang, L. Yan, and Y. Yuan, "Research progress of true color digital night vision technology," SPIE 11763, 117636C (2021).
  8. K. Chrzanowski, "Review of night vision technology," Opto-Electron. Rev. 21, 153-181 (2013). https://doi.org/10.2478/s11772-013-0089-3
  9. M. R. Khosravi, M. Sharif-Yazd, M. K. Moghimi, A. Keshavarz, H. Rostami, and S. Mansouri, "MRF-based multispectral image fusion using an adaptive approach based on edgeguided interpolation," arXiv:1512.08475 (2015). https://doi.org/10.4236/jgis.2017.92008
  10. M. Morimatsu, Y. Monno, M. Tanaka, and M. Okutomi, "Monochrome and color polarization demosaicking using edge-aware residual interpolation," in Proc. IEEE International Conference on Image Processing-ICIP (Abu Dhabi, United Arab Emirates, Oct. 25-28, 2020), pp. 2571-2575.
  11. L. Yu and B. Pan, "Color stereo-digital image correlation method using a single 3CCD color camera," Exp. Mech. 57, 649-657 (2017). https://doi.org/10.1007/s11340-017-0253-7
  12. O. M. B. Saeed, S. Sankaran, A. R. M. Shariff, H. Z. M. Shafri, R. Ehsani, M. S. Alfatni, and M. H. M. Hazir, "Classification of oil palm fresh fruit bunches based on their maturity using portable four-band sensor system," Comput. Electron. Agric. 82, 55-60 (2012). https://doi.org/10.1016/j.compag.2011.12.010
  13. X. Dong, W. Xu, Z. Miao, L. Ma, C. Zhang, J. Yang, Z. Jin, A. B. J. Teoh, and J. Shen, "Abandoning the Bayer-filter to see in the dark," in Proc. IEEE/CVF Conference on Computer Vision and Pattern Recognition (New Orleans, LA, USA, Jun. 21-24, 2022) pp. 17431-17440.
  14. G. G. Jeon, "Optimally determined modified Bayer color array for imagery," Adv. Mater. Res. 717, 501-505 (2013). https://doi.org/10.4028/www.scientific.net/AMR.717.501
  15. J. Kriesel and N. Gat, "True-color night vision cameras," SPIE 6540, 65400D (2007).
  16. Y. Jiang and D. Wu, "Analysis and test of signal-to-noise ratio of LLL night vision system," in Proc. IEEE 3rd Advanced Information Management, Communicates, Electronic and Automation Control Conference-IMCEC (Chongqing, China, Oct. 11-13, 2019), pp. 648-651.
  17. M. Aboelaze and F. Aloul, "Current and future trends in sensor networks: a survey," in Proc. Second IFIP International Conference on Wireless and Optical Communications Networks (Dubai, United Arab Emirates, Mar. 6-8, 2005), pp. 551-555.
  18. P. Cinzano, "Night sky photometry with sky quality meter," ISTIL Int. Rep. (2005), Number 9, Version 1.4.
  19. R. P. Desale and S. V. Verma, "Study and analysis of PCA, DCT & DWT based image fusion techniques," in Proc. 2013 International Conference on Signal Processing, Image Processing & Pattern Recognition (Coimbatore, India, Feb. 7-8, 2013), pp. 66-69.
  20. Y. Song, W. Wei, L. Zheng, X. Yang, L. Kai, and L. Wei, "An adaptive pansharpening method by using weighted least squares filter," IEEE Geosci. Remote Sens. Lett. 13, 18-22 (2016). https://doi.org/10.1109/LGRS.2015.2492569
  21. L. Sun and F. Zhong, "Mixed noise estimation for hyperspectral image based on multiple bands prediction," IEEE Geosci. Remote Sens. Lett. 19, 6007705 (2022).
  22. K. Peng, X. Shen, F. Huang, and X. He, "A joint transform correlator encryption system based on binary encoding for grayscale images," Curr. Opt. Photonics 3, 548-554 (2019). https://doi.org/10.3807/COPP.2019.3.6.548