Journal of the Korea Society of Computer and Information (한국컴퓨터정보학회논문지)

Korean Society of Computer Information (한국컴퓨터정보학회)
권호 표지
DOI QR코드

DOI QR Code

An Improved Multi-resolution image fusion framework using image enhancement technique

  • Received : 2017.10.11
  • Accepted : 2017.11.17
  • Published : 2017.12.29
Download PDF
⟨ Previous Next ⟩

Abstract

This paper represents a novel framework for multi-scale image fusion. Multi-scale Kalman Smoothing (MKS) algorithm with quad-tree structure can provide a powerful multi-resolution image fusion scheme by employing Markov property. In general, such approach provides outstanding image fusion performance in terms of accuracy and efficiency, however, quad-tree based method is often limited to be applied in certain applications due to its stair-like covariance structure, resulting in unrealistic blocky artifacts at the fusion result where finest scale data are void or missed. To mitigate this structural artifact, in this paper, a new scheme of multi-scale fusion framework is proposed. By employing Super Resolution (SR) technique on MKS algorithm, fine resolved measurement is generated and blended through the tree structure such that missed detail information at data missing region in fine scale image is properly inferred and the blocky artifact can be successfully suppressed at fusion result. Simulation results show that the proposed method provides significantly improved fusion results in the senses of both Root Mean Square Error (RMSE) performance and visual improvement over conventional MKS algorithm.

Keywords

References

  1. G. Pajares, and J.M de la Cruz, "A wavelet-based image fusion tutorial," Pattern Recognition, Vol. 37, Issue 9, pp. 1855-1872, Sep. 2004. https://doi.org/10.1016/j.patcog.2004.03.010
  2. M. M. Daniel and A. S. Willsky, "A multiresolution methodology for signal-level fusion and data assimilation with applications to remote sensing," Proc. IEEE, Vol. 85, pp. 164-180, Jan. 1997. https://doi.org/10.1109/5.554216
  3. W. Irving, W. Karl, and A. Willsky, "A Theory for Multiscale Stochastic Realization," 33rd Conference on Decision and Control, Vol. 1, pp. 655-662, Jan. 1994.
  4. H. E. Rauch, C. T. Striebel, and F. Tung, "Maximum likelihood estimates of linear dynamic systems," AIAA Journal, Vol. 3, No. 8, pp. 1445-1450, Aug. 1965. https://doi.org/10.2514/3.3166
  5. K. Chou, A, Willsky, and R. Nikoukhah, "Multiscale systems, Kalman filters, and Riccati equations," IEEE Transactions on Automatic Control, Vol. 39, pp. 479-492, Mar. 1994. https://doi.org/10.1109/9.280747
  6. S.M Kay, "Fundamentals of Statistical Signal Processing: Estimation Theory," Prentice Hall, Upper Saddle River, NJ, 1993.
  7. L. Yue, et al., "A locally adaptive L1-L2 norm for multi-frame super-resolution of images with mixed noise and outliers," Signal Processing, Vol. 105, Nu. pp. 156-174, 2014. https://doi.org/10.1016/j.sigpro.2014.04.031
  8. Q. Zhou, and A.-X. Zhu, "The recent advancement in digital terrain analysis and modeling," International Journal of Geographical Information Science, Vol. 27, No.7, pp. 1269-1271, 2013. https://doi.org/10.1080/13658816.2013.794281
  9. M.R. Luettgen, W.C. Karl, and A. Willsky, "Multiscale Representations of Markov Random Fields," IEEE Trans. Signal Processing, Vol. 41, pp. 3377-3395, Dec. 1993. https://doi.org/10.1109/78.258081
  10. A.S. Willsky, "Multiresolution Markov models for signal and image processing," Proceedings of the IEEE , Vol. 90, No. 8, p.p 1396-1458, Aug. 2002. https://doi.org/10.1109/JPROC.2002.800717
  11. W. Fieguth, W. C. Karl, and A. S. Willsky, "Multiscale Stochastic Processing of Topex/Poseidon Oceanogrphic Altimetry," IEEE Trans. Image Proc., Vol. 9, pp. 456-468, Mar. 2000. https://doi.org/10.1109/83.826782
  12. K. Chou, A. Willsky, and R. Nikoukhah, "Multiscale systems, Kalman filters, and Riccati equations," IEEE Transactions on Automatic Control, Vol. 39, No. 3, pp.479-492, Mar. 1994. https://doi.org/10.1109/9.280747
  13. K.C. Slatton, M.M. Crawford, and B.L. Evans, "Fusing interferometric radar and laser altimeter data to estimate surface topography and vegetation heights," IEEE Transactions on Geoscience and Remote Sensing, Vol. 39, pp. 2470-2482, 2001. https://doi.org/10.1109/36.964984
  14. H. Zebker, S. Madsen, and J. Martin, "The TOPSAR interferometric radar topographic mapping instrument," IEEE Transactions on Geoscience and Remote Sensing, Vol. 30, pp. 933-940, 1992. https://doi.org/10.1109/36.175328
  15. H. Jhee, S. Cheung, and K.C Slatton, "Efficient observational updating for fusion of incomplete image data," In Proceedings of the IEEE International Geoscience and Remote Sensing Symposium, Vol. 4, pp. 2807-2810, Jul. 2005.
  16. S. Todorovic, and M.C. Nechyba, "Interpretation of complex scenes using dynamic tree-structure Bayesian networks," Computer Vision and Image Understanding, Vol. 106 No.1, p.71-84, Apr. 2007. https://doi.org/10.1016/j.cviu.2005.09.005