• Title/Summary/Keyword: Fusion Image

Search Result 885, Processing Time 0.066 seconds

Wavelet Transform based Image Registration using MCDT Method for Multi-Image

  • Lee, Choel;Lee, Jungsuk;Jung, Kyedong;Lee, Jong-Yong
    • International Journal of Internet, Broadcasting and Communication
    • /
    • v.7 no.1
    • /
    • pp.36-41
    • /
    • 2015
  • This paper is proposed a wavelet-based MCDT(Mask Coefficient Differential and Threshold) method of image registration of Multi-images contaminated with visible image and infrared image. The method for ensure reliability of the image registration is to the increase statistical corelation as getting the common feature points between two images. The method of threshold the wavelet coefficients using derivatives of the wavelet coefficients of the detail subbands was proposed to effectively registration images with distortion. And it can define that the edge map. Particularly, in order to increase statistical corelation the method of the normalized mutual information. as similarity measure common feature between two images was selected. The proposed method is totally verified by comparing with the several other multi-image and the proposed image registration.

Turbulent-image Restoration Based on a Compound Multibranch Feature Fusion Network

  • Banglian Xu;Yao Fang;Leihong Zhang;Dawei Zhang;Lulu Zheng
    • Current Optics and Photonics
    • /
    • v.7 no.3
    • /
    • pp.237-247
    • /
    • 2023
  • In middle- and long-distance imaging systems, due to the atmospheric turbulence caused by temperature, wind speed, humidity, and so on, light waves propagating in the air are distorted, resulting in image-quality degradation such as geometric deformation and fuzziness. In remote sensing, astronomical observation, and traffic monitoring, image information loss due to degradation causes huge losses, so effective restoration of degraded images is very important. To restore images degraded by atmospheric turbulence, an image-restoration method based on improved compound multibranch feature fusion (CMFNetPro) was proposed. Based on the CMFNet network, an efficient channel-attention mechanism was used to replace the channel-attention mechanism to improve image quality and network efficiency. In the experiment, two-dimensional random distortion vector fields were used to construct two turbulent datasets with different degrees of distortion, based on the Google Landmarks Dataset v2 dataset. The experimental results showed that compared to the CMFNet, DeblurGAN-v2, and MIMO-UNet models, the proposed CMFNetPro network achieves better performance in both quality and training cost of turbulent-image restoration. In the mixed training, CMFNetPro was 1.2391 dB (weak turbulence), 0.8602 dB (strong turbulence) respectively higher in terms of peak signal-to-noise ratio and 0.0015 (weak turbulence), 0.0136 (strong turbulence) respectively higher in terms of structure similarity compared to CMFNet. CMFNetPro was 14.4 hours faster compared to the CMFNet. This provides a feasible scheme for turbulent-image restoration based on deep learning.

Impact Assessment of Forest Development on Net Primary Production using Satellite Image Spatial-temporal Fusion and CASA-Model (위성영상 시공간 융합과 CASA 모형을 활용한 산지 개발사업의 식생 순일차생산량에 대한 영향 평가)

  • Jin, Yi-Hua;Zhu, Jing-Rong;Sung, Sun-Yong;Lee, Dong-Ku
    • Journal of the Korean Society of Environmental Restoration Technology
    • /
    • v.20 no.4
    • /
    • pp.29-42
    • /
    • 2017
  • As the "Guidelines for GHG Environmental Assessment" was revised, it pointed out that the developers should evaluate GHG sequestration and storage of the developing site. However, the current guidelines only taking into account the quantitative reduction lost within the development site, and did not consider the qualitative decrease in the carbon sequestration capacity of forest edge produced by developments. In order to assess the quantitative and qualitative effects of vegetation carbon uptake, the CASA-NPP model and satellite image spatial-temporal fusion were used to estimate the annual net primary production in 2005 and 2015. The development projects between 2006 and 2014 were examined for evaluate quantitative changes in development site and qualitative changes in surroundings by development types. The RMSE value of the satellite image fusion results is less than 0.1 and approaches 0, and the correlation coefficient is more than 0.6, which shows relatively high prediction accuracy. The NPP estimation results range from 0 to $1335.53g\;C/m^2$ year before development and from 0 to $1333.77g\;C/m^2$ year after development. As a result of analyzing NPP reduction amount within the development area by type of forest development, the difference is not significant by type of development but it shows the lowest change in the sports facilities development. It was also found that the vegetation was most affected by the edge vegetation of industrial development. This suggests that the industrial development causes additional development in the surrounding area and indirectly influences the carbon sequestration function of edge vegetaion due to the increase of the edge and influx of disturbed species. The NPP calculation method and results presented in this study can be applied to quantitative and qualitative impact assessment of before and after development, and it can be applied to policies related to greenhouse gas in environmental impact assessment.

The emotional evaluation of color pattern based on information fusion (정보융합 기법을 이용한 칼라 패턴의 감성 평가)

  • 김성환;엄경배;이준환
    • Proceedings of the Korean Institute of Intelligent Systems Conference
    • /
    • 2000.11a
    • /
    • pp.23-27
    • /
    • 2000
  • In this paper, we propose an emotional evaluation model based on information fusion. This model can transform the physical features of a color pattern to the emotional features. Our proposed model consists of the fuzzy logic system and neural network model. The evaluation values produced by them were fused. The model shows comparable performances to the neural network and fuzzy logic system for the approximation of the nonlinear transforms. We believe the evaluated results of a color pattern can be used to the emotion-based color image retrievals.

  • PDF

A Wavelet-Domain IKONOS Satellite Image Fusion Algorithm Considering the Spectrum Range of Multispectral Images (다중분광 영상의 색상별 스펙트럼 영역을 고려한 웨이블릿 변역 IKONOS 위성영상 융합 알고리즘)

  • Lee, Young-Gun;Kuk, Jung-Gap;Cho, Nam-Ik
    • Journal of Broadcast Engineering
    • /
    • v.16 no.1
    • /
    • pp.14-22
    • /
    • 2011
  • The conventional satellite image fusion methods usually add the same amount of higher frequency components extracted from the panchromatic image to all the multispectral images. However, it is noted that each of multispectral images has different amount of overlap with the panchromatic image in terms of its spectrum, and also has different intensities. Thus giving the same amount of high frequency contents to all the spectral bands does not match with this observation, which causes color distortion in the fused image. In this paper, we propose a new wavelet-domain satellite image fusion algorithm that can compensate for these differences in intensity and spectrum overlap. For the compensation of intensity differences, we first estimate the high resolution multispectral images from P, considering the relative intensity ratios. For the compensation of the amount of spectral overlap, their wavelet coefficients are appended to the conventional wavelet-domain method where the coefficients for the addition is determined by the amount of spectrum overlap. Experiments are conducted for the IKONOS satellite images whose spectrums are well known, and the results show that the proposed algorithm gives higher PSNR and correlation coefficients compared to the conventional methods.

Recognition of contact surfaces using optical tactile and F/T sensors integrated by fuzzy fusion algorithm (광촉각 센서와 힘/역학센서의 퍼지융합을 통한 접촉면의 인식)

  • 고동환;한헌수
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1996.10b
    • /
    • pp.628-631
    • /
    • 1996
  • This paper proposes a surface recognition algorithm which determines the types of contact surfaces by fusing the information collected by the multisensor system, consisted of the optical tactile and force/torque sensors. Since the image shape measured by the optical tactile sensor system, which is used for determining the surface type, varies depending on the forces provided at the measuring moment, the force information measured by the f/t sensor takes an important role. In this paper, an image contour is represented by the long and short axes and they are fuzzified individually by the membership function formulated by observing the variation of the lengths of the long and short axes depending on the provided force. The fuzzified values of the long and short axes are fused using the average Minkowski's distance. Compared to the case where only the contour information is used, the proposed algorithm has shown about 14% of enhancement in the recognition ratio. Especially, when imposing the optimal force determined by the experiments, the recognition ratio has been measured over 91%.

  • PDF

Comparative Analysis of Image Fusion methods using KOMPSAT-2 Imagery (KOMPSAT-2 위성영상을 이용한 영상융합기법 비교연구)

  • Yu, Beong-Hyeok;Chi, Gwang-Hoon
    • Proceedings of the KSRS Conference
    • /
    • 2009.03a
    • /
    • pp.196-201
    • /
    • 2009
  • KOMPSAT-2 위성영상은 공간해상도가 우수한 1-m급 전정색 영상과, 상대적으로 분광해상도가 우수한 4-m급 다중분광 영상을 동시 취득하는 다중 센서이다. 영상융합기법의 적용을 통해 1-m급 고해상도 다중분광 영상의 취득이 가능하며, 이것은 1-m급에서 식별 가능한 객체들을 분류하고 변화 탐지하는데 활용될 수 있다. 본 연구는 IHS (Intensity-Hue-Saturation) 융합 기법의 I (Intensity) 와 $\delta$ 값을 조정함으로써 새로운 융합기법을 제안하였으며, 육안분석과 상관계수를 가지고 다른 융합기법들과 비교분석하였다. 실험 결과, 제안된 기법의 융합영상은 원본 다중분광영상과 가장 높은 상관계수를 나타내었으며, 상관계수가 유사한 웨이브릿 융합 또는 고대역 필터링과의 육안분석에서 확연히 우수한 공간 선명도를 나타내는 것으로 평가되었다.

  • PDF

Local-Based Iterative Histogram Matching for Relative Radiometric Normalization

  • Seo, Dae Kyo;Eo, Yang Dam
    • Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
    • /
    • v.37 no.5
    • /
    • pp.323-330
    • /
    • 2019
  • Radiometric normalization with multi-temporal satellite images is essential for time series analysis and change detection. Generally, relative radiometric normalization, which is an image-based method, is performed, and histogram matching is a representative method for normalizing the non-linear properties. However, since it utilizes global statistical information only, local information is not considered at all. Thus, this paper proposes a histogram matching method considering local information. The proposed method divides histograms based on density, mean, and standard deviation of image intensities, and performs histogram matching locally on the sub-histogram. The matched histogram is then further partitioned and this process is performed again, iteratively, controlled with the wasserstein distance. Finally, the proposed method is compared to global histogram matching. The experimental results show that the proposed method is visually and quantitatively superior to the conventional method, which indicates the applicability of the proposed method to the radiometric normalization of multi-temporal images with non-linear properties.

Pose Tracking of Moving Sensor using Monocular Camera and IMU Sensor

  • Jung, Sukwoo;Park, Seho;Lee, KyungTaek
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.15 no.8
    • /
    • pp.3011-3024
    • /
    • 2021
  • Pose estimation of the sensor is important issue in many applications such as robotics, navigation, tracking, and Augmented Reality. This paper proposes visual-inertial integration system appropriate for dynamically moving condition of the sensor. The orientation estimated from Inertial Measurement Unit (IMU) sensor is used to calculate the essential matrix based on the intrinsic parameters of the camera. Using the epipolar geometry, the outliers of the feature point matching are eliminated in the image sequences. The pose of the sensor can be obtained from the feature point matching. The use of IMU sensor can help initially eliminate erroneous point matches in the image of dynamic scene. After the outliers are removed from the feature points, these selected feature points matching relations are used to calculate the precise fundamental matrix. Finally, with the feature point matching relation, the pose of the sensor is estimated. The proposed procedure was implemented and tested, comparing with the existing methods. Experimental results have shown the effectiveness of the technique proposed in this paper.

Improved Residual Network for Single Image Super Resolution

  • Xu, Yinxiang;Wee, Seungwoo;Jeong, Jechang
    • Proceedings of the Korean Society of Broadcast Engineers Conference
    • /
    • 2019.06a
    • /
    • pp.102-105
    • /
    • 2019
  • In the classical single-image super-resolution (SISR) reconstruction method using convolutional neural networks, the extracted features are not fully utilized, and the training time is too long. Aiming at the above problems, we proposed an improved SISR method based on a residual network. Our proposed method uses a feature fusion technology based on improved residual blocks. The advantage of this method is the ability to fully and effectively utilize the features extracted from the shallow layers. In addition, we can see that the feature fusion can adaptively preserve the information from current and previous residual blocks and stabilize the training for deeper network. And we use the global residual learning to make network training easier. The experimental results show that the proposed method gets better performance than classic reconstruction methods.

  • PDF