• 제목/요약/키워드: Multiscale fusion

검색결과 12건 처리시간 0.026초

Perceptual Fusion of Infrared and Visible Image through Variational Multiscale with Guide Filtering

  • Feng, Xin;Hu, Kaiqun
    • Journal of Information Processing Systems
    • /
    • 제15권6호
    • /
    • pp.1296-1305
    • /
    • 2019
  • To solve the problem of poor noise suppression capability and frequent loss of edge contour and detailed information in current fusion methods, an infrared and visible light image fusion method based on variational multiscale decomposition is proposed. Firstly, the fused images are separately processed through variational multiscale decomposition to obtain texture components and structural components. The method of guided filter is used to carry out the fusion of the texture components of the fused image. In the structural component fusion, a method is proposed to measure the fused weights with phase consistency, sharpness, and brightness comprehensive information. Finally, the texture components of the two images are fused. The structure components are added to obtain the final fused image. The experimental results show that the proposed method displays very good noise robustness, and it also helps realize better fusion quality.

Multiscale self-coordination of bidimensional empirical mode decomposition in image fusion

  • An, Feng-Ping;Zhou, Xian-Wei;Lin, Da-Chao
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • 제9권4호
    • /
    • pp.1441-1456
    • /
    • 2015
  • The bidimensional empirical mode decomposition (BEMD) algorithm with high adaptability is more suitable to process multiple image fusion than traditional image fusion. However, the advantages of this algorithm are limited by the end effects problem, multiscale integration problem and number difference of intrinsic mode functions in multiple images decomposition. This study proposes the multiscale self-coordination BEMD algorithm to solve this problem. This algorithm outside extending the feather information with the support vector machine which has a high degree of generalization, then it also overcomes the BEMD end effects problem with conventional mirror extension methods of data processing,. The coordination of the extreme value point of the source image helps solve the problem of multiscale information fusion. Results show that the proposed method is better than the wavelet and NSCT method in retaining the characteristics of the source image information and the details of the mutation information inherited from the source image and in significantly improving the signal-to-noise ratio.

Attention-based for Multiscale Fusion Underwater Image Enhancement

  • Huang, Zhixiong;Li, Jinjiang;Hua, Zhen
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • 제16권2호
    • /
    • pp.544-564
    • /
    • 2022
  • Underwater images often suffer from color distortion, blurring and low contrast, which is caused by the propagation of light in the underwater environment being affected by the two processes: absorption and scattering. To cope with the poor quality of underwater images, this paper proposes a multiscale fusion underwater image enhancement method based on channel attention mechanism and local binary pattern (LBP). The network consists of three modules: feature aggregation, image reconstruction and LBP enhancement. The feature aggregation module aggregates feature information at different scales of the image, and the image reconstruction module restores the output features to high-quality underwater images. The network also introduces channel attention mechanism to make the network pay more attention to the channels containing important information. The detail information is protected by real-time superposition with feature information. Experimental results demonstrate that the method in this paper produces results with correct colors and complete details, and outperforms existing methods in quantitative metrics.

A Novel Multifocus Image Fusion Algorithm Based on Nonsubsampled Contourlet Transform

  • Liu, Cuiyin;Cheng, Peng;Chen, Shu-Qing;Wang, Cuiwei;Xiang, Fenghong
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • 제7권3호
    • /
    • pp.539-557
    • /
    • 2013
  • A novel multifocus image fusion algorithm based on NSCT is proposed in this paper. In order to not only attain the image focusing properties and more visual information in the fused image, but also sensitive to the human visual perception, a local multidirection variance (LEOV) fusion rule is proposed for lowpass subband coefficient. In order to introduce more visual saliency, a modified local contrast is defined. In addition, according to the feature of distribution of highpass subband coefficients, a direction vector is proposed to constrain the modified local contrast and construct the new fusion rule for highpass subband coefficients selection The NSCT is a flexible multiscale, multidirection, and shift-invariant tool for image decomposition, which can be implemented via the atrous algorithm. The proposed fusion algorithm based on NSCT not only can prevent artifacts and erroneous from introducing into the fused image, but also can eliminate 'block effect' and 'frequency aliasing' phenomenon. Experimental results show that the proposed method achieved better fusion results than wavelet-based and CT-based fusion method in contrast and clarity.

Temperature thread multiscale finite element simulation of selective laser melting for the evaluation of process

  • Lee, Kang-Hyun;Yun, Gun Jin
    • Advances in aircraft and spacecraft science
    • /
    • 제8권1호
    • /
    • pp.31-51
    • /
    • 2021
  • Selective laser melting (SLM), one of the most widely used powder bed fusion (PBF) additive manufacturing (AM) technology, enables the fabrication of customized metallic parts with complex geometry by layer-by-layer fashion. However, SLM inherently poses several problems such as the discontinuities in the molten track and the steep temperature gradient resulting in a high degree of residual stress. To avoid such defects, thisstudy proposes a temperature thread multiscale model of SLM for the evaluation of the process at different scales. In microscale melt pool analysis, the laser beam parameters were evaluated based on the predicted melt pool morphology to check for lack-of-fusion or keyhole defects. The analysis results at microscale were then used to build an equivalent body heat flux model to obtain the residual stress distribution and the part distortions at the macroscale (part level). To identify the source of uneven heat dissipation, a liquid lifetime contour at macroscale was investigated. The predicted distortion was also experimentally validated showing a good agreement with the experimental measurement.

A multisource image fusion method for multimodal pig-body feature detection

  • Zhong, Zhen;Wang, Minjuan;Gao, Wanlin
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • 제14권11호
    • /
    • pp.4395-4412
    • /
    • 2020
  • The multisource image fusion has become an active topic in the last few years owing to its higher segmentation rate. To enhance the accuracy of multimodal pig-body feature segmentation, a multisource image fusion method was employed. Nevertheless, the conventional multisource image fusion methods can not extract superior contrast and abundant details of fused image. To superior segment shape feature and detect temperature feature, a new multisource image fusion method was presented and entitled as NSST-GF-IPCNN. Firstly, the multisource images were resolved into a range of multiscale and multidirectional subbands by Nonsubsampled Shearlet Transform (NSST). Then, to superior describe fine-scale texture and edge information, even-symmetrical Gabor filter and Improved Pulse Coupled Neural Network (IPCNN) were used to fuse low and high-frequency subbands, respectively. Next, the fused coefficients were reconstructed into a fusion image using inverse NSST. Finally, the shape feature was extracted using automatic threshold algorithm and optimized using morphological operation. Nevertheless, the highest temperature of pig-body was gained in view of segmentation results. Experiments revealed that the presented fusion algorithm was able to realize 2.102-4.066% higher average accuracy rate than the traditional algorithms and also enhanced efficiency.

Contourlet 변환 및 PCA에 의한 얼굴인식 (Face Recognition using Contourlet Transform and PCA)

  • 송창규;권석영;전명근
    • 한국지능시스템학회논문지
    • /
    • 제17권3호
    • /
    • pp.403-409
    • /
    • 2007
  • 컨투어렛 변환은 2차원의 웨이블렛 변환을 확장한 개념으로 다중스케일과 방향성필터뱅크를 이용한다. 이러한 컨투어렛 변환은 웨이블렛 변환의 특징인 다중스케일과 시간-주파수의 지역적 특성뿐만 아니라 방향성분에 대해서도 풍부한 정보를 얻을 수 있는 장점을 가지고 있다 본 논문에서는 컨투어렛 변환과 주성분분석기법을 이용하는 융합기법에 의한 얼굴인식 시스템을 제안한다. 제안된 방법은 먼저 컨투어렛 변환에 의해 얼굴영상을 방향성 부대역 영상으로 분할한 후, 주성분분석기법을 이용하여 방향성분별로 분할된 각각의 부영상에 대하여 특징벡터를 산출한다. 그리고 최종 단계에서는 각각의 대역별로 산출된 매칭도를 효과적으로 융합할 수 있는 융합기법을 이용하여 얼굴인식을 수행한다. 제안된 방법의 타당성을 보이기 위해 ORL 얼굴영상과 CBNU 얼굴영상을 대상으로 실험한 결과 기존 방법인 PCA나 웨이블렛 변환을 이용한 방법에 비해 향상된 인식 성능을 보임을 확인할 수 있었다.

다층 퍼셉트론과 마코프 랜덤 필드 모델을 이용한 베이지안 결 분할 (Bayesian Texture Segmentation Using Multi-layer Perceptron and Markov Random Field Model)

  • 김태형;엄일규;김유신
    • 대한전자공학회논문지SP
    • /
    • 제44권1호
    • /
    • pp.40-48
    • /
    • 2007
  • 이 논문은 다중 스케일 베이지안 관점에서 다층 퍼셉트론과 마코프 랜덤 필드를 사용한 새로운 결 분할 방법을 제안한다. 다층 퍼셉트론의 출력은 사후 확률을 모델링하므로 본 논문에서는 다중 스케일 웨이블릿 계수들을 다층 퍼셉트론의 입력으로 사용한다. 다층 퍼셉트론으로부터 구한 사후 확률과 MAP (maximum a posterior) 분류를 이용하여 각 스케일에서 결 분류를 수행한다. 또한 가장 섬세한 스케일에서 더 개선된 분할 결과를 얻기 위하여 모든 스케일에서 MAP 분류 결과들을 거친 스케일에서 섬세한 스케일까지 차례로 융합한다. 이런 과정은 한 스케일에서의 분류 정보와 그 인접한 보다 거친 스케일에서 얻어지는 문맥과 관련한 연역적 정보를 이용하여 MAP 분류를 행함으로써 이루어진다. 이 융합 과정에서, MRF (Markov random fields) 사전 모델이 평탄화 제한자로서 동작하고, 깁스 샘플러 (Gibbs sampler)는 MAP 분류기로서 동작한다. 제안한 분할 방법은 HMT (Hidden Markov Trees) 모델과 HMTseg 알고리즘을 이용한 결 분할 방법보다 더 좋은 성능을 보인다.

Vehicle Image Recognition Using Deep Convolution Neural Network and Compressed Dictionary Learning

  • Zhou, Yanyan
    • Journal of Information Processing Systems
    • /
    • 제17권2호
    • /
    • pp.411-425
    • /
    • 2021
  • In this paper, a vehicle recognition algorithm based on deep convolutional neural network and compression dictionary is proposed. Firstly, the network structure of fine vehicle recognition based on convolutional neural network is introduced. Then, a vehicle recognition system based on multi-scale pyramid convolutional neural network is constructed. The contribution of different networks to the recognition results is adjusted by the adaptive fusion method that adjusts the network according to the recognition accuracy of a single network. The proportion of output in the network output of the entire multiscale network. Then, the compressed dictionary learning and the data dimension reduction are carried out using the effective block structure method combined with very sparse random projection matrix, which solves the computational complexity caused by high-dimensional features and shortens the dictionary learning time. Finally, the sparse representation classification method is used to realize vehicle type recognition. The experimental results show that the detection effect of the proposed algorithm is stable in sunny, cloudy and rainy weather, and it has strong adaptability to typical application scenarios such as occlusion and blurring, with an average recognition rate of more than 95%.

Thermo-mechanical damage of tungsten surfaces exposed to rapid transient plasma heat loads

  • Crosby, Tamer;Ghoniem, Nasr M.
    • Interaction and multiscale mechanics
    • /
    • 제4권3호
    • /
    • pp.207-217
    • /
    • 2011
  • International efforts have focused recently on the development of tungsten surfaces that can intercept energetic ionized and neutral atoms, and heat fluxes in the divertor region of magnetic fusion confinement devices. The combination of transient heating and local swelling due to implanted helium and hydrogen atoms has been experimentally shown to lead to severe surface and sub-surface damage. We present here a computational model to determine the relationship between the thermo-mechanical loading conditions, and the onset of damage and failure of tungsten surfaces. The model is based on thermo-elasticity, coupled with a grain boundary damage mode that includes contact cohesive elements for grain boundary sliding and fracture. This mechanics model is also coupled with a transient heat conduction model for temperature distributions following rapid thermal pulses. Results of the computational model are compared to experiments on tungsten bombarded with energetic helium and deuterium particle fluxes.