• Title/Summary/Keyword: Multi-Level Fusion

Search Result 86, Processing Time 0.026 seconds

Multi-level Attention Fusion Network for Machine Reading Comprehension (Multi-level Attention Fusion을 이용한 기계독해)

  • Park, Kwang-Hyeon;Na, Seung-Hoon;Choi, Yun-Su;Chang, Du-Seong
    • Annual Conference on Human and Language Technology
    • /
    • 2018.10a
    • /
    • pp.259-262
    • /
    • 2018
  • 기계독해의 목표는 기계가 주어진 문맥을 이해하고 문맥에 대한 질문에 대답할 수 있도록 하는 것이다. 본 논문에서는 Multi-level Attention에 정보를 효율적으로 융합 수 있는 Fusion 함수를 결합하고, Answer module에Stochastic multi-step answer를 적용하여 SQuAD dev 데이터 셋에서 EM=78.63%, F1=86.36%의 성능을 보였다.

  • PDF

Multi-Frame Face Classification with Decision-Level Fusion based on Photon-Counting Linear Discriminant Analysis

  • Yeom, Seokwon
    • International Journal of Fuzzy Logic and Intelligent Systems
    • /
    • v.14 no.4
    • /
    • pp.332-339
    • /
    • 2014
  • Face classification has wide applications in security and surveillance. However, this technique presents various challenges caused by pose, illumination, and expression changes. Face recognition with long-distance images involves additional challenges, owing to focusing problems and motion blurring. Multiple frames under varying spatial or temporal settings can acquire additional information, which can be used to achieve improved classification performance. This study investigates the effectiveness of multi-frame decision-level fusion with photon-counting linear discriminant analysis. Multiple frames generate multiple scores for each class. The fusion process comprises three stages: score normalization, score validation, and score combination. Candidate scores are selected during the score validation process, after the scores are normalized. The score validation process removes bad scores that can degrade the final output. The selected candidate scores are combined using one of the following fusion rules: maximum, averaging, and majority voting. Degraded facial images are employed to demonstrate the robustness of multi-frame decision-level fusion in harsh environments. Out-of-focus and motion blurring point-spread functions are applied to the test images, to simulate long-distance acquisition. Experimental results with three facial data sets indicate the efficiency of the proposed decision-level fusion scheme.

Multi-Level Fusion Processing Algorithm for Complex Radar Signals Based on Evidence Theory

  • Tian, Runlan;Zhao, Rupeng;Wang, Xiaofeng
    • Journal of Information Processing Systems
    • /
    • v.15 no.5
    • /
    • pp.1243-1257
    • /
    • 2019
  • As current algorithms unable to perform effective fusion processing of unknown complex radar signals lacking database, and the result is unstable, this paper presents a multi-level fusion processing algorithm for complex radar signals based on evidence theory as a solution to this problem. Specifically, the real-time database is initially established, accompanied by similarity model based on parameter type, and then similarity matrix is calculated. D-S evidence theory is subsequently applied to exercise fusion processing on the similarity of parameters concerning each signal and the trust value concerning target framework of each signal in order. The signals are ultimately combined and perfected. The results of simulation experiment reveal that the proposed algorithm can exert favorable effect on the fusion of unknown complex radar signals, with higher efficiency and less time, maintaining stable processing even of considerable samples.

Rank-level Fusion Method That Improves Recognition Rate by Using Correlation Coefficient (상관계수를 이용하여 인식률을 향상시킨 rank-level fusion 방법)

  • Ahn, Jung-ho;Jeong, Jae Yeol;Jeong, Ik Rae
    • Journal of the Korea Institute of Information Security & Cryptology
    • /
    • v.29 no.5
    • /
    • pp.1007-1017
    • /
    • 2019
  • Currently, most biometrics system authenticates users by using single biometric information. This method has many problems such as noise problem, sensitivity to data, spoofing, a limitation of recognition rate. One method to solve this problems is to use multi biometric information. The multi biometric authentication system performs information fusion for each biometric information to generate new information, and then uses the new information to authenticate the user. Among information fusion methods, a score-level fusion method is widely used. However, there is a problem that a normalization operation is required, and even if data is same, the recognition rate varies depending on the normalization method. A rank-level fusion method that does not require normalization is proposed. However, a existing rank-level fusion methods have lower recognition rate than score-level fusion methods. To solve this problem, we propose a rank-level fusion method with higher recognition rate than a score-level fusion method using correlation coefficient. The experiment compares recognition rate of a existing rank-level fusion methods with the recognition rate of proposed method using iris information(CASIA V3) and face information(FERET V1). We also compare with score-level fusion methods. As a result, the recognition rate improve from about 0.3% to 3.3%.

Multi-Level Anterior Interbody Fusion with Internal Fixation in Cervical Spine (다분절 경추 유합 및 내고정 수술결과)

  • Jeon, Woo-Youl;Bae, Jang-Ho;Jung, Byoung-Woo;Kim, Seong-Ho;Kim, Oh-Lyong;Choi, Byung-Yon;Cho, Soo-Ho
    • Journal of Korean Neurosurgical Society
    • /
    • v.30 no.sup1
    • /
    • pp.55-60
    • /
    • 2001
  • Objective : The purpose of the present study was to examine neurologic changes, fusion rate and degree of kyphosis from the surgical results of those patients who underwent multi-level anterior interbody fusion and internal fixation. Methods : Among 63 cases of the patients who received multi-level anterior interbody fusion and internal fixation in 5 years between 1995 to 1999 at the neurosurgery department, we performed a retrospective study in 52 cases that could be followed up with dynamic view imaging ; the results were compared and analyzed. The analysis was based on the results of history taking, physical findings and radiologic findings, and Odom criteria were used to classify those cases with neurologic changes. Results : Among those 52 cases in whom the follow-up was possible for at least a year and dynamic view imaging was possible, bone fusion was seen in 93% of the trauma cases and 95% in the non-trauma cases and overall bone fusion was observed in 94% of the cases. Bone fusion was seen in 93% of the autobone cases, 95% of the allobone cases, and 94% of the Mesh cases. Radiologic changes were observed by comparing the lateral view after surgery ; kyphosis was seen in 53% of the autobone cases, in 70% of the allobone cases, and in 35% of Mesh cases ; in 45% and 60% of the non-trauma cases and trauma cases, respectively ; and in 55% of the 2 level fusion cases and 46% of the 3 level fusion cases. Neurologic changes classified according to Odom criteria showed excellent result in 48% of all the cases, good in 23%, fair in 4%, and poor in 25%. Conclusion : Even those cases with multi-level fusion, a high fusion rate could be obtained by performing anterior interbody fusion and internal fixation ; those cases with kyphosis were related more with the presence or absence of posterior compartment injury rather than the fusion level ; and those trauma cases showed not much difference in the fusion rate compared with non-trauma cases but had a high possibility of kyphosis.

  • PDF

Convolutional Neural Network Based Multi-feature Fusion for Non-rigid 3D Model Retrieval

  • Zeng, Hui;Liu, Yanrong;Li, Siqi;Che, JianYong;Wang, Xiuqing
    • Journal of Information Processing Systems
    • /
    • v.14 no.1
    • /
    • pp.176-190
    • /
    • 2018
  • This paper presents a novel convolutional neural network based multi-feature fusion learning method for non-rigid 3D model retrieval, which can investigate the useful discriminative information of the heat kernel signature (HKS) descriptor and the wave kernel signature (WKS) descriptor. At first, we compute the 2D shape distributions of the two kinds of descriptors to represent the 3D model and use them as the input to the networks. Then we construct two convolutional neural networks for the HKS distribution and the WKS distribution separately, and use the multi-feature fusion layer to connect them. The fusion layer not only can exploit more discriminative characteristics of the two descriptors, but also can complement the correlated information between the two kinds of descriptors. Furthermore, to further improve the performance of the description ability, the cross-connected layer is built to combine the low-level features with high-level features. Extensive experiments have validated the effectiveness of the designed multi-feature fusion learning method.

Multimodal Biometric Using a Hierarchical Fusion of a Person's Face, Voice, and Online Signature

  • Elmir, Youssef;Elberrichi, Zakaria;Adjoudj, Reda
    • Journal of Information Processing Systems
    • /
    • v.10 no.4
    • /
    • pp.555-567
    • /
    • 2014
  • Biometric performance improvement is a challenging task. In this paper, a hierarchical strategy fusion based on multimodal biometric system is presented. This strategy relies on a combination of several biometric traits using a multi-level biometric fusion hierarchy. The multi-level biometric fusion includes a pre-classification fusion with optimal feature selection and a post-classification fusion that is based on the similarity of the maximum of matching scores. The proposed solution enhances biometric recognition performances based on suitable feature selection and reduction, such as principal component analysis (PCA) and linear discriminant analysis (LDA), as much as not all of the feature vectors components support the performance improvement degree.

A Survey of Fusion Techniques for Multi-spectral Images

  • Achalakul, Tiranee
    • Proceedings of the IEEK Conference
    • /
    • 2002.07b
    • /
    • pp.1244-1247
    • /
    • 2002
  • This paper discusses various algorithms to the fusion of multi-spectral image. These fusion techniques have a wide variety of applications that range from hospital pathology to battlefield management. Different algorithms in each fusion level, namely data, feature, and decision are compared. The PCT-Based algorithm, which has the characteristic of data compression, is described. The algorithm is experimented on a foliated aerial scene and the fusion result is presented.

  • PDF

Multi-focus Image Fusion using Fully Convolutional Two-stream Network for Visual Sensors

  • Xu, Kaiping;Qin, Zheng;Wang, Guolong;Zhang, Huidi;Huang, Kai;Ye, Shuxiong
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.12 no.5
    • /
    • pp.2253-2272
    • /
    • 2018
  • We propose a deep learning method for multi-focus image fusion. Unlike most existing pixel-level fusion methods, either in spatial domain or in transform domain, our method directly learns an end-to-end fully convolutional two-stream network. The framework maps a pair of different focus images to a clean version, with a chain of convolutional layers, fusion layer and deconvolutional layers. Our deep fusion model has advantages of efficiency and robustness, yet demonstrates state-of-art fusion quality. We explore different parameter settings to achieve trade-offs between performance and speed. Moreover, the experiment results on our training dataset show that our network can achieve good performance with subjective visual perception and objective assessment metrics.

Minimally Invasive Multi-Level Posterior Lumbar Interbody Fusion Using a Percutaneously Inserted Spinal Fixation System : Technical Tips, Surgical Outcomes

  • Kim, Hyeun-Sung;Park, Keun-Ho;Ju, Chag-Il;Kim, Seok-Won;Lee, Seung-Myung;Shin, Ho
    • Journal of Korean Neurosurgical Society
    • /
    • v.50 no.5
    • /
    • pp.441-445
    • /
    • 2011
  • Objective : There are technical limitations of multi-level posterior pedicle screw fixation performed by the percutaneous technique. The purpose of this study was to describe the surgical technique and outcome of minimally invasive multi-level posterior lumbar interbody fusion (PLIF) and to determine its efficacy. Methods : Forty-two patients who underwent mini-open PLIF using the percutaneous screw fixation system were studied. The mean age of the patients was 59.1 (range, 23 to 78 years). Two levels were involved in 32 cases and three levels in 10 cases. The clinical outcome was assessed using the visual analog scale (VAS) and Low Back Outcome Score (LBOS). Achievement of radiological fusion, intra-operative blood loss, the midline surgical scar and procedure related complications were also analyzed. Results : The mean follow-up period was 25.3 months. The mean LBOS prior to surgery was 34.5, which was improved to 49.1 at the final follow up. The mean pain score (VAS) prior to surgery was 7.5 and it was decreased to 2.9 at the last follow up. The mean estimated blood loss was 238 mL (140-350) for the two level procedures and 387 mL (278-458) for three levels. The midline surgical scar was 6.27 cm for two levels and 8.25 cm for three level procedures. Complications included two cases of asymptomatic medial penetration of the pedicle border. However, there were no signs of neurological deterioration or fusion failure. Conclusion : Multi-level, minimally invasive PLIF can be performed effectively using the percutaneous transpedicular screw fixation system. It can be an alternative to the traditional open procedures.