• 제목/요약/키워드: multi-modal

검색결과 631건 처리시간 0.023초

메모리공유 기반의 DVB-T/T-DMB 통합 TS의 역다중화기 (Integral TS Demultiplexer of Memory Sharing based DVB-T/T-DMB Receiver)

  • 권기원;백종호;강민구
    • 한국인터넷방송통신학회논문지
    • /
    • 제10권6호
    • /
    • pp.17-22
    • /
    • 2010
  • 본 논문에서는 유럽향 지상파 디지털 방송 표준인 DVB-T(Digital Video Broadcasting Terrestrial)와 지상파 모바일 방송 표준인 T-DMB(Terrestrial Digital Multimedia Broadcasting)의 TS(Transport Stream)를 하나의 TS로 역다중화하는 멀티모드 방송의 통합 역다중화기(Demultiplexer)를 제안한다. 제안한 TS통합 역다중화 기능을 수행하는 USB 기반의 통합 수신기는 메모리공유기법에 의해 시스템의 부하를 감소하도록 스트림을 제어함으로서 오디오를 재생하였다. 그 결과로 위도우즈 기반의 통합 역다중화기는 각각 기존의 단일모드 DVB-T 역다중화기에 비해 CPU의 사용 점유율 성능이 향상되었다.

균등화 및 분류기에 따른 다중 생체 인식 시스템의 성능 평가 (Performance Evaluation of Multimodal Biometric System for Normalization Methods and Classifiers)

  • 고현주;우나영;신용녀;김재성;김학일;전명근
    • 한국정보과학회논문지:소프트웨어및응용
    • /
    • 제34권4호
    • /
    • pp.377-388
    • /
    • 2007
  • 본 연구는 다중 생체 인식 기법을 이용하여 개인 확인 및 인증을 구현한 것으로, 단일생체인식 에서 많이 사용되어 지고 있는 생체 정보 중 얼굴과 지문, 홍채를 이용하여 상호 비교하고 구현하였다. 이를 위한 결합방식으로 단일 생체인식에서 얻은 유사도를 이용하는 방식인 유사도 단계에서의 결합방식을 적용하였으며, 이때의 각 유사도가 동일한 범위가 되도록 하는 여러 가지 균등화 방법에 대하여 연구하였다. 결합방법으로는 가중치 합, Support Vector Machine, Fisher 분류기, 베이시안 분류기를 사용하여 비교하였다. 다양한 실험결과, 사용되는 다중생체인식 조합에 따라 우수한 성능을 보이는 균등화 방법 및 분류기가 다르게 나타남을 알 수 있었다.

Jointly Image Topic and Emotion Detection using Multi-Modal Hierarchical Latent Dirichlet Allocation

  • Ding, Wanying;Zhu, Junhuan;Guo, Lifan;Hu, Xiaohua;Luo, Jiebo;Wang, Haohong
    • Journal of Multimedia Information System
    • /
    • 제1권1호
    • /
    • pp.55-67
    • /
    • 2014
  • Image topic and emotion analysis is an important component of online image retrieval, which nowadays has become very popular in the widely growing social media community. However, due to the gaps between images and texts, there is very limited work in literature to detect one image's Topics and Emotions in a unified framework, although topics and emotions are two levels of semantics that often work together to comprehensively describe one image. In this work, a unified model, Joint Topic/Emotion Multi-Modal Hierarchical Latent Dirichlet Allocation (JTE-MMHLDA) model, which extends previous LDA, mmLDA, and JST model to capture topic and emotion information at the same time from heterogeneous data, is proposed. Specifically, a two level graphical structured model is built to realize sharing topics and emotions among the whole document collection. The experimental results on a Flickr dataset indicate that the proposed model efficiently discovers images' topics and emotions, and significantly outperform the text-only system by 4.4%, vision-only system by 18.1% in topic detection, and outperforms the text-only system by 7.1%, vision-only system by 39.7% in emotion detection.

  • PDF

SVM 결정법칙에 의한 얼굴 및 서명기반 다중생체인식 시스템 (Multi-modal Biometrics System Based on Face and Signature by SVM Decision Rule)

  • 민준오;이대종;전명근
    • 정보처리학회논문지B
    • /
    • 제11B권7호
    • /
    • pp.885-892
    • /
    • 2004
  • 본 논문에서는 SVM에 기반을 둔 결정법칙에 의해 얼굴인식과 서명인식시스템으로 구성된 다중생체인식시스템을 제안하고자 한다. 이를 위해 퍼지 선형판별기법(Fuzzy Linear Discriminant Analysis : Fnzzy LDA)를 이용한 얼굴인식과 선형판별분석기법과 구간매칭기법을 이용한 서명인식을 구축하였다. 두 개의 단일생체인식시스템을 효과적으로 융합시키기 위해 우선 독립적인 두 개의 생체인식시스템에 의해 산출된 매칭도로부터 등록자(Genuine)와 침입자(Impostor)의 확률 분포 모델을 생성한 후, SVM(Support Vector Machine)에 의해 최종 인증하는 구조로 되어있다. 제안된 방법인 SVM기반 결정법칙을 적용하여 실험한 결과 기존에 결정법칙으로 많이 사용되고 있는 가중치합과 결정트리 방식에 비해 각각 $1.654{\%}$$3.3{\%}$의 인식률 향상을 나타내 제안된 방법의 우수성을 나타냈다.

Deep Image Annotation and Classification by Fusing Multi-Modal Semantic Topics

  • Chen, YongHeng;Zhang, Fuquan;Zuo, WanLi
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • 제12권1호
    • /
    • pp.392-412
    • /
    • 2018
  • Due to the semantic gap problem across different modalities, automatically retrieval from multimedia information still faces a main challenge. It is desirable to provide an effective joint model to bridge the gap and organize the relationships between them. In this work, we develop a deep image annotation and classification by fusing multi-modal semantic topics (DAC_mmst) model, which has the capacity for finding visual and non-visual topics by jointly modeling the image and loosely related text for deep image annotation while simultaneously learning and predicting the class label. More specifically, DAC_mmst depends on a non-parametric Bayesian model for estimating the best number of visual topics that can perfectly explain the image. To evaluate the effectiveness of our proposed algorithm, we collect a real-world dataset to conduct various experiments. The experimental results show our proposed DAC_mmst performs favorably in perplexity, image annotation and classification accuracy, comparing to several state-of-the-art methods.

BIM and Thermographic Sensing: Reflecting the As-is Building Condition in Energy Analysis

  • Ham, Youngjib;Golparvar-Fard, Mani
    • Journal of Construction Engineering and Project Management
    • /
    • 제5권4호
    • /
    • pp.16-22
    • /
    • 2015
  • This paper presents an automated computer vision-based system to update BIM data by leveraging multi-modal visual data collected from existing buildings under inspection. Currently, visual inspections are conducted for building envelopes or mechanical systems, and auditors analyze energy-related contextual information to examine if their performance is maintained as expected by the design. By translating 3D surface thermal profiles into energy performance metrics such as actual R-values at point-level and by mapping such properties to the associated BIM elements using XML Document Object Model (DOM), the proposed method shortens the energy performance modeling gap between the architectural information in the as-designed BIM and the as-is building condition, which improve the reliability of building energy analysis. Several case studies were conducted to experimentally evaluate their impact on BIM-based energy analysis to calculate energy load. The experimental results on existing buildings show that (1) the point-level thermography-based thermal resistance measurement can be automatically matched with the associated BIM elements; and (2) their corresponding thermal properties are automatically updated in gbXML schema. This paper provides practitioners with insight to uncover the fundamentals of how multi-modal visual data can be used to improve the accuracy of building energy modeling for retrofit analysis. Open research challenges and lessons learned from real-world case studies are discussed in detail.

Updating BIM: Reflecting Thermographic Sensing in BIM-based Building Energy Analysis

  • Ham, Youngjib;Golparvar-Fard, Mani
    • 국제학술발표논문집
    • /
    • The 6th International Conference on Construction Engineering and Project Management
    • /
    • pp.532-536
    • /
    • 2015
  • This paper presents an automated computer vision-based system to update BIM data by leveraging multi-modal visual data collected from existing buildings under inspection. Currently, visual inspections are conducted for building envelopes or mechanical systems, and auditors analyze energy-related contextual information to examine if their performance is maintained as expected by the design. By translating 3D surface thermal profiles into energy performance metrics such as actual R-values at point-level and by mapping such properties to the associated BIM elements using XML Document Object Model (DOM), the proposed method shortens the energy performance modeling gap between the architectural information in the as-designed BIM and the as-is building condition, which improve the reliability of building energy analysis. The experimental results on existing buildings show that (1) the point-level thermography-based thermal resistance measurement can be automatically matched with the associated BIM elements; and (2) their corresponding thermal properties are automatically updated in gbXML schema. This paper provides practitioners with insight to uncover the fundamentals of how multi-modal visual data can be used to improve the accuracy of building energy modeling for retrofit analysis. Open research challenges and lessons learned from real-world case studies are discussed in detail.

  • PDF

Monitoring and performance assessment of a highway bridge via operational modal analysis

  • Reza Akbari;Saeed Maadani;Shahrokh Maalek
    • Structural Monitoring and Maintenance
    • /
    • 제10권3호
    • /
    • pp.191-205
    • /
    • 2023
  • In this paper, through operational modal analysis and ambient vibration tests, the dynamic characteristics of a multi-span simply-supported reinforced concrete highway bridge deck was determined and the results were used to assess the quality of construction of the individual spans. Supporting finite element (FE) models were created and analyzed according to the design drawings. After carrying out the dynamic tests and extracting the modal properties of the deck, the quality of construction was relatively assessed by comparing the results obtained from all the tests from the individual spans and the FE results. A comparison of the test results among the different spans showed a maximum difference value of around 9.3 percent between the superstructure's natural frequencies. These minor differences besides the obtained values of modal damping ratios, in which the differences were not more than 5 percent, can be resulted from suitable performance, health, and acceptable construction quality of the bridge.

A novel PSO-based algorithm for structural damage detection using Bayesian multi-sample objective function

  • Chen, Ze-peng;Yu, Ling
    • Structural Engineering and Mechanics
    • /
    • 제63권6호
    • /
    • pp.825-835
    • /
    • 2017
  • Significant improvements to methodologies on structural damage detection (SDD) have emerged in recent years. However, many methods are related to inversion computation which is prone to be ill-posed or ill-conditioning, leading to low-computing efficiency or inaccurate results. To explore a more accurate solution with satisfactory efficiency, a PSO-INM algorithm, combining particle swarm optimization (PSO) algorithm and an improved Nelder-Mead method (INM), is proposed to solve multi-sample objective function defined based on Bayesian inference in this study. The PSO-based algorithm, as a heuristic algorithm, is reliable to explore solution to SDD problem converted into a constrained optimization problem in mathematics. And the multi-sample objective function provides a stable pattern under different level of noise. Advantages of multi-sample objective function and its superior over traditional objective function are studied. Numerical simulation results of a two-storey frame structure show that the proposed method is sensitive to multi-damage cases. For further confirming accuracy of the proposed method, the ASCE 4-storey benchmark frame structure subjected to single and multiple damage cases is employed. Different kinds of modal identification methods are utilized to extract structural modal data from noise-contaminating acceleration responses. The illustrated results show that the proposed method is efficient to exact locations and extents of induced damages in structures.

적층 직물 구조에 따른 탄소강화플라스틱 소재 동적 특성 분석 (Dynamic Analysis of Carbon-fiber-reinforced Plastic for Different Multi-layered Fabric Structure)

  • 김찬중
    • 한국소음진동공학회논문집
    • /
    • 제26권4호
    • /
    • pp.375-382
    • /
    • 2016
  • The mechanical property of a carbon-fiber-reinforced plastic (CFRP) is subjected to two elements, carbon fiber and polymer resin, in a first step and the selection of multi-layered structure is second one. Many combination of fabric layers, i.e. plainweave, twillweave, can be derived for candidates of test specimen used for a basic mechanical components so that a reliable identification of dynamic nature of possible multi-layered structures are essential during the development of CFRP based component system. In this paper, three kinds of multi-layered structure specimens were prepared and the dynamic characteristics of service specimens were conducted through classical modal test process with impact hammer. In addition, the design sensitivity analysis based on transmissibility function was applied for the measured response data so that the response sensitivity for each resonance frequency were compared for three CFRP test specimens. Finally, the evaluation of CFRP specimen over different multi-layered fabric structures are commented from the experimental consequences.