• Title/Summary/Keyword: multi-modal

Search Result 629, Processing Time 0.025 seconds

Modal Parameter Extraction Using a Digital Camera (디지털 카메라를 이용한 구조물의 동특성 추출)

  • Kim, Byeong-Hwa
    • Proceedings of the Korean Society for Noise and Vibration Engineering Conference
    • /
    • 2008.11a
    • /
    • pp.61-68
    • /
    • 2008
  • A set of modal parameters of a stay-cable have been extracted from a moving picture captured by a digital camera supported by shaking hands. It is hard to identify the center of targets attached on the cable surface from the blurred cable motion image, because of the high speed motion of cable, low sampling frequency of camera, and the shaking effect of camera. This study proposes a multi-template matching algorithm to resolve such difficulties. In addition, a sensitivity-based system identification algorithm is introduced to extract the natural frequencies and damping ratios from the ambient cable vibration data. Three sets of vibration tests are conducted to examine the validity of the proposed algorithms. The results show that the proposed technique is pretty feasible for extracting modal parameters from the severely shaking motion pictures.

  • PDF

Results and implications of the damage index method applied to a multi-span continuous segmental prestressed concrete bridge

  • Wang, Ming L.;Xu, Fan L.;Lloyd, George M.
    • Structural Engineering and Mechanics
    • /
    • v.10 no.1
    • /
    • pp.37-51
    • /
    • 2000
  • Identification of damage location based on modal measurement is an important problem in structural health monitoring. The damage index method that attempts to evaluate the changes in modal strain energy distribution has been found to be effective under certain circumstances. In this paper two damage index methods using bending strain energy and shear strain energy have been evaluated for numerous cases at different locations and degrees of damage. The objective is to evaluate the feasibility of the damage index method to localize the damage on large span concrete bridge. Finite element models were used as the test structures. Finally this method was used to predict the damage location in an actual structure, using the results of a modal survey from a large concrete bridge.

A Vibration Mode Analysis of Resilient Mounting System and Foundation Structure of Acoustic Enclosure using Finite Element Method (유한요소법을 이용한 음향차폐장치용 탄성마운트 시스템 및 받침대의 진동모드 해석)

  • 정우진;배수룡;함일배
    • Journal of KSNVE
    • /
    • v.9 no.3
    • /
    • pp.493-501
    • /
    • 1999
  • The vibration modes of resilient mounting system and foundation structure which support diesel engine/generator set and acoustic enclosure walls play an important role in the vibration transmission process. So, it is necessary to perform vibration mode analysis of resilient mounting system and foundation structure. For some reasons, if the vibration modal analysis of resilient mounting system and foundation structure of acoustic enclosure could be simultaneously done by finite element method, it would be very efficient approach. In this paper, vibration modal analysis method using finite element method for multi stage mounting system having n d.o.f model was proposed. Vibration analysis of single and double stage resilient mounting system was performed to verify the validity of the proposed method. Also frequency response results were compared in case of rigid foundation model and finite element foundation model which was compared with experimental modal analysis results.

  • PDF

Modal Parameter Extraction Using a Digital Camera (카메라를 이용한 구조물의 동특성 추출)

  • Kim, Byeong-Hwa
    • Transactions of the Korean Society for Noise and Vibration Engineering
    • /
    • v.18 no.12
    • /
    • pp.1229-1236
    • /
    • 2008
  • A set of modal parameters of a stay-cable have been extracted fi:on a moving picture captured by a digital camera supported by shaking hands. It is hard to identify the center of targets attached on the cable surface from the blurred cable motion image, because of the high speed motion of cable, low sampling frequency of camera, and the shaking effect of camera. This study proposes a multi-template matching algorithm to resolve such difficulties. In addition, a sensitivity-based system identification algorithm is introduced to extract the natural frequencies and damping ratios from the ambient cable vibration data. Three sets of vibration tests are conducted to examine the validity of the proposed algorithms. The results show that the proposed technique is pretty feasible for extracting modal parameters from the severely shaking motion pictures.

Modal rigidity center: it's use for assessing elastic torsion in asymmetric buildings

  • Georgoussis, George K.
    • Earthquakes and Structures
    • /
    • v.1 no.2
    • /
    • pp.163-175
    • /
    • 2010
  • The vertical axis through the modal center of rigidity (m-CR) is used for interpreting the code torsional provisions in the design of eccentric multi-story building structures. The concept of m-CR has been demonstrated by the author in an earlier paper and the particular feature of this point is that when the vertical line of the centers of mass at the floor levels is passing through m-CR, minimum base torsion is developed. For this reason the aforesaid axis is used as reference axis for implementing the code provisions required by the equivalent static analysis. The study examines uniform mixed-bent-type multistory buildings with simple eccentricity, ranging from torsionally stiff to torsionally flexible systems. Using the results of a dynamic response spectrum analysis as a basis for comparisons, it is shown that the results of the code static design are on the safe side in torsionally stiff buildings, but unable to predict the required strength of bents on the stiff side of systems with a predominantly torsional response. Suggestions are made for improving the code provisions in such cases.

A wavelet finite element-based adaptive-scale damage detection strategy

  • He, Wen-Yu;Zhu, Songye;Ren, Wei-Xin
    • Smart Structures and Systems
    • /
    • v.14 no.3
    • /
    • pp.285-305
    • /
    • 2014
  • This study employs a novel beam-type wavelet finite element model (WFEM) to fulfill an adaptive-scale damage detection strategy in which structural modeling scales are not only spatially varying but also dynamically changed according to actual needs. Dynamical equations of beam structures are derived in the context of WFEM by using the second-generation cubic Hermite multiwavelets as interpolation functions. Based on the concept of modal strain energy, damage in beam structures can be detected in a progressive manner: the suspected region is first identified using a low-scale structural model and the more accurate location and severity of the damage can be estimated using a multi-scale model with local refinement in the suspected region. Although this strategy can be implemented using traditional finite element methods, the multi-scale and localization properties of the WFEM considerably facilitate the adaptive change of modeling scales in a multi-stage process. The numerical examples in this study clearly demonstrate that the proposed damage detection strategy can progressively and efficiently locate and quantify damage with minimal computation effort and a limited number of sensors.

Multi-dimensional sensor placement optimization for Canton Tower focusing on application demands

  • Yi, Ting-Hua;Li, Hong-Nan;Wang, Xiang
    • Smart Structures and Systems
    • /
    • v.12 no.3_4
    • /
    • pp.235-250
    • /
    • 2013
  • Optimal sensor placement (OSP) technique plays a key role in the structural health monitoring (SHM) of large-scale structures. According to the mathematical background and implicit assumptions made in the triaxial effective independence (EfI) method, this paper presents a novel multi-dimensional OSP method for the Canton Tower focusing on application demands. In contrast to existing methods, the presented method renders the corresponding target mode shape partitions as linearly independent as possible and, at the same time, maintains the stability of the modal matrix in the iteration process. The modal assurance criterion (MAC), determinant of the Fisher Information Matrix (FIM) and condition number of the FIM have been taken as the optimal criteria, respectively, to demonstrate the feasibility and effectiveness of the proposed method. Numerical investigations suggest that the proposed method outperforms the original EfI method in all instances as expected, which is looked forward to be even more pronounced should it be used for other multi-dimensional optimization problems.

Multimodal Sentiment Analysis Using Review Data and Product Information (리뷰 데이터와 제품 정보를 이용한 멀티모달 감성분석)

  • Hwang, Hohyun;Lee, Kyeongchan;Yu, Jinyi;Lee, Younghoon
    • The Journal of Society for e-Business Studies
    • /
    • v.27 no.1
    • /
    • pp.15-28
    • /
    • 2022
  • Due to recent expansion of online market such as clothing, utilizing customer review has become a major marketing measure. User review has been used as a tool of analyzing sentiment of customers. Sentiment analysis can be largely classified with machine learning-based and lexicon-based method. Machine learning-based method is a learning classification model referring review and labels. As research of sentiment analysis has been developed, multi-modal models learned by images and video data in reviews has been studied. Characteristics of words in reviews are differentiated depending on products' and customers' categories. In this paper, sentiment is analyzed via considering review data and metadata of products and users. Gated Recurrent Unit (GRU), Long Short-Term Memory (LSTM), Self Attention-based Multi-head Attention models and Bidirectional Encoder Representation from Transformer (BERT) are used in this study. Same Multi-Layer Perceptron (MLP) model is used upon every products information. This paper suggests a multi-modal sentiment analysis model that simultaneously considers user reviews and product meta-information.

Research on Generative AI for Korean Multi-Modal Montage App (한국형 멀티모달 몽타주 앱을 위한 생성형 AI 연구)

  • Lim, Jeounghyun;Cha, Kyung-Ae;Koh, Jaepil;Hong, Won-Kee
    • Journal of Service Research and Studies
    • /
    • v.14 no.1
    • /
    • pp.13-26
    • /
    • 2024
  • Multi-modal generation is the process of generating results based on a variety of information, such as text, images, and audio. With the rapid development of AI technology, there is a growing number of multi-modal based systems that synthesize different types of data to produce results. In this paper, we present an AI system that uses speech and text recognition to describe a person and generate a montage image. While the existing montage generation technology is based on the appearance of Westerners, the montage generation system developed in this paper learns a model based on Korean facial features. Therefore, it is possible to create more accurate and effective Korean montage images based on multi-modal voice and text specific to Korean. Since the developed montage generation app can be utilized as a draft montage, it can dramatically reduce the manual labor of existing montage production personnel. For this purpose, we utilized persona-based virtual person montage data provided by the AI-Hub of the National Information Society Agency. AI-Hub is an AI integration platform aimed at providing a one-stop service by building artificial intelligence learning data necessary for the development of AI technology and services. The image generation system was implemented using VQGAN, a deep learning model used to generate high-resolution images, and the KoDALLE model, a Korean-based image generation model. It can be confirmed that the learned AI model creates a montage image of a face that is very similar to what was described using voice and text. To verify the practicality of the developed montage generation app, 10 testers used it and more than 70% responded that they were satisfied. The montage generator can be used in various fields, such as criminal detection, to describe and image facial features.

A Study on Method for User Gender Prediction Using Multi-Modal Smart Device Log Data (스마트 기기의 멀티 모달 로그 데이터를 이용한 사용자 성별 예측 기법 연구)

  • Kim, Yoonjung;Choi, Yerim;Kim, Solee;Park, Kyuyon;Park, Jonghun
    • The Journal of Society for e-Business Studies
    • /
    • v.21 no.1
    • /
    • pp.147-163
    • /
    • 2016
  • Gender information of a smart device user is essential to provide personalized services, and multi-modal data obtained from the device is useful for predicting the gender of the user. However, the method for utilizing each of the multi-modal data for gender prediction differs according to the characteristics of the data. Therefore, in this study, an ensemble method for predicting the gender of a smart device user by using three classifiers that have text, application, and acceleration data as inputs, respectively, is proposed. To alleviate privacy issues that occur when text data generated in a smart device are sent outside, a classification method which scans smart device text data only on the device and classifies the gender of the user by matching text data with predefined sets of word. An application based classifier assigns gender labels to executed applications and predicts gender of the user by comparing the label ratio. Acceleration data is used with Support Vector Machine to classify user gender. The proposed method was evaluated by using the actual smart device log data collected from an Android application. The experimental results showed that the proposed method outperformed the compared methods.