• Title/Summary/Keyword: Multi-modal Data

Search Result 134, Processing Time 0.026 seconds

Human body learning system using multimodal and user-centric interfaces (멀티모달 사용자 중심 인터페이스를 적용한 인체 학습 시스템)

  • Kim, Ki-Min;Kim, Jae-Il;Park, Jin-Ah
    • 한국HCI학회:학술대회논문집
    • /
    • 2008.02a
    • /
    • pp.85-90
    • /
    • 2008
  • This paper describes the human body learning system using the multi-modal user interface. Through our learning system, students can study about human anatomy interactively. The existing learning methods use the one-way materials like images, text and movies. But we propose the new learning system that includes 3D organ surface models, haptic interface and the hierarchical data structure of human organs to serve enhanced learning that utilizes sensorimotor skills.

  • PDF

Band Selection Using Forward Feature Selection Algorithm for Citrus Huanglongbing Disease Detection

  • Katti, Anurag R.;Lee, W.S.;Ehsani, R.;Yang, C.
    • Journal of Biosystems Engineering
    • /
    • v.40 no.4
    • /
    • pp.417-427
    • /
    • 2015
  • Purpose: This study investigated different band selection methods to classify spectrally similar data - obtained from aerial images of healthy citrus canopies and citrus greening disease (Huanglongbing or HLB) infected canopies - using small differences without unmixing endmember components and therefore without the need for an endmember library. However, large number of hyperspectral bands has high redundancy which had to be reduced through band selection. The objective, therefore, was to first select the best set of bands and then detect citrus Huanglongbing infected canopies using these bands in aerial hyperspectral images. Methods: The forward feature selection algorithm (FFSA) was chosen for band selection. The selected bands were used for identifying HLB infected pixels using various classifiers such as K nearest neighbor (KNN), support vector machine (SVM), naïve Bayesian classifier (NBC), and generalized local discriminant bases (LDB). All bands were also utilized to compare results. Results: It was determined that a few well-chosen bands yielded much better results than when all bands were chosen, and brought the classification results on par with standard hyperspectral classification techniques such as spectral angle mapper (SAM) and mixture tuned matched filtering (MTMF). Median detection accuracies ranged from 66-80%, which showed great potential toward rapid detection of the disease. Conclusions: Among the methods investigated, a support vector machine classifier combined with the forward feature selection algorithm yielded the best results.

Wind load estimation of super-tall buildings based on response data

  • Zhi, Lun-hai;Chen, Bo;Fang, Ming-xin
    • Structural Engineering and Mechanics
    • /
    • v.56 no.4
    • /
    • pp.625-648
    • /
    • 2015
  • Modern super-tall buildings are more sensitive to strong winds. The evaluation of wind loads for the design of these buildings is of primary importance. A direct monitoring of wind forces acting on super-tall structures is quite difficult to be realized. Indirect measurements interpreted by inverse techniques are therefore favourable since dynamic response measurements are easier to be carried out. To this end, a Kalman filtering based inverse approach is developed in this study so as to estimate the wind loads on super-tall buildings based on limited structural responses. The optimum solution of Kalman filter gain by solving the Riccati equation is used to update the identification accuracy of external loads. The feasibility of the developed estimation method is investigated through the wind tunnel test of a typical super-tall building by using a Synchronous Multi-Pressure Scanning System. The effects of crucial factors such as the type of wind-induced response, the covariance matrix of noise, errors of structural modal parameters and levels of noise involved in the measurements on the wind load estimations are examined through detailed parametric study. The effects of the number of vibration modes on the identification quality are studied and discussed in detail. The made observations indicate that the proposed inverse approach is an effective tool for predicting the wind loads on super-tall buildings.

Moan Noise Analysis of Rear Disc Brake (후륜 디스크 브레이크 Moan 노이즈 해석)

  • 박진국;김찬중;이봉현;정호일;문창룡;김정락;이충렬
    • Proceedings of the Korean Society for Noise and Vibration Engineering Conference
    • /
    • 2004.05a
    • /
    • pp.607-612
    • /
    • 2004
  • Disc brake noise continues to be a major concern throughout the automotive industry despite efforts to reduce its occurrence. Eliminating vibrations during braking is an important task for both vehicle passenger comfort and reducing the overall environmental noise levels. There are several classes of disc brake noise, the major ones being squeal, judder, groan, and moan. In this study, analytical model for moan noise of rear disk brake is investigated. Modeling of the disc brake assembly to take account of the effect of different geometrical and contact parameters is studied through the use of multi-body model. The contact stiffness of the caliper and torque member plays an important role in controlling brake vibration. Therefore, a suitable material pair at the caliper/body contact has been made. An ADAMS model of a rear disc brake system was integrated with a flexible suspension trailng arm from MSC/NASTRAN. A fully non-linear dynamic simulatin of brake system behavior, containing rigid and flexible bodies, was performed for a Prescribed set of operating conditions. Simulation results were validated using data from vehicle experimental testing.

  • PDF

Function Optimization and Event Clustering by Adaptive Differential Evolution (적응성 있는 차분 진화에 의한 함수최적화와 이벤트 클러스터링)

  • Hwang, Hee-Soo
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.12 no.5
    • /
    • pp.451-461
    • /
    • 2002
  • Differential evolution(DE) has been preyed to be an efficient method for optimizing real-valued multi-modal objective functions. DE's main assets are its conceptual simplicity and ease of use. However, the convergence properties are deeply dependent on the control parameters of DE. This paper proposes an adaptive differential evolution(ADE) method which combines with a variant of DE and an adaptive mechanism of the control parameters. ADE contributes to the robustness and the easy use of the DE without deteriorating the convergence. 12 optimization problems is considered to test ADE. As an application of ADE the paper presents a supervised clustering method for predicting events, what is called, an evolutionary event clustering(EEC). EEC is tested for 4 cases used widely for the validation of data modeling.

The phenomenology of pain in Parkinson's disease

  • Camacho-Conde, Jose Antonio;Campos-Arillo, Victor Manuel
    • The Korean Journal of Pain
    • /
    • v.33 no.1
    • /
    • pp.90-96
    • /
    • 2020
  • Background: Parkinson's disease (PD) is a neurodegenerative disorder that is the second most common disorder after Alzheimer's disease. PD includes both "motor" and "non-motor" symptoms, one of which is pain. The aim of this study was to investigate the clinical characteristics of pain in patients with PD. Methods: This cross-sectional study included 250 patients diagnosed with PD, 70% of which had mild to moderate PD (stages 2/3 of Hoehn and Yahr scale). The average age was 67.4 years, and the average duration since PD diagnosis was 7.1 years. Relevant data collected from PD patients were obtained from their personal medical history. Results: The prevalence of pain was found to be high (82%), with most patients (79.2%) relating their pain to PD. Disease duration was correlated with the frequency of intense pain (R: 0.393; P < 0.05). PD pain is most frequently perceived as an electrical current (64%), and two pain varieties were most prevalent (2.60 ± 0.63). Our findings confirm links between pain, its evolution over time, its multi-modal character, the wide variety of symptoms of PD, and the female sex. Conclusions: Our results demonstrated that the pain felt by PD patients is mainly felt as an electrical current, which contrasts with other studies where the pain is described as burning and itching. Our classification is innovative because it is based on anatomy, whereas those of other authors were based on syndromes.

Sentence generation on sequential multi-modal data using random hypergraph model (랜덤 하이퍼그래프 모델을 이용한 순차적 멀티모달 데이터에서의 문장 생성)

  • Yoon, Woong-Chang;Zhang, Byoung-Tak
    • Proceedings of the Korean Information Science Society Conference
    • /
    • 2010.06c
    • /
    • pp.376-379
    • /
    • 2010
  • 인간의 학습과 기억현상에 있어서 멀티모달 데이터를 사용하는 것은 단순 모달리티 데이터를 사용하는 것에 비해서 향상된 효과를 보인다는 여러 연구 결과가 있어왔다. 이 논문에서는 인간의 순차적인 정보처리와 생성현상을 기계에서의 시뮬레이션을 통해서 기계학습에 있어서도 동일한 현상이 나타나는지에 대해서 알아보고자 하였다. 이를 위해서 가중치를 가진 랜덤 하이퍼그래프 모델을 통해서 순차적인 멀티모달 데이터의 상호작용을 하이퍼에지들의 조합으로 나타내는 것을 제안 하였다. 이러한 제안의 타당성을 알아보기 위해서 비디오 데이터를 이용한 문장생성을 시도하여 보았다. 이전 장면의 사진과 문장을 주고 다음 문장의 생성을 시도하였으며, 단순 암기학습이나 주어진 룰을 통하지 않고 의미 있는 실험 결과를 얻을 수 있었다. 단순 텍스트와 텍스트-이미지 쌍의 단서를 통한 실험을 통해서 멀티 모달리티가 단순 모달리티에 비해서 미치는 영향을 보였으며, 한 단계 이전의 멀티모달 단서와 두 단계 및 한 단계 이전의 멀티모달 단서를 통한 실험을 통해서 순차적 데이터의 단계별 단서의 차이에 따른 영향을 알아볼 수 있었다. 이를 통하여 멀티 모달리티가 시공간적으로 미치는 기계학습에 미치는 영향과 순차적 데이터의 시간적 누적에 따른 효과가 어떻게 나타날 수 있는지에 대한 실마리를 제공할 수 있었다고 생각된다.

  • PDF

Multi-Modal based ViT Model for Video Data Emotion Classification (영상 데이터 감정 분류를 위한 멀티 모달 기반의 ViT 모델)

  • Yerim Kim;Dong-Gyu Lee;Seo-Yeong Ahn;Jee-Hyun Kim
    • Proceedings of the Korean Society of Computer Information Conference
    • /
    • 2023.01a
    • /
    • pp.9-12
    • /
    • 2023
  • 최근 영상 콘텐츠를 통해 영상물의 메시지뿐 아니라 메시지의 형식을 통해 전달된 감정이 시청하는 사람의 심리 상태에 영향을 주고 있다. 이에 따라, 영상 콘텐츠의 감정을 분류하는 연구가 활발히 진행되고 있고 본 논문에서는 대중적인 영상 스트리밍 플랫폼 중 하나인 유튜브 영상을 7가지의 감정 카테고리로 분류하는 여러 개의 영상 데이터 중 각 영상 데이터에서 오디오와 이미지 데이터를 각각 추출하여 학습에 이용하는 멀티 모달 방식 기반의 영상 감정 분류 모델을 제안한다. 사전 학습된 VGG(Visual Geometry Group)모델과 ViT(Vision Transformer) 모델을 오디오 분류 모델과 이미지 분류 모델에 이용하여 학습하고 본 논문에서 제안하는 병합 방법을 이용하여 병합 후 비교하였다. 본 논문에서는 기존 영상 데이터 감정 분류 방식과 다르게 영상 속에서 화자를 인식하지 않고 감정을 분류하여 최고 48%의 정확도를 얻었다.

  • PDF

Digital Mirror System with Machine Learning and Microservices (머신 러닝과 Microservice 기반 디지털 미러 시스템)

  • Song, Myeong Ho;Kim, Soo Dong
    • KIPS Transactions on Software and Data Engineering
    • /
    • v.9 no.9
    • /
    • pp.267-280
    • /
    • 2020
  • Mirror is a physical reflective surface, typically of glass coated with a metal amalgam, and it is to reflect an image clearly. They are available everywhere anytime and become an essential tool for us to observe our faces and appearances. With the advent of modern software technology, we are motivated to enhance the reflection capability of mirrors with the convenience and intelligence of realtime processing, microservices, and machine learning. In this paper, we present a development of Digital Mirror System that provides the realtime reflection functionality as mirror while providing additional convenience and intelligence including personal information retrieval, public information retrieval, appearance age detection, and emotion detection. Moreover, it provides a multi-model user interface of touch-based, voice-based, and gesture-based. We present our design and discuss how it can be implemented with current technology to deliver the realtime mirror reflection while providing useful information and machine learning intelligence.

Analysis of Ride Comfort for an Automobile with flexible Vehicle Body (차체의 유연성을 고려한 차량 승차감 해석)

  • Kim Junghoon;Choi Kwangsung;Park Sungyong;Lee Jangmoo;Kang Sangwook;Kang Juseok
    • Transactions of the Korean Society of Automotive Engineers
    • /
    • v.13 no.4
    • /
    • pp.121-128
    • /
    • 2005
  • In most researches on the ride comfort analysis of passenger vehicles, the flexibility of the vehicle body has been not considered as an important factor, because the resonance frequencies of the vehicle body related to pitching, yawing and rolling motions are below 10Hz while the resonance frequencies of the vehicle body related to the flexibility are above 20Hz approximately. Nevertheless, the paper shows that the consideration of the local flexibility (or local stiffness) of the 4 corners on which shock absorbers are mounted influences the ride comfort. A simple beam model is devised to qualitatively examine the effect of the change of the local stiffness of the vehicle body on the ride comfort. Based on the results obtained from the analysis of the one-dimensional model, multi-body dynamic analysis considering the flexibility of the vehicle body is performed using ADAMS and MSC/NASTRAN. Natural frequencies and mode shapes computed by MSC/NASTRAN are used as input data for multi-body dynamic analysis in ADAMS. Through simulations using ADAMS, it has been found that the ride comfort can be improved by changing the local stiffness of the vehicle body and that the simulation results agree with experiment results.