• Title/Summary/Keyword: multi modal control

Search Result 77, Processing Time 0.019 seconds

Implementation of a Multimodal Controller Combining Speech and Lip Information (음성과 영상정보를 결합한 멀티모달 제어기의 구현)

  • Kim, Cheol;Choi, Seung-Ho
    • The Journal of the Acoustical Society of Korea
    • /
    • v.20 no.6
    • /
    • pp.40-45
    • /
    • 2001
  • In this paper, we implemented a multimodal system combining speech and lip information, and evaluated its performance. We designed speech recognizer using speech information and lip recognizer using image information. Both recognizers were based on HMM recognition engine. As a combining method we adopted the late integration method in which weighting ratio for speech and lip is 8:2. By the way, Our constructed multi-modal recognition system was ported on DARC system. That is, our system was used to control Comdio of DARC. The interrace between DARC and our system was done with TCP/IP socked. The experimental results of controlling Comdio showed that lip recognition can be used for an auxiliary means of speech recognizer by improving the rate of the recognition. Also, we expect that multi-model system will be successfully applied to o traffic information system and CNS (Car Navigation System).

  • PDF

Satellite finite element model updating for the prediction of the effect of micro-vibration (미소진동 영향성 예측을 위한 인공위성 유한요소모델 보정)

  • Lim, Jae Hyuk;Eun, Hee-Kwang;Kim, Dae-Kwan;Kim, Hong-Bae;Kim, Sung-Hoon
    • Journal of the Korean Society for Aeronautical & Space Sciences
    • /
    • v.42 no.8
    • /
    • pp.692-700
    • /
    • 2014
  • In this work, satellite FE (finite element) model updating for the prediction of the effect of micro-vibration is described. In the case of satellites launched in low earth orbit, high agility and more mission accomplishments are required by the customer in order to procure many images from satellites. To achieve the goal, many mechanisms, including high capacity wheels and antennas with multi-axis gimbals have been widely adopted, but they become a source of micro-vibration which could significantly deteriorate the quality of images. To investigate the effect due to the micro-vibration in orbit on the ground, a prediction is conducted through an integrated model coupling the measured jitter sources with FE (finite element) model. Before prediction, the FE model is updated to match simulation results with the modal survey test. Subsequently, the quality of FE model is evaluated in terms of frequency deviation error, the resemblance of mode shapes and FRFs (frequency response functions) between test and analysis.

The Properties of a Nonlinear Direct Spectrum Method for Estimating the Seismic Performance (내진성능평가를 위한 비선형 직접스펙트럼법의 특성)

  • 강병두;김재웅
    • Journal of the Earthquake Engineering Society of Korea
    • /
    • v.6 no.4
    • /
    • pp.65-73
    • /
    • 2002
  • It has been recognized that the damage control must become a more explicit design consideration. In an effort to develop design methods based on performance it is clear that the evaluation of the nonlinear response is required. The methods available to the design engineer today are nonlinear time history analyses, monotonic static nonlinear analyses, or equivalent static analyses with simulated nonlinear influences. Some building codes propose the capacity spectrum method based on the nonlinear static analysis(pushover analysis) to determine the earthquake-induced demand given by the structure pushover curve. These procedures are conceptually simple but iterative and time consuming with some errors. This paper presents a nonlinear direct spectrum method(NDSM) to evaluate seismic performance of structures, without iterative computations, given by the structural initial elastic period and yield strength from the pushover analysis, especially for MDF(multi degree of freedom) systems. The purpose of this paper is to investigate the accuracy and confidence of this method from a point of view of various earthquakes and unloading stiffness degradation parameters. The conclusions of this study are as follows; 1) NDSM is considered as practical method because the peak deformations of nonlinear system of MDF by NDSM are almost equal to the results of nonlinear time history analysis(NTHA) for various ground motions. 2) When the results of NDSM are compared with those of NTHA. mean of errors is the smallest in case of post-yielding stiffness factor 0.1, static force by MAD(modal adaptive distribution) and unloading stiffness degradation factor 0.2~0.3.

Vortex-induced vibration of a long flexible cylinder in uniform cross-flow

  • Ji, Chunning;Peng, Ziteng;Alam, Md. Mahbub;Chen, Weilin;Xu, Dong
    • Wind and Structures
    • /
    • v.26 no.5
    • /
    • pp.267-277
    • /
    • 2018
  • Numerical simulations are performed of a long flexible cylinder undergoing vortex-induced vibration at a Reynolds number of 500. The cylinder is pinned at both ends, having an aspect ratio of 100 (cylinder length to cylinder diameter) and a mass ratio of 4.2 (structural mass to displaced fluid mass). Temporal and spatial information on the cross-flow (CF) and in-line (IL) vibrations is extracted. High modal vibrations up to the $6^{th}$ in the CF direction and the $11^{th}$ in the IL direction are observed. Both the CF and IL vibrations feature a multi-mode mixed pattern. Mode competition is observed. The $2^{nd}$ mode with a low frequency dominates the IL vibration and its existence is attributed to a wave group propagating back and forth along the span. Distributions of fluid force coefficients are correlated to those of the CF and IL vibrations along the span. Histograms of the x'-y motion phase difference are evaluated from the total simulation time and a complete vibration cycle representing the standing or travelling wave pattern. Correlations between the phase difference and the vibrations are discussed. Vortex structures behind the cylinder show an interwoven near-wake pattern when the standing wave pattern dominates, but an oblique near-wake pattern when the travelling wave pattern prevails.

Development of the Growth and Wavelength Control Technique of In As Quantum Dots for 1.3 μm Optical Communication Devices (1.3 μm 광통신용 소자를 위한 InAs 양자점 성장 및 파장조절기술 개발)

  • Park, Ho-Jin;Kim, Do-Yeob;Kim, Goon-Sik;Kim, Jong-Ho;Ryu, H.H.;Jeon, Min-Hyon;Leem, Jae-Young
    • Korean Journal of Materials Research
    • /
    • v.17 no.7
    • /
    • pp.390-395
    • /
    • 2007
  • We systematically investigated the effects of InAs coverage variation, two-step annealing and an asymmetric InGaAs quantum well (QW) on the structural and optical characteristics of InAs quantum dots (QDs) by using atomic force microscopy (AFM), transmission electron microscopy (TEM) and photoluminescence (PL) measurement. The transition of size distribution of InAs QDs from bimodal to multi-modal was noticeably observed with increasing InAs coverage. By means of two-step annealing, it is found that significant narrowing of the luminescence linewidth (from 132 to 31 meV) from the InAs QDs occurs together with about 150 meV blueshift, compared to as-grown InAs QDs. Finally, the InAs QDs emitting at longer wavelength of $1.3\;{\mu}m$ with narrow linewidth were grown by an asymmetric InGaAs QW. The excited-state transition for the InAs QDs with an asymmetric InGaAs QW was not noticeably observed due to the large energy-level spacing between the ground states and the first excited states. The InAs QDs with an asymmetric InGaAs QW will be promising for the device applications such as $1.3\;{\mu}m$ optical-fiber communication.

Multi-Modal Biometries System for Ubiquitous Sensor Network Environment (유비쿼터스 센서 네트워크 환경을 위한 다중 생체인식 시스템)

  • Noh, Jin-Soo;Rhee, Kang-Hyeon
    • Journal of the Institute of Electronics Engineers of Korea CI
    • /
    • v.44 no.4 s.316
    • /
    • pp.36-44
    • /
    • 2007
  • In this paper, we implement the speech & face recognition system to support various ubiquitous sensor network application services such as switch control, authentication, etc. using wireless audio and image interface. The proposed system is consist of the H/W with audio and image sensor and S/W such as speech recognition algorithm using psychoacoustic model, face recognition algorithm using PCA (Principal Components Analysis) and LDPC (Low Density Parity Check). The proposed speech and face recognition systems are inserted in a HOST PC to use the sensor energy effectively. And improve the accuracy of speech and face recognition, we implement a FEC (Forward Error Correction) system Also, we optimized the simulation coefficient and test environment to effectively remove the wireless channel noises and correcting wireless channel errors. As a result, when the distance that between audio sensor and the source of voice is less then 1.5m FAR and FRR are 0.126% and 7.5% respectively. The face recognition algorithm step is limited 2 times, GAR and FAR are 98.5% and 0.036%.

The Effects of Multi-Modal Cue for Haptic Imagery on Perceived Ownership (촉각적 심상화를 위한 다중감각 단서가 지각된 소유감에 미치는 영향)

  • Kim, Minsun;Han, Kwanghee
    • Science of Emotion and Sensibility
    • /
    • v.20 no.3
    • /
    • pp.49-60
    • /
    • 2017
  • Previous research found that merely touching an object can create psychological ownership and the endowment effect. It was also found that just imagining touching an object without actually touching the object can make the same effect on psychological ownership. Prior research on haptic imagery examined the effect of haptic imagery induced by direct instruction of imaging on psychological ownership. We investigate a new method which can induce the haptic imagery in a more natural way than direct instruction of imaging. We manipulated imagery conditions such as visual-haptic congruence multimodal cue, visual-haptic incongruent multimodal cue, direct instruction condition and control condition, and examined the effects on imagery vividness, feeling of physical control, perceived ownership, and purchase intention. We conducted the experiment on 140 undergraduate students and our results showed that visual-haptic congruence multimodal cue condition is more effective than direct instruction of haptic imagery while visual-haptic incongruence multimodal cue condition is not effective. Our study extends prior haptic imagery research by making important marketing implications for online retailing.