• Title/Summary/Keyword: Attention module

Search Result 242, Processing Time 0.024 seconds

Lip and Voice Synchronization Using Visual Attention (시각적 어텐션을 활용한 입술과 목소리의 동기화 연구)

  • Dongryun Yoon;Hyeonjoong Cho
    • The Transactions of the Korea Information Processing Society
    • /
    • v.13 no.4
    • /
    • pp.166-173
    • /
    • 2024
  • This study explores lip-sync detection, focusing on the synchronization between lip movements and voices in videos. Typically, lip-sync detection techniques involve cropping the facial area of a given video, utilizing the lower half of the cropped box as input for the visual encoder to extract visual features. To enhance the emphasis on the articulatory region of lips for more accurate lip-sync detection, we propose utilizing a pre-trained visual attention-based encoder. The Visual Transformer Pooling (VTP) module is employed as the visual encoder, originally designed for the lip-reading task, predicting the script based solely on visual information without audio. Our experimental results demonstrate that, despite having fewer learning parameters, our proposed method outperforms the latest model, VocaList, on the LRS2 dataset, achieving a lip-sync detection accuracy of 94.5% based on five context frames. Moreover, our approach exhibits an approximately 8% superiority over VocaList in lip-sync detection accuracy, even on an untrained dataset, Acappella.

Implementation of Main Computation Board for Safety Improvement of railway system (철도시스템의 안전성 향상을 위한 주연산보드 구현)

  • Park, Joo-Yul;Kim, Hyo-Sang;Lee, Joon-Hwan;Kim, Bong-Taek;Chung, Ki-Seok
    • Proceedings of the KSR Conference
    • /
    • 2011.05a
    • /
    • pp.1195-1201
    • /
    • 2011
  • Since the release of safety standard IEC 61508 which defines functional safety of electronic safety-related systems, SIL(Safety Integrity Level) certification for railway systems has gained lots of attention lately. In this paper, we propose a new design technique of the computer board for train control systems with high reliability and safety. The board is designed with TMR(Triple Modular Redundancy) using a certified SIL3 Texas Instrument(TI)'s TMS570 MCU(Micro-Controller Unit) to guarantee safety and reliability. TMR for the control device is implemented on FPGA(Field Programmable Gate Array) which integrates a comparator, a CAN(Controller Area Network) communication module, built-in self-error checking, error discriminant function to improve the reliability of the board. Even if a malfunction of a processing module occurs, the safety control function based on the proposed technique lets the system operate properly by detecting and masking the malfunction. An RTOS (Real Time Operation System) called FreeRTOS is ported on the board so that reliable and stable operation and convenient software development can be provided.

  • PDF

V2X Technology Trends for Next-Generation Mobility

  • Kim, Young-Hak
    • International Journal of Internet, Broadcasting and Communication
    • /
    • v.12 no.1
    • /
    • pp.7-13
    • /
    • 2020
  • We describes V2X technology, a connectivity-based recognition technology that is attracting attention as a key technology for implementing autonomous driving technology, and autonomous communication modules that implement ADAS technology, a sensor-based recognition technology. It also explains the trends in V2X technology standardization centered on IEEE 802.11p, which is a WAVE technology standard based on Wi-Fi/DSRC. Finally, we will discuss the market growth trend of V2X communication modules in the United States, the leading V2X technology module, and the development of technology development trends of major domestic and international companies that are leading the global technology market related to V2X communication modules. V2X and ADAS technologies will be the biggest influence on automotive purchasing decisions. In recent years, V2I mandates have been promoted beyond V2V, mainly in developed countries such as the United States. The related industry needs to focus on the development of information transmission network technology that can support high frequency high efficiency(transmission rate) and sophisticated positioning accuracy beyond conventional vehicle communication.

PC Based Distributed Control System of AGV with Multi-Thread Method (다중 쓰레드 기법을 미용한 AGV의 PC기반 분산제어 시스템)

  • Jun, Sung-Jae;Cho, Yon-Sang;Park, Heung-Sik
    • Journal of the Korean Society for Precision Engineering
    • /
    • v.22 no.9 s.174
    • /
    • pp.107-114
    • /
    • 2005
  • With the recent progress in flexible manufacturing systems (FMS) in industry, increasing attention has been given to Automatic Guided Vehicle (AGV) systems. An AGV is a self-powered unit for transporting materials between stations without needing to be controlled by an operator. Such a system has several sensors to recognize the external state, and it is designed to travel between stations automatically without external assistance. To manage each device automatically in real time it requires a distributed controller with a main computer as the host, as well as a number of micro-controllers. In this study, an AGV system with dual motor drive was constructed. A Pentium 4 personal computer was set up as the main host for the distributed control, and this communicated with other micro-controllers in the management of the motor. The speed of each motor was also controlled by a micro-controller.

A Real Time Model of Dynamic Thermal Response for 120kW IGBT Inverter (120kW급 IGBT 인버터의 열 응답 특성 실시간 모델)

  • Im, Seokyeon;Cha, Gangil;Yu, Sangseok
    • Transactions of the Korean hydrogen and new energy society
    • /
    • v.26 no.2
    • /
    • pp.184-191
    • /
    • 2015
  • As the power electronics system increases the frequency, the power loss and thermal management are paid more attention. This research presents a real time model of dissipation power with junction temperature response for 120kw IGBT inverter which is applied to the thermal management of high power IGBT inverter. Since the computational time is critical for real time simulation, look-up tables of IGBT module characteristic curve are implemented. The power loss from IGBT provides a clue to calculate the temperature of each module of IGBT. In this study, temperature of each layer in IGBT is predicted by lumped capacitance analysis of layers with convective heat transfer. The power loss and temperature of layers in IGBT is then communicated due to mutual dependence. In the dynamic model, PWM pulses are employed to calculation real time IGBT and diode power loss. Under Matlab/Simulink$^{(R)}$ environment, the dynamic model is validated with experiment. Results showed that the dynamic response of power loss is closely coupled with effective thermal management. The convective heat transfer is enough to achieve proper thermal management under guideline temperature.

Implementation of cost-effective wireless photovoltaic monitoring module at panel level

  • Jeong, Jin-Doo;Han, Jinsoo;Lee, Il-Woo;Chong, Jong-Wha
    • ETRI Journal
    • /
    • v.40 no.5
    • /
    • pp.664-676
    • /
    • 2018
  • Given the rapidly increasing market penetration of photovoltaic (PV) systems in many fields, including construction and housing, the effective maintenance of PV systems through remote monitoring at the panel level has attracted attention to quickly detect faults that cause reductions in yearly PV energy production, and which can reduce the whole-life cost. A key point of PV monitoring at the panel level is cost-effectiveness, as the installation of the massive PV panels that comprise PV systems is showing rapid growth in the market. This paper proposes an implementation method that involves the use of a panel-level wireless PV monitoring module (WPMM), and which assesses the cost-effectiveness of this approach. To maximize the cost-effectiveness, the designed WPMM uses a voltage-divider scheme for voltage metering and a shunt-resistor scheme for current metering. In addition, the proposed method offsets the effect of element errors by extracting calibration parameters. Furthermore, a design method is presented for portable and user-friendly PV monitoring, and demonstration results using a commercial 30-kW PV system are described.

Optical, Thermal property by Applied PCB Structure design (PCB 구조적 설계에 따른 LED Module의 열적 광학적 특성)

  • Lee, Seung-Min;Lee, Seong-Jin;Choi, Gi-Seung;Lee, Jong-Chan;Park, Dae-Hee
    • Proceedings of the KIEE Conference
    • /
    • 2006.07c
    • /
    • pp.1735-1736
    • /
    • 2006
  • As developing the information society, Lighting Emitted diode(LED) which is light source for illumination of next generation is attracted public attention. LED have many problem as narrow light view angle, high price, drift phenomenon of color coordinate, high heating problem for lower power, lower weight and small size. So, many researches have continued in a illumination as LED module type. in this problem, heating problem is very important and difficult and that is caused in decreasing phenomenon of brightness and drift phenomenon of color coordinate. so the problem of heating is urgent question for illumination of LED. In this paper, structural design of PCB changed as two type for solving the heating problem. also the properties of heating is analysed and optical properties is measured with heating image camera and spectrometer according to change in this design.

  • PDF

Study on designing of Flat Transformer and operating characteristics of Converter (Flat Transformer 코아의 설계와 컨버터 동작 특성)

  • Han, Se-Won;Cho, Han-Goo
    • Proceedings of the Korean Institute of Electrical and Electronic Material Engineers Conference
    • /
    • 2003.11a
    • /
    • pp.587-590
    • /
    • 2003
  • The first attention in designing a transformer for low temperature rise should be to reduce losses. Leakage inductance and temperature rise are two of the more impotent problems facing the magnetic core technology of today's high frequency transformers. Excessive leakage inductance increases the stress on the switching transistors and limits the duty-cycle, and excessive temperature rise can lead the design limitation of high frequency transformer with high current. The flat transformer technology provides a very good solution to the problems of leakage inductance and thermal management for high frequency power. The critical magnetic components and windings are optimized and packaged within a completely assembled module. The turns ratio in a flat transformer is determined as the product of the number of elements or modules times the number of primary turns. The leakage inductance increase proportionately to the number of elements, but since it is reduced as the square of the turns, the net reduction can be very significant. The flat transformer modules use cores which have no gap. This eliminates fringing fluxes and stray flux outside of the core. The secondary windings are formed of flat metal and are bonded to the inside surface of the core. The secondary winding thus surrounds the primary winding, so nearly all of the flux is captured.

  • PDF

A Study on the Safety Vest by Sports and Leisure Population Distribution -Focusing on Motorcycle Vest- (스포츠 레저 인구 확산에 따른 안전 상의에 관한 연구 -모터사이클 상의를 중심으로-)

  • Lee, Hyunyoung
    • Journal of Fashion Business
    • /
    • v.22 no.5
    • /
    • pp.125-136
    • /
    • 2018
  • This study intended to develop a motorcycle safe vest that can be prepared against accidents by mounting a smart module (with built-in sensor) on the safe vest in order to emphasize safety among functional aspects of the motorcycle clothing. The research method investigated professional books, prior research, and Internet data to examine the characteristics of motorcycle wear and the theoretical examination of smart wear, and analyzed the functional characteristics of the design by reviewing smart jacket and vest design cases for motorcycles currently on the market. As a results of study an interface device sensor, which contains a sensor with IMU(Intertial Measurement Unit) and CPU(Central Processing Unit), was inserted into a motorcycle top in order to draw attention to the safety of motorcycle riders. The IMU sensor attached to the vest detected the tilting motion of the rider to either left or right side to obtain data on left or right direction, sudden stop, and so forth and displayed left or right turn signal and sudden stop sign on the backplate (back) through the LED module. As for charging the device to operate LEDs, a generator, which is designed to convert the heat energy in the exhaust into electric energy, was used to efficiently self-produce the power required to operate LEDs of the top while riding.

Design, Fabrication and temperature measuring experiments of solar collecting system using a single module reflectors (단일 모듈 반사경을 이용한 태양열 집열 시스템의 설계, 제작 및 온도측정 시험연구)

  • Yang, Byeong-Soo;Yang, Woo;Seo, Tae-Il;Son, Chang-Woo
    • Design & Manufacturing
    • /
    • v.13 no.1
    • /
    • pp.19-24
    • /
    • 2019
  • Currently, the world is paying keen attention to the production of renewable energy along with environmental issues, and the share of renewable energy in the world is rising above that of nuclear power. Especially when Korea, which is heavily dependent on foreign countries, needs to reconsider its national competitiveness due to the recent high oil prices, the government's energy policy is to develop and use renewable energy that replaces fossil fuels. In particular, solar energy, the most actively studied and commercialized field of renewable energy, is the main research for solar energy and is commercialized and used. However, the efficiency of solar energy has already reached saturation. Studies are also focusing on increasing the reflectivity of solar energy to increase efficiency. Therefore, this paper proposes a solar collection system that can utilize solar energy rather than solar energy. The proposed solar heat collection system uses solar tracking systems to effectively collect solar energy, particularly those that can be easily produced using single-modular reflectors and have price competitiveness. In addition, temperature measurement experiments with temperature measuring sensors were conducted to ensure reliability in order to verify the results interpreted.