• Title/Summary/Keyword: 강인성 분석

Search Result 465, Processing Time 0.029 seconds

Wanda Pruning for Lightweighting Korean Language Model (Wanda Pruning에 기반한 한국어 언어 모델 경량화)

  • Jun-Ho Yoon;Daeryong Seo;Donghyeon Jeon;Inho Kang;Seung-Hoon Na
    • Annual Conference on Human and Language Technology
    • /
    • 2023.10a
    • /
    • pp.437-442
    • /
    • 2023
  • 최근에 등장한 대규모 언어 모델은 다양한 언어 처리 작업에서 놀라운 성능을 발휘하고 있다. 그러나 이러한 모델의 크기와 복잡성 때문에 모델 경량화의 필요성이 대두되고 있다. Pruning은 이러한 경량화 전략 중 하나로, 모델의 가중치나 연결의 일부를 제거하여 크기를 줄이면서도 동시에 성능을 최적화하는 방법을 제시한다. 본 논문에서는 한국어 언어 모델인 Polyglot-Ko에 Wanda[1] 기법을 적용하여 Pruning 작업을 수행하였다. 그리고 이를 통해 가중치가 제거된 모델의 Perplexity, Zero-shot 성능, 그리고 Fine-tuning 후의 성능을 분석하였다. 실험 결과, Wanda-50%, 4:8 Sparsity 패턴, 2:4 Sparsity 패턴의 순서로 높은 성능을 나타냈으며, 특히 일부 조건에서는 기존의 Dense 모델보다 더 뛰어난 성능을 보였다. 이러한 결과는 오늘날 대규모 언어 모델 중심의 연구에서 Pruning 기법의 효과와 그 중요성을 재확인하는 계기가 되었다.

  • PDF

A Study on Robust Matched Field Processing Based on Feature Extraction (특성치 추출 기법에 의한 강인한 정합장 처리에 관한 연구)

  • 황성진;성우제;박정수
    • The Journal of the Acoustical Society of Korea
    • /
    • v.20 no.7
    • /
    • pp.83-88
    • /
    • 2001
  • In this paper, matched field processing algorithm robust to environmental mismatches in an ocean waveguide based on feature extraction is summarized. However, in applying this processor to localize a source there are two preliminary issues to be resolved. One is the number of eigenvectors to be extracted and the other is the number of environmental samples to be used. To determine these issues, the relation between the number of dominant modes propagating in a given ocean waveguide and that of eigenvectors to be extracted is analyzed. Then, the analysis results are confirmed by the subspace analysis. This analysis quantifies the similarity between the subspace spanned by the signal vectors and that spanned by the eigenvectors to be extracted. The error index is defined as a relative difference between the location estimated by the current processor and the real source location. It is identified that in the case of extracting the largest eigenvectors equal to the number of dominant modes in a given environment, the processor localizes the source successfully. From the numerical simulations, it is shown that use of at least 30 environmental samples guarantee stable performance of the proposed processor.

  • PDF

Estimation and Control of Speed of Induction Motor using FNN and ANN (FNN과 ANN을 이용한 유도전동기의 속도 제어 및 추정)

  • Lee Jung-Chul;Park Gi-Tae;Chung Dong-Hwa
    • Journal of the Institute of Electronics Engineers of Korea SC
    • /
    • v.42 no.6
    • /
    • pp.77-82
    • /
    • 2005
  • This paper is proposed fuzzy neural network(FNN) and artificial neural network(ANN) based on the vector controlled induction motor drive system. The hybrid combination of fuzzy control and neural network will produce a powerful representation flexibility and numerical processing capability. Also, this paper is proposed control and estimation of speed of induction motor using fuzzy and neural network. The back propagation neural network technique is used to provide a real time adaptive estimation of the motor speed. The error between the desired state variable and the actual one is back-propagated to adjust the rotor speed, so that the actual state variable will coincide with the desired one. The back propagation mechanism is easy to derive and the estimated speed tracks precisely the actual motor speed. This paper is proposed the experimental results to verify the effectiveness of the new method.

Design of the Robust Active Power Filter under the Unbalanced and Distorted Source Voltages in Three-phase Four-wire Systems (전원전압의 불평형 및 왜곡에 강인한 3상 4선식 전력용 능동 필터의 설계)

  • Min Joon-Ki;Kim HyoSung;Choi Jaeho;Kim Kyung-Hwan
    • The Transactions of the Korean Institute of Power Electronics
    • /
    • v.9 no.5
    • /
    • pp.420-429
    • /
    • 2004
  • This paper proposes a novel current control strategy on active power filters using PQR instantaneous power theory which can compensate the line current harmonics and the neutral line current under the unbalanced and/or distorted source conditions in three-phase four-wire systems. The characteristics of the inverter ac filters are analyzed and a novel digital controller are proposed to overcome the inherent time delay problem in digital controllers with designed control gain in this paper. The proposed current control method is based on a sinusoidal PWM for fully-digital implementation compared with a conventional hysteresis PWM. PSiM simulation results verify the good performance of the proposed current control strategy on shunt type APFs.

Effective Method of Video Services over QoS Controlled Network (QoS 서비스 모델에서의 비디오 서비스의 효과적 적용 기법)

  • Jeong, Jun-Ho;Suh, Doug-Young;Shin, Ji-Tae;Seok, Joo-Myoung;Lee, Kyou-Ho
    • Journal of the Institute of Electronics Engineers of Korea SP
    • /
    • v.39 no.6
    • /
    • pp.672-686
    • /
    • 2002
  • 현재 단대단(End-to-End) 비디오 서비스의 질을 높이기 위해 많은 연구가 각 계층별로 진행되고 있다. 전송계층에서의 오류 제어(Error Control), 네트워크계층에서의 QoS (Quality of Service)모델, 표현 및 응용계층에서의 오류 강인성(Error resilience)/오류 은닉(Error concealment) 등이 연구 개발되고 있다. 그러나 계층 간의 연관성이 높은 부분에서의 통합을 통한 성능향상에 관한 연구는 그 필요성과 효율에 비해 아직도 미흡하다. 본 논문은 QoS 서비스 모델하에서의 적응적 FEC(Forward Error Correction) 적용 및 우선순위에 따른 비디오패킷(VP ,VideoPacket)을 통하여 효율적인 계층화 비디오 스트리밍을 단대단 QoS성능의 향상에 관점을 맞추어 제안한다. 제안하는 방식은 최소 화질 보장과 같은 효율에서 보다 적은 가격에서의 서비스를 제공할 수 있다. 이를 위하여 통합형 서비스(IntServ, IS, Integrated Service) 의 자원예약을 사용하는 방법과 높은 가격의 자원 예약을 사용하지 않는 차별화 서비스(DiffServ, DS, Differentiated Service)를 적용했으며 이에 보장형 서비스의 특징을 공통을 가지기 위해 계층화 FEC를 적용하였으며 적절한 가격의 조절을 위하여 비디오패킷을 통한 데이터 분할을 적용하였다. 본 논문은 또한 최종 사용자의 만족도를 PSNR(Picture Signal to Noise Ration)과 PSNR에서 표현하지 못하는 부분의 평가를 위해 손상프레임율(DFR, Damaged Frame Ratio)과 오류프레임율(EFR,Error Frame Ratio)을 제안 이를 통해 평가하고자 한다. 제안하는 방식의 실험 결과는 비디오 코딩계층과 전송 계층, 네트워크 계층의 결합된 성능이며 이는 또한 화질의 개선뿐만 아니라 사용자의 가격문제에 대하여서도 비교 분석하였다.

Structural Similarity Index for Image Assessment Using Pixel Difference and Saturation Awareness (이미지 평가를 위한 픽셀 변화량과 포화 인지의 구조적 유사도 기법)

  • Jeong, Ji-Soo;Kim, Young-Jin
    • Journal of KIISE
    • /
    • v.41 no.10
    • /
    • pp.847-858
    • /
    • 2014
  • Until now, a lot of image quality assessment techniques or tools for optimal human visual system(HVS)-awareness have been researched and SSIM(Structural SIMilarity) and its improved techniques are representative examples. However, they often cannot cope with various images and different distortion types robustly, and thus this can cause a large gap between their index values and HVS-awareness. In this paper, we conduct image quality assessment on SSIM and its variants intensively and analyze the causes of each component function's observed anomalies. Then, we propose a novel image quality assessment technique to compensate and improve such anomalies. Additionally, through extensive image assessment simulations, we show that the proposed technique can indicate HVS-awareness more robustly and consistently than SSIM and its variants for various images and different distortion types.

A Functional Unit Dynamic API Birthmark for Windows Programs Code Theft Detection (Windows 프로그램 도용 탐지를 위한 기능 단위 동적 API 버스마크)

  • Choi, Seok-Woo;Cho, Woo-Young;Han, Tai-Sook
    • Journal of KIISE:Software and Applications
    • /
    • v.36 no.9
    • /
    • pp.767-776
    • /
    • 2009
  • A software birthmark is a set of characteristics that are extracted from a program itself to detect code theft. A dynamic API birthmark is extracted from the run-time API call sequences of a program. The dynamic Windows API birthmarks of Tamada et al. are extracted from API call sequences during the startup period of a program. Therefore. the dynamic birthmarks cannot reflect characteristics of main functions of the program. In this paper. we propose a functional unit birthmark(FDAPI) that is defined as API call sequences recorded during the execution of essential functions of a program. To find out that some functional units of a program are copied from an original program. two FDAPIs are extracted by executing the programs with the same input. The FDAPIs are compared using the semi-global alignment algorithm to compute a similarity between two programs. Programs with the same functionality are compared to show credibility of our birthmark. Binary executables that are compiled differently from the same source code are compared to prove resilience of our birthmark. The experimental result shows that our birthmark can detect module theft of software. to which the existing birthmarks of Tamada et al. cannot be applied.

Vision Based Position Detection System of Used Oil Filter using Line Laser (라인형 레이저를 이용한 비전기반 차량용 폐오일필터 검출 시스템)

  • Xing, Xiong;Song, Un-Ji;Choi, Byung-Jae
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.20 no.3
    • /
    • pp.332-336
    • /
    • 2010
  • There are so many successful applications to image processing systems in industries. In this study we propose a position detection system for used oil filter by using a line laser. We have been done on the development of line laser as interaction devices. A camera captures images of a display surface of a used oil filter and then a laser beam location is extracted from the captured image. This image is processed and used as a cursor position. We also discuss an algorithm that can distinguish the front part and rear part. In particular we present a robust and efficient linear detection algorithm that allows us to use our system under a variety lighting conditions, and allows us to reduce the amount of image parsing required to find a laser position by an order of magnitude.

Design of the Robust Generalized Sinusoidal Frequency Modulated Pulse in Reverberation Environments (잔향환경에 강인한 Generalized Sinusoidal Frequency Modulated 펄스 생성 기법)

  • Kim, Guenhwan;Yoon, Kyungsik;Lee, Donghwa;Cho, Chomgun;Hong, Jungpyo;Lee, Kyunkyung
    • Journal of Korea Society of Industrial Information Systems
    • /
    • v.24 no.5
    • /
    • pp.95-104
    • /
    • 2019
  • In this paper, we propose a method to design a generalized sinusoidal frequency modulated(GSFM) pulse that is robust to reverberation environment. GSFM pulses are a generalized form of SFM(Sinusoidal frequency modulated) pulses, which have the advantage of having a thumbtack ambiguity function with excellent range and Doppler resolution. However, the periodicity disappears during the generalization process, therefore, the detection performance is reduced in reverberation environment compared to SFM pulse with comb spectrum. In this paper, the trade-off relationship between the reverberation suppression performance of the SFM pulse and the range resolution performance of the GSFM pulse is analyzed by appropriately changing the parameter ${\rho}$ of the GSFM pulse. In order to verify the performance of the proposed GSFM pulse, the simulation was performed and it was confirmed that the proposed GSFM pulse has excellent distance resolution while detecting the slow Doppler target.

S.O.S : Shield of Steam Protection Based on API Call Birthmark in Online Game ESD DRM (S.O.S : Shield of Steam API 콜 버스마크 기반의 온라인 게임 ESD DRM 보호)

  • Oh, Dong Bin;Kim, Huy Kang
    • Journal of the Korea Institute of Information Security & Cryptology
    • /
    • v.28 no.6
    • /
    • pp.1297-1307
    • /
    • 2018
  • The rise of Online game ESD(Electronic Software Distribution) like Steam, the method of game piracy are more diversified. In Online Game ESD, Software DRM is applied to game because we have to play in offline situation, but it is easily bypassed due to low security level. In this study, we analyze crack files of pirated games to learn how to bypass Steam DRM and to establish countermeasures for based on API call birthmark. The generated birthmark showed more than 85% resilience in representing crack groups and 95% credibility in detecting cracked games. With this study, it is possible to enhance the security of the online game Electronic Software Distribution platform, and to provide a high level of game piracy protection for indie game developers, especially those who can not purchase Third Party DRM to protect their own games.