• Title/Summary/Keyword: autoEncoder

Search Result 126, Processing Time 0.034 seconds

Network Anomaly Detection Technologies Using Unsupervised Learning AutoEncoders (비지도학습 오토 엔코더를 활용한 네트워크 이상 검출 기술)

  • Kang, Koohong
    • Journal of the Korea Institute of Information Security & Cryptology
    • /
    • v.30 no.4
    • /
    • pp.617-629
    • /
    • 2020
  • In order to overcome the limitations of the rule-based intrusion detection system due to changes in Internet computing environments, the emergence of new services, and creativity of attackers, network anomaly detection (NAD) using machine learning and deep learning technologies has received much attention. Most of these existing machine learning and deep learning technologies for NAD use supervised learning methods to learn a set of training data set labeled 'normal' and 'attack'. This paper presents the feasibility of the unsupervised learning AutoEncoder(AE) to NAD from data sets collecting of secured network traffic without labeled responses. To verify the performance of the proposed AE mode, we present the experimental results in terms of accuracy, precision, recall, f1-score, and ROC AUC value on the NSL-KDD training and test data sets. In particular, we model a reference AE through the deep analysis of diverse AEs varying hyper-parameters such as the number of layers as well as considering the regularization and denoising effects. The reference model shows the f1-scores 90.4% and 89% of binary classification on the KDDTest+ and KDDTest-21 test data sets based on the threshold of the 82-th percentile of the AE reconstruction error of the training data set.

Combining multi-task autoencoder with Wasserstein generative adversarial networks for improving speech recognition performance (음성인식 성능 개선을 위한 다중작업 오토인코더와 와설스타인식 생성적 적대 신경망의 결합)

  • Kao, Chao Yuan;Ko, Hanseok
    • The Journal of the Acoustical Society of Korea
    • /
    • v.38 no.6
    • /
    • pp.670-677
    • /
    • 2019
  • As the presence of background noise in acoustic signal degrades the performance of speech or acoustic event recognition, it is still challenging to extract noise-robust acoustic features from noisy signal. In this paper, we propose a combined structure of Wasserstein Generative Adversarial Network (WGAN) and MultiTask AutoEncoder (MTAE) as deep learning architecture that integrates the strength of MTAE and WGAN respectively such that it estimates not only noise but also speech features from noisy acoustic source. The proposed MTAE-WGAN structure is used to estimate speech signal and the residual noise by employing a gradient penalty and a weight initialization method for Leaky Rectified Linear Unit (LReLU) and Parametric ReLU (PReLU). The proposed MTAE-WGAN structure with the adopted gradient penalty loss function enhances the speech features and subsequently achieve substantial Phoneme Error Rate (PER) improvements over the stand-alone Deep Denoising Autoencoder (DDAE), MTAE, Redundant Convolutional Encoder-Decoder (R-CED) and Recurrent MTAE (RMTAE) models for robust speech recognition.

Side Information Extrapolation Using Motion-aligned Auto Regressive Model for Compressed Sensing based Wyner-Ziv Codec

  • Li, Ran;Gan, Zongliang;Cui, Ziguan;Wu, Minghu;Zhu, Xiuchang
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.7 no.2
    • /
    • pp.366-385
    • /
    • 2013
  • In this paper, we propose a compressed sensing (CS) based Wyner-Ziv (WZ) codec using motion-aligned auto regressive model (MAAR) based side information (SI) extrapolation to improve the compression performance of low-delay distributed video coding (DVC). In the CS based WZ codec, the WZ frame is divided into small blocks and CS measurements of each block are acquired at the encoder, and a specific CS reconstruction algorithm is proposed to correct errors in the SI using CS measurements at the decoder. In order to generate high quality SI, a MAAR model is introduced to improve the inaccurate motion field in auto regressive (AR) model, and the Tikhonov regularization on MAAR coefficients and overlapped block based interpolation are performed to reduce block effects and errors from over-fitting. Simulation experiments show that our proposed CS based WZ codec associated with MAAR based SI generation achieves better results compared to other SI extrapolation methods.

Rice Yield Estimation of South Korea from Year 2003-2016 Using Stacked Sparse AutoEncoder (SSAE 알고리즘을 통한 2003-2016년 남한 전역 쌀 생산량 추정)

  • Ma, Jong Won;Lee, Kyungdo;Choi, Ki-Young;Heo, Joon
    • Korean Journal of Remote Sensing
    • /
    • v.33 no.5_2
    • /
    • pp.631-640
    • /
    • 2017
  • The estimation of rice yield affects the income of farmers as well as the fields related to agriculture. Moreover, it has an important effect on the government's policy making including the control of supply demand and the price estimation. Thus, it is necessary to build the crop yield estimation model and from the past, many studies utilizing empirical statistical models or artificial neural network algorithms have been conducted through climatic and satellite data. Presently, scientists have achieved successful results with deep learning algorithms in the field of pattern recognition, computer vision, speech recognition, etc. Among deep learning algorithms, the SSAE (Stacked Sparse AutoEncoder) algorithm has been confirmed to be applicable in the field of forecasting through time series data and in this study, SSAE was utilized to estimate the rice yield in South Korea. The climatic and satellite data were used as the input variables and different types of input data were constructed according to the period of rice growth in South Korea. As a result, the combination of the satellite data from May to September and the climatic data using the 16 day average value showed the best performance with showing average annual %RMSE (percent Root Mean Square Error) and region %RMSE of 7.43% and 7.16% that the applicability of the SSAE algorithm could be proved in the field of rice yield estimation.

Deep Learning-Based Motion Reconstruction Using Tracker Sensors (트래커를 활용한 딥러닝 기반 실시간 전신 동작 복원 )

  • Hyunseok Kim;Kyungwon Kang;Gangrae Park;Taesoo Kwon
    • Journal of the Korea Computer Graphics Society
    • /
    • v.29 no.5
    • /
    • pp.11-20
    • /
    • 2023
  • In this paper, we propose a novel deep learning-based motion reconstruction approach that facilitates the generation of full-body motions, including finger motions, while also enabling the online adjustment of motion generation delays. The proposed method combines the Vive Tracker with a deep learning method to achieve more accurate motion reconstruction while effectively mitigating foot skating issues through the use of an Inverse Kinematics (IK) solver. The proposed method utilizes a trained AutoEncoder to reconstruct character body motions using tracker data in real-time while offering the flexibility to adjust motion generation delays as needed. To generate hand motions suitable for the reconstructed body motion, we employ a Fully Connected Network (FCN). By combining the reconstructed body motion from the AutoEncoder with the hand motions generated by the FCN, we can generate full-body motions of characters that include hand movements. In order to alleviate foot skating issues in motions generated by deep learning-based methods, we use an IK solver. By setting the trackers located near the character's feet as end-effectors for the IK solver, our method precisely controls and corrects the character's foot movements, thereby enhancing the overall accuracy of the generated motions. Through experiments, we validate the accuracy of motion generation in the proposed deep learning-based motion reconstruction scheme, as well as the ability to adjust latency based on user input. Additionally, we assess the correction performance by comparing motions with the IK solver applied to those without it, focusing particularly on how it addresses the foot skating issue in the generated full-body motions.

A study on the application of residual vector quantization for vector quantized-variational autoencoder-based foley sound generation model (벡터 양자화 변분 오토인코더 기반의 폴리 음향 생성 모델을 위한 잔여 벡터 양자화 적용 연구)

  • Seokjin Lee
    • The Journal of the Acoustical Society of Korea
    • /
    • v.43 no.2
    • /
    • pp.243-252
    • /
    • 2024
  • Among the Foley sound generation models that have recently begun to be studied, a sound generation technique using the Vector Quantized-Variational AutoEncoder (VQ-VAE) structure and generation model such as Pixelsnail are one of the important research subjects. On the other hand, in the field of deep learning-based acoustic signal compression, residual vector quantization technology is reported to be more suitable than the conventional VQ-VAE structure. Therefore, in this paper, we aim to study whether residual vector quantization technology can be effectively applied to the Foley sound generation. In order to tackle the problem, this paper applies the residual vector quantization technique to the conventional VQ-VAE-based Foley sound generation model, and in particular, derives a model that is compatible with the existing models such as Pixelsnail and does not increase computational resource consumption. In order to evaluate the model, an experiment was conducted using DCASE2023 Task7 data. The results show that the proposed model enhances about 0.3 of the Fréchet audio distance. Unfortunately, the performance enhancement was limited, which is believed to be due to the decrease in the resolution of time-frequency domains in order to do not increase consumption of the computational resources.

Development of automatic assembly module for yoke parts in auto-focusing actuator (Auto-Focusing 미세부품 Yoke 조립 자동화 모듈 개발)

  • Ha, Seok-Jae;Park, Jeong-Yeon;Park, Kyu-Sub;Yoon, Gil-Sang
    • Design & Manufacturing
    • /
    • v.13 no.1
    • /
    • pp.55-60
    • /
    • 2019
  • Smart-phone in the recently released high-end applied to the camera module is equipped with the most features auto focusing camera module. Also, auto focusing camera module is divided into voice coil motor, encoder, and piezo according to type of motion mechanism. Auto focusing camera module is composed of voice coil motor (VCM) as an actuator and leaf spring as a guide and suspension. VCM actuator is made of magnet, yoke as a metal, and coil as a copper wire. Recently, the assembly as yoke and magnet is made by human resources. These process has a long process time and it is difficult to secure quality. Also, These process is not economical in cost, and productivity is reduced. Therefore, an automatic assembly as yoke and magnet is needed in the present process. In this paper, we have developed an automatic assembly device that can automatically assemble yoke and magnet, and performed verifying performance. Therefore, by using the developed automatic assembly device, it is possible to increase the productivity and reduce the production cost.

Design of Automatic Assembly & Evaluation System for Phone Camera Module (폰 카메라 모듈 자동 조립.평가시스템 설계)

  • Song J.Y.;Lee C.W.;Ha T.W.;Jung Y.W.;Kim Y.G.;Lee M.C.
    • Proceedings of the Korean Society of Precision Engineering Conference
    • /
    • 2006.05a
    • /
    • pp.71-72
    • /
    • 2006
  • In this study, automatic assembly and evaluation system fer phone camera module is conceptually designed. The designed core(Auto focus & UV curing, Image Test) equipments adopts a clustering mechanism and compactible structure using index table for minimum tact time. Using a ball screw actuator and absolute encoder in each axis, we can verifies the repeatability and position accuracy of system within ${\pm}3{\mu}m$. In result of simulation test, the proposed system is expected up to 30% in productivity than manual operation.

  • PDF

A study on Development of Auto Steel-Plate Pile System Using Measurement System (계측시스템을 이용한 자동 강재 적치 관리 시스템 개발에 관한 연구)

  • Yu, Ji-Hun;Kim, Ho-Kyoung;Kim, Rea-Soo;Sin, Hun-Joo
    • Proceedings of the SAREK Conference
    • /
    • 2008.11a
    • /
    • pp.424-428
    • /
    • 2008
  • On processing of the shipbuilding, Various steel plates are used as the important material in many fields including the shell plate, a structure, etc. Therefore, the proper steel plate management system like a warehousing, pile, delivery is very important. Presently Operators manage the steel plate by using the software program, but they manage many parts manually, so many problems are generated on the steel plate check, management, and operator safety. In order to solve this problem, we developed Auto Steel-Plate Piling System. Also this system automatically manages and traces the steel-plate from warehousing to delivery.

  • PDF

Shock Resistance Characteristic of Auto Focus Actuator using Finite Element Method and Drop Impact Test (유한요소해석과 낙하충격 실험을 통한 자동초점 액추에이터의 내충격 특성 향상)

  • Shin, Min-Ho;Kim, Hyo-Jun;Park, Gyusub;Kim, Young-Joo
    • Transactions of the Society of Information Storage Systems
    • /
    • v.9 no.2
    • /
    • pp.56-61
    • /
    • 2013
  • The recent increased use of mobile phone has resulted in a technical focusing on reliability issues related to drop performance. Since mobile phone may be dropped several times during their use, it is required to survive common drop accidents. The plastic injection parts such as base stopper and carrier in the encoder type actuator can be broken easily in the actual reliability test of 1.5m free drop. So, we analyzed the shock resistance characteristics of auto focus actuator with variables in the material properties using finite element method. By applying the new resin materials, we can decrease the breakage of plastic injection parts and improve the reliability of mobile phone.