• Title/Summary/Keyword: sequence-to-sequence neural network

Search Result 183, Processing Time 0.024 seconds

Malware Classification Possibility based on Sequence Information (순서 정보 기반 악성코드 분류 가능성)

  • Yun, Tae-Uk;Park, Chan-Soo;Hwang, Tae-Gyu;Kim, Sung Kwon
    • Journal of KIISE
    • /
    • v.44 no.11
    • /
    • pp.1125-1129
    • /
    • 2017
  • LSTM(Long Short-term Memory) is a kind of RNN(Recurrent Neural Network) in which a next-state is updated by remembering the previous states. The information of calling a sequence in a malware can be defined as system call function that is called at each time. In this paper, we use calling sequences of system calls in malware codes as input for malware classification to utilize the feature remembering previous states via LSTM. We run an experiment to show that our method can classify malware and measure accuracy by changing the length of system call sequences.

Title Generation Model for which Sequence-to-Sequence RNNs with Attention and Copying Mechanisms are used (주의집중 및 복사 작용을 가진 Sequence-to-Sequence 순환신경망을 이용한 제목 생성 모델)

  • Lee, Hyeon-gu;Kim, Harksoo
    • Journal of KIISE
    • /
    • v.44 no.7
    • /
    • pp.674-679
    • /
    • 2017
  • In big-data environments wherein large amounts of text documents are produced daily, titles are very important clues that enable a prompt catching of the key ideas in documents; however, titles are absent for numerous document types such as blog articles and social-media messages. In this paper, a title-generation model for which sequence-to-sequence RNNs with attention and copying mechanisms are employed is proposed. For the proposed model, input sentences are encoded based on bi-directional GRU (gated recurrent unit) networks, and the title words are generated through a decoding of the encoded sentences with keywords that are automatically selected from the input sentences. Regarding the experiments with 93631 training-data documents and 500 test-data documents, the attention-mechanism performances are more effective (ROUGE-1: 0.1935, ROUGE-2: 0.0364, ROUGE-L: 0.1555) than those of the copying mechanism; in addition, the qualitative-evaluation radiative performance of the former is higher.

Prediction of Nonlinear Sequences by Self-Organized CMAC Neural Network (자율조직 CMAC 신경망에 의한 비선형 시계열 예측)

  • 이태호
    • Journal of the Institute of Convergence Signal Processing
    • /
    • v.3 no.4
    • /
    • pp.62-66
    • /
    • 2002
  • An attempt of using SOCMAC neural network for the prediction of a nonlinear sequence, which is generated by Mackey-Glass equation, is reported. The ,report shows the SOCMAC can handle a system with multi-dimensional continuous inputs, which has been considered very difficult, if not impossible, task to be implemented by a CMAC neural network because of a huge amount of memory required. Also, an improved training method based on the variable receptive fields is proposed. The Performance ranged somewhere around those of TDNN and BP neural networks.

  • PDF

Neural acquisition system of DS/SS communication system using binary neural network (이진 신경회로망을 이용한 DS/SS에서의 초기 동기 신경 시스팀)

  • 한동수;박승권
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.21 no.11
    • /
    • pp.2991-3000
    • /
    • 1996
  • In this paper, an effective neural acquisition system is suggested for acquisition of the DS/SS communication system. The suggested system uses a binary neural network which geometrically analyzes and learns a given PN sequence in the binary field. the probabilities of detection and false alarm are obtained and are compared to simulation values. The equation of the mean acquisition time is derived and is compared to the doubledwell time of the serial serial search system. The significant improvement of the performance is demonstrated. As the length of synchronization sequence becomes longer and the number is increased, the performance is improved.

  • PDF

Acquisition of PN sequence by neural netowrks in direct-sequence spread-spectrum systems (신경망을 이용한 DS/SS 시스템의 PN 코드의 초기 동기)

  • 이상목;유철우;강창언;홍대식
    • Journal of the Korean Institute of Telematics and Electronics A
    • /
    • v.33A no.7
    • /
    • pp.44-54
    • /
    • 1996
  • In DS/SS systems it is necessary to synchronize the locally generated despreading signal with the received spreading signal to demodulate the received signal. The synch process between the two signals is usually accomplished in two steps : first acquisition then tracking. In this paper, an acquisition system aided by the neural network is proposed for the rapid and exact acquisition in DS/SS. the neural netowrk is composed o fthree-layered perpecptrons and trained by the backpropagation algorithm. The performance of the proposed system is analyzed and compared with ones of conventional systems using the sequential estimation technique under an additive while gaussian noisy channel. In all of th econsidered simulations, the proposed system outperforms conventional systems.

  • PDF

DeepAct: A Deep Neural Network Model for Activity Detection in Untrimmed Videos

  • Song, Yeongtaek;Kim, Incheol
    • Journal of Information Processing Systems
    • /
    • v.14 no.1
    • /
    • pp.150-161
    • /
    • 2018
  • We propose a novel deep neural network model for detecting human activities in untrimmed videos. The process of human activity detection in a video involves two steps: a step to extract features that are effective in recognizing human activities in a long untrimmed video, followed by a step to detect human activities from those extracted features. To extract the rich features from video segments that could express unique patterns for each activity, we employ two different convolutional neural network models, C3D and I-ResNet. For detecting human activities from the sequence of extracted feature vectors, we use BLSTM, a bi-directional recurrent neural network model. By conducting experiments with ActivityNet 200, a large-scale benchmark dataset, we show the high performance of the proposed DeepAct model.

Design of an Improved On-line Neural Network with Circulating Layer Connections (순환하는 레이어 연결을 갖는 개선된 On-line 신경회로망의 설계)

  • Yeo, Seong-Won;Lee, Chong-Ho
    • Proceedings of the KIEE Conference
    • /
    • 1998.07g
    • /
    • pp.2293-2295
    • /
    • 1998
  • In this paper, an improved on-line neural network model is suggested. This neural network is designed to store and recall sequence of key strokes in on-line. The network stores incoming patterns as weight connections between series of layers. The layer has a 2-dimensionally distributed neurons where the location of neurons are relevant to the actual location of computer keyboard. To store longer patterns, the network has circulating layer connections and different patterns can be superposed on the same layer. Also, when the patterns are stored over the layers, the starting layer is not fixed but changed by the characteristics of Patterns to increases network capability. The ways how to choose the starting layer during the store and recall process are investigated.

  • PDF

Fuzzy-ARTMAP based Multi-User Detection

  • Lee, Jung-Sik
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.37 no.3A
    • /
    • pp.172-178
    • /
    • 2012
  • This paper studies the application of a fuzzy-ARTMAP (FAM) neural network to multi-user detector (MUD) for direct sequence (DS)-code division multiple access (CDMA) system. This method shows new solution for solving the problems, such as complexity and long training, which is found when implementing the previously developed neural-basis MUDs. The proposed FAM based MUD is fast and easy to train and includes capabilities not found in other neural network approaches; a small number of parameters, no requirements for the choice of initial weights, automatic increase of hidden units, no risk of getting trapped in local minima, and the capabilities of adding new data without retraining previously trained data. In simulation studies, binary signals were generated at random in a linear channel with Gaussian noise. The performance of FAM based MUD is compared with other neural net based MUDs in terms of the bit error rate.

Design of maneuvering target tracking system using neural network as an input estimator (입력 추정기로서의 신경회로망을 이용한 기동 표적 추적 시스템 설계)

  • 김행구;진승희;박진배;주영훈
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1997.10a
    • /
    • pp.524-527
    • /
    • 1997
  • Conventional target tracking algorithms based on the linear estimation techniques perform quite efficiently when the target motion does not involve maneuvers. Target maneuvers involving short term accelerations, however, cause a bias in the measurement sequence. Accurate compensation for the bias requires processing more samples of which adds to the computational complexity. The primary motivation for employing a neural network for this task comes from the efficiency with which more features can be as inputs for bias compensation. A system architecture that efficiently integrates the fusion capabilities of a trained multilayer neural net with the tracking performance of a Kalman filter is described. The parallel processing capability of a properly trained neural network can permit fast processing of features to yield correct acceleration estimates and hence can take the burden off the primary Kalman filter which still provides the target position and velocity estimates.

  • PDF

ANNs on Co-occurrence Matrices for Mobile Malware Detection

  • Xiao, Xi;Wang, Zhenlong;Li, Qi;Li, Qing;Jiang, Yong
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.9 no.7
    • /
    • pp.2736-2754
    • /
    • 2015
  • Android dominates the mobile operating system market, which stimulates the rapid spread of mobile malware. It is quite challenging to detect mobile malware. System call sequence analysis is widely used to identify malware. However, the malware detection accuracy of existing approaches is not satisfactory since they do not consider correlation of system calls in the sequence. In this paper, we propose a new scheme called Artificial Neural Networks (ANNs) on Co-occurrence Matrices Droid (ANNCMDroid), using co-occurrence matrices to mine correlation of system calls. Our key observation is that correlation of system calls is significantly different between malware and benign software, which can be accurately expressed by co-occurrence matrices, and ANNs can effectively identify anomaly in the co-occurrence matrices. Thus at first we calculate co-occurrence matrices from the system call sequences and then convert them into vectors. Finally, these vectors are fed into ANN to detect malware. We demonstrate the effectiveness of ANNCMDroid by real experiments. Experimental results show that only 4 applications among 594 evaluated benign applications are falsely detected as malware, and only 18 applications among 614 evaluated malicious applications are not detected. As a result, ANNCMDroid achieved an F-Score of 0.981878, which is much higher than other methods.