International Journal of Advanced Culture Technology

The International Promotion Agency of Culture Technology (국제문화기술진흥원)
권호 표지
DOI QR코드

DOI QR Code

Comparison of Neural Network Techniques for Text Data Analysis

  • Kim, Munhee (Department of Statistics, Hankuk University of Foreign Studies) ;
  • Kang, Kee-Hoon (Department of Statistics, Hankuk University of Foreign Studies)
  • Received : 2020.04.30
  • Accepted : 2020.05.30
  • Published : 2020.06.30
Download PDF
⟨ Previous Next ⟩

Abstract

Generally, sequential data refers to data having continuity. Text data, which is a representative type of unstructured data, is also sequential data in that it is necessary to know the meaning of the preceding word in order to know the meaning of the following word or context. So far, many techniques for analyzing sequential data such as text data have been proposed. In this paper, four methods of 1d-CNN, LSTM, BiLSTM, and C-LSTM are introduced, focusing on neural network techniques. In addition, by using this, IMDb movie review data was classified into two classes to compare the performance of the techniques in terms of accuracy and analysis time.

Keywords

References

  1. R. Collobert, J. Weston, L. Bottou, M. Karlen, K. Kavukcuoglu, and P. Kuksa, "Natural language processing (almost) from scratch," The Journal of Machine Learning Research, Vol. 12, pp. 2493-2537, 2011.
  2. M. Denil, A. Demiraj, N. Kalchbrenner, P. Blunsom, and N. Freitas, "Modelling, visualising and summarising documents with a single convolutional neural network," arXiv:1406.3830, 2014.
  3. N. Kalchbrenner, E. Grefenstette and P. Blunsom, "A convolutional neural network for modelling sentences," in Proc. 52nd Annual Meeting of the Association for Computational Linguistics, pp. 655-665, June, 2014.
  4. S. Hochreiter and J. Schmidhuber, "Long short-term memory," Neural computation, Vol. 9, No. 8, pp. 1735-1780, November, 1997. https://doi.org/10.1162/neco.1997.9.8.1735
  5. K. Xu, J. Ba, R. Kiros, A. Courville, R. Salakhutdinov, R. Zemel and Y. Bengio, "Show, attend and tell: Neural image caption generation with visual attention," in Proc. 32nd International Conference on Machine Learning, pp. 2048-2057, 2015.
  6. S. Lai, L. Xu, K. Liu and J. Zhao, "Recurrent convolutional neural networks for text classification," in Proc. 29th Conference of the Association for the Advancement of Artificial Intelligence, pp. 2267-2273, January, 2015.
  7. C. Zhou, C. Sun, Z. Liu and F.C.M. Lau, "A C-LSTM neural network for text text classification," arXiv:1511.08630v2, 2015.