Sentiment Analysis of Movie Review Using Integrated CNN-LSTM Mode (CNN-LSTM 조합모델을 이용한 영화리뷰 감성분석)
-
- Journal of Intelligence and Information Systems
- /
- v.25 no.4
- /
- pp.141-154
- /
- 2019
Rapid growth of internet technology and social media is progressing. Data mining technology has evolved to enable unstructured document representations in a variety of applications. Sentiment analysis is an important technology that can distinguish poor or high-quality content through text data of products, and it has proliferated during text mining. Sentiment analysis mainly analyzes people's opinions in text data by assigning predefined data categories as positive and negative. This has been studied in various directions in terms of accuracy from simple rule-based to dictionary-based approaches using predefined labels. In fact, sentiment analysis is one of the most active researches in natural language processing and is widely studied in text mining. When real online reviews aren't available for others, it's not only easy to openly collect information, but it also affects your business. In marketing, real-world information from customers is gathered on websites, not surveys. Depending on whether the website's posts are positive or negative, the customer response is reflected in the sales and tries to identify the information. However, many reviews on a website are not always good, and difficult to identify. The earlier studies in this research area used the reviews data of the Amazon.com shopping mal, but the research data used in the recent studies uses the data for stock market trends, blogs, news articles, weather forecasts, IMDB, and facebook etc. However, the lack of accuracy is recognized because sentiment calculations are changed according to the subject, paragraph, sentiment lexicon direction, and sentence strength. This study aims to classify the polarity analysis of sentiment analysis into positive and negative categories and increase the prediction accuracy of the polarity analysis using the pretrained IMDB review data set. First, the text classification algorithm related to sentiment analysis adopts the popular machine learning algorithms such as NB (naive bayes), SVM (support vector machines), XGboost, RF (random forests), and Gradient Boost as comparative models. Second, deep learning has demonstrated discriminative features that can extract complex features of data. Representative algorithms are CNN (convolution neural networks), RNN (recurrent neural networks), LSTM (long-short term memory). CNN can be used similarly to BoW when processing a sentence in vector format, but does not consider sequential data attributes. RNN can handle well in order because it takes into account the time information of the data, but there is a long-term dependency on memory. To solve the problem of long-term dependence, LSTM is used. For the comparison, CNN and LSTM were chosen as simple deep learning models. In addition to classical machine learning algorithms, CNN, LSTM, and the integrated models were analyzed. Although there are many parameters for the algorithms, we examined the relationship between numerical value and precision to find the optimal combination. And, we tried to figure out how the models work well for sentiment analysis and how these models work. This study proposes integrated CNN and LSTM algorithms to extract the positive and negative features of text analysis. The reasons for mixing these two algorithms are as follows. CNN can extract features for the classification automatically by applying convolution layer and massively parallel processing. LSTM is not capable of highly parallel processing. Like faucets, the LSTM has input, output, and forget gates that can be moved and controlled at a desired time. These gates have the advantage of placing memory blocks on hidden nodes. The memory block of the LSTM may not store all the data, but it can solve the CNN's long-term dependency problem. Furthermore, when LSTM is used in CNN's pooling layer, it has an end-to-end structure, so that spatial and temporal features can be designed simultaneously. In combination with CNN-LSTM, 90.33% accuracy was measured. This is slower than CNN, but faster than LSTM. The presented model was more accurate than other models. In addition, each word embedding layer can be improved when training the kernel step by step. CNN-LSTM can improve the weakness of each model, and there is an advantage of improving the learning by layer using the end-to-end structure of LSTM. Based on these reasons, this study tries to enhance the classification accuracy of movie reviews using the integrated CNN-LSTM model.
Introduction As consumers' purchase behavior change into a rational and practical direction, the discount store industry came to have keen competition along with rapid external growth. Therefore as a solution, distribution businesses are concentrating on developing PB(Private Brand) which can realize differentiation and profitability at the same time. And as improvement in customer loyalty beyond customer satisfaction is effective in surviving in an environment with keen competition, PB is being used as a strategic tool to improve customer loyalty. To improve loyalty among PB users, it is necessary to develop PB by examining properties of a customer group, first of all, quality level perceived by consumers should be met to obtain customer satisfaction and customer trust and consequently induce customer loyalty. To provide results of systematic analysis on relations between antecedents influenced perceived quality and variables affecting customer loyalty, this study proposed a research model based on causal relations verified in prior researches and set 16 hypotheses about relations among 9 theoretical variables. Data was collected from 400 adult customers residing in Seoul and the Metropolitan area and using large scale discount stores, among them, 375 copies were analyzed using SPSS 15.0 and Amos 7.0. The findings of the present study followed as; We ascertained that the higher company reputation, brand reputation, product experience and brand familiarity, the higher perceived quality. The study also examined the higher perceived quality, the higher customer satisfaction, customer trust and customer loyalty. The findings showed that the higher customer satisfaction and customer trust, the higher customer loyalty. As for moderating effects between PB and NB in terms of influences of perceived quality factors on perceived quality, we can ascertain that PB was higher than NB in the influences of company reputation on perceived quality while NB was higher than PB in the influences of brand reputation and brand familiarity on perceived quality. These results of empirical analysis will be useful for those concerned to do marketing activities based on a clearer understanding of antecedents and consecutive factors influenced perceived quality. At last, discussions about academical and managerial implications in these results, we suggested the limitations of this study and the future research directions. Research Model and Hypotheses Test After analyzing if antecedent variables having influence on perceived quality shows any difference between PB and NB in terms of their influences on them, the relation between variables that have influence on customer loyalty was determined as Figure 1. We established 16 hypotheses to test and hypotheses are as follows; H1-1: Perceived price has a positive effect on perceived quality. H1-2: It is expected that PB and NB would have different influence in terms of perceived price on perceived quality. H2-1: Company reputation has a positive effect on perceived quality. H2-2: It is expected that PB and NB would have different influence in terms of company reputation on perceived quality. H3-1: Brand reputation has a positive effect on perceived quality. H3-2: It is expected that PB and NB would have different influence in terms of brand reputation on perceived quality. H4-1: Product experience has a positive effect on perceived quality. H4-2: It is expected that PB and NB would have different influence in terms of product experience on perceived quality. H5-1: Brand familiarity has a positive effect on perceived quality. H5-2: It is expected that PB and NB would have different influence in terms of brand familiarity on perceived quality. H6: Perceived quality has a positive effect on customer satisfaction. H7: Perceived quality has a positive effect on customer trust. H8: Perceived quality has a positive effect on customer loyalty. H9: Customer satisfaction has a positive effect on customer trust. H10: Customer satisfaction has a positive effect on customer loyalty. H11: Customer trust has a positive effect on customer loyalty. Results from analyzing main effects of research model is shown as