Target-Aspect-Sentiment Joint Detection with CNN Auxiliary Loss for Aspect-Based Sentiment Analysis (CNN 보조 손실을 이용한 차원 기반 감성 분석)
-
- Journal of Intelligence and Information Systems
- /
- v.27 no.4
- /
- pp.1-22
- /
- 2021
Aspect Based Sentiment Analysis (ABSA), which analyzes sentiment based on aspects that appear in the text, is drawing attention because it can be used in various business industries. ABSA is a study that analyzes sentiment by aspects for multiple aspects that a text has. It is being studied in various forms depending on the purpose, such as analyzing all targets or just aspects and sentiments. Here, the aspect refers to the property of a target, and the target refers to the text that causes the sentiment. For example, for restaurant reviews, you could set the aspect into food taste, food price, quality of service, mood of the restaurant, etc. Also, if there is a review that says, "The pasta was delicious, but the salad was not," the words "steak" and "salad," which are directly mentioned in the sentence, become the "target." So far, in ABSA, most studies have analyzed sentiment only based on aspects or targets. However, even with the same aspects or targets, sentiment analysis may be inaccurate. Instances would be when aspects or sentiment are divided or when sentiment exists without a target. For example, sentences like, "Pizza and the salad were good, but the steak was disappointing." Although the aspect of this sentence is limited to "food," conflicting sentiments coexist. In addition, in the case of sentences such as "Shrimp was delicious, but the price was extravagant," although the target here is "shrimp," there are opposite sentiments coexisting that are dependent on the aspect. Finally, in sentences like "The food arrived too late and is cold now." there is no target (NULL), but it transmits a negative sentiment toward the aspect "service." Like this, failure to consider both aspects and targets - when sentiment or aspect is divided or when sentiment exists without a target - creates a dual dependency problem. To address this problem, this research analyzes sentiment by considering both aspects and targets (Target-Aspect-Sentiment Detection, hereby TASD). This study detected the limitations of existing research in the field of TASD: local contexts are not fully captured, and the number of epochs and batch size dramatically lowers the F1-score. The current model excels in spotting overall context and relations between each word. However, it struggles with phrases in the local context and is relatively slow when learning. Therefore, this study tries to improve the model's performance. To achieve the objective of this research, we additionally used auxiliary loss in aspect-sentiment classification by constructing CNN(Convolutional Neural Network) layers parallel to existing models. If existing models have analyzed aspect-sentiment through BERT encoding, Pooler, and Linear layers, this research added CNN layer-adaptive average pooling to existing models, and learning was progressed by adding additional loss values for aspect-sentiment to existing loss. In other words, when learning, the auxiliary loss, computed through CNN layers, allowed the local context to be captured more fitted. After learning, the model is designed to do aspect-sentiment analysis through the existing method. To evaluate the performance of this model, two datasets, SemEval-2015 task 12 and SemEval-2016 task 5, were used and the f1-score increased compared to the existing models. When the batch was 8 and epoch was 5, the difference was largest between the F1-score of existing models and this study with 29 and 45, respectively. Even when batch and epoch were adjusted, the F1-scores were higher than the existing models. It can be said that even when the batch and epoch numbers were small, they can be learned effectively compared to the existing models. Therefore, it can be useful in situations where resources are limited. Through this study, aspect-based sentiments can be more accurately analyzed. Through various uses in business, such as development or establishing marketing strategies, both consumers and sellers will be able to make efficient decisions. In addition, it is believed that the model can be fully learned and utilized by small businesses, those that do not have much data, given that they use a pre-training model and recorded a relatively high F1-score even with limited resources.
The author intended to investigate external and internal changes in the cone structure, changes in water content, sugar, fat and protein during the period of seed maturation which bears a proper germinability. The experimental results can be summarized as in the following. 1. Male flowers 1) Pollen-mother cells occur as a mass from late in April to early in May, and form pollen tetrads through meiosis early and middle of May. Pollen with simple nucleus reach maturity late in May. 2) Stamen number of a male flower is almost same as the scale number of cone and is 69-102 stamens. One stamen includes 5800-7300 pollen. 3) The shape is round and elliptical, both of a pollen has air-sac with
Experiments and investigations were done basically and practically for the purpose of labor saving in paddy rice cultivation especially on Homizil i.e. hoeing and herbicide, 1969. 8 concrete tanks were established on the open base of Keon Kuk University for comparison of percolation, dissolved oxygen and yield test of rice in the paddy plot of tank. The dimension of the bottom of each tank is square meter. Each of the 4 of the 8 tanks is 21cm in height and each of the remaining 4 tanks is 36cm. Each tank has a system that comprises 2 sets of tubes, each of which has 20 holes of 5mm in diameter scattered every side and is covered with nylon cloth taking water in the tank. One set consists of 4 P.V.C tubes. The first set is situated 8cm below the top of the tank and the second set is located at bottom layer inside the tank. The 4 tubes of each set are combined together and led to the glass tube which protects from inside to outside. And this inside-outside glass tube is connected to the small rubber tube. Also a glass tube is set 4cm below the top of the tank. Paddy loam was filled on sand in each of the tanks in the soil depth of either 15cm or 30cm. The depth of sand was 5cm in the soil depth of 15cm and 10cm in the soil depth of 30cm. (Fig. 1, 2 and 3). The paddy rice was grown in the tank. The percolation of water, the dissolved oxygen and the yield of rice were observed in the tank. And the dissolved oxygen was detected by Winkler method. A sandy paddy field of heavy percolation was selected at the field of the National Agricultural Material Inspection Center in Seoul. It was divided into 9 plots. These plots were given 3 treatments: (A) not hoeing, (B) hoeing one time and (C) hoeing two times. These treatments were replicated 3 times along the latin square design. The paddy rice was grown and sprayed with Stam F-34 in the all plots for the purpose of killing weeds before hoeing. The two types of paddy of field i.e. one for normal percolation and the other for ill drainage were selected at Iri Crop Experiment Station, Jeonla-Bukdo. Each field was divided into 24 plots for 8 treatments. They are: (A) not hoeing; (B) hoeing one time; (C) hoeing two times; (D) not hoeing but treating with herbicide, Pamcon; (E) hoeing one time and weeding two times also treating with herbicide, Pamcon; (F) hoeing two times and weeding one time a], o treating with herbicide, Pamcon; (G) hoeing two times and weeding two times also treating with herbicide, Pamcon, ; (H) usual manner. The labor hours and expenses needed for weeding in the paddy by hoeing were investigated in a farmer at Suwon and the price of herbicide and the yield of rice were taken out at Iri, Jeonla-Bukdo. The results obtained from the above experiments and investigations are as follows: 1. The relationship between percolation and dissolved oxygen shows that a very small amount of oxygen is detected in the soil water under 2cm below surface of earth in the paddy even when percolation is over 4.0cm per 24 hours (Tab. 1). 2. The relationship between percolation and yield of rice shows that the yield of rice increases in the percolation of 0cm and 1.5cm per 24 hours and decreases in the percolation of 2.5cm and 3.4cm in the plot of the 15cm ploughing depth and increases in the percolation of 1.4cm and 3.0cm and decreases in the percolation of 0cm and 4.0cm in the plot of 30cm ploughing depth (Tab. 1 and Fig. 5). 3. The yield of paddy weeded with Stam F-34 in the sandy field of heavy percolation in Seoul was 3.02 tons in the plot of not hoeing, 2.99 tons in hoeing one time and 3.05 tons in hoeing two times per hectare (Tab. 5). 4.1). 4. 1) The yield of rice per 10 ares in the field of normal percolation at Iri was 338kg in not hoeing, 379kg in hoeing one time, 383kg in hoeing two times, 413kg in spraying herbicide, Pamcon, and not hoeing, 433kg in spraying herbicide, Pamcon, and hoeing one time and weeding two times, 399kg in spraying herbicide, Pamcon, and hoeing two times and weeding one time, 420kg in spraying herbicide, Pamcon, and hoeing two times and weeding two times and 418kg in usual manner (Tab. 6-1). 2) The yield of rice per 10 ares in the field of ill drainage at Iri was 323kg in not hoeing, 363kg in hoeing one time, 342kg in hoeing two times, 388kg in spraying herbicide, Pamcon, and not hoeing, 425kg in spraying herbicide, Pamcon, and hoeing one time and weeding two times, 427kg in spraying herbicide, Pamcon, and hoeing two times and weeding one time, 449kg in spraying herbicide, Pamcon, and hoeing two times and weeding two times and 412kg in usual manner (Tab. 6-2). 5. 1) The labor hours for weeding by hoeing was 37.1 hours but 53.5 hours if hours for meal, smoking and so on are included, and the expenses including labor cost needed for weeding by hoeing in the paddy rice was 2, 346 Won per 10 ares at Suwon (Tab. 7). 2) The labor hours for weeding by spraying herbicide with hand sprayer in the paddy rice was about 5 hours per 10 ares at Suwon and the expenses for weeding by spraying herbicide in the paddy rice was 750 Won but 1130 Won if the loss by decrement of rice in the paddy field of ill drainage per 10 ares is calculated in estimation at Iri (Tab. 8). From these observations and investigations it is known that using of some kinds of herbicides Saves labor and expenses of weeding, almost without giving damages to the rice itself, in the field of normal or heavy percolation comparing usual manner of hoeing.
It is very important in forestry to study the shear strength of weathered granitic soil, because the soil covers 66% of our country, and because the majority of land slides have been occured in the soil. In general, the causes of land slide can be classified both the external and internal factors. The external factors are known as vegetations, geography and climate, but internal factors are known as engineering properties originated from parent rocks and weathering. Soil engineering properties are controlled by the skeleton structure, texture, consistency, cohesion, permeability, water content, mineral components, porosity and density etc. of soils. And the effects of these internal factors on sliding down summarize as resistance, shear strength, against silding of soil mass. Shear strength basically depends upon effective stress, kinds of soils, density (void ratio), water content, the structure and arrangement of soil particles, among the properties. But these elements of shear strength work not all alone, but together. The purpose of this thesis is to clarify the characteristics of shear strength and the related elements, such as water content (