• Journal of Intelligence and Information Systems
• /
• v.25 no.1
• /
• pp.163-177
• /
• 2019

As smartphones are getting widely used, human activity recognition (HAR) tasks for recognizing personal activities of smartphone users with multimodal data have been actively studied recently. The research area is expanding from the recognition of the simple body movement of an individual user to the recognition of low-level behavior and high-level behavior. However, HAR tasks for recognizing interaction behavior with other people, such as whether the user is accompanying or communicating with someone else, have gotten less attention so far. And previous research for recognizing interaction behavior has usually depended on audio, Bluetooth, and Wi-Fi sensors, which are vulnerable to privacy issues and require much time to collect enough data. Whereas physical sensors including accelerometer, magnetic field and gyroscope sensors are less vulnerable to privacy issues and can collect a large amount of data within a short time. In this paper, a method for detecting accompanying status based on deep learning model by only using multimodal physical sensor data, such as an accelerometer, magnetic field and gyroscope, was proposed. The accompanying status was defined as a redefinition of a part of the user interaction behavior, including whether the user is accompanying with an acquaintance at a close distance and the user is actively communicating with the acquaintance. A framework based on convolutional neural networks (CNN) and long short-term memory (LSTM) recurrent networks for classifying accompanying and conversation was proposed. First, a data preprocessing method which consists of time synchronization of multimodal data from different physical sensors, data normalization and sequence data generation was introduced. We applied the nearest interpolation to synchronize the time of collected data from different sensors. Normalization was performed for each x, y, z axis value of the sensor data, and the sequence data was generated according to the sliding window method. Then, the sequence data became the input for CNN, where feature maps representing local dependencies of the original sequence are extracted. The CNN consisted of 3 convolutional layers and did not have a pooling layer to maintain the temporal information of the sequence data. Next, LSTM recurrent networks received the feature maps, learned long-term dependencies from them and extracted features. The LSTM recurrent networks consisted of two layers, each with 128 cells. Finally, the extracted features were used for classification by softmax classifier. The loss function of the model was cross entropy function and the weights of the model were randomly initialized on a normal distribution with an average of 0 and a standard deviation of 0.1. The model was trained using adaptive moment estimation (ADAM) optimization algorithm and the mini batch size was set to 128. We applied dropout to input values of the LSTM recurrent networks to prevent overfitting. The initial learning rate was set to 0.001, and it decreased exponentially by 0.99 at the end of each epoch training. An Android smartphone application was developed and released to collect data. We collected smartphone data for a total of 18 subjects. Using the data, the model classified accompanying and conversation by 98.74% and 98.83% accuracy each. Both the F1 score and accuracy of the model were higher than the F1 score and accuracy of the majority vote classifier, support vector machine, and deep recurrent neural network. In the future research, we will focus on more rigorous multimodal sensor data synchronization methods that minimize the time stamp differences. In addition, we will further study transfer learning method that enables transfer of trained models tailored to the training data to the evaluation data that follows a different distribution. It is expected that a model capable of exhibiting robust recognition performance against changes in data that is not considered in the model learning stage will be obtained.

• Journal of Intelligence and Information Systems
• /
• v.27 no.4
• /
• pp.1-22
• /
• 2021

Aspect Based Sentiment Analysis (ABSA), which analyzes sentiment based on aspects that appear in the text, is drawing attention because it can be used in various business industries. ABSA is a study that analyzes sentiment by aspects for multiple aspects that a text has. It is being studied in various forms depending on the purpose, such as analyzing all targets or just aspects and sentiments. Here, the aspect refers to the property of a target, and the target refers to the text that causes the sentiment. For example, for restaurant reviews, you could set the aspect into food taste, food price, quality of service, mood of the restaurant, etc. Also, if there is a review that says, "The pasta was delicious, but the salad was not," the words "steak" and "salad," which are directly mentioned in the sentence, become the "target." So far, in ABSA, most studies have analyzed sentiment only based on aspects or targets. However, even with the same aspects or targets, sentiment analysis may be inaccurate. Instances would be when aspects or sentiment are divided or when sentiment exists without a target. For example, sentences like, "Pizza and the salad were good, but the steak was disappointing." Although the aspect of this sentence is limited to "food," conflicting sentiments coexist. In addition, in the case of sentences such as "Shrimp was delicious, but the price was extravagant," although the target here is "shrimp," there are opposite sentiments coexisting that are dependent on the aspect. Finally, in sentences like "The food arrived too late and is cold now." there is no target (NULL), but it transmits a negative sentiment toward the aspect "service." Like this, failure to consider both aspects and targets - when sentiment or aspect is divided or when sentiment exists without a target - creates a dual dependency problem. To address this problem, this research analyzes sentiment by considering both aspects and targets (Target-Aspect-Sentiment Detection, hereby TASD). This study detected the limitations of existing research in the field of TASD: local contexts are not fully captured, and the number of epochs and batch size dramatically lowers the F1-score. The current model excels in spotting overall context and relations between each word. However, it struggles with phrases in the local context and is relatively slow when learning. Therefore, this study tries to improve the model's performance. To achieve the objective of this research, we additionally used auxiliary loss in aspect-sentiment classification by constructing CNN(Convolutional Neural Network) layers parallel to existing models. If existing models have analyzed aspect-sentiment through BERT encoding, Pooler, and Linear layers, this research added CNN layer-adaptive average pooling to existing models, and learning was progressed by adding additional loss values for aspect-sentiment to existing loss. In other words, when learning, the auxiliary loss, computed through CNN layers, allowed the local context to be captured more fitted. After learning, the model is designed to do aspect-sentiment analysis through the existing method. To evaluate the performance of this model, two datasets, SemEval-2015 task 12 and SemEval-2016 task 5, were used and the f1-score increased compared to the existing models. When the batch was 8 and epoch was 5, the difference was largest between the F1-score of existing models and this study with 29 and 45, respectively. Even when batch and epoch were adjusted, the F1-scores were higher than the existing models. It can be said that even when the batch and epoch numbers were small, they can be learned effectively compared to the existing models. Therefore, it can be useful in situations where resources are limited. Through this study, aspect-based sentiments can be more accurately analyzed. Through various uses in business, such as development or establishing marketing strategies, both consumers and sellers will be able to make efficient decisions. In addition, it is believed that the model can be fully learned and utilized by small businesses, those that do not have much data, given that they use a pre-training model and recorded a relatively high F1-score even with limited resources.

• Journal of Korean Society of Forest Science
• /
• v.66 no.1
• /
• pp.16-36
• /
• 1984

It is very important in forestry to study the shear strength of weathered granitic soil, because the soil covers 66% of our country, and because the majority of land slides have been occured in the soil. In general, the causes of land slide can be classified both the external and internal factors. The external factors are known as vegetations, geography and climate, but internal factors are known as engineering properties originated from parent rocks and weathering. Soil engineering properties are controlled by the skeleton structure, texture, consistency, cohesion, permeability, water content, mineral components, porosity and density etc. of soils. And the effects of these internal factors on sliding down summarize as resistance, shear strength, against silding of soil mass. Shear strength basically depends upon effective stress, kinds of soils, density (void ratio), water content, the structure and arrangement of soil particles, among the properties. But these elements of shear strength work not all alone, but together. The purpose of this thesis is to clarify the characteristics of shear strength and the related elements, such as water content ($w_o$), void ratio($e_o$), dry density (${\gamma}_d$) and specific gravity ($G_s$), and the interrelationship among related elements in order to decide the dominant element chiefly influencing on shear strength in natural/undisturbed state of weathered granitic soil, in addition to the characteristics of soil hardness of weathered granitic soil and root distribution of Pinus rigida Mill and Pinus rigida ${\times}$ taeda planted in erosion-controlled lands. For the characteristics of shear strength of weathered granitic soil and the related elements of shear strength, three sites were selected from Kwangju district. The outlines of sampling sites in the district were: average specific gravity, 2.63 ~ 2.79; average natural water content, 24.3 ~ 28.3%; average dry density, $1.31{\sim}1.43g/cm^3$, average void ratio, 0.93 ~ 1.001 ; cohesion, $ 0.2{\sim}0.75kg/cm^2$ ; angle of internal friction, $29^{\circ}{\sim}45^{\circ}$ ; soil texture, SL. The shear strength of the soil in different sites was measured by a direct shear apparatus (type B; shear box size, $62.5{\times}20mm$; ${\sigma}$, $1.434kg/cm^2$; speed, 1/100mm/min.). For the related element analyses, water content was moderated through a series of drainage experiments with 4 levels of drainage period, specific gravity was measured by KS F 308, analysis of particle size distribution, by KS F 2302 and soil samples were dried at $110{\pm}5^{\circ}C$ for more than 12 hours in dry oven. Soil hardness represents physical properties, such as particle size distribution, porosity, bulk density and water content of soil, and test of the hardness by soil hardness tester is the simplest approach and totally indicative method to grasp the mechanical properties of soil. It is important to understand the mechanical properties of soil as well as the chemical in order to realize the fundamental phenomena in the growth and the distribution of tree roots. The writer intended to study the correlation between the soil hardness and the distribution of tree roots of Pinus rigida Mill. planted in 1966 and Pinus rigida ${\times}$ taeda in 199 to 1960 in the denuded forest lands with and after several erosion control works. The soil texture of the sites investigated was SL originated from weathered granitic soil. The former is situated at Py$\ddot{o}$ngchangri, Ky$\ddot{o}$m-my$\ddot{o}$n, Kogs$\ddot{o}$ng-gun, Ch$\ddot{o}$llanam-do (3.63 ha; slope, $17^{\circ}{\sim}41^{\circ}$ soil depth, thin or medium; humidity, dry or optimum; height, 5.66/3.73 ~ 7.63 m; D.B.H., 9.7/8.00 ~ 12.00 cm) and the Latter at changun-long Kwangju-shi (3.50 ha; slope, $12^{\circ}{\sim}23^{\circ}$; soil depth, thin; humidity, dry; height, 10.47/7.3 ~ 12.79 m; D.B.H., 16.94/14.3 ~ 19.4 cm).The sampling areas were 24quadrats ($10m{\times}10m$) in the former area and 12 in the latter expanding from summit to foot. Each sampling trees for hardness test and investigation of root distribution were selected by purposive selection and soil profiles of these trees were made at the downward distance of 50 cm from the trees, at each quadrat. Soil layers of the profile were separated by the distance of 10 cm from the surface (layer I, II, ... ...). Soil hardness was measured with Yamanaka soil hardness tester and indicated as indicated soil hardness at the different soil layers. The distribution of tree root number per unit area in different soil depth was investigated, and the relationship between the soil hardness and the number of tree roots was discussed. The results obtained from the experiments are summarized as follows. 1. Analyses of simple relationship between shear strength and elements of shear strength, water content ($w_o$), void ratio ($e_o$), dry density (${\gamma}_d$) and specific gravity ($G_s$). 1) Negative correlation coefficients were recognized between shear strength and water content. and shear strength and void ratio. 2) Positive correlation coefficients were recognized between shear strength and dry density. 3) The correlation coefficients between shear strength and specific gravity were not significant. 2. Analyses of partial and multiple correlation coefficients between shear strength and the related elements: 1) From the analyses of the partial correlation coefficients among water content ($x_1$), void ratio ($x_2$), and dry density ($x_3$), the direct effect of the water content on shear strength was the highest, and effect on shear strength was in order of void ratio and dry density. Similar trend was recognized from the results of multiple correlation coefficient analyses. 2) Multiple linear regression equations derived from two independent variables, water content ($x_1$ and dry density ($x_2$) were found to be ineffective in estimating shear strength ($\hat{Y}$). However, the simple linear regression equations with an independent variable, water content (x) were highly efficient to estimate shear strength ($\hat{Y}$) with relatively high fitness. 3. A relationship between soil hardness and the distribution of root number: 1) The soil hardness increased proportionally to the soil depth. Negative correlation coefficients were recognized between indicated soil hardness and the number of tree roots in both plantations. 2) The majority of tree roots of Pinus rigida Mill and Pinus rigida ${\times}$ taeda planted in erosion-controlled lands distributed at 20 cm deep from the surface. 3) Simple linear regression equations were derived from indicated hardness (x) and the number of tree roots (Y) to estimate root numbers in both plantations.

• MISULJARYO - National Museum of Korea Art Journal
• /
• v.96
• /
• pp.54-88
• /
• 2019

The Album of Complete Views of Seas and Mountains comprises sixty real scenery landscape paintings depicting Geumgangsan Mountain, the Haegeumgang River, and the eight scenic views of Gwandong regions, as well as fifty-one pieces of writing. It is a rare example in terms of its size and painting style. The paintings in this album, which are densely packed with natural features, follow the painting style of the Southern School yet employ crude and unconventional elements. In them, stones on the mountains are depicted both geometrically and three-dimensionally. Since 1973, parts of this album have been published in some exhibition catalogues. The entire album was opened to the public at the special exhibition "Through the Eyes of Joseon Painters: Real Scenery Landscapes of Korea" held at the National Museum of Korea in 2019. The Album of Complete Views of Seas and Mountains was attributed to Kim Eung-hwan (1742-1789) due to the signature on the final leaf of the album and the seal reading "Bokheon(painter's penname)" on the currently missing album leaf of Chilbodae Peaks. However, there is a strong possibility that this signature and seal may have been added later. This paper intends to reexamine the creator of this album based on a variety of related factors. In order to understand the production background of Album of Complete Views of Seas and Mountains, I investigated the eighteenth-century tradition of drawing scenic spots while travelling in which scenery of was depicted during private travels or official excursions. Jeong Seon(1676-1759), Sim Sa-jeong(1707-1769), Kim Yun-gyeom(1711-1775), Choe Buk(1712-after 1786), and Kang Se-hwang(1713-1791) all went on a journey to Geumgangsan Mountain, the most famous travel destination in the late Joseon period, and created paintings of the mountain, including Album of Pungak Mountain in the Sinmyo Year(1711) by Jeong Seon. These painters presented their versions of the traditional scenic spots of Inner Geumgangsan and newly depicted vistas they discovered for themselves. To commemorate their private visits, they produced paintings for their fellow travelers or sponsors in an album format that could include several scenes. While the production of paintings of private travels to Geumgangsan Mountain increased, King Jeongjo(r. 1776-1800) ordered Kim Eung-hwan and Kim Hong-do, court painters at the Dohwaseo(Royal Bureau of Painting), to paint scenic spots in the nine counties of the Yeongdong region and around Geumgangsan Mountain. King Jeongjo selected these two as the painters for the official excursion taking into account their relationship, their administrative experience as regional officials, and their distinct painting styles. Starting in the reign of King Yeongjo(r. 1724-1776), Kim Eung-hwan and Kim Hong-do served as court painters at the Dohwaseo, maintained a close relationship as a senior and a junior and as colleagues, and served as chalbang(chief in large of post stations) in the Yeongnam region. While Kim Hong-do was proficient at applying soft and delicate brushstrokes, Kim Eung-hwan was skilled at depicting the beauty of robust and luxuriant landscapes. Both painters produced about 100 scenes of original drawings over fifty days of the official excursion. Based on these original drawings, they created around seventy album leaves or handscrolls. Their paintings enriched the tradition of depicting scenic spots, particularly Outer Inner Geumgang and the eight scenic views of Gwandong around Geumgangsan Mountain during private journeys in the eighteenth century. Moreover, they newly discovered places of scenic beauty in the Outer Geungang and Yeongdong regions, establishing them as new painting themes. The Album of Complete Views of Seas and Mountains consists of four volumes. The volumes I, II include twenty-nine paintings of Inner Geumgangsan; the volume III, seventeen scenes of Outer Geumgangsan; and the volume IV, fourteen images of Maritime Geumgangsan and the eight scenic views of Gwandong. These paintings produced on silk show crowded compositions, geometrical depictions of the stones and the mountains, and distinct presentation of the rocky peaks of Geumgangsan Mountain using white and grayish-blue pigments. This album reflects the Joseon painting style of the mid- and late eighteenth century, integrating influences from Jeong Seon, Kang Se-hwang, Sim Sa-jeong, Jeong Chung-yeop(1725-after 1800), and Kim Hong-do. In particular, some paintings in the album show similarities to Kim Hong-do's Album of Famous Mountains in Korea in terms of its compositions and painterly motifs. However, "Yeongrangho Lake," "Haesanjeong Pavilion," and "Wolsongjeong Pavilion" in Kim Eung-hwan's album differ from in the version by Kim Hong-do. Thus, Kim Eung-hwan was influenced by Kim Hong-do, but produced his own distinctive album. The Album of Complete Views of Seas and Mountains includes scenery of "Jaundam Pool," "Baegundae Peak," "Viewing Birobong Peak at Anmunjeom groove," and "Baekjeongbong Peak," all of which are not depicted in other albums. In his version, Kim Eung-hwan portrayed the characteristics of the natural features in each scenic spot in a detailed and refreshing manner. Moreover, he illustrated stones on the mountains using geometric shapes and added a sense of three-dimensionality using lines and planes. Based on the painting traditions of the Southern School, he established his own characteristics. He also turned natural features into triangular or rectangular chunks. All sixty paintings in this album appear rough and unconventional, but maintain their internal consistency. Each of the fifty-one writings included in the Album of Complete Views of Seas and Mountains is followed by a painting of a scenic spot. It explains the depicted landscape, thus helping viewers to understand and appreciate the painting. Intimately linked to each painting, the related text notes information on traveling from one scenic spot to the next, the origins of the place names, geographic features, and other related information. Such encyclopedic documentation began in the early nineteenth century and was common in painting albums of Geumgangsan Mountain in the mid- nineteenth century. The text following the painting of Baekhwaam Hermitage in the Album of Complete Views of Seas and Mountains documents the reconstruction of the Baekhwaam Hermitage in 1845, which provides crucial evidence for dating the text. Therefore, the owner of the Album of Complete Views of Seas and Mountains might have written the texts or asked someone else to transcribe them in the mid- or late nineteenth century. In this paper, I have inferred the producer of the Album of Complete Views of Seas and Mountains to be Kim Eung-hwan based on the painting style and the tradition of drawing scenic spots during official trips. Moreover, its affinity with the Handscroll of Pungak Mountain created by Kim Ha-jong(1793-after 1878) after 1865 is another decisive factor in attributing the album to Kim Eung-hwan. In contrast to the Album of Famous Mountains in Korea by Kim Hong-do, the Album of Complete Views of Seas and Mountains exerted only a minor influence on other painters. The Handscroll of Pungak Mountain by Kim Ha-jong is the sole example that employs the subject matter from the Album of Complete Views of Seas and Mountains and follows its painting style. In the Handscroll of Pungak Mountain, Kim Ha-jong demonstrated a painting style completely different from that in the Album of Seas and Mountains that he produced fifty years prior in 1816 for Yi Gwang-mun, the magistrate of Chuncheon. He emphasized the idea of "scholar thoughts" by following the compositions, painterly elements, and depictions of figures in the painting manual style from Kim Eung-hwan's Album of Complete Views of Seas and Mountains. Kim Ha-jong, a member of the Gaeseong Kim clan and the eldest grandson of Kim Eung-hwan, is presumed to have appreciated the paintings depicted in the nature of Album of Complete Views of Seas and Mountains, which had been passed down within the family, and newly transformed them. Furthermore, the contents and narrative styles of Yi Yu-won's writings attached to the paintings in the Handscroll of Pungak Mountain are similar to those of the fifty-one writings in Kim Eunghwan's album. This suggests a possible influence of the inscriptions in Kim Eung-hwan's album or the original texts from which these inscriptions were quoted upon the writings in Kim Ha-jong's handscroll. However, a closer examination will be needed to determine the order of the transcription of the writings. The Album of Complete View of Seas and Mountains differs from Kim Hong-do's paintings of his official trips and other painting albums he influenced. This album is a siginificant artwork in that it broadens the understanding of the art world of Kim Eung-hwan and illustrates another layer of real scenery landscape paintings in the late eighteenth century.