Product evaluation criteria is an indicator describing attributes or values of products, which enable users or manufacturers measure and understand the products. When companies analyze their products or compare them with competitors, appropriate criteria must be selected for objective evaluation. The criteria should show the features of products that consumers considered when they purchased, used and evaluated the products. However, current evaluation criteria do not reflect different consumers' opinion from product to product. Previous studies tried to used online reviews from e-commerce sites that reflect consumer opinions to extract the features and topics of products and use them as evaluation criteria. However, there is still a limit that they produce irrelevant criteria to products due to extracted or improper words are not refined. To overcome this limitation, this research suggests LDA-k-NN model which extracts possible criteria words from online reviews by using LDA and refines them with k-nearest neighbor. Proposed approach starts with preparation phase, which is constructed with 6 steps. At first, it collects review data from e-commerce websites. Most e-commerce websites classify their selling items by high-level, middle-level, and low-level categories. Review data for preparation phase are gathered from each middle-level category and collapsed later, which is to present single high-level category. Next, nouns, adjectives, adverbs, and verbs are extracted from reviews by getting part of speech information using morpheme analysis module. After preprocessing, words per each topic from review are shown with LDA and only nouns in topic words are chosen as potential words for criteria. Then, words are tagged based on possibility of criteria for each middle-level category. Next, every tagged word is vectorized by pre-trained word embedding model. Finally, k-nearest neighbor case-based approach is used to classify each word with tags. After setting up preparation phase, criteria extraction phase is conducted with low-level categories. This phase starts with crawling reviews in the corresponding low-level category. Same preprocessing as preparation phase is conducted using morpheme analysis module and LDA. Possible criteria words are extracted by getting nouns from the data and vectorized by pre-trained word embedding model. Finally, evaluation criteria are extracted by refining possible criteria words using k-nearest neighbor approach and reference proportion of each word in the words set. To evaluate the performance of the proposed model, an experiment was conducted with review on '11st', one of the biggest e-commerce companies in Korea. Review data were from 'Electronics/Digital' section, one of high-level categories in 11st. For performance evaluation of suggested model, three other models were used for comparing with the suggested model; actual criteria of 11st, a model that extracts nouns by morpheme analysis module and refines them according to word frequency, and a model that extracts nouns from LDA topics and refines them by word frequency. The performance evaluation was set to predict evaluation criteria of 10 low-level categories with the suggested model and 3 models above. Criteria words extracted from each model were combined into a single words set and it was used for survey questionnaires. In the survey, respondents chose every item they consider as appropriate criteria for each category. Each model got its score when chosen words were extracted from that model. The suggested model had higher scores than other models in 8 out of 10 low-level categories. By conducting paired t-tests on scores of each model, we confirmed that the suggested model shows better performance in 26 tests out of 30. In addition, the suggested model was the best model in terms of accuracy. This research proposes evaluation criteria extracting method that combines topic extraction using LDA and refinement with k-nearest neighbor approach. This method overcomes the limits of previous dictionary-based models and frequency-based refinement models. This study can contribute to improve review analysis for deriving business insights in e-commerce market.
Ancestral Burial Ground on the Inwangsan Mountain is a ten-panel folding screen with images and postscripts. Commissioned by Bak Gyeong-bin (dates unknown), this screen was painted by Jo Jung-muk (1820-after 1894) in 1868. The postscripts were written by Hong Seon-ju (dates unknown). The National Museum of Korea restored this painting, which had been housed in the museum on separate sheets, to its original folding screen format. The museum also opened the screen to the public for the first time at the special exhibition Through the Eyes of Joseon Painters: Real Scenery Landscapes of Korea held from July 23 to September 22, 2019. Ancestral Burial Ground on the Inwangsan Mountain depicts real scenery on the western slopes of Inwangsan Mountain spanning present-day Hongje-dong and Hongeun-dong in Seodaemun-gu, Seoul. In the distance, the Bukhansan Mountain ridges are illustrated. The painting also bears place names, including Inwangsan Mountain, Chumohyeon Hill, Hongjewon Inn, Samgaksan Mountain, Daenammun Gate, and Mireukdang Hall. The names and depictions of these places show similarities to those found on late Joseon maps. Jo Jung-muk is thought to have studied the geographical information marked on maps so as to illustrate a broad landscape in this painting. Field trips to the real scenery depicted in the painting have revealed that Jo exaggerated or omitted natural features and blended and arranged them into a row for the purposes of the horizontal picture plane. Jo Jung-muk was a painter proficient at drawing conventional landscapes in the style of the Southern School of Chinese painting. Details in Ancestral Burial Ground on the Inwangsan Mountain reflect the painting style of the School of Four Wangs. Jo also applied a more decorative style to some areas. The nineteenth-century court painters of the Dohwaseo(Royal Bureau of Painting), including Jo, employed such decorative painting styles by drawing houses based on painting manuals, applying dots formed like sprinkled black pepper to depict mounds of earth and illustrating flowers by dotted thick pigment. Moreover, Ancestral Burial Ground on the Inwangsan Mountain shows the individualistic style of Jeong Seon(1676~1759) in the rocks drawn with sweeping brushstrokes in dark ink, the massiveness of the mountain terrain, and the pine trees simply depicted using horizontal brushstrokes. Jo Jung-muk is presumed to have borrowed the authority and styles of Jeong Seon, who was well-known for his real scenery landscapes of Inwangsan Mountain. Nonetheless, the painting lacks an spontaneous sense of space and fails in conveying an impression of actual sites. Additionally, the excessively grand screen does not allow Jo Jung-muk to fully express his own style. In Ancestral Burial Ground on the Inwangsan Mountain, the texts of the postscripts nicely correspond to the images depicted. Their contents can be divided into six parts: (1) the occupant of the tomb and the reason for its relocation; (2) the location and geomancy of the tomb; (3) memorial services held at the tomb and mysterious responses received during the memorial services; (4) cooperation among villagers to manage the tomb; (5) the filial piety of Bak Gyeong-bin, who commissioned the painting and guarded the tomb; and (6) significance of the postscripts. The second part in particular is faithfully depicted in the painting since it can easily be visualized. According to the fifth part revealing the motive for the production of the painting, the commissioner Bak Gyeongbin was satisfied with the painting, stating that "it appears impeccable and is just as if the tomb were newly built." The composition of the natural features in a row as if explaining each one lacks painterly beauty, but it does succeed in providing information on the geomantic topography of the gravesite. A fair number of the existing depictions of gravesites are woodblock prints of family gravesites produced after the eighteenth century. Most of these are included in genealogical records and anthologies. According to sixteenth- and seventeenth-century historical records, hanging scrolls of family gravesites served as objects of worship. Bowing in front of these paintings was considered a substitute ritual when descendants could not physically be present to maintain their parents' or other ancestors' tombs. Han Hyo-won (1468-1534) and Jo Sil-gul (1591-1658) commissioned the production of family burial ground paintings and asked distinguished figures of the time to write a preface for the paintings, thus showing off their filial piety. Such examples are considered precedents for Ancestral Burial Ground on the Inwangsan Mountain. Hermitage of the Recluse Seokjeong in a private collection and Old Villa in Hwagae County at the National Museum of Korea are not paintings of family gravesites. However, they serve as references for seventeenth-century paintings depicting family gravesites in that they are hanging scrolls in the style of the paintings of literary gatherings and they illustrate geomancy. As an object of worship, Ancestral Burial Ground on the Inwangsan Mountain recalls a portrait. As indicated in the postscripts, the painting made Bak Gyeong-bin "feel like hearing his father's cough and seeing his attitudes and behaviors with my eyes." The fable of Xu Xiaosu, who gazed at the portrait of his father day and night, is reflected in this gravesite painting evoking a deceased parent. It is still unclear why Bak Gyeong-bin commissioned Ancestral Burial Ground on the Inwangsan Mountain to be produced as a real scenery landscape in the folding screen format rather than a hanging scroll or woodblock print, the conventional formats for a family gravesite paintings. In the nineteenth century, commoners came to produce numerous folding screens for use during the four rites of coming of age, marriage, burial, and ancestral rituals. However, they did not always use the screens in accordance with the nature of these rites. In the Ancestral Burial Ground on the Inwangsan Mountain, the real scenery landscape appears to have been emphasized more than the image of the gravesite in order to allow the screen to be applied during different rituals or for use to decorate space. The burial mound, which should be the essence of Ancestral Burial Ground on the Inwangsan Mountain, might have been obscured in order to hide its violation of the prohibition on the construction of tombs on the four mountains around the capital. At the western foot of Inwangsan Mountain, which was illustrated in this painting, the construction of tombs was forbidden. In 1832, a tomb discovered illegally built on the forbidden area was immediately dug up and the related people were severely punished. This indicates that the prohibition was effective until the mid-nineteenth century. The postscripts on the Ancestral Burial Ground on the Inwangsan Mountain document in detail Bak Gyeong-bin's efforts to obtain the land as a burial site. The help and connivance of villagers were necessary to use the burial site, probably because constructing tombs within the prohibited area was a burden on the family and villagers. Seokpajeong Pavilion by Yi Han-cheol (1808~1880), currently housed at the Los Angeles County Museum of Art, is another real scenery landscape in the format of a folding screen that is contemporaneous and comparable with Ancestral Burial Ground on the Inwangsan Mountain. In 1861 when Seokpajeong Pavilion was created, both Yi Han-cheol and Jo Jung-muk participated in the production of a portrait of King Cheoljong. Thus, it is highly probable that Jo Jung-muk may have observed the painting process of Yi's Seokpajeong Pavilion. A few years later, when Jo Jungmuk was commissioned to produce Ancestral Burial Ground on the Inwangsan Mountain, his experience with the impressive real scenery landscape of the Seokpajeong Pavilion screen could have been reflected in his work. The difference in the painting style between these two paintings is presumed to be a result of the tastes and purposes of the commissioners. Since Ancestral Burial Ground on the Inwangsan Mountain contains the multilayered structure of a real scenery landscape and family gravesite, it seems to have been perceived in myriad different ways depending on the viewer's level of knowledge, closeness to the commissioner, or viewing time. In the postscripts to the painting, the name and nickname of the tomb occupant as well as the place of his surname are not recorded. He is simply referred to as "Mister Bak." Biographical information about the commissioner Bak Gyeong-bin is also unavailable. However, given that his family did not enter government service, he is thought to have been a person of low standing who could not become a member of the ruling elite despite financial wherewithal. Moreover, it is hard to perceive Hong Seon-ju, who wrote the postscripts, as a member of the nobility. He might have been a low-level administrative official who belonged to the Gyeongajeon, as documented in the Seungjeongwon ilgi (Daily Records of Royal Secretariat of the Joseon Dynasty). Bak Gyeong-bin is presumed to have moved the tomb of his father to a propitious site and commissioned Ancestral Burial Ground on the Inwangsan Mountain to stress his filial piety, a conservative value, out of his desire to enter the upper class. However, Ancestral Burial Ground on the Inwangsan Mountain failed to live up to its original purpose and ended up as a contradictory image due to its multiple applications and the concern over the exposure of the violation of the prohibition on the construction of tombs on the prohibited area. Forty-seven years after its production, this screen became a part of the collection at the Royal Yi Household Museum with each panel being separated. This suggests that Bak Gyeong-bin's dream of bringing fortune and raising his family's social status by selecting a propitious gravesite did not come true.