Automatic Quality Evaluation with Completeness and Succinctness for Text Summarization (완전성과 간결성을 고려한 텍스트 요약 품질의 자동 평가 기법)
-
- Journal of Intelligence and Information Systems
- /
- v.24 no.2
- /
- pp.125-148
- /
- 2018
Recently, as the demand for big data analysis increases, cases of analyzing unstructured data and using the results are also increasing. Among the various types of unstructured data, text is used as a means of communicating information in almost all fields. In addition, many analysts are interested in the amount of data is very large and relatively easy to collect compared to other unstructured and structured data. Among the various text analysis applications, document classification which classifies documents into predetermined categories, topic modeling which extracts major topics from a large number of documents, sentimental analysis or opinion mining that identifies emotions or opinions contained in texts, and Text Summarization which summarize the main contents from one document or several documents have been actively studied. Especially, the text summarization technique is actively applied in the business through the news summary service, the privacy policy summary service, ect. In addition, much research has been done in academia in accordance with the extraction approach which provides the main elements of the document selectively and the abstraction approach which extracts the elements of the document and composes new sentences by combining them. However, the technique of evaluating the quality of automatically summarized documents has not made much progress compared to the technique of automatic text summarization. Most of existing studies dealing with the quality evaluation of summarization were carried out manual summarization of document, using them as reference documents, and measuring the similarity between the automatic summary and reference document. Specifically, automatic summarization is performed through various techniques from full text, and comparison with reference document, which is an ideal summary document, is performed for measuring the quality of automatic summarization. Reference documents are provided in two major ways, the most common way is manual summarization, in which a person creates an ideal summary by hand. Since this method requires human intervention in the process of preparing the summary, it takes a lot of time and cost to write the summary, and there is a limitation that the evaluation result may be different depending on the subject of the summarizer. Therefore, in order to overcome these limitations, attempts have been made to measure the quality of summary documents without human intervention. On the other hand, as a representative attempt to overcome these limitations, a method has been recently devised to reduce the size of the full text and to measure the similarity of the reduced full text and the automatic summary. In this method, the more frequent term in the full text appears in the summary, the better the quality of the summary. However, since summarization essentially means minimizing a lot of content while minimizing content omissions, it is unreasonable to say that a "good summary" based on only frequency always means a "good summary" in its essential meaning. In order to overcome the limitations of this previous study of summarization evaluation, this study proposes an automatic quality evaluation for text summarization method based on the essential meaning of summarization. Specifically, the concept of succinctness is defined as an element indicating how few duplicated contents among the sentences of the summary, and completeness is defined as an element that indicating how few of the contents are not included in the summary. In this paper, we propose a method for automatic quality evaluation of text summarization based on the concepts of succinctness and completeness. In order to evaluate the practical applicability of the proposed methodology, 29,671 sentences were extracted from TripAdvisor 's hotel reviews, summarized the reviews by each hotel and presented the results of the experiments conducted on evaluation of the quality of summaries in accordance to the proposed methodology. It also provides a way to integrate the completeness and succinctness in the trade-off relationship into the F-Score, and propose a method to perform the optimal summarization by changing the threshold of the sentence similarity.
The problem addressed by this study was to determine the effect of nurse - patient agreement on the means to achieve nursing goals in the early postpartum period of primiparous mothers. It was hypothesized that the experimental treatment would result in hegher self-confidence and satisfaction in maternal role performance. This purpose was to contribute to the planning of nursing care to enhance self- confidence and satisfaction in maternal role performance and to the development of relevant nursing theory. Especially, the early postpartum period is crucial toward in recovery from childbirth and attainment of the maternal role. Maternal role attaintment is a complex social and cognitive process of stimulus -response accomplished by learning. Most women attain the maternal role sucessfully. But, some primiparous mothers experience difficultites in attainment of the maternal role due to lack of experience and knowledge. Self-confidence and satisfaction in maternal role performance are important factors in attainment and adjustment to the maternal role (Mercer, 1981a, 1981b ; Lederman, Weigarten, and Lederman, 1981 :Bobak and Jensen, 1985). Nursing is defined as behaviors of nurses add patients that attain nursing goals through action, reaction, interaction, and transaction. For attainment of nursing goals, active participating transactions must occur by agreement on the means to achieve those goals through nurse -patient mutual goal setting and establishment of their active relationships(King, 1981, Ha, 1977). Based on King's theory of goal attainment (1981), this stuy was planned as a non-equivalent control group, non -synchronized quasi -experimental design using agreement on the means to achieve nursing goals in early postpartum as the experimental treatment. The data were collected from July 20 to Sep. 1, 1991 by questionnaires with 60 primiparous mothers planing to breast feed after normal deliveries at W hospital in Pusan, Korea. The subjects were divided into a control group(conventional group) -those admitted from July 20 to Aug. 12, and an experimental group(agreement group) - those admitted from Aug. 13 to Sep. 1. The instument for agreement on the means to nursing goals in the early postpartum period included five steps - identification of disturbances of problems through action, reaction, and interaction with primiparous mothers : mutual early postpartal nursing goal setting : exploration of the means to achieve goals ; agreement on the means (self- care, ealry maternal -infant contact, performance of mothering behavior, and communicating about the infant's behavior and health condition) : implementation of the means. This instrument was developed on the basis of King's elements that lead to transactions in nurse-patient interactions. Lederman et al's (1981) scale for Confidence in ability to cope with tasks of motherhood and Lederman et al's(1981) scale for Mother's satisfaction with motherhood and infant care were used to measure self-confidence and satisfaction in maternal role performance ·with the subjects immediately after admission and on the day of discharge. Self-care performance in the experimental group was measured by self -evaluation tool developed by the investigator from the literature concerned. The tools to measure Pelf-confidence and satisfaction in maternal role performance, and the tool to measure self-evaluation of self-care performance were tested for internal reliability. Cronbach's Alphas were 0.94, 0.94, and 0.63. The data were analysed by using in S.P.S.S. computerized program and included percentage, x²-test, t-test, ANOVA, and Pearson Correlation Coefficient. The conclusions obtained from this study are summerized as follows : 1. The degree of self-confidence in maternal role performance of the total subjects group measured before the experimental treatment was above average with a mean score of 2.77(range 2.14-3.64). Out of 14 items, those with relatively high mean scores were ‘I would like to be a better mother than I am’(3.95), and ‘I have my doubts about whether I am a good mother’(2.87). Those with low mean scores were ‘I know that my baby wants most of the times’(2.28), ‘When the baby cries, I can tell what she /he wants’(2.37), and ‘I have confidence in my ability to care for the baby’(2;50). That is, the self - confidence of Primiparous mothers was considerably high in mothering, but rather low in activities concerning the infant care and understanding of the infant behavior. The degree of satisfaction in maternal role performance of the total subjects group measured before the experimental treatment was high with a mean score of 3.18(range 1.92-3.92). Out of 13 items, those with relatively high mean scores were ‘I am glad 1 had this baby now’(3.75), ‘I play with the baby between feedings when s/he is awake and quiet’(3.67), and ‘I enjoy being a mother’(3.27). Those with low mean scores were ‘I am upset about having too many responsibilities as a mother’(2.78), ‘It bothers me to get up for the baby at night’(2.82), and ‘I get annoyed if the baby frequently interrupts my activities’.(2.82), That is, the satisfaction of primiparous mothers was considerably high in mothering and infant care, but rather low in restraints in time or on the mother's self accomplishment and development. 2. Agreement on the means to achieve nursing goals in the early postpartum period included process of mutual goal setting, exploration of the means to achieve goals, and ahreement in concert means to achieve goals based on the mothers' condition, concerns, self-perception of the nurse - patient interactions. In the process of agreement, there was agreement that the means to achieve goals should be through trust and establishment of active relationships with the nurse through identification of problems according to planned nursing goals and active interaction, such as explanations, teaching, changing of opinions, acceptance or rejection of explanations, and proposing of questions. Therefore agreement on the means to achieve nursing goals in the early postpartum period appears to be an effective nursing intervention for primiparous mothers. 3. The degree of self- confidence in maternal role performance of the exprimental group was higher than that of the control group(t＝3.95, p＜0.01). Out of 14 items, those with higher score in the experimental group were ‘I would like to be a better mother than I am’(t＝1.93, p＜0.05), ‘I know that my baby wants most of the times’(t＝2.75, p＜0.01), ‘When the baby cries, 1 can tell what she/he wants’(t＝2.10, p＜0.05), ‘I have confidence in my ability to care for the baby’(t＝3.72, p＜0.01), ‘I trust my own judement in deciding how to care for the baby’(t＝1.96, p＜0.05), ‘I feel that I know my baby and what to do for him /her’(t＝2.44, p＜0.01), ‘I am concerned about being able to meet the baby's needs’(t＝2.87, p＜0.01), ‘I know what my baby likes and dislikes’(t＝3.26, p＜0.01), ‘I don't know to care for the baby as well as I should’(t＝2.07, p＜0.05), and ‘I am unsure about whether I give enough attention to the baby’(t＝3.04, p＜0.01), That is, the degree of self-confidence in mothering, activities concerning infant care, and understanding of infant behavior of the experimental group was higher than that of the control group. Therefore, the first hypothesis, that the degree of self-confidence in maternal role performance of the experimental group would be higher than that of the control group, was supported(t＝3.95, p＜0.01). 4. The degree of satisfaction in the maternal role performance of the exprimental group was higer than that or the control group(t＝2.31, p＜0.05). Out of 13 items, those with higher score in the experimental group were ‘I am glad I had this baby now’(t＝2.29, p＜0.05), ‘I enjoy taking care of the baby’(t＝2.4g, p＜0.01), ‘It is boring for me to care for the baby and do the same thing over and over’(t＝2.87, P＜0.01), ‘I am unhappy with the amount of time I have for activities other than childcare’(t＝2.51, p＜0.01), and ‘When bathing and diapering the baby, I would like to be doing something else’(t＝2.43, p＜0.01). That is, the degree of satisfaction in mothering, infant care, and restraints in time of on the mother's self accomplishment and development in the experimental group was higher than that of the control group. Therefore, the second hypothesis, that the degree of satisfaction in maternal role performance of the experimental group would be higher than that of the control group, was supported(t＝2.31, p＜0.05). 5. The third hypothesis, that the higher the degree of satisfaction in materenal role performance, the higher the degree of self-confidence in materenal role performance in the experimental group, was supported (r＝0.57, p＜0.01)
Background: Factors related to waiting and staying time for patient care in emergency care center (ECC) were examined during 1 month from Apr. 1 to Apr. 30, 1997 at an ECC of Yeungnam university hospital in Taegu metropolitan city, to obtain the baseline data on the strategy of effective management of emergency patients. Method: The study subjects consisted of the 1,742 patients who visited at ECC and the data were obtained from the medical records of ECC and direct surveys. Results: The mean interval between ECC admission time and initial care time by each ECC duty residents was 83.1 minutes for male patients and 84.9 minutes for female patients, and mean ECC staying time (time interval between admission and final disposition from ECC) was 718.0 minutes in men and 670.5 minutes in women. As the results, the mean staying time in ECC was higher in older age, and especially the both of initial care time and staying time were highest in patients of medical aid, and shortest in patients of worker's accident compensation insurance. The on admission or not, previously endotracheal-intubation state of patient. The ECC staying ti initial care time was much more delayed in patients of not having previous medical records and the ECC staying time was higher in referred patients from out-patient department, in transferred patients from the other hospitals and patients having previous records, and in patients partly used the order-communicating system. The factors associated with the initial care time were the numbers of ECC patients and the existence of any true emergent patients, being cardiopulmonary resuscitation (CPR) statusme was much more longer in patients of drug intoxication, in CPR patients, in medical department patients, in transfused patients and in patients related to 3 or more departments. And according to the numbers of duty internships, the ECC staying time for four internships was more longer than for five internships and after admission ordering was done, also-more longer in status being of no available beds. As above mentioned results, the factors for the ECC staying time were thought to be statistically significant (P<0.01) according to the patient's age and the laboratory orders and the X-ray films checked. And also the factor for the ECC staying time were thought to be statistically significant (P<0.01) according to the status being of no available beds, the laboratory orders and/or the special laboratory orders, the X-ray films checked, final disposing department, transferred to other hospital or not, home medication or not, admission or not, the grades of beds, the year grades of residents, the causes of ECC visit, the being CPR status on admission or not, the surgical operation or not, being known personells in our hospital. Conclution: Authors concluded that the relieving method of long-staying time in ECC was being establishing the legally proved apparatus which could differentiate the true emergency or non-emergency patients, and that the methods of shortening ECC staying time were doing definitely necessary laboratory orders and managing beds more flexibly to admit for ECC patients and finally this methods were thought to be a method of unloading for ECC personnels and improving the quality of care in emergency patients.
The evolution of instant communication has mirrored the development of the Internet and messenger applications are among the most representative manifestations of instant communication technologies. In messenger applications, senders use emoticons to supplement the emotions conveyed in the text of their messages. The fact that communication via messenger applications is not face-to-face makes it difficult for senders to communicate their emotions to message recipients. Emoticons have long been used as symbols that indicate the moods of speakers. However, at present, emoticon-use is evolving into a means of conveying the psychological states of consumers who want to express individual characteristics and personality quirks while communicating their emotions to others. The fact that companies like KakaoTalk, Line, Apple, etc. have begun conducting emoticon business and sales of related content are expected to gradually increase testifies to the significance of this phenomenon. Nevertheless, despite the development of emoticons themselves and the growth of the emoticon market, no suitable emoticon recommendation system has yet been developed. Even KakaoTalk, a messenger application that commands more than 90% of domestic market share in South Korea, just grouped in to popularity, most recent, or brief category. This means consumers face the inconvenience of constantly scrolling around to locate the emoticons they want. The creation of an emoticon recommendation system would improve consumer convenience and satisfaction and increase the sales revenue of companies the sell emoticons. To recommend appropriate emoticons, it is necessary to quantify the emotions that the consumer sees and emotions. Such quantification will enable us to analyze the characteristics and emotions felt by consumers who used similar emoticons, which, in turn, will facilitate our emoticon recommendations for consumers. One way to quantify emoticons use is metadata-ization. Metadata-ization is a means of structuring or organizing unstructured and semi-structured data to extract meaning. By structuring unstructured emoticon data through metadata-ization, we can easily classify emoticons based on the emotions consumers want to express. To determine emoticons' precise emotions, we had to consider sub-detail expressions-not only the seven common emotional adjectives but also the metaphorical expressions that appear only in South Korean proved by previous studies related to emotion focusing on the emoticon's characteristics. We therefore collected the sub-detail expressions of emotion based on the "Shape", "Color" and "Adumbration". Moreover, to design a highly accurate recommendation system, we considered both emotion-technical indexes and emoticon-emotional indexes. We then identified 14 features of emoticon-technical indexes and selected 36 emotional adjectives. The 36 emotional adjectives consisted of contrasting adjectives, which we reduced to 18, and we measured the 18 emotional adjectives using 40 emoticon sets randomly selected from the top-ranked emoticons in the KakaoTalk shop. We surveyed 277 consumers in their mid-twenties who had experience purchasing emoticons; we recruited them online and asked them to evaluate five different emoticon sets. After data acquisition, we conducted a factor analysis of emoticon-emotional factors. We extracted four factors that we named "Comic", Softness", "Modernity" and "Transparency". We analyzed both the relationship between indexes and consumer attitude and the relationship between emoticon-technical indexes and emoticon-emotional factors. Through this process, we confirmed that the emoticon-technical indexes did not directly affect consumer attitudes but had a mediating effect on consumer attitudes through emoticon-emotional factors. The results of the analysis revealed the mechanism consumers use to evaluate emoticons; the results also showed that consumers' emoticon-technical indexes affected emoticon-emotional factors and that the emoticon-emotional factors affected consumer satisfaction. We therefore designed the emoticon recommendation system using only four emoticon-emotional factors; we created a recommendation method to calculate the Euclidean distance from each factors' emotion. In an attempt to increase the accuracy of the emoticon recommendation system, we compared the emotional patterns of selected emoticons with the recommended emoticons. The emotional patterns corresponded in principle. We verified the emoticon recommendation system by testing prediction accuracy; the predictions were 81.02% accurate in the first result, 76.64% accurate in the second, and 81.63% accurate in the third. This study developed a methodology that can be used in various fields academically and practically. We expect that the novel emoticon recommendation system we designed will increase emoticon sales for companies who conduct business in this domain and make consumer experiences more convenient. In addition, this study served as an important first step in the development of an intelligent emoticon recommendation system. The emotional factors proposed in this study could be collected in an emotional library that could serve as an emotion index for evaluation when new emoticons are released. Moreover, by combining the accumulated emotional library with company sales data, sales information, and consumer data, companies could develop hybrid recommendation systems that would bolster convenience for consumers and serve as intellectual assets that companies could strategically deploy.