• Journal of Software Assessment and Valuation
• /
• v.17 no.2
• /
• pp.1-10
• /
• 2021

The ability to recognize human emotions by computer vision is a very important task, with many potential applications. Therefore the demand for emotion recognition using not only RGB images but also thermal images is increasing. Compared to RGB images, thermal images has the advantage of being less affected by lighting conditions but require a more sophisticated recognition method with low-resolution sources. In this paper, we propose a Divide and Conquer-based CNN training strategy to improve the performance of facial thermal image-based emotion recognition. The proposed method first trains to classify difficult-to-classify similar emotion classes into the same class group by confusion matrix analysis and then divides and solves the problem so that the emotion group classified into the same class group is recognized again as actual emotions. In experiments, the proposed method has improved accuracy in all the tests than when recognizing all the presented emotions with a single CNN model.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2017.06a
• /
• pp.26-28
• /
• 2017

스마트폰 보유율과 모바일 이용 행태가 급변함에 따라 방송사에서는 양방향 서비스를 포함한 다양한 방송 서비스를 제공하려고 노력하고 있다. 양방향 서비스 방송에서 시청자가 보낸 문구를 실제 화면에 보여주기까지 PD 와 담당자들의 수작업이 필요하다. 하지만 하루 평균 약 7,200 건 (MBC 오늘아침 소통중계)의 양방향 서비스 관련 로그가 남게 되어, PD 가 일일이 판별하기에는 많은 노력이 따른다. 이러한 불필요한 노력을 줄이기 위해 본 논문에서는 감정 분석을 이용한 딥러닝 인공지능 기반 양방향 서비스 방송 소프트웨어 시스템을 제안한다. 첫째, 시청자들이 전송한 의견, 건의사항, 내용 등을 전처리 과정을 진행한다. 둘째, 감정 사전을 이용해 전처리 된 단어와 비교하여 시청자가 보낸 문구의 감정 점수를 계산한다. 셋째, 과거 실제 방송에 송출된 시청자 문구를 감정 점수와 함께 딥러닝을 이용하여 훈련시킨다. 본 논문의 성능을 평가하기 위해, 2017 년 생방송 오늘아침 소통중계에 사례연구를 진행하였고 효율성을 보였다. 앞으로 이러한 양방향 서비스 방송 소프트웨어 시스템 도입으로, PD 가 방송 제작에 더욱 집중 할 수 있도록 차별화된 방송을 준비하는데 크게 기여할 것이라 기대한다.

• Journal of the Korea Computer Industry Society
• /
• v.2 no.11
• /
• pp.1439-1444
• /
• 2001

Inspection of program products illegal reproduction is a significant field in deciding illegal recopy of program duplication, reproduction, plagiarization and electronic information by expertized programmer or specialist using computer science knowledge and technical methods. This is important for propelling the S/W industry in the high value creating industry. In particular, social demands are increasing the conflicts of the program products illegal recopy because of knowledge property problems. Therefore, legal and structural methods have been inspection of the program products illegal copy and usage. This article describes the existing problems of the inspecting of the program products illegal recopy and discusses the future directions and developing methods for propelling and setting the knowledge property industry field such as S/W industry.

• Journal of the Korea Computer Graphics Society
• /
• v.29 no.3
• /
• pp.33-43
• /
• 2023

Not only emotions affect physical sensations, but they also have an impact on physical movements. The responses to emotions vary depending on the type of emotional stimuli. However, research on the effects of emotional stimuli on the activation of bodily movements has not been rigorously examined, and these effects have not been investigated in Autonomous Emotion Recognition (AER) systems. In this study, we aimed to compare the emotional responses of 20 participants to three types of emotional stimuli (words, pictures, and videos) and investigate their activation or deactivation for the AER system. Our dependent measures included emotional responses, computer-based self-reporting methods, and bodily movements recorded using motion capture devices. The results suggested that video stimuli elicited higher levels of emotional movement, and emotional movement patterns were similar across different types of emotional stimuli for happiness, sadness, anger, and neutrality. Additionally, the findings indicated that bodily changes observed during video stimuli had the highest classification accuracy. These findings have implications for future research on the bodily changes elicited by emotional stimuli.

• The Journal of the Convergence on Culture Technology
• /
• v.9 no.4
• /
• pp.687-692
• /
• 2023

We analyze the accuracy of emotion analysis of natural language processing deep learning model and propose to use it for emotional content development. After looking at the outline of the GPT-3 model, about 6,000 pieces of dialogue data provided by Aihub were input to 9 emotion categories: 'joy', 'sadness', 'fear', 'anger', 'disgust', and 'surprise'. ', 'interest', 'boredom', and 'pain'. Performance evaluation was conducted using the evaluation indices of accuracy, precision, recall, and F1-score, which are evaluation methods for natural language processing models. As a result of the emotion analysis, the accuracy was over 91%, and in the case of precision, 'fear' and 'pain' showed low values. In the case of reproducibility, a low value was shown in negative emotions, and in the case of 'disgust' in particular, an error appeared due to the lack of data. In the case of previous studies, emotion analysis was mainly used only for polarity analysis divided into positive, negative, and neutral, and there was a limitation in that it was used only in the feedback stage due to its nature. We expand emotion analysis into 9 categories and suggest its use in the development of emotional content considering it from the planning stage. It is expected that more accurate results can be obtained if emotion analysis is performed by additionally collecting more diverse daily conversations through follow-up research.

• Journal of Software Assessment and Valuation
• /
• v.17 no.1
• /
• pp.25-30
• /
• 2021

In case of evaluating the similarity of the source code analysis material in the embedded system, the provided source code must be confirmed to be executable. However, it is currently being in which compilation and interface matching with hardware are provided in an unconfirmed materials. The complainant assumes that many parts of the source code are similar because the characteristics of the operation are similar and the expression of the function is similar. As for the analysis result, the analysis result may appear different than expected due to these unidentified objects. In this study, the improvement direction is sugested through the case study by the analysis process of the source code and the similarity of the unverified source code.

• Journal of Software Assessment and Valuation
• /
• v.12 no.2
• /
• pp.1-8
• /
• 2016

In this paper, we study abstracting and identifying license file from a package to prevent unintentional intellectual property infringement because of lost/modified/confliction of license information when redistributing open source software. To invest character of the license files, we analyzed 322 licenses by n-gram and TF-IDF methods, and abstract license files from the packages. We identified license information with a similarity of the registered licenses by cosine measurement.

• Science of Emotion and Sensibility
• /
• v.15 no.4
• /
• pp.503-516
• /
• 2012

According to the researches of robot and software agent until now, computational emotion model is dependent on system, so it is hard task that emotion models is separated from existing systems and then recycled into new systems. Therefore, I introduce the Engine of computational Emotion model (shall hereafter appear as EE) to integrate with any robots or agents. This is the engine, ie a software for independent form from inputs and outputs, so the EE is Emotion Generation to control only generation and processing of emotions without both phases of Inputs(Perception) and Outputs(Expression). The EE can be interfaced with any inputs and outputs, and produce emotions from not only emotion itself but also personality and emotions of person. In addition, the EE can be existed in any robot or agent by a kind of software library, or be used as a separate system to communicate. In EE, emotions is the Primary Emotions, ie Joy, Surprise, Disgust, Fear, Sadness, and Anger. It is vector that consist of string and coefficient about emotion, and EE receives this vectors from input interface and then sends its to output interface. In EE, each emotions are connected to lists of emotional experiences, and the lists consisted of string and coefficient of each emotional experiences are used to generate and process emotional states. The emotional experiences are consisted of emotion vocabulary understanding various emotional experiences of human. This study EE is available to use to make interaction products to response the appropriate reaction of human emotions. The significance of the study is on development of a system to induce that person feel that product has your sympathy. Therefore, the EE can help give an efficient service of emotional sympathy to products of HRI, HCI area.

• Journal of Software Assessment and Valuation
• /
• v.16 no.2
• /
• pp.1-8
• /
• 2020

The similarity detection to plagiarism or duplication of computer programs requires a different type of analysis methods and tools according to the programming language used in the implementation and the sort of code to be analyzed. In recent years, the similarity appraisal for the object code in the embedded system, which requires a considerable resource along with a more complicated procedure and advanced skill compared to the source code, is increasing. In this study, we described a method for analyzing the similarity of functional units in the assembly language through the conversion of object code using the reverse engineering approach, such as the reverse assembly technique to the object code. The instruction and operand table for comparing the similarity is generated by using the syntax analysis of the code in assembly language, and a tool for detecting the similarity is designed.

• Journal of Software Assessment and Valuation
• /
• v.16 no.2
• /
• pp.87-98
• /
• 2020

Recently, IoT, artificial intelligence, cloud, big data, and mobile fields have converged, leading to a new industrial era called the 4th industrial revolution. This 4th industrial revolution has been expanded to all industry area and Software has been taken as important role in this revolution. Thus Software Safety is the huge factor because Software is highly relevant to human safety in accordance with Software expansion. However this Software Safety has been focused on not organization improvement activities but current design/development, In this paper, to solve this issue, Software Safety Maturity level and relevant Process Area is defined. This study is expected to contribute to systematic software safety activities.