• Title/Summary/Keyword: emotion technology

Search Result 802, Processing Time 0.029 seconds

Audio and Video Bimodal Emotion Recognition in Social Networks Based on Improved AlexNet Network and Attention Mechanism

  • Liu, Min;Tang, Jun
    • Journal of Information Processing Systems
    • /
    • v.17 no.4
    • /
    • pp.754-771
    • /
    • 2021
  • In the task of continuous dimension emotion recognition, the parts that highlight the emotional expression are not the same in each mode, and the influences of different modes on the emotional state is also different. Therefore, this paper studies the fusion of the two most important modes in emotional recognition (voice and visual expression), and proposes a two-mode dual-modal emotion recognition method combined with the attention mechanism of the improved AlexNet network. After a simple preprocessing of the audio signal and the video signal, respectively, the first step is to use the prior knowledge to realize the extraction of audio characteristics. Then, facial expression features are extracted by the improved AlexNet network. Finally, the multimodal attention mechanism is used to fuse facial expression features and audio features, and the improved loss function is used to optimize the modal missing problem, so as to improve the robustness of the model and the performance of emotion recognition. The experimental results show that the concordance coefficient of the proposed model in the two dimensions of arousal and valence (concordance correlation coefficient) were 0.729 and 0.718, respectively, which are superior to several comparative algorithms.

Emotion Coding of Sijo "The Light of the Sun in June" by Lee Jin-moon (이진문의 시조 「유월 쬐는 볕」의 감정 코딩)

  • Park, Inkwa
    • The Journal of the Convergence on Culture Technology
    • /
    • v.5 no.3
    • /
    • pp.203-207
    • /
    • 2019
  • This researcher is working on coding emotional codes from the Sijos that were created. So the purpose of this study is to derive the potential for literary therapy with Sijo's emotional coding. This time, we are going to study Lee Jin-moon's Sijo "The Light of the Sun in June." In this Sijo, the code of joy is generated in the first line, the code of joy in the second line, and the code of sadness in the last line. These emotional codes can be combined in different ways in the Emotion Codon. What this combination means is that the human body can be treated with literary emotion. It is believed that we will be able to continue this research and learn a better way of life.

Emotion Recognition Method using Gestures and EEG Signals (제스처와 EEG 신호를 이용한 감정인식 방법)

  • Kim, Ho-Duck;Jung, Tae-Min;Yang, Hyun-Chang;Sim, Kwee-Bo
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.13 no.9
    • /
    • pp.832-837
    • /
    • 2007
  • Electroencephalographic(EEG) is used to record activities of human brain in the area of psychology for many years. As technology develope, neural basis of functional areas of emotion processing is revealed gradually. So we measure fundamental areas of human brain that controls emotion of human by using EEG. Hands gestures such as shaking and head gesture such as nodding are often used as human body languages for communication with each other, and their recognition is important that it is a useful communication medium between human and computers. Research methods about gesture recognition are used of computer vision. Many researchers study Emotion Recognition method which uses one of EEG signals and Gestures in the existing research. In this paper, we use together EEG signals and Gestures for Emotion Recognition of human. And we select the driver emotion as a specific target. The experimental result shows that using of both EEG signals and gestures gets high recognition rates better than using EEG signals or gestures. Both EEG signals and gestures use Interactive Feature Selection(IFS) for the feature selection whose method is based on a reinforcement learning.

Multimodal Emotion Recognition using Face Image and Speech (얼굴영상과 음성을 이용한 멀티모달 감정인식)

  • Lee, Hyeon Gu;Kim, Dong Ju
    • Journal of Korea Society of Digital Industry and Information Management
    • /
    • v.8 no.1
    • /
    • pp.29-40
    • /
    • 2012
  • A challenging research issue that has been one of growing importance to those working in human-computer interaction are to endow a machine with an emotional intelligence. Thus, emotion recognition technology plays an important role in the research area of human-computer interaction, and it allows a more natural and more human-like communication between human and computer. In this paper, we propose the multimodal emotion recognition system using face and speech to improve recognition performance. The distance measurement of the face-based emotion recognition is calculated by 2D-PCA of MCS-LBP image and nearest neighbor classifier, and also the likelihood measurement is obtained by Gaussian mixture model algorithm based on pitch and mel-frequency cepstral coefficient features in speech-based emotion recognition. The individual matching scores obtained from face and speech are combined using a weighted-summation operation, and the fused-score is utilized to classify the human emotion. Through experimental results, the proposed method exhibits improved recognition accuracy of about 11.25% to 19.75% when compared to the most uni-modal approach. From these results, we confirmed that the proposed approach achieved a significant performance improvement and the proposed method was very effective.

The Influence of Engineering Students' Emotional Regulation Strategies on Interpersonal Conflict Coping Strategies (공과대학생의 정서조절전략이 대인관계 갈등대처전략에 미치는 영향)

  • Choi, Jung Ah
    • Journal of Engineering Education Research
    • /
    • v.27 no.1
    • /
    • pp.50-62
    • /
    • 2024
  • This study examined how emotion regulation strategies specifically function in the interpersonal conflict coping strategies of engineering students. For this purpose, a interpersonal conflict coping strategies and emotion regulation strategies scale was used for 548 engineering students. Multiple regression analysis was conducted. Among the emotion regulation strategies, the "return to body" strategy was related to understanding, validation, focusing, and the "stop action" strategy. In particular, the "stop action" strategy was closely related only to the "return to body" strategy. Among interpersonal conflict coping strategies, the dominating strategy used both positive emotion regulation strategies, such as high refocus on planning, and negative emotion regulation strategies, such as other-blame. Additionally, among negative conflict coping strategies, it was confirmed that both aggression and negative emotional expression, which seem to have similar attributes, share a common feature of having high difficulty in emotional clarity. However, in the case of negative emotional expression, it is characterized by a lack of putting into perspective and high other-blame. On the other hand, the agression strategy seemed to have different characteristics, such as high self-blame and low return to body. By investigating the relationship between interpersonal conflict coping strategies and specific emotion regulation strategies, this study provides implications for education and intervention on which specific emotion regulation strategies need to be cultivated for engineering students to improve their interpersonal conflict resolution capabilities.

A Study on Sijo Literature Therapy structuralized in the Rated Codon

  • Park, In-Kwa
    • International Journal of Advanced Culture Technology
    • /
    • v.5 no.2
    • /
    • pp.9-18
    • /
    • 2017
  • The purpose of this study is to find out how to use emotional activity rate in sentence. The aim is to estimate the Emotion-Codon status of emotion-DNA wiggling as well as the sequence of codons in which amino acids of human body are spread. It is as if the amino acids are translated from the DNA of the human body, and the emotions that cooperate with each other are diversified and refined. Through these attempts, we anticipate the change of emotions by literary works and present the direction of the synapse working and the direction of the encoding. Therefore, this study analyzed the emotional activity of Rated Emotion-Codon, which works as Rated Sijo. At this time, the emotional change in the human body, in which the sentence is more clearly pronounced, is predicted and detected. This result shows how emotions can activate the human body. This state of activation is an indicator of how much the sentence pushes the physiological action of the human body. It is judged that Codon is constructed precisely for the activation of the rated Sijo additive definition by this index. Our result is evidenced by the fact that three sentences of Rated Sijo show an array with the same rating as the Rated Codon's, The first sentence fuses with the sentiment between the second sentence and the third sentence of Rated Sijo. The emotional symbols between the sentence symbols "A, U, J, L" in the first base of the Codon table and the sentences fusing between the sentences of the first sentence and the third sentence are "A, U, J, L". The emotional symbols between the sentences flowing in the second base of the Codon table and between the sentences of the first sentence and the second sentence are structured in the third base of the Codon table as "A, U, J, L". The Rated Sijo, which is resiliently and precisely assigned to the human body's Rated Emotion-Codon, will require a rich experience in our Rated Life.

The Relationship between Insecure Adult Attachment and Emotion Dysregulation : The Mediation Effect of Mentalization (불안정 성인애착과 정서조절곤란 간의 관계 :정신화의 매개효과)

  • Ko Mi Na
    • The Journal of the Convergence on Culture Technology
    • /
    • v.9 no.4
    • /
    • pp.171-177
    • /
    • 2023
  • The purpose of this study was to verify the mediating effect of mentalization in the relationship between insecure adult attachment and emotion dysregulation. A total of 468 data were collected by requesting a survey to an online research company. The collected data were subjected to descriptive statistics and hierarchical regression analysis using SPSS 25.0. The Sobel test was conducted to verify the mediating effect of mentalization. The research results are as follows. First, there was a significant correlation between attachment anxiety, attachment avoidance, mentalization, and emotion dysregulation. Second, the mediating effect of mentalization in the relationship between attachment anxiety and emotion dysregulation was found to be significant, and a partial mediating effect was found. Third, the mediating effect of mentalization in the relationship between attachment avoidance and emotion dysregulation was found to be significant and a partial mediating effect was found. Through the results of this study, the relationship between insecure adult attachment and emotion dysregulation was confirmed, and the role of mentalization in the relationship between them was also confirmed.

Development of Driver's Emotion and Attention Recognition System using Multi-modal Sensor Fusion Algorithm (다중 센서 융합 알고리즘을 이용한 운전자의 감정 및 주의력 인식 기술 개발)

  • Han, Cheol-Hun;Sim, Kwee-Bo
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.18 no.6
    • /
    • pp.754-761
    • /
    • 2008
  • As the automobile industry and technologies are developed, driver's tend to more concern about service matters than mechanical matters. For this reason, interests about recognition of human knowledge and emotion to make safe and convenient driving environment for driver are increasing more and more. recognition of human knowledge and emotion are emotion engineering technology which has been studied since the late 1980s to provide people with human-friendly services. Emotion engineering technology analyzes people's emotion through their faces, voices and gestures, so if we use this technology for automobile, we can supply drivels with various kinds of service for each driver's situation and help them drive safely. Furthermore, we can prevent accidents which are caused by careless driving or dozing off while driving by recognizing driver's gestures. the purpose of this paper is to develop a system which can recognize states of driver's emotion and attention for safe driving. First of all, we detect a signals of driver's emotion by using bio-motion signals, sleepiness and attention, and then we build several types of databases. by analyzing this databases, we find some special features about drivers' emotion, sleepiness and attention, and fuse the results through Multi-Modal method so that it is possible to develop the system.

Emotion Recognition by Vision System (비젼에 의한 감성인식)

  • 이상윤;오재흥;주영훈;심귀보
    • Proceedings of the Korean Institute of Intelligent Systems Conference
    • /
    • 2001.12a
    • /
    • pp.203-207
    • /
    • 2001
  • In this Paper, we propose the neural network based emotion recognition method for intelligently recognizing the human's emotion using CCD color image. To do this, we first acquire the color image from the CCD camera, and then propose the method for recognizing the expression to be represented the structural correlation of man's feature Points(eyebrows, eye, nose, mouse) It is central technology that the Process of extract, separate and recognize correct data in the image. for representation is expressed by structural corelation of human's feature Points In the Proposed method, human's emotion is divided into four emotion (surprise, anger, happiness, sadness). Had separated complexion area using color-difference of color space by method that have separated background and human's face toughly to change such as external illumination in this paper. For this, we propose an algorithm to extract four feature Points from the face image acquired by the color CCD camera and find normalization face picture and some feature vectors from those. And then we apply back-prapagation algorithm to the secondary feature vector. Finally, we show the Practical application possibility of the proposed method.

  • PDF