• Journal of Information Technology Applications and Management
• /
• v.21 no.4
• /
• pp.203-223
• /
• 2014

This study proposes a novel context-aware recommender system, which is designed to recommend the items according to the customer's responses to the previously recommended item. In specific, our proposed system predicts the user's emotional state from his or her responses (such as facial expressions and movements) to the previous recommended item, and then it recommends the items that are similar to the previous one when his or her emotional state is estimated as positive. If the customer's emotional state on the previously recommended item is regarded as negative, the system recommends the items that have characteristics opposite to the previous item. Our proposed system consists of two sub modules-(1) emotion prediction module, and (2) responsive recommendation module. Emotion prediction module contains the emotion prediction model that predicts a customer's arousal level-a physiological and psychological state of being awake or reactive to stimuli-using the customer's reaction data including facial expressions and body movements, which can be measured using Microsoft's Kinect Sensor. Responsive recommendation module generates a recommendation list by using the results from the first module-emotion prediction module. If a customer shows a high level of arousal on the previously recommended item, the module recommends the items that are most similar to the previous item. Otherwise, it recommends the items that are most dissimilar to the previous one. In order to validate the performance and usefulness of the proposed recommender system, we conducted empirical validation. In total, 30 undergraduate students participated in the experiment. We used 100 trailers of Korean movies that had been released from 2009 to 2012 as the items for recommendation. For the experiment, we manually constructed Korean movie trailer DB which contains the fields such as release date, genre, director, writer, and actors. In order to check if the recommendation using customers' responses outperforms the recommendation using their demographic information, we compared them. The performance of the recommendation was measured using two metrics-satisfaction and arousal levels. Experimental results showed that the recommendation using customers' responses (i.e. our proposed system) outperformed the recommendation using their demographic information with statistical significance.

• Proceedings of the Korean Society for Emotion and Sensibility Conference
• /
• 1998.11a
• /
• pp.143-147
• /
• 1998

Autonomic and EEG responses of 38 college students were studied during 60-sec long presentation of International Affective Picture System (IAPS )slides evoking, according to subjective reports, negative (disgust, sadness, surprise) and positive (happiness, exciting) emotional. states. Observed were significant heart rate (HR) deceleration, large skin conductance responses (SCR), moderate respiration frequency slowing, reduction of frontal (F 3, F 4 ) and occipital (O 1, O 2 ) fast alpha, and increases of theta, delta and beta relative spectral power values during the first 30 sec of exposure of IAPS pictures. Analysis carried out to differentiate emotion categories according to autonomic responses indicated that observed HR deceleration was larger in magnitude in surprise and sadness than in disgust, SCR amplitude higher in sadness than in disgust. EEC showed significant differences in theta (F 3, F 4 ) and delta (O 1) power increase in disgust vs. happiness, fast alpha (F 3, F 4 ) power was lower in surprise than in happiness, and slow beta power higher. in happiness than in disgust (0 1). Despite some differences. observed within discrete emotion conditions, overall responses pattern of monitored parameters exhibited similar profiles with few variations, most. obvious. in disgust state, which suggests that affective visual stimulation elicits stereotypical responses in a given passive viewing paradigm. However, the magnitude of physiological responses may vary to certain extent across discrete emotional states making it possible to differentiate among particular experimentally-induced emotional states, e.g., disgust vs. sadness by ANS responses or disgust vs. happiness by EEG measures.

• Phonetics and Speech Sciences
• /
• v.12 no.3
• /
• pp.25-32
• /
• 2020

An analysis of emotional English utterances with 7 emotions (calm, happy, sad, angry, fearful, disgust, surprised) was conducted using the measurement of prosodic distance between 672 emotional and 48 neutral utterances. Applying the technique proposed in the automatic evaluation model of English pronunciation to the present study on emotional utterances, Euclidean distance measurement of 3 prosodic elements such as F0, intensity and duration extracted from emotional and neutral utterances was utilized. This paper, furthermore, extended the analytical methods to include Euclidean distance normalization, z-score and z-score normalization resulting in 4 groups of measurement schemes (sqrF0, sqrINT, sqrDUR; norsqrF0, norsqrINT, norsqrDUR; sqrzF0, sqrzINT, sqrzDUR; norsqrzF0, norsqrzINT, norsqrzDUR). All of the results from perceptual analysis and acoustical analysis of emotional utteances consistently indicated the greater effectiveness of norsqrF0, norsqrINT and norsqrDUR, among 4 groups of measurement schemes, which normalized the Euclidean measurement. The greatest acoustical change of prosodic information influenced by emotion was shown in the values of F0 followed by duration and intensity in descending order according to the effect size based on the estimation of distance between emotional utterances and neutral counterparts. Tukey Post Hoc test revealed 4 homogeneous subsets (calm

• Science of Emotion and Sensibility
• /
• v.24 no.3
• /
• pp.115-124
• /
• 2021

Non-verbal communication is important in human interaction. It provides a layer of information that complements the message being transmitted. This type of information is not limited to human speakers. In human-robot communication, increasing the animacy of the robotic agent-by using non-verbal cues-can aid the expression of abstract concepts such as emotions. Considering the physical limitations of artificial agents, robots can use light and movement to express equivalent emotional feedback. This study analyzes the effects of LED and motion animation of a spherical robot on the emotion being expressed by the robot. A within-subjects experiment was conducted at the University of Tsukuba where participants were asked to rate 28 video samples of a robot interacting with a person. The robot displayed different motions with and without light animations. The results indicated that adding LED animations changes the emotional impression of the robot for valence, arousal, and dominance dimensions. Furthermore, people associated various situations according to the robot's behavior. These stimuli can be used to modulate the intensity of the emotion being expressed and enhance the interaction experience. This paper facilitates the possibility of designing more affective robots in the future, using simple feedback.

• International conference on construction engineering and project management
• /
• 2022.06a
• /
• pp.1245-1246
• /
• 2022

Walkability is an indicator of how much pedestrians are willing to walk and how well a walking environment is created. As walking can promote pedestrians' mental and physical health, there has been increasing focus on improving walkability in different ways. Thus, plenty of research has been undertaken to measure walkability. When measuring walkability, there are many objective and subjective variables. Subjective variables include a feeling of safety, pleasure, or comfort, which can significantly affect perceived walkability. However, these subjective factors are difficult to measure by making the walkability index more reliant on objective and physical factors. Because many subjective variables are associated with human emotional states, understanding pedestrians' emotional states provides an opportunity to measure the subjective walkability variables more quantitatively. Pedestrians' emotions can be examined through surveys, but there are social and economic difficulties involved when conducting surveys. Recently, an increasing number of studies have employed physiological data to measure pedestrians' stress responses when navigating unpleasant environmental barriers on their walking paths. However, studies investigating the emotional states of pedestrians in the walking environment, including assessing their positive emotions felt, such as pleasure, have rarely been conducted. Using wearable devices, this study examined the various emotional states of pedestrians affected by the walking environment. Specifically, this study aimed to demonstrate the feasibility of monitoring biometric data, such as electrodermal activity (EDA) and heart rate variability (HRV), using wearable devices as an indicator of pedestrians' emotional states-both pleasant-unpleasant and aroused-relaxed states. To this end, various walking environments with different characteristics were set up to collect and analyze the pedestrians' biometric data. Subsequently, the subjects wearing the wearable devices were allowed to walk on the experimental paths as usual. After the experiment, the valence (i.e., pleasant or unpleasant) and arousal (i.e., activated or relaxed) scale of the pedestrians was identified through a bipolar dimension survey. The survey results were compared with many potentially relevant EDA and HRV signal features. The research results revealed the potential for physiological responses to indicate the pedestrians' emotional states, but further investigation is warranted. The research results were expected to provide a method to measure the subjective factors of walkability by measuring emotions and monitoring pedestrians' positive or negative feelings when walking to improve the walking environment. However, due to the lack of samples and other internal and external factors influencing emotions (which need to be studied further), it cannot be comprehensively concluded that the pedestrians' emotional states were affected by the walking environment.

• Science of Emotion and Sensibility
• /
• v.27 no.1
• /
• pp.3-12
• /
• 2024

This study examined affective representation by analyzing physiological responses measured using wearable devices and affective ratings in response to emotional videos. To achieve this aim, a published dataset was reanalyzed using multidimensional scaling to demonstrate affective representation in two dimensions. Cross-participant classification was also conducted to identify the consistency of emotional responses across participants. The accuracy and misclassification in each emotional condition were described by exploring the confusion matrix derived from the classification analysis. Multidimensional scaling revealed that the represented objects, namely, emotional videos, were positioned along the rated valence and arousal vectors, supporting the core affect theory (Russell, 1980). Vector fittings of physiological responses also showed the associations between heart rate acceleration and low arousal, increased heart rate variability and negative and high arousal, and increased electrodermal activity and negative and low arousal. Using the data of behavioral and physiological responses across participants, the classification results revealed that emotional videos were more accurately classified than the chance level of classification. The confusion matrix showed that awe, enthusiasm, and liking, which were categorized as positive, low arousal emotions in this study, were less accurately classified than the other emotions and were misclassified for each other. Through multivariate analyses, this study confirms the core affect theory using physiological responses measured through wearable devices and affective ratings in response to emotional videos.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2019.11a
• /
• pp.131-133
• /
• 2019

감정인식 기술은 인간과 인공지능이 감정적인 상호작용을 위하여 매우 중요한 기술이다. 얼굴영상 기반의 감정인식 연구는 가장 널리 진행되어 왔으나 우리는 표정에서 드러나지 않는 내면의 감정을 인식하기 위하여 뇌전도를 이용한 감정인식 기법을 제안한다. 먼저 2 초 구간의 뇌전도 신호에 대하여 time, frequency, time-frequency 영역에서 특징점을 추출하고 이를 3 개의 fully connected layer 로 구성되어 있는 regressor 를 이용하여 valence 정보를 추정한다. MAHNOB-HCI 데이터세트에 대한 실험결과에서 제안기법은 종래기법보다 낮은 오차를 보이며 감정의 변화를 실시간으로 인식하는 결과를 보인다.

• Journal of Korean Elementary Science Education
• /
• v.24 no.5
• /
• pp.602-611
• /
• 2005

The 'Mobile Science Lab' is a public program designed to bring teenagers to be engaged in the activities of science and technology. In this study, we attended to elementary school students' participating actions in the program and intended to understand their enjoyment of science from sociocultural and practical perspectives. By drawing on case materials culled from our database, we articulated the features of the enjoyable science activities in the form of two major claims. First, students had rich opportunities to communicate emotionality, which therefore grounds emerging actions on the positive emotional valence. Second, ongoing actions opened up new action possibilities not only to the actors themselves, but also to other community members. The results of this study constitute theoretical frameworks for understanding enjoyment without dichotomizing emotion and cognition, and thereby contribute to designing enjoyable activities of learning science.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2008.05a
• /
• pp.51-53
• /
• 2008

최근 오디오 압축 기술의 발전에 힘입은 디지털 음원과 웹 스트리밍의 보급으로, 사용자가 음악 정보에 손쉽게 접할 수 있게 되었다. 이에 따라 음악을 보다 쉽고 효율적인 방법으로 검색하는 방법뿐 아니라 사용자의 환경에 따라 적절한 음악을 검색할 수 있는 기능의 필요성이 증가하게 되었다. 본 논문에서는 음악의 특징에 따라 분류된 데이터베이스를 사용하고, 사용자의 감정을 분석하여 적절한 음악을 검색하는 시스템을 제안한다. 본 시스템은 사용자의 감정 입력을 효율적으로 처리하기 위한 방법으로 Thayer의 2D emotional space를 적용하여 Valence-Arousal model의 두 가지의 입력을 처리한다. 가장 적합한 음악의 정보를 얻기 위해 사용된 Fuzzy Inference System의 IF-THEN 규칙을 정의하기 위하여 언어적으로 정의된 기존의 음악 감정 연구 결과를 적용하였고, 도출된 결과와 가장 유사도가 깊은 음악을 우선적으로 검색하도록 설계하였다. 이와 같이 구현된 시스템의 타당성을 검증하기 위해 사용자 설문조사를 수행하였다.

• Science of Emotion and Sensibility
• /
• v.16 no.4
• /
• pp.457-468
• /
• 2013

Common theories of affect underscore valence and arousal dimensions or specific emotion. However, given the role of affect in transacting social behavior, sociality may determine the subjective experience and interpersonal response to positive stimuli. The current study examined the relationships between social positive affect and perspective taking as well as positive coping. One potential moderating effect of agreeableness on these relations was also examined. In two experiments, film segments induced socially and non-socially generated positive affects. We hypothesized and found that positive affect associated with sociality would enhance perspective taking ability and positive coping, while non-social positive affect would not. Moreover, these effects varied as a function of the level of agreeableness. These findings suggest that the social/non-social dimension influenced which positive affects elicited perspective taking and positive coping, which could not be explained by differences in subjective emotional valence or arousal. Taken together, these findings have important implications, as they point toward a previously overlooked relation linking sociality to positive affect.