• International Journal of Computer Science & Network Security
• /
• v.21 no.8
• /
• pp.369-376
• /
• 2021

One of the most active areas of research in the field of affective computing and signal processing is emotion recognition. This paper proposes emotion recognition of low-resource (Sindhi) language. This work's uniqueness is that it examines the emotions of languages for which there is currently no publicly accessible dataset. The proposed effort has provided a dataset named MAVDESS (Mehran Audio-Visual Dataset Mehran Audio-Visual Database of Emotional Speech in Sindhi) for the academic community of a significant Sindhi language that is mainly spoken in Pakistan; however, no generic data for such languages is accessible in machine learning except few. Furthermore, the analysis of various emotions of Sindhi language in MAVDESS has been carried out to annotate the emotions using line features such as pitch, volume, and base, as well as toolkits such as OpenSmile, Scikit-Learn, and some important classification schemes such as LR, SVC, DT, and KNN, which will be further classified and computed to the machine via Python language for training a machine. Meanwhile, the dataset can be accessed in future via https://doi.org/10.5281/zenodo.5213073.

• Journal of the Korean School Mathematics Society
• /
• v.16 no.2
• /
• pp.337-362
• /
• 2013

The purposes of the study were to develop STEM instructional materials for teaching and learning mathematics and to investigate how the STEM based approach affects on students' learning of mathematics in cognitive and affective domain and career choice. STEM instructional materials were designed for learning of mathematical concepts in the contexts of science, technology, and engineering as well as real world. According to the results of the study, STEM instructional materials for teaching and learning mathematics were effective for improving students' problem solving ability and affective achievement such as self-regulation, self-efficacy, and value of mathematics. In addition, STEM program played a positive role in tempting students' career choice into science and engineering fields including mathematics.

• Healthcare Informatics Research
• /
• v.24 no.4
• /
• pp.309-316
• /
• 2018

Objectives: Both the valence and arousal components of affect are important considerations when managing mental healthcare because they are associated with affective and physiological responses. Research on arousal and valence analysis, which uses images, texts, and physiological signals that employ deep learning, is actively underway; research investigating how to improve the recognition rate is needed. The goal of this research was to design a deep learning framework and model to classify arousal and valence, indicating positive and negative degrees of emotion as high or low. Methods: The proposed arousal and valence classification model to analyze the affective state was tested using data from 40 channels provided by a dataset for emotion analysis using electrocardiography (EEG), physiological, and video signals (the DEAP dataset). Experiments were based on 10 selected featured central and peripheral nervous system data points, using long short-term memory (LSTM) as a deep learning method. Results: The arousal and valence were classified and visualized on a two-dimensional coordinate plane. Profiles were designed depending on the number of hidden layers, nodes, and hyperparameters according to the error rate. The experimental results show an arousal and valence classification model accuracy of 74.65 and 78%, respectively. The proposed model performed better than previous other models. Conclusions: The proposed model appears to be effective in analyzing arousal and valence; specifically, it is expected that affective analysis using physiological signals based on LSTM will be possible without manual feature extraction. In a future study, the classification model will be adopted in mental healthcare management systems.

• KIPS Transactions on Software and Data Engineering
• /
• v.3 no.10
• /
• pp.451-456
• /
• 2014

The correlations between electroencephalographic (EEG) spectral power and emotional responses during affective sound clip listening are important parameters. Hemispheric asymmetry in prefrontal activation have been proposed in two decades ago, as measured by power value, is related to reactivity to affectively pleasure audio stimuli. In this study, we designed an emotional audio stimulus experiment in order to verify frontal EEG asymmetry by analyzing Event-related Spectral Perturbation (ERSP) results. Thirty healthy college male students volunteered the stimulus experiment with the standard IADS(International Affective Digital Sounds) clips. These affective sound clips are classified in three emotion states, high pleasure-high arousal (happy), middle pleasure-low arousal (neutral) and low pleasure-high arousal (fear). The analysis of the data was performed in both theta (4-8Hz) and alpha (8-13Hz) bands. ERSP maps in the alpha band revealed that there are the stronger power responses of high pleasure (happy) in the right frontal lobe, while the stronger power responses of middle-low pleasure (neutral and fear) in the left frontal lobe. Moreover, ERSP maps in the theta band revealed that there are the stronger power responses of high arousal (fear and happy) in the left pre-frontal lobe, while the stronger responses of low arousal (neutral) in the right pre-frontal lobe. However, the high pleasure emotions (happy) can elicit greater relative right EEG activity, while the low and middle pleasure emotions (fear and neutral) can elicit the greater relative left EEG activity. Additionally, the most differences of theta band have been found out in the medial frontal lobe, which is proved as the frontal midline theta. And there are the strongest responses of happy sounds in the alpha band around the whole frontal regions. These results are well suited for emotion recognition, and provide the evidences that theta and alpha powers may have the more important role in the emotion processing than previously believed.

• The Korean Journal of Franchise Management
• /
• v.13 no.3
• /
• pp.1-15
• /
• 2022

Purpose: In the restaurant sector, it has been known that consumers' positive perception of brands influences their positive WOM intention, and information sources play an important role in increasing credibility by enhancing consumer awareness and developing differentiated brands. This study examines the effects of information sources (e.g., advertisement, WOM, SNS) on trust (cognitive and affective) and, WOM and eWOM intention in the restaurant context. In the model, cognitive and affective trust play mediating roles in the relationships between information sources (e.g., advertisement, WOM, SNS) WOM and eWOM intention. Research design, data, and methodology: Research models and hypotheses were developed according to the research direction. The survey questionnaire items were developed and used appropriately according to the contents of this paper based on prior studies. All constructs were measured with multiple items developed and validated in prior studies. A total of 502 responses were collected from an online survey. The research model was evaluated using SmartPLS 4.0. Frequency analysis was performed to understand the demographic characteristics of the survey respondents. The reliability, convergent validity, and discriminant validity were assessed using measurement model analysis. The proposed model was verified using the structural equation model. Results: Advertisement, WOM, and SNS information sources all had a positive effect on affective trust, whereas only WOM had a significant effect on cognitive trust. In addition, affective trust had a positive effect on cognitive trust and eWOM intention but did not affect WOM intention. Finally, cognitive trust was found to have a positive effect on both WOM intention and eWOM intention. Conclusions: This study redefines the concept of where restaurant service companies should focus when providing consumers with information about their products and services. As a result, the conceptual framework of positive word of mouth intention to increase new customer visits to the restaurant brand has been expanded. In addition, this study not only presents an information source management strategy for restaurant brands, but also presents practical implications for resource allocation guidelines for customer management in the restaurant sector.

• Annual Conference of KIPS
• /
• 2014.04a
• /
• pp.992-994
• /
• 2014

Hemispheric asymmetry in prefrontal activation have been proposed in two decades ago, as measured by electroencephalographic (EEG) power in the theta band (4-8Hz), is related to reactivity to affectively pleasure audio stimuli. In this study, we designed an emotional audio stimulus experiment in order to verify frontal EEG asymmetry by analyzing ERSP results. Thirty healthy college students volunteered the stimulus experiment with the standard IADS affective sounds. These affective sound clips are classified in three emotion states, happy, neutral and fear. ERSP image results revealed that there are the stronger responses of high arousal (fear and happy) in the left prefrontal lobe, while the stronger responses of low arousal (neutral) in the right pre-frontal lobe. However, the high pleasure emotions (happy) can elicit greater relative right EEG activity, while the low and middle pleasure emotions (fear and neutral) can elicit the greater relative left EEG activity. Additionally, the most response differences of theta band have been found out in the medial frontal lobe, which is proved as the frontal midline theta.

• International Journal of Computer Science & Network Security
• /
• v.22 no.9
• /
• pp.271-279
• /
• 2022

In the discipline of design science, the integration of cognitive, semantic, and affective elements is crucial in the conception and development of a product. Affective components in IT artefacts have attracted researchers' attention, but little attention has been given to Geographic Information Systems (GIS). This research was conducted to identify emotions in web-based GIS, and determine design influences on the emotions using Kansei engineering (KE). In the evaluation procedure, ten web-based GIS were used as specimens, and 20 Kansei words were used as emotional descriptors in the Kansei checklist. 50 participants were asked to rate their emotional responses towards the specimens on the Kansei checklist. Principal Component Analysis was used to discover the semantic structure of Kansei, in which dynamism and spaciousness were identified. Significant Kansei concepts were identified using Factor Analysis, in which dynamic & well-organized, refreshing, spacious, professional, and nautical-look were identified. Partial Least Square analysis has assisted the research in discovering the significant design influence to the Kansei. These findings provide designers and other stakeholders with valuable knowledge for strategizing future web-based GIS designs that incorporate user emotions.

• Journal of the Ergonomics Society of Korea
• /
• v.36 no.2
• /
• pp.123-144
• /
• 2017

Objective: The objective of this study is to evaluate affection on how users perceive colors viewed from an automotive visual display according to cultural and radical differences including North America, Europe, and Southeast Asia. This study especially aims to identify effects of the variation of tone and chroma of representative color groups by analyzing affection differences depending on cultural and racial differences targeting the colors constituted through variation of tone and chroma, centered on representative colors. Background: The colors of the menu, information display or background viewed through an automotive visual display are an important factor stimulating consumer's affection, and therefore an effort to express the vehicle's brand and product image through colors is made. The studies on colors focus only on the research on unique characteristics of colors, but an affective approach lacks according to cultural and racial differences on colors considering tone and chroma variation within a color from the currently used automotive visual displays. Method: To grasp the visual affection felt by users, this study extracted affective adjectives related with colors through existing literature and a dictionary for adjectives, and presented human affection dimensions on colors through evaluation of various colors. Prior to carrying out affection evaluation, the basic light sources, red (R), green (G), and blue (B) constituting the colors used for automotive visual displays were defined as a representative color group, respectively. When colors in a color group are constituted, the evaluation target of each color group consisted of the colors considering the variation of tone and chroma by changing color sense through RGB values of the remaining two light sources. And then, this study carried out affection evaluation on the constituted colors targeting the subjects with cultural and racial differences. Results: As a result of evaluating the constituted colors with representative affections, there were statistically significant differences between the groups having cultural and racial differences. As a result of S-N-K post-hoc analysis on the colors showing significant differences, North America and Europe were classified as heterogeneous groups. In some cases, Korea was classified as the homogeneous group with North America, but Korea was mainly classified as the homogenous group with Europe. Conclusion: The representative affections on colors from an automotive visual display was drawn as three affective dimensions: passionate, neat, and masculine. Based on these, the affection of Korea and Europe on the constituted colors showed significant differences from that of North America, as a result of affection evaluation on the constituted colors viewed through the visual display by reflecting cultural and racial factors. Regarding representative color groups, bigger cultural and racial differences were revealed in terms of affection on red and green colors than on blue color, and variation of affection was the biggest in the red color. Application: This study analyzed correlations of affection considering the colors constituted through variation of tone and chroma, and the culture and race in the representative color groups constituting a visual display. The results of this study are predicted to be utilized in coordination and selection of colors viewed from an automotive visual display taking into account culture and race.

• Journal of the Ergonomics Society of Korea
• /
• v.28 no.4
• /
• pp.35-49
• /
• 2009

This study investigated perceived discomforts and those reasons of the young and middle-aged, the aged, the disabled and the pregnant in various daily activities, and elicited universal design factors based on human capacities (physical, sensory, cognitive and affective). A total of eighty people (twenty subjects for each user group) participated in one-to-one interviews about thirty six items of daily activities. A degree of discomfort of the daily activities was measured using Borg's CR10 scale. As a result, the disabled and the pregnant complained about almost all of the daily activities, and their degrees of discomforts were significantly higher than those of the youth and middle-aged and the aged. However, the youth and middle-aged and the aged only complained about some specific items. The major reasons of discomforts were related to physical and affective capabilities in general, where the detailed reasons of each user group were comparatively different. Finally, the universal design factors were elicited for each daily activity item based on the results of each user group. This study can be used to understand the discomforts and characteristics of the aged, the disabled and the pregnant in the various daily activities. The universal design factors elicited can also be applied to design related products and facilities universally.

• Journal of the Korean Institute of Illuminating and Electrical Installation Engineers
• /
• v.29 no.10
• /
• pp.25-33
• /
• 2015

LED lightings combined with IT technology can provide variable illumination environments that can be controlled by users according to their emotional need and preferences. This is one of the most beneficial functions compared with conventional lightings offering only fixed color and brightness. There is however lack of analysis data for creating practical lighting solutions satisfying user preferences in a wide range of applications from residential to commercial places. To materialize the technical advantages of user-controllable LED lightings, more observation data are required in various situations. Therefore, dissimilar emotional needs are determined in the present study for compartmental office spaces (staff lounge room, meeting room and desk job place) through subjective experiments by 45 observers. The optimum lighting conditions (CCT and illuminance) are finally obtained using Response Surface Method and relevant prediction functions are also deduced. The final outcome can be applied for making user-preferred office illumination products.