• Journal of Information Processing Systems
• /
• v.4 no.4
• /
• pp.159-168
• /
• 2008

Human-Robot Interaction (HRI), based on already well-researched Human-Computer Interaction (HCI), has been under vigorous scrutiny since recent developments in robot technology. Robots may be more successful in establishing common ground in project-based education or foreign language learning for children than in traditional media. Backed by its strong IT environment and advances in robot technology, Korea has developed the world's first available e-Learning home robot. This has demonstrated the potential for robots to be used as a new educational media - robot-learning, referred to as 'r-Learning'. Robot technology is expected to become more interactive and user-friendly than computers. Also, robots can exhibit various forms of communication such as gestures, motions and facial expressions. This study compared the effects of non-computer based (NCB) media (using a book with audiotape) and Web-Based Instruction (WBI), with the effects of Home Robot-Assisted Learning (HRL) for children. The robot gestured and spoke in English, and children could touch its monitor if it did not recognize their voice command. Compared to other learning programs, the HRL was superior in promoting and improving children's concentration, interest, and academic achievement. In addition, the children felt that a home robot was friendlier than other types of instructional media. The HRL group had longer concentration spans than the other groups, and the p-value demonstrated a significant difference in concentration among the groups. In regard to the children's interest in learning, the HRL group showed the highest level of interest, the NCB group and the WBI group came next in order. Also, academic achievement was the highest in the HRL group, followed by the WBI group and the NCB group respectively. However, a significant difference was also found in the children's academic achievement among the groups. These results suggest that home robots are more effective as regards children's learning concentration, learning interest and academic achievement than other types of instructional media (such as: books with audiotape and WBI) for English as a foreign language.

• The Journal of the Institute of Internet, Broadcasting and Communication
• /
• v.20 no.6
• /
• pp.115-121
• /
• 2020

With the spread of IoT technology, various IoT applications using facial recognition are emerging. This paper describes the design and implementation of a remote control system using deep learning-based face recognition and hand gesture recognition. In general, an application system using face recognition consists of a part that takes an image in real time from a camera, a part that recognizes a face from the image, and a part that utilizes the recognized result. Raspberry PI, a single board computer that can be mounted anywhere, has been used to shoot images in real time, and face recognition software has been developed using tensorflow's FaceNet model for server computers and hand gesture recognition software using OpenCV. We classified users into three groups: Known users, Danger users, and Unknown users, and designed and implemented an application that opens automatic door locks only for Known users who have passed both face recognition and hand gestures.

• The Journal of the Korea Contents Association
• /
• v.21 no.1
• /
• pp.1-11
• /
• 2021

The users of a chatbot messenger can be better engaged in the conversation if they feel intimacy with the chatbot. This can be achieved by the chatbot's effective expressions of human emotions to chatbot users. Thus motivated, this study aims to identify the appropriate emotional expressions of a chatbot that make people feel the social presence of the chatbot. In the background research, we obtained that facial expression is the most effective way of emotions and movement is important for relationship emersion. In a survey, we prepared moving text, moving gestures, and still emoticon that represent five emotions such as happiness, sadness, surprise, fear, and anger. Then, we asked the best way for them to feel social presence with a chatbot in each emotion. We found that, for an arousal and pleasant emotion such as 'happiness', people prefer moving gesture and text most while for unpleasant emotions such as 'sadness' and 'anger', people prefer emoticons. Lastly, for the neutral emotions such as 'surprise' and 'fear', people tend to select moving text that delivers clear meaning. We expect that this results of the study are useful for developing emotional chatbots that enable more effective conversations with users.

• Journal of Intelligence and Information Systems
• /
• v.20 no.1
• /
• pp.1-14
• /
• 2014

Both researchers and practitioners are showing an increased interested in interactive exhibition services. Interactive exhibition services are designed to directly respond to visitor responses in real time, so as to fully engage visitors' interest and enhance their satisfaction. In order to install an effective interactive exhibition service, it is essential to adopt intelligent technologies that enable accurate estimation of a visitor's emotional state from responses to exhibited stimulus. Studies undertaken so far have attempted to estimate the human emotional state, most of them doing so by gauging either facial expressions or audio responses. However, the most recent research suggests that, a multimodal approach that uses people's multiple responses simultaneously may lead to better estimation. Given this context, we propose a new multimodal emotional state estimation model that uses various responses including facial expressions, gestures, and movements measured by the Microsoft Kinect Sensor. In order to effectively handle a large amount of sensory data, we propose to use stratified sampling-based MRA (multiple regression analysis) as our estimation method. To validate the usefulness of the proposed model, we collected 602,599 responses and emotional state data with 274 variables from 15 people. When we applied our model to the data set, we found that our model estimated the levels of valence and arousal in the 10~15% error range. Since our proposed model is simple and stable, we expect that it will be applied not only in intelligent exhibition services, but also in other areas such as e-learning and personalized advertising.

• The Journal of the Korea Contents Association
• /
• v.12 no.1
• /
• pp.265-274
• /
• 2012

This study aims to examine the physical language of dance art's acceptability of the discourse method of story-telling as a narrative discourse system from the view of story-telling of cultural contents. Dance, through the establishment of relationship between dancers and stage art, can form a discourse system with various literary devices including figures of speech, metaphors, and symbols. The argument over manifestation of dance's narrative components in the concept of story-telling is shown as follows; the background as an object can offer time and spatial backgrounds through stage art and the dancers' performance elements; and, for the character, the dancer himself can be the first-person-narrator and possibly makes plane personality descriptions. As for the elements of main affairs of dance, the stage art components present the background of primary motif of incident and the dancer's diverse relationships form conflicts through the correlation of solo dance, duet, and group dance. The plot as a process of developing the main affair is led by actant such as the dancer's mime actions, gestures, facial expressions, etc. The element of dance's revealing narration is the dance art itself and the developing structure of narration is the dance language's own grammar. Choreographers should compose persuasive dance texts to convey stories efficiently through character decisions, their actions, stage art's elements that display the time and spatial backgrounds, and the development of plot, as a narrative discourse of dance.

• The Journal of the Korea Contents Association
• /
• v.16 no.7
• /
• pp.609-621
• /
• 2016

A close-up shot, capturing all the fine details of an actor's face by filling up the frame, expresses an actor's performance more realistically than a stage where a living actor performs on. This is because a close-up generates an impact with its specific images and meanings seizing the attention of the audience and conjures up a psychological effect as if an actor's face is directly communicating with the audience at a minimum distance. Therefore, this study analyzed the film to examine the photographic effect and acting effect of close-up shots and recommend the need for acting training thereof. The film was selected since Song Kang-ho, to add more realism to his character acted going back and forth 20 years of age with a special makeup on face, his facial expressions, gestures, props in close-up successfully helped deliver the actor's performance by revealing the character's personality and emotions of the film, and generated an array of linguistic, visual and emotional meanings which are the key to film acting. This study is expected to contribute to helping actors to learn about the effect of close-ups and the key to film acting and find effective ways to express themselves in front of the camera.

• Journal of Korea Entertainment Industry Association
• /
• v.13 no.2
• /
• pp.123-132
• /
• 2019

This paper analyzes the performances of actor Song Kang-Ho in the background of interdisciplinary and integrated film acting, using performance rather than acting as a general term. If the act is a concept limited to acting training or acting skills, performance is a broad concept that includes expressions, movements, and emotions. The performance on the screen can be explained in the context of film and can be extended to the social attitude of acting. In addition, I used the term screen in terms of representation rather than film referring to medium. Song Kang-Ho expressed the performances of various characters in more than 30 films. Although his facial expressions, gestures, and voices suitable for individual characters in various genres are represented in various ways, personality inherent in the actor Song Kang-Ho integrates persona with character. What drives it is the social attitude of screen performance. As a sign, acting is an ideological construct and foregrounds a character who describes a certain social and historical moment. Song Gang-Ho as actor, persona and character, who asserts the popularity, speaks to society and makes discourse. His comic performance is always confronting the tragedy of life, his face is the spirit of the times, and it expands into social meaning. The face of the close-up does not laugh at all, the gesture symbolized by the curved rear view is exaggerated disorderedly and disturbingly, and the voice using dialect accent does not follow the standard of the vocal.