• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.25 no.10
• /
• pp.1323-1329
• /
• 2021

For hand expression recognition, hand pose recognition based on the static shape of the hand and hand gesture recognition based on the dynamic hand movement are used together. In this paper, we propose a hierarchical hand pose model based on finger position and shape for hand expression recognition. For hand pose recognition, a finger model representing the finger state and a hand pose model using the finger state are hierarchically constructed, which is based on the open source MediaPipe. The finger model is also hierarchically constructed using the bending of one finger and the touch of two fingers. The proposed model can be used for various applications of transmitting information through hands, and its usefulness was verified by applying it to number recognition in sign language. The proposed model is expected to have various applications in the user interface of computers other than sign language recognition.

• Journal of Korean Society of Industrial and Systems Engineering
• /
• v.45 no.4
• /
• pp.150-156
• /
• 2022

As the 4th industrial revolution emerges, the implementation of smart factories are essential in the manufacturing industry. However, 80% of small and medium-sized enterprises that have introduced smart factories remain at the basic level. In addition, in root industries such as injection molding, PLC and HMI software are used to implement functions that simply show operation data aggregated by facilities in real time. This has limitations for managers to make decisions related to product production other than viewing data. This study presents a method for upgrading the level of smart factories to suit the reality of small and medium-sized enterprises. By monitoring the data collected from the facility, it is possible to determine whether there is an abnormal situation by proposing an appropriate algorithm for meaningful decision-making, and an alarm sounds when the process is out of control. In this study, the function of HMI has been expanded to check the failure frequency rate, facility time operation rate, average time between failures, and average time between failures based on facility operation signals. For the injection molding industry, an HMI prototype including the extended function proposed in this study was implemented. This is expected to provide a foundation for SMEs that do not have sufficient IT capabilities to advance to the middle level of smart factories without making large investments.

• Design Convergence Study
• /
• v.16 no.6
• /
• pp.137-152
• /
• 2017

This research aims to develop the companion robot experience design for elderly in korea based on needs-function deploy matrix of robot and emotion expression research of robot in multimodal interaction. First, Elder users' main needs were categorized into 4 groups based on ethnographic research. Second, the functional elements and physical actuators of robot were mapped to user needs in function- needs deploy matrix. The final UX design prototype was implemented with a robot type that has a verbal non-touch multi modal interface with emotional facial expression based on Ekman's Facial Action Coding System (FACS). The proposed robot prototype was validated through a user test session to analyze the influence of the robot interaction on the cognition and emotion of users by Story Recall Test and face emotion analysis software; Emotion API when the robot changes facial expression corresponds to the emotion of the delivered information by the robot and when the robot initiated interaction cycle voluntarily. The group with emotional robot showed a relatively high recall rate in the delayed recall test and In the facial expression analysis, the facial expression and the interaction initiation of the robot affected on emotion and preference of the elderly participants.

• The Journal of the Institute of Internet, Broadcasting and Communication
• /
• v.23 no.5
• /
• pp.191-197
• /
• 2023

Mobile shooting games are a representative example of PC games being transferred as they are. In the most mobile shooting games, joystick-like UI used in PC games have been moved to touch buttons, but the display is small, so the user's fingers cover the game screen, which is inconvenient. In mobile shooting games, in order to overcome the limitations of the small display and increase the immersion of the game, this paper introduces a user interface that integrates character movement and aiming, and intuitive UIs such as display rotation, shaking, and vibration. In addition, by analyzing the match process for each round, the character's insufficient abilities are identified and synergies to supplement the abilities are recommended in order to add fun to the game. This paper proved that the proposed goals are achieved by actually designing and implementing a mobile shooting game with the proposed functions on an Android smartphone.

• Journal of the Korean Society of Industry Convergence
• /
• v.26 no.6_3
• /
• pp.1315-1323
• /
• 2023

Rehabilitation assistive devices not only assist the rehabilitation therapy and daily life of the disabled and the elderly, but also assist the labor of their caregivers, so various functions are required to improve their quality of life. In this study, a design method considering its practicality is introduced for an active rehabilitation assistive device that can perform both standing and walking assistance by driving various actuators. For this purpose, the force required to assist standing was calculated using statics with the body segmentation method. Also, the overturning stability of the device was verified for various physical conditions and postures. The actuator in the active rehabilitation assistive device was operated by a patient using a graphical user interface in an embedded computer and a touch panel for easy usage. The detailed design was performed for implementation through the help of 3D-CAD and the finite element analysis, and a prototype was produced. Finally, it was proven that the design goal was satisfied by experimental validation.

• The Journal of the Korea Contents Association
• /
• v.13 no.12
• /
• pp.595-603
• /
• 2013

Touchscreen is now installed in the majority of information devices thanks to the developed digital technology. In case of copiers, although touchscreen was installed earlier than any other information device, current user interface indicates that conventional methods have been maintained without any special re-validation. But, since common office devices such as copiers have brief usage time and clear, straightforward purposes, user experience between an user and device is perhaps an important element. Nevertheless, conservativeness of the market and the fact that users and buyers are not always the same are a stumbling block to actively changing UI. Recently, however, as hardware element, buttons, have moved to touchscreen mostly for smartphone, and common and public devices have seen rapid changes in UX, mostly with touchscreen, it has led to high demand for changes in UX of copiers. To remedy the issues with copiers, a literature review was conducted through existing studies and user evaluation based on user survey and prototype was done to examine the copier's UI elements and relevant changes in usage. In particular, a new direction for UX of copiers was suggested by analyzing the impact of differences between software button-oriented UI and hardware button-oriented UI on users and usability. This study findings could be used as basic data for improving the usability of future common devices including copier and UX design.

• Science of Emotion and Sensibility
• /
• v.13 no.1
• /
• pp.103-110
• /
• 2010

TPR(Total Physical Response) is a new representative learning method for children's education. Today's approach to TPR has focused on signals from a user which becomes input data in a human-computer interaction, but the accuracy of sensing from body signals(e. g. motion and voice) isn't so perfect that it seems difficult to apply on an education system. To overcome these limits, we suggest a mediating interface device which can detect the user's motion using correct numerical values such as acceleration and angular speed. In addition, we suggest new design requirements for the mediating device through analyzing children's behavior as human factors by ethnography research and protocol analysis. As a result, we found that; children are unskilled in physical control when they use objects; tend to lean on an object unconsciously with touch. Also their behaviors are restricted, when they use objects. Therefore a mediating device should satisfy new design requirements which are make up for unskilled handling, support familiar and natural physical activity.

• Journal of Intelligence and Information Systems
• /
• v.28 no.4
• /
• pp.135-155
• /
• 2022

This study analyzes patent trends by deriving sub-technical fields of Organic Light-Emitting Diodes (OLEDs) industry, and analyzing technology value, originality, and diversity for each sub-technical field. To collect patent data, a set of international patent classification(IPC) codes related to OLED technology was defined, and OLED-related patents applied from 2005 to 2017 were collected using a set of IPC codes. Then, a large number of collected patent documents were classified into 12 major technologies using the Latent Dirichlet Allocation(LDA) topic model and trends for each technology were investigated. Patents related to touch sensor, module, image processing, and circuit driving showed an increasing trend, but virtual reality and user interface recently decreased, and thin film transistor, fingerprint recognition, and optical film showed a continuous trend. To compare the technological value, the number of forward citations, originality, and diversity of patents included in each technology group were investigated. From the results, image processing, user interface(UI) and user experience(UX), module, and adhesive technology with high number of forward citations, originality and diversity showed relatively high technological value. The results provide useful information in the process of establishing a company's technology strategy.

• Cartoon and Animation Studies
• /
• s.41
• /
• pp.533-552
• /
• 2015

The environment of images in VR-based animation is constructed to generate and promote interactivity between the images and the viewer without any physical space like a screen, or a monitor. In this process, the images and the viewer are combined as a complex through the media technology, that is, an interface. And it is far more in the case of the animation consisted of the bio-feedback interface closely connecting with the body of viewer. As a result, the viewer experiences a permeable interaction between ego and images world, namely virtual reality. That is different from the way of seeing and interpreting the images from a distance. So it needs to analyse the perception of viewer in the world of virtual images. This paper examines the complex phenomena of both the VR-based animation and the viewer mediated by the interface in light of Media Aesthetics. Media Aesthetics is effective in analysing the phenomena of VR-based animation, for it is concerned with the perception of viewer mediated by the media technology. The perception in VR-based animation is a full-body immersion, or embodied immersion, and it is different from the contemplative immersion in that it is remediated continuously by the technological apparatus. The viewer as an immersant, especially with a bio-feedback interface, can immediately touch and control the images in VR-based animation. Such an immersion, therefore, is new every single moment. And the world of VR-based animation is ultimately constructed through the viewer's full-body, or embodied immersion crossing between the virtual and the real. So the animation is not interpreted, but embodied. And the meaning of it is constructed and reconstructed by the viewer's embodied immersion as an immersant. Here, a new frame of animation more oriented to the viewer's participation as an full-body immersant can be created.

• The Journal of the Korea Contents Association
• /
• v.16 no.10
• /
• pp.503-513
• /
• 2016

Innovator and Early Adopter are main clients of smart phone until now, but the silver generation enjoying price stability and the Internet emerges, so a strategy of the importance, systematic classification, and focus of a neglected class is needed. It is necessary to analyze UI that can departmentalize not a neglected class limited to the silver generation but potential users who can be voluntarily users and can secure them. To secure them, the researcher analyzes how Windows, Icons, Mouse Pull-Down-Menus(WIMP) of UI has been applied in the process that skeuomorphism UI of iPhone, Metro UI of MS, and Material UI of Google change. As a result of an analysis, skeuomorphism is not entirely new and has secured potential users slowly with a method to compensate and improve a part that users disregard. As a concept of touch UI, Metro UI considered potential users from the beginning but did not secure them with new and epoch-making UI. However, Material UI of Google compensates the weaknesses of skeuomorphism UI and Metro UI and emphasizes cost-effectiveness, so has developed into UI that can secure final consumers of potential users. Therefore, to secure potential users, it should make users themselves understand why they should use smart phone, and it should approach with more organized studies on UI through feedback of observation and direct talks.