• Title/Summary/Keyword: Self Video-based

Search Result 186, Processing Time 0.023 seconds

A Vision-based Approach for Facial Expression Cloning by Facial Motion Tracking

  • Chun, Jun-Chul;Kwon, Oryun
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.2 no.2
    • /
    • pp.120-133
    • /
    • 2008
  • This paper presents a novel approach for facial motion tracking and facial expression cloning to create a realistic facial animation of a 3D avatar. The exact head pose estimation and facial expression tracking are critical issues that must be solved when developing vision-based computer animation. In this paper, we deal with these two problems. The proposed approach consists of two phases: dynamic head pose estimation and facial expression cloning. The dynamic head pose estimation can robustly estimate a 3D head pose from input video images. Given an initial reference template of a face image and the corresponding 3D head pose, the full head motion is recovered by projecting a cylindrical head model onto the face image. It is possible to recover the head pose regardless of light variations and self-occlusion by updating the template dynamically. In the phase of synthesizing the facial expression, the variations of the major facial feature points of the face images are tracked by using optical flow and the variations are retargeted to the 3D face model. At the same time, we exploit the RBF (Radial Basis Function) to deform the local area of the face model around the major feature points. Consequently, facial expression synthesis is done by directly tracking the variations of the major feature points and indirectly estimating the variations of the regional feature points. From the experiments, we can prove that the proposed vision-based facial expression cloning method automatically estimates the 3D head pose and produces realistic 3D facial expressions in real time.

Development of Extracting System for Meaning·Subject Related Social Topic using Deep Learning (딥러닝을 통한 의미·주제 연관성 기반의 소셜 토픽 추출 시스템 개발)

  • Cho, Eunsook;Min, Soyeon;Kim, Sehoon;Kim, Bonggil
    • Journal of Korea Society of Digital Industry and Information Management
    • /
    • v.14 no.4
    • /
    • pp.35-45
    • /
    • 2018
  • Users are sharing many of contents such as text, image, video, and so on in SNS. There are various information as like as personal interesting, opinion, and relationship in social media contents. Therefore, many of recommendation systems or search systems are being developed through analysis of social media contents. In order to extract subject-related topics of social context being collected from social media channels in developing those system, it is necessary to develop ontologies for semantic analysis. However, it is difficult to develop formal ontology because social media contents have the characteristics of non-formal data. Therefore, we develop a social topic system based on semantic and subject correlation. First of all, an extracting system of social topic based on semantic relationship analyzes semantic correlation and then extracts topics expressing semantic information of corresponding social context. Because the possibility of developing formal ontology expressing fully semantic information of various areas is limited, we develop a self-extensible architecture of ontology for semantic correlation. And then, a classifier of social contents and feed back classifies equivalent subject's social contents and feedbacks for extracting social topics according semantic correlation. The result of analyzing social contents and feedbacks extracts subject keyword, and index by measuring the degree of association based on social topic's semantic correlation. Deep Learning is applied into the process of indexing for improving accuracy and performance of mapping analysis of subject's extracting and semantic correlation. We expect that proposed system provides customized contents for users as well as optimized searching results because of analyzing semantic and subject correlation.

A Case Study on the 'Theory of Home Economics Education' Using Online ProblemBased Learning (온라인 문제중심학습을 활용한 '가정교육론' 수업 사례 연구)

  • Choi, Seong-Youn
    • Human Ecology Research
    • /
    • v.60 no.2
    • /
    • pp.187-209
    • /
    • 2022
  • The objective of this study was to conduct a 'Theory of Home Economics Education' class using online problem-based learning(PBL) for prospective home economics(HE) teachers. The aim was to enable teachers to analyze the learning experience in the classroom, and to prepare operational strategies for online PBL on this basis. In order to achieve this, online PBL was applied to 31 students participating in the 'Theory of Home Economics Education' at the Department of HE in a university in Seoul, and the results were collected from the learning process. This also involved a reflective journal, a survey on the learning experience and the impacts was conducted. Moreover, analysis was undertaken on the learning activities, learning difficulties, and improvements. The main research results are as follows. Firstly, students accessed Webex, an online video conferencing program, and performed two PBL tasks: 'Making Home Economics Promotion Materials' and 'Presenting Teaching Strategies to Improve Learner's Immersion in Online Classes'. Secondly, learners established their own identity of HE learned about the HE class plans themselves. They also encountered realistic experience as HE teachers and learned communication and collaboration skills. Furthermore, they acquired creative problem-solving and self-directed learning ability, community consciousness, as well as the attitude of consideration and respect. Thirdly, students lacked knowledge of learning content and encountered difficulty in solving data research, analysis processes, and unstructured problems. They were affected by a lack of time and encountered problem in communicating with other team members in an online environment. As an improvement in online class operation, it was considrered necessary to reduce the learning burden by securing time and reducing the number of assignments, as well as to explain active interaction with instructors and PBL.

A scoping review on education on donning and doffing personal protective equipment to prevent healthcare-associated infections in Korea (국내 의료관련감염 예방을 위한 개인보호구 착·탈의 교육에 대한 주제범위 문헌고찰)

  • Sung Ae Choi;Gi-Ran Lee
    • Journal of Industrial Convergence
    • /
    • v.22 no.9
    • /
    • pp.121-131
    • /
    • 2024
  • The purpose of this study is to supply evidences through scoping review of educational intervention studies for donning and doffing PPE to prevent healthcare-associated infection provided to nurses and student nurses in Korea. Through the search engines RISS, KISS, and DBpia, 12 articles were chosen by searching through theses and journals which were published before May 1, 2024. According to the study result, relevant studies were 12, and the education programs provided to donning and doffing PPE to prevent healthcare-associated infection were classified into 1) simulation based education, 2) video and practice based education, and 3) non-contact education. Knowledge, performance confidence, self-efficacy, performance, attitude, and awareness were confirmed as effects of the intervention. Based on the results of this study, there is necessity to develop more diverse teaching and learning methods and evaluation methods for donning and doffing PPE that can prevent healthcare-associated infection in infectious disease and emerging infectious disease situations, and repeatedly conduct research on educational intervention for donning and doffing PPE.

Multimodal Sentiment Analysis Using Review Data and Product Information (리뷰 데이터와 제품 정보를 이용한 멀티모달 감성분석)

  • Hwang, Hohyun;Lee, Kyeongchan;Yu, Jinyi;Lee, Younghoon
    • The Journal of Society for e-Business Studies
    • /
    • v.27 no.1
    • /
    • pp.15-28
    • /
    • 2022
  • Due to recent expansion of online market such as clothing, utilizing customer review has become a major marketing measure. User review has been used as a tool of analyzing sentiment of customers. Sentiment analysis can be largely classified with machine learning-based and lexicon-based method. Machine learning-based method is a learning classification model referring review and labels. As research of sentiment analysis has been developed, multi-modal models learned by images and video data in reviews has been studied. Characteristics of words in reviews are differentiated depending on products' and customers' categories. In this paper, sentiment is analyzed via considering review data and metadata of products and users. Gated Recurrent Unit (GRU), Long Short-Term Memory (LSTM), Self Attention-based Multi-head Attention models and Bidirectional Encoder Representation from Transformer (BERT) are used in this study. Same Multi-Layer Perceptron (MLP) model is used upon every products information. This paper suggests a multi-modal sentiment analysis model that simultaneously considers user reviews and product meta-information.

Design and Implementation of Web Based Instruction Based on Constructivism for Self-Directed Learning Ablity (구성주의 이론에 기반한 자기주도적 웹 기반 교육의 설계와 구현)

  • Kim Gi-Nam;Kim Eui-Jeong;Kim Chang-Suk
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2006.05a
    • /
    • pp.855-858
    • /
    • 2006
  • First of all, Developing information technology makes it possible to change a paradigm of all kinds of areas, including an education. Students can choose learning goals and objects themselves and acquire not the accumulation of knowledge but the method of their learning. Moreover, Teachers get to be adviser, and students play a key role in teaming. That is, the subject of leaning is students. Constructivism emphasizes the student-oriented environment of education, which corresponds to the characteristics of hypeimedia. In addition, Internet allows us to make a practical plan for constructivism. Web Based Internet provides us with a proper environment to make constructivism practice md causes an education system to change. Sure Web Based Instruction makes them motivated to learn more, they can gain plenty of information regardless of places or time. Besides, they are able to consult more up-to-date information regarding their learning use hypermedia such as an image, audio, video, and test, and effectively communicate with their instructor through a board, an e-mail, a chatting etc. A school and instructors have been making effort to develop a new model of a teaching method to cope with a new environment change. In this thesis, with 'Design and Implementation of Web Based Instruction Based on Constructivism', providing online learner-oriented and indexed video lesson, learners can get chance of self-oriented learning. In addition, learners doesn't have to cover all contents of a lesson but can choose contents they want to have from a indexed list of a lesson, and they ran search contents they want to have with a 'Keyword Search' on a main page, which can make learners improve learner's achievement.

  • PDF

Motion based Autonomous Emotion Recognition System: A Preliminary Study on Bodily Map according to Type of Emotional Stimuli (동작 기반 Autonomous Emotion Recognition 시스템: 감정 유도 자극에 따른 신체 맵 형성을 중심으로)

  • Jungeun Bae;Myeongul Jung;Youngwug Cho;Hyungsook Kim;Kwanguk (Kenny) Kim
    • Journal of the Korea Computer Graphics Society
    • /
    • v.29 no.3
    • /
    • pp.33-43
    • /
    • 2023
  • Not only emotions affect physical sensations, but they also have an impact on physical movements. The responses to emotions vary depending on the type of emotional stimuli. However, research on the effects of emotional stimuli on the activation of bodily movements has not been rigorously examined, and these effects have not been investigated in Autonomous Emotion Recognition (AER) systems. In this study, we aimed to compare the emotional responses of 20 participants to three types of emotional stimuli (words, pictures, and videos) and investigate their activation or deactivation for the AER system. Our dependent measures included emotional responses, computer-based self-reporting methods, and bodily movements recorded using motion capture devices. The results suggested that video stimuli elicited higher levels of emotional movement, and emotional movement patterns were similar across different types of emotional stimuli for happiness, sadness, anger, and neutrality. Additionally, the findings indicated that bodily changes observed during video stimuli had the highest classification accuracy. These findings have implications for future research on the bodily changes elicited by emotional stimuli.

A Study on Factors Affecting Usage Intention of Metaverse Services in the Work Environment (업무환경에서의 메타버스 사용의도에 대한 영향요인 연구)

  • Wonsang Cho;Hyunchul Ahn
    • Knowledge Management Research
    • /
    • v.23 no.4
    • /
    • pp.251-273
    • /
    • 2022
  • Metaverse is one of the most frequently used words recently, with digitalization accelerated by the COVID-19 pandemic that started in 2019 and the development of information and communication technology. It is expected to bring a new revolution in our life as a whole in user experience. In particular, as telecommuting was adopted in the business area, interest in virtual office services such as digital video conferencing and remote offices, which are similar to the metaverse, has also increased. In this study, a study on the intention to use the metaverse service used in the work environment was applied to the Unified Theory of Acceptance and Use of Technology 2(UTAUT2). External variables for metaverse characteristics, such as self-presentation, telepresence, and technostress, were analyzed and discussed. In this study, PC-based Gather.town and VR-based Facebook Horizon, currently the most well-known and considered usable in work environments, were introduced to potential users and conducted a survey. This study has academic implications in that the research has examined the factors that affect the technology acceptance intention of users who want to apply the metaverse as a work environment based on the UTAUT2 model, unlike previous studies that have been mainly researched on the general metaverse. In practice, it may be helpful to suggest factors that should be considered when firms adopt the metaverse for business purposes.

Failure Mechanism of Geosynthetic Reinforced Segmental Retaining Well in Tiered Configuration Using Reduced-scale Model Tests (축소 모형 실험에 의한 계단식 보강토옹벽의 파괴 메카니즘)

  • Yoo Chung-Sik;Jung Hyuk-Sang;Jeon Sang-Soo;Lee Bong-Won;Kim Ki-Yeon;Jeon Han-Yong
    • Journal of the Korean Geotechnical Society
    • /
    • v.21 no.3
    • /
    • pp.65-77
    • /
    • 2005
  • This paper investigates the failure mechanism of geosynthetic-reinforced segmental retaining walls with tiered configuration using reduced-scale model tests. The reduced scale model test set-up was established to simulate a 5 m high full-scale wall. The geometry and material properties used in the model test were determined based on the Similitude Laws. The wall failures in the model tests were successfully generated by their self weight without any surface loading and analyzed examining the digital video recordings. The failure mechanisms was examined with respect to the various offsets between the lower and upper teres and the reinforcement length. Based on the results the appropriateness of the current design guideline was discussed.

Design and Implementation of A Mobile-based Demonstration System 'Smart Demo' (모바일 기반 시연 시스템 '스마트 데모'의 설계 및 구현)

  • Lim, Choong-Gyoo
    • The Journal of the Korea Contents Association
    • /
    • v.11 no.12
    • /
    • pp.1-11
    • /
    • 2011
  • An application's demonstration takes much time because there are a number of interactions involved. When a demonstration is indeed necessary, a separate session of demonstration is commonly carried out besides a presentation. If one can control the application wirelessly using mobile devices, he can present his messages effectively by having a live self-paced demonstration. This method of demonstration has not been possible to implement due to the limitations on performance and/or screen size of feature phones. Lately commercialized smartphones, however, are equipped with better performance and various features so that they can be utilized to implement the new demonstration method. With these smartphones, one can view the application images right on mobile devices to control applications directly. This paper describes the issues of design and implementation of a mobile-based demonstration system, 'Smart Demo'.