• KIPS Transactions on Software and Data Engineering
• /
• v.11 no.10
• /
• pp.409-418
• /
• 2022

In this paper, we propose SAAnnot-C3Pap, a semi-automatic annotation method for obtaining ground truth of a player's posture. In order to obtain ground truth about the two-dimensional joint position in the existing music domain, openpose, a two-dimensional posture estimation method, was used or manually labeled. However, automatic annotation methods such as the existing openpose have the disadvantages of showing inaccurate results even though they are fast. Therefore, this paper proposes SAAnnot-C3Pap, a semi-automated annotation method that is a compromise between the two. The proposed approach consists of three main steps: extracting postures using openpose, correcting the parts with errors among the extracted parts using supervisely, and then analyzing the results of openpose and supervisely. Perform the synchronization process. Through the proposed method, it was possible to correct the incorrect 2D joint position detection result that occurred in the openpose, solve the problem of detecting two or more people, and obtain the ground truth in the playing posture. In the experiment, we compare and analyze the results of the semi-automated annotation method openpose and the SAAnnot-C3Pap proposed in this paper. As a result of comparison, the proposed method showed improvement of posture information incorrectly collected through openpose.

• Smart Media Journal
• /
• v.12 no.7
• /
• pp.59-67
• /
• 2023

Recently, research on behavior analysis tracking human posture and movement has been actively conducted. In particular, OpenPose, an open-source software developed by CMU in 2017, is a representative method for estimating human appearance and behavior. OpenPose can detect and estimate various body parts of a person, such as height, face, and hands in real-time, making it applicable to various fields such as smart healthcare, exercise training, security systems, and medical fields. In this paper, we propose a method for classifying four exercise movements - Squat, Walk, Wave, and Fall-down - which are most commonly performed by users in the gym, using OpenPose-based deep learning models, DNN and CNN. The training data is collected by capturing the user's movements through recorded videos and real-time camera captures. The collected dataset undergoes preprocessing using OpenPose. The preprocessed dataset is then used to train the proposed DNN and CNN models for exercise movement classification. The performance errors of the proposed models are evaluated using MSE, RMSE, and MAE. The performance evaluation results showed that the proposed DNN model outperformed the proposed CNN model.

• Proceedings of the Korean Society of Computer Information Conference
• /
• 2020.07a
• /
• pp.289-290
• /
• 2020

본 논문에서는 오픈 소스인 openpose skeleton tracking 기술을 이용하여 특정 운동 동작을 영상처리 기술과 딥러닝 기술로 인체 자세에 대해서 인지와 상황 판단하여 운동 동작에 대한 인식 결과를 도출할 수 있다. 먼저 입력받은 영상을 전달받아서 딥러닝 인식 시스템를 통해 인식 결과을 추출한 뒤 비교, 분석한 후에 사전 등록된 운동 동작 명칭으로 화면에 표시하여 이용자가 정확한 동작을 취할 수 있도록 지도하는 데 활용할 수 있다. 또한, 이 기술은 행동 인식부터 얼굴 인식, 손동작 인식 등에 다양하게 활용할 수 있다.

• Proceedings of the Korean Society of Computer Information Conference
• /
• 2023.07a
• /
• pp.489-490
• /
• 2023

본 논문에서는 신체 영상 인식 기술을 이용한 운동 자세 교정 시스템을 제안하고 개발하였다. 구글에서 제공하는 미디어파이프 포즈(MediaPipe Pose) 오픈소스를 사용하여 웹캠으로 사용자의 운동 동작을 실시간으로 인식하여, 인식된 신체 구조의 33개의 관절 위치로 Pose Landmark를 사용하여 사용자의 운동 자세에 대한 횟수 카운트, 운동 동작의 정확도 측정을 할 수 있게 하여 혼자 운동하거나 처음 운동하는 사람들에게 운동의 접근성을 높이고, 올바른 자세로 운동을 하도록 유도할 수 있다.

• The Journal of the Korea institute of electronic communication sciences
• /
• v.19 no.3
• /
• pp.583-588
• /
• 2024

With the emergence of Brain-Computer Interface (BCI) technology, analyzing mirror neurons has become more feasible. However, evaluating the accuracy of BCI systems that rely on human thoughts poses challenges due to their qualitative nature. To harness the potential of BCI, we propose a new approach to measure accuracy based on the characteristics of mirror neurons in the human brain that are influenced by speech speed, depending on the ultimate goal of movement. In Chapter 2 of this paper, we introduce mirror neurons and provide an explanation of human posture estimation for mirror neurons. In Chapter 3, we present a powerful pose estimation method suitable for real-time dynamic environments using the technique of human posture estimation. Furthermore, we propose a method to analyze the accuracy of BCI using this robotic environment.

• The Journal of the Institute of Internet, Broadcasting and Communication
• /
• v.19 no.2
• /
• pp.161-168
• /
• 2019

Recently, video equipments such as CCTV, which is spreading rapidly, is being used as a means to monitor and cope with abnormal situations in almost governments, companies, and households. However, in most cases, since recognizing the abnormal situation is carried out by the monitoring person, the immediate response is difficult and is used only for post-analysis. In this paper, we present the results of the development of video surveillance system that automatically recognizing the abnormal situations and sending such events to the smartphone immediately using the latest deep learning technology. The proposed system extracts skeletons from the human objects in real time using Openpose library and then recognizes the human behaviors automatically using deep learning technology. To this end, we reconstruct Openpose library, which developed in the Caffe framework, on Darknet framework to improve real-time processing. We also verified the performance improvement through experiments. The system to be introduced in this paper has accurate and fast behavioral recognition performance and scalability, so it is expected that it can be used for video surveillance systems for various applications.

• The Journal of the Convergence on Culture Technology
• /
• v.9 no.1
• /
• pp.347-353
• /
• 2023

Currently, soldiers enlisted in the military (Army) are receiving measurements (automatic, manual) of body parts and trying on sample clothing at boot training centers, and then receiving clothing in the desired size. Due to the low accuracy of the measured size during the measurement process, in the military, which uses a relatively more detailed sizing system than civilian casual clothes, the supplied clothes do not fit properly, so the frequency of changing the clothes is very frequent. In addition, there is a problem in that inventory is managed inefficiently by applying the measurement system based on the old generation body shape data collected more than a decade ago without reflecting the western-changed body type change of the MZ generation. That is, military uniforms of the necessary size are insufficient, and many unnecessary-sized military uniforms are in stock. Therefore, in order to reduce the frequency of clothing replacement and improve the efficiency of stock management, deep learning-based automatic measurement of body size, big data analysis, and machine learning-based "Personalized Combat Uniform Automatic Recommendation System for Enlisted Soldiers" is proposed.

• The Journal of the Convergence on Culture Technology
• /
• v.10 no.4
• /
• pp.367-372
• /
• 2024

Although developmental disabilities account for a relatively low number of the total number of disabilities, they are generally classified as severe disabilities considering the degree of disability. If these developmental disorders are discovered early, adaptability and early treatment efficiency can be improved, but most parents do not detect any signs from their children or miss the right time for treatment. In this paper, we conducted development of the developmental disorder diagnosis algorithm that can recognize hand-flapping, one of the early unusual behaviors of developmental disorders, for parents and early childhood care workers who cannot recognize signs of early developmental disorders based on specific behavioral characteristics as a pilot study. It was confirmed that the recognition area and fingers were accurately recognized, and the number of hand flapping was accurately counted. It is expected that research on algorithms that can diagnose various behavioral patterns will continue to be conducted and expanded all through algorithms advancement and expansion of functional performance using big data.