• Title/Summary/Keyword: skeleton data

Search Result 149, Processing Time 0.024 seconds

Multi-Region based Radial GCN algorithm for Human action Recognition (행동인식을 위한 다중 영역 기반 방사형 GCN 알고리즘)

  • Jang, Han Byul;Lee, Chil Woo
    • Smart Media Journal
    • /
    • v.11 no.1
    • /
    • pp.46-57
    • /
    • 2022
  • In this paper, multi-region based Radial Graph Convolutional Network (MRGCN) algorithm which can perform end-to-end action recognition using the optical flow and gradient of input image is described. Because this method does not use information of skeleton that is difficult to acquire and complicated to estimate, it can be used in general CCTV environment in which only video camera is used. The novelty of MRGCN is that it expresses the optical flow and gradient of the input image as directional histograms and then converts it into six feature vectors to reduce the amount of computational load and uses a newly developed radial type network model to hierarchically propagate the deformation and shape change of the human body in spatio-temporal space. Another important feature is that the data input areas are arranged being overlapped each other, so that information is not spatially disconnected among input nodes. As a result of performing MRGCN's action recognition performance evaluation experiment for 30 actions, it was possible to obtain Top-1 accuracy of 84.78%, which is superior to the existing GCN-based action recognition method using skeleton data as an input.

Interactive lens through smartphones for supporting level-of-detailed views in a public display

  • Kim, Minseok;Lee, Jae Yeol
    • Journal of Computational Design and Engineering
    • /
    • v.2 no.2
    • /
    • pp.73-78
    • /
    • 2015
  • In this paper, we propose a new approach to providing interactive and collaborative lens among multi-users for supporting level-of-detailed views using smartphones in a public display. In order to provide smartphone-based lens capability, the locations of smartphones are effectively detected and tracked using Kinect, which provides RGB data and depth data (RGB-D). In particular, human skeleton information is extracted from the Kinect 3D depth data to calculate the smartphone location more efficiently and correctly with respect to the public display and to support head tracking for easy target selection and adaptive view generation. The suggested interactive and collaborative lens using smartphones not only can explore local spaces of the shared display but also can provide various kinds of activities such as LOD viewing and collaborative interaction. Implementation results are given to show the advantage and effectiveness of the proposed approach.

A Study on Posture Discrimination using Coordinate Transformation of Skeleton Data (골격 데이터의 좌표변환을 이용한 자세판별 연구)

  • Kim, Yong-jin;Noh, Yun-hong;Jeong, Do-un
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2017.05a
    • /
    • pp.510-511
    • /
    • 2017
  • In this paper, a study was conducted to prevent spinal - related diseases and to help posture correction by feeding back the wrong attitude to the users. Kinect sensor was used for this purpose. In order to measure the movement of the user, the degree of motion change was measured by indexing the skeletal data coordinate value. It is confirmed that the implemented system can observe not only posture but also distraction of user.

  • PDF

Motion Capture of the Human Body Using Multiple Depth Sensors

  • Kim, Yejin;Baek, Seongmin;Bae, Byung-Chull
    • ETRI Journal
    • /
    • v.39 no.2
    • /
    • pp.181-190
    • /
    • 2017
  • The movements of the human body are difficult to capture owing to the complexity of the three-dimensional skeleton model and occlusion problems. In this paper, we propose a motion capture system that tracks dynamic human motions in real time. Without using external markers, the proposed system adopts multiple depth sensors (Microsoft Kinect) to overcome the occlusion and body rotation problems. To combine the joint data retrieved from the multiple sensors, our calibration process samples a point cloud from depth images and unifies the coordinate systems in point clouds into a single coordinate system via the iterative closest point method. Using noisy skeletal data from sensors, a posture reconstruction method is introduced to estimate the optimal joint positions for consistent motion generation. Based on the high tracking accuracy of the proposed system, we demonstrate that our system is applicable to various motion-based training programs in dance and Taekwondo.

Classification of Head Shape and 3-dimensional Analysis for Korean Women (한국 성인 여성 머리 유형분류와 입체적 분석)

  • Choi, Young-Lim;Kim, Jae-Seung;Nam, Yun-Ja
    • The Korean Fashion and Textile Research Journal
    • /
    • v.11 no.5
    • /
    • pp.779-787
    • /
    • 2009
  • The purpose of this study was to classify the head shape for the apparel industry and to suggest standard head model for korean women. The 23 measurement items of 891 females, aged more than 18 years were used to analysis by statistical methods. Factor analysis, cluster analysis and duncan test were performed using these data. Through factor analysis, 5 factors were extracted upon factor scores and those factors comprised 68.76% for the total variances. 5 clusters as their head and face shape were categorized. We decided for the type 3 to standard head shape. 24 participants were measured using computed tomography(CT). The measured data of skin and skeleton and the standard head shapes were illustrated.

A Study on the Strain Analysis by Image Processing Technique (part 1: Development of Image Processing Technique with Microcomputer) (화상처리기법을 이용한 변형율해석에 관한 연구 (제1보 마이크로 컴퓨터를 이용한 화상처리기법의 개발))

  • 백인환;신문교
    • Journal of Advanced Marine Engineering and Technology
    • /
    • v.12 no.3
    • /
    • pp.43-56
    • /
    • 1988
  • The image processing system consisted of the microcomputer IBM PC-XT and the graphic board (16 gray level and $640{\times}400$ pixels resolution) has been proposed, and the image processing softwares programmed in the BASIC and in the assembler language have been developed. The programs are consisted of the main menu and the sub menu, that have contained the subroutine for the capture for image data, the determination of region, the histogram, the change of value, the montage, the skeleton, the mask, the moving, the zoom, the disk access and the print. For the application, the photoelastic fringe data have been captured and analyzed. It was seen that the programs are available for the image processing.

  • PDF

Realistic Visual Simulation of Water Effects in Response to Human Motion using a Depth Camera

  • Kim, Jong-Hyun;Lee, Jung;Kim, Chang-Hun;Kim, Sun-Jeong
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.11 no.2
    • /
    • pp.1019-1031
    • /
    • 2017
  • In this study, we propose a new method for simulating water responding to human motion. Motion data obtained from motion-capture devices are represented as a jointed skeleton, which interacts with the velocity field in the water simulation. To integrate the motion data into the water simulation space, it is necessary to establish a mapping relationship between two fields with different properties. However, there can be severe numerical instability if the mapping breaks down, with the realism of the human-water interaction being adversely affected. To address this problem, our method extends the joint velocity mapped to each grid point to neighboring nodes. We refine these extended velocities to enable increased robustness in the water solver. Our experimental results demonstrate that water animation can be made to respond to human motions such as walking and jumping.

A Study on the IDL Compiler using the Marshal Buffer Management

  • Kim, Dong-Hyun
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • v.9 no.1
    • /
    • pp.843-847
    • /
    • 2005
  • The development of distributed application in the standardized CORBA(Common Object Request Broker Architecture) environments reduces the developing time and maintaining cost of the systems. Because of these advantages, the development of application is being progressed in the several fields using the CORBA environments. The programmers in the CORBA environments usually develop the application programs using the CORBA IDL(Interface Definition Language). The IDL files are compiled by IDL compiler and translated into the stubs and skeleton codes which are mapped onto particular target language. The stubs produced by IDL compilers processes the marshaling a data into message buffer. Before a stub can marshal a data into its message buffer, the stub must ensure that the buffer has at least enough free space to contain the encoded representation of the data. But, the stubs produced by typical IDL compilers check the amount of free buffer space before every atomic data is marshaled, and if necessary, expand the message buffer. These repeated tests are wasteful and incidence of overheads, especially if the marshal buffer space must be continually expanded. Thus, the performance of the application program may be poor. In this paper, we suggest the way that the stub code is maintain the enough free space before marshaling the data into message buffer. This methods were analyzes the overall storage requirements of every message that will be exchanged between client and server. For these analysis, in the Front End of compiler has maintain the information that the storage requirements and alignment constraints for data types. Thus, stub code is optimized and the performance of application program is increased.

  • PDF

Efficient Collecting Scheme the Crack Data via Vector based Data Augmentation and Style Transfer with Artificial Neural Networks (벡터 기반 데이터 증강과 인공신경망 기반 특징 전달을 이용한 효율적인 균열 데이터 수집 기법)

  • Yun, Ju-Young;Kim, Donghui;Kim, Jong-Hyun
    • Proceedings of the Korean Society of Computer Information Conference
    • /
    • 2021.07a
    • /
    • pp.667-669
    • /
    • 2021
  • 본 논문에서는 벡터 기반 데이터 증강 기법(Data augmentation)을 제안하여 학습 데이터를 구축한 뒤, 이를 합성곱 신경망(Convolutional Neural Networks, CNN)으로 실제 균열과 가까운 패턴을 표현할 수 있는 프레임워크를 제안한다. 건축물의 균열은 인명 피해를 가져오는 건물 붕괴와 낙하 사고를 비롯한 큰 사고의 원인이다. 이를 인공지능으로 해결하기 위해서는 대량의 데이터 확보가 필수적이다. 하지만, 실제 균열 이미지는 복잡한 패턴을 가지고 있을 뿐만 아니라, 위험한 상황에 노출되기 때문에 대량의 데이터를 확보하기 어렵다. 이러한 데이터베이스 구축의 문제점은 인위적으로 특정 부분에 변형을 주어 데이터양을 늘리는 탄성왜곡(Elastic distortion) 기법으로 해결할 수 있지만, 본 논문에서는 이보다 향상된 균열 패턴 결과를 CNN을 활용하여 보여준다. 탄성왜곡 기법보다 CNN을 이용했을 때, 실제 균열 패턴과 유사하게 추출된 결과를 얻을 수 있었고, 일반적으로 사용되는 픽셀 기반 데이터가 아닌 벡터 기반으로 데이터 증강을 설계함으로써 균열의 변화량 측면에서 우수함을 보였다. 본 논문에서는 적은 개수의 균열 데이터를 입력으로 사용했음에도 불구하고 균열의 방향 및 패턴을 다양하게 생성하여 쉽게 균열 데이터베이스를 구축할 수 있었다. 이는 장기적으로 구조물의 안정성 평가에 이바지하여 안전사고에 대한 불안감에서 벗어나 더욱 안전하고 쾌적한 주거 환경을 조성할 것으로 기대된다.

  • PDF

Osteological Development of Larvae and Juvenile of Hemibarbus longirostris (Cypriniformes: Cyprinidae) from Korea (한국산 참마자, Hemibarbus longirostris(Cypriniformes: Cyprinidae) 자치어의 골격발달)

  • Mun, Seong Jun;Park, Jae Min;Han, Kyeong Ho
    • Korean Journal of Ichthyology
    • /
    • v.31 no.4
    • /
    • pp.214-221
    • /
    • 2019
  • This study suggests basic data for taxonomic research among similar species by observing osteological development of larvae of Hemibarbus longirostris. Newly hatched yolk-sac larvae were 8.10±0.02 mm (n=5) in mean total length, and frontal, parasphenoid, and basioccipital in the cranium were ossified. On the 6 days after hatching, flexion-larvae were 10.9±0.26 mm (n=5) in mean total length, hyomandibular, sympletic, and ectopterygoid in the cranium were ossified. On the 12 days after hatching, post-larvae were 12.2±0.55 mm (n=5) in mean total length, interopercle in operculum region and postclavicle in shoulder girdle bone were ossified. On the 25 days after hatching, post-larvae were 16.1±0.27 mm (n=5) in mean total length, epihyal and interhyal in hyoid arch, two epural in caudal skeleton, interneural processes, and interhaemal processes were ossified. On the 40 days after hatching, juvenile were 27.9±3.74 mm (n=5) in mean total length, all skeletal development completed with hypural bone in the caudal skeleton region fused in three forms (1, 2+3, 4+5).