• Title/Summary/Keyword: 3D motion capture

Search Result 216, Processing Time 0.023 seconds

Realtime Facial Expression Control of 3D Avatar by PCA Projection of Motion Data (모션 데이터의 PCA투영에 의한 3차원 아바타의 실시간 표정 제어)

  • Kim Sung-Ho
    • Journal of Korea Multimedia Society
    • /
    • v.7 no.10
    • /
    • pp.1478-1484
    • /
    • 2004
  • This paper presents a method that controls facial expression in realtime of 3D avatar by having the user select a sequence of facial expressions in the space of facial expressions. The space of expression is created from about 2400 frames of facial expressions. To represent the state of each expression, we use the distance matrix that represents the distances between pairs of feature points on the face. The set of distance matrices is used as the space of expressions. Facial expression of 3D avatar is controled in real time as the user navigates the space. To help this process, we visualized the space of expressions in 2D space by using the Principal Component Analysis(PCA) projection. To see how effective this system is, we had users control facial expressions of 3D avatar by using the system. This paper evaluates the results.

  • PDF

Non-restraint Master Interface of Minimally Invasive Surgical Robot Using Hand Motion Capture (손동작 영상획득을 이용한 최소침습수술로봇 무구속 마스터 인터페이스)

  • Jang, Ik-Gyu
    • Journal of Biomedical Engineering Research
    • /
    • v.37 no.3
    • /
    • pp.105-111
    • /
    • 2016
  • Introduction: Surgical robot is the alternative instrument that substitutes the difficult and precise surgical operation; should have intuitiveness operationally to transfer natural motions. There are limitations of hand motion derived from contacting mechanical handle in the surgical robot master interface such as mechanical singularity, isotropy, coupling problems. In this paper, we will confirm and verify the feasibility of intuitive Non-restraint master interface which tracking the hand motion using infra-red camera and only 3 reflective markers without the hardware handle for the surgical robot master interface. Materials & methods: We configured S/W and H/W system; arranged 6 infra-red cameras and attached 3 reflective markers on hands for measuring 3 dimensional coordinate then we find the 7 motions of grasp, yaw, pitch, roll, px, py, pz. And we connected Virtual-Master to the slave surgical robot(Laparobot) and observed the feasibility. To verify the result of motion, we compare the result of Non-restraint master and that of clinometer (and protractor) through measuring 0~180 degree, 10degree interval, 1000 samples and recorded standard deviation stands for error rate of the value. Results: We confirmed that the average angle values of Non-restraint master interface is accurately corresponds to the result of clinometer (and protractor) and have low error rates during motion. Investigation & Conclusion: In this paper, we confirmed the feasibility and accuracy of 3D Non-restraint master interface that can offer the intuitive motion of non-contact hardware handle. As a result, we can expect the high intuitiveness, dexterousness of surgical robot.

An Efficient Generation of Walking and Running Motion on Various Terrains (다양한 지형에서의 걷기와 달리기 동작의 효율적 생성)

  • Song Mi-Young;Cho Hyung-Je
    • The KIPS Transactions:PartB
    • /
    • v.13B no.2 s.105
    • /
    • pp.187-196
    • /
    • 2006
  • In 3D animation most people adjust the moving motion of their characters on various terrains by using motion data acquired with the motion capture equipment. The motion data can be used to present real human motions naturally, but the data must be captured again to apply to the different terrains from those given at acquiring mode. In addition, there would be a difficulty when applying the data to other characters, in that case the motion data must be captured newly or the existing motion data must be heavily edited manually. In this paper we propose a unified method to generate human motions of walking and running for various terrains such as flat plane, inclined plane, stairway and irregular face. With these methods we are able to generate human motions controlled by the parameters : body height, moving speed, stride, etc. In the proposed methods, the positions and angles of joint can be calculated by using inverse kinematics, and we calculate the trajectory of the swing leg and pelvis according to the cubic spline. With these methods we were presented moving motions using a model of a human body.

Dragging Body Parts in 3D Space to Direct Animated Characters (3차원 공간 상의 신체 부위 드래깅을 통한 캐릭터 애니메이션 제어)

  • Lee, Kang Hoon;Choi, Myung Geol
    • Journal of the Korea Computer Graphics Society
    • /
    • v.21 no.2
    • /
    • pp.11-20
    • /
    • 2015
  • We present a new interactive technique for directing the motion sequences of an animated character by dragging its specific body part to a desired location in the three-dimensional virtual environment via a hand motion tracking device. The motion sequences of our character is synthesized by reordering subsequences of captured motion data based on a well-known graph representation. For each new input location, our system samples the space of possible future states by unrolling the graph into a spatial search tree, and retrieves one of the states at which the dragged body part of the character gets closer to the input location. We minimize the difference between each pair of successively retrieved states, so that the user is able to anticipate which states will be found by varying the input location, and resultantly, to quickly reach the desired states. The usefulness of our method is demonstrated through experiments with breakdance, boxing, and basketball motion data.

Writer Identification using Wii Remote Controller

  • Watanabe, Takashi;Shin, Jung-Pil;Chong, Ui-Pil
    • Journal of the Institute of Convergence Signal Processing
    • /
    • v.14 no.1
    • /
    • pp.21-26
    • /
    • 2013
  • The objective of this study was to develop a system for handwriting recognition in three dimensions (3D) to authenticate users. While previous studies have used a stylus pen for two-dimensional input on a tablet, this study uses the Wii Remote controller because it can capture 3D human motion and could therefore be more effective means of recognition. The information obtained from a Wii Remote controller included x and y coordinates, acceleration (x, y, z), angular velocity (pitch, yaw, roll), twelve input buttons, and time. The proposed system calculates distances using six features extracted after preprocessing the data. In an experiment where 15 subjects wrote "AIZU" 10 times, we obtained a 94.8% identification rate using a combination of writing velocity, the peak value of pitch, and the peak value of yaw. This suggests that this system holds promise for handwriting-based authentication in the future.

Marker-Free Motion Capture System (마커프리 모션캡처 시스템)

  • Park, C.J.;Kim, S.E.;Lee, I.H.
    • Electronics and Telecommunications Trends
    • /
    • v.20 no.4 s.94
    • /
    • pp.16-28
    • /
    • 2005
  • 최근 컴퓨터비전 기술을 이용하는 새로운 패러다임의 마커프리 모션캡처 기술이 미국의 MIT, CMU, MS, 일본의 ATR, MERL, 영국의 Oxford 대학 등에서 개발되고 있다. 마커프리 모션캡처는 연기자의 몸에 마커나 센서를 부착하지 않으며 특별한 조명이 필요 없으므로, 애니메이션 제작뿐만 아니라 일반인을 대상으로 하는 동작 인터페이스분야로의 확대 적용이 가능한 모션캡처 방식이다. ETRI에서는 여러 응용 분야에 모션인터페이스로 활용할 수 있는 환경 변화에 강인한 마커프리 모션캡처 시스템을 개발하고 있다. 몸에 마커나 센서를 부착하지 않은 자유 복장 상태의 동작자에 대해 조명 조건 변화 및 배경 변화에 강건하게 실시간 모션캡처 할 수 있는 기술 개발을 목표로 한다. 본 연구 개발이 성공한다면, 2007년에 876억 달러 규모로 확대될 전망인 영화, 방송물, 게임 등을 포함한 세계 영상 콘텐츠 시장에서 핵심 요소 기술 역할을 할 것이다. 그리고, 차세대 3D OS에서는 직관적 3D 포인팅 수단으로 활용될 수 있을 것이며, 2004년에 18,600만 대가 출고된 PC 시장을 고려하면 폭발적 수요가 예측된다.

Procedural Geometry Calibration and Color Correction ToolKit for Multiple Cameras (절차적 멀티카메라 기하 및 색상 정보 보정 툴킷)

  • Kang, Hoonjong;Jo, Dongsik
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.25 no.4
    • /
    • pp.615-618
    • /
    • 2021
  • Recently, 3D reconstruction of real objects with multi-cameras has been widely used for many services such as VR/AR, motion capture, and plenoptic video generation. For accurate 3D reconstruction, geometry and color matching between multiple cameras will be needed. However, previous calibration and correction methods for geometry (internal and external parameters) and color (intensity) correction is difficult for non-majors to perform manually. In this paper, we propose a toolkit with procedural geometry calibration and color correction among cameras with different positions and types. Our toolkit consists of an easy user interface and turned out to be effective in setting up multi-cameras for reconstruction.

The Effect of the Technical and Virtual Creator Characteristics of Vtuber's Personal Broadcasting on Pleasure, Satisfaction, and Paid Sponsorship Intention: Based on the S-O-R Model (브이튜버(Vtuber) 개인방송의 기술적 특성과 가상 크리에이터 특성이 즐거움, 시청만족도 및 유료후원의도에 미치는 영향: S-O-R 모델을 기반으로)

  • Jin, Chengjun;Yang, Sung-Byung;Yoon, Sang-Hyeak
    • Journal of Information Technology Services
    • /
    • v.21 no.5
    • /
    • pp.107-127
    • /
    • 2022
  • Personal broadcasting utilizing Vtuber, a virtual creator made of 2D or 3D avatars, has recently appeared and is growing in popularity. Vtuber is a virtual person who broadcasts on the Internet using 2D or 3D avatars with real-time motion capture and computer graphics technologies. While the personal broadcasting industry utilizing Vtuber is proliferating, related studies have mainly concentrated on technical issues. Therefore, in this study, the antecedent factors that form the technical characteristics and virtual creator characteristics of Vtuber personal broadcasting are derived using the Stimulus-Organism-Response (S-O-R) model. Then the effect of these factors on viewer pleasure and satisfaction, which lead to increased paid sponsorship is to be examined. Furthermore, we investigate how this influencing mechanism fluctuates based on the avatar type (2D vs. 3D). This study contributes to empirical examinations of viewers' paid sponsorship intention in Vtuber personal broadcasting through the S-O-R model. It also offers insights that technological or virtual creator characteristics could improve viewers' pleasure, satisfaction, and even paid sponsorship.

A Study on Random Reconstruction Method of 3-D Objects Based on Conditional Generative Adversarial Networks (cGANs) (cGANs(Conditional Generative Adversarial Networks) 기반 3차원 객체의 임의 재생 기법 연구)

  • Shin, Kwang-Seong;Shin, Seong-Yoon
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2019.05a
    • /
    • pp.157-159
    • /
    • 2019
  • Hologram technology has been actively developed in terms of generation, transmission, and reproduction of 3D objects, but it is currently in a state of rest because of various limitations. Beyond VR and AR, the pseudo-hologram market is growing at an intermediate stage to meet the needs of new technologies. The key to the technology of hologram is to generate vast 3 dimensional data in the form of a point cloud, transmit the vast amount of data through the communication network in real time, and reproduce it like the original at the destination. In this paper, we propose a method to transmit massive 3 - D data in real - time and transmit the minutiae points of 3 - dimensional object information to reproduce the object as similar to original.

  • PDF

Helicopter BVI Noise Prediction Using Acoustic Analogy and High Resolution Airloads of Time Marching Free Wake Method (자유후류기법에 의한 고해상도 공기력과 음향상사법을 이용한 헬리콥터 로터 블레이드-와류 상호작용 소음 예측)

  • Chung, K.;Lee, D.J.;Hwang, C.
    • Transactions of the Korean Society for Noise and Vibration Engineering
    • /
    • v.16 no.3 s.108
    • /
    • pp.291-297
    • /
    • 2006
  • The BVI(blade vortex interaction) noise Prediction has been one of the most challenging acoustic analyses in helicopter aeromechanical Phenomenon. It is well known high resolution airloads data with accurate tip vortex positions are necessary for the accurate prediction of this phenomenon. The truly unsteady time-marching free-wake method, which is able to capture the tip vortices instability in hover and axial flights, is expanded with the rotor flapping motion and trim routine to predict unsteady airloads in forward and descent flights. And Farassat formulation 1-A based on the FW-H equation is applied for the noise prediction considering the blade flapping motion. Main objective of this study is to validate the newly developed prediction code. To achieve the objective, the descent flight condition of AH-1 OLS(operational loads survey) configuration is analyzed using present code. The predicted sectional thrust distribution and sectional airloads time histories show the present scheme is able to capture well the unsteady airloads caused by a parallel BVI. Finally, the predicted noise data, observed in two different positions where are 3.44 times of rotor radius far from the hub center, are quite reasonable agreements with the experimental data compared to the other analysis results.