• Title/Summary/Keyword: real time motion tracking

Search Result 234, Processing Time 0.026 seconds

Development of a Ubiquitous Vision System for Location-awareness of Multiple Targets by a Matching Technique for the Identity of a Target;a New Approach

  • Kim, Chi-Ho;You, Bum-Jae;Kim, Hag-Bae
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2005.06a
    • /
    • pp.68-73
    • /
    • 2005
  • Various techniques have been proposed for detection and tracking of targets in order to develop a real-world computer vision system, e.g., visual surveillance systems, intelligent transport systems (ITSs), and so forth. Especially, the idea of distributed vision system is required to realize these techniques in a wide-spread area. In this paper, we develop a ubiquitous vision system for location-awareness of multiple targets. Here, each vision sensor that the system is composed of can perform exact segmentation for a target by color and motion information, and visual tracking for multiple targets in real-time. We construct the ubiquitous vision system as the multiagent system by regarding each vision sensor as the agent (the vision agent). Therefore, we solve matching problem for the identity of a target as handover by protocol-based approach. We propose the identified contract net (ICN) protocol for the approach. The ICN protocol not only is independent of the number of vision agents but also doesn't need calibration between vision agents. Therefore, the ICN protocol raises speed, scalability, and modularity of the system. We adapt the ICN protocol in our ubiquitous vision system that we construct in order to make an experiment. Our ubiquitous vision system shows us reliable results and the ICN protocol is successfully operated through several experiments.

  • PDF

A Study on Sensor-Based Upper Full-Body Motion Tracking on HoloLens

  • Park, Sung-Jun
    • Journal of the Korea Society of Computer and Information
    • /
    • v.26 no.4
    • /
    • pp.39-46
    • /
    • 2021
  • In this paper, we propose a method for the motion recognition method required in the industrial field in mixed reality. In industrial sites, movements (grasping, lifting, and carrying) are required throughout the upper full-body, from trunk movements to arm movements. In this paper, we use a method composed of sensors and wearable devices that are not vision-based such as Kinect without using heavy motion capture equipment. We used two IMU sensors for the trunk and shoulder movement, and used Myo arm band for the arm movements. Real-time data coming from a total of 4 are fused to enable motion recognition for the entire upper body area. As an experimental method, a sensor was attached to the actual clothes, and objects were manipulated through synchronization. As a result, the method using the synchronization method has no errors in large and small operations. Finally, through the performance evaluation, the average result was 50 frames for single-handed operation on the HoloLens and 60 frames for both-handed operation.

Camera Tracking Method based on Model with Multiple Planes (다수의 평면을 가지는 모델기반 카메라 추적방법)

  • Lee, In-Pyo;Nam, Bo-Dam;Hong, Hyun-Ki
    • Journal of Korea Game Society
    • /
    • v.11 no.4
    • /
    • pp.143-149
    • /
    • 2011
  • This paper presents a novel camera tracking method based on model with multiple planes. The proposed algorithm detects QR code that is one of the most popular types of two-dimensional barcodes. A 3D model is imported from the detected QR code for augmented reality application. Based on the geometric property of the model, the vertices are detected and tracked using optical flow. A clipping algorithm is applied to identify each plane from model surfaces. The proposed method estimates the homography from coplanar feature correspondences, which is used to obtain the initial camera motion parameters. After deriving a linear equation from many feature points on the model and their 3D information, we employ DLT(Direct Linear Transform) to compute camera information. In the final step, the error of camera poses in every frame are minimized with local Bundle Adjustment algorithm in real-time.

Effectiveness of the Respiratory Gating System for Stereotectic Radiosurgery of Lung Cancer (Lung Cancer의 Stereotactic Radiosurgery시 Respiratory Gating system의 유용성에 대한 연구)

  • Song Heung Kwon;Kim Min Su;Yang Oh Nam;Park Cheol Su;Kwon Kyung Tae;Kim Jeong Man
    • 대한방사선치료학회:학술대회논문집
    • /
    • 2005.06a
    • /
    • pp.13-17
    • /
    • 2005
  • Introduction : For stereotactic radiosurgery (SRS) of a tumor in the region whose movement due to respiration is significant, like Lung lower lobe, the gated therapy, which delivers radiation dose to the selected respiratory phases when tumor motion is small, was peformed using the Respiratory gating system and its clinical effectiveness was evaluated. Methode and Materials : For two SRS patients with a tumor in Lung lower lobe, a marker block (infrared reflector) was attached on the abdomen. While patient' respiratory cycle was monitored with Real-time Position Management (RPM, Varian, USA), 4D CT was performed (10 phases per a cycle). Phases in which tumor motion did not change rapidly were decided as treatment phases. The treatment volume was contoured on the CT images for selected treatment phases using maximum intensity projection (MIP) method. In order to verify setup reproducibility and positional variation, 4D CT was repeated. Result : Gross tumor volume (GTV) showed maximum movement in superior-inferior direction. For patient $\#$1, motion of GTV was reduced to 2.6 mm in treatment phases ($30\%\~60\%$), while that was 9.4 mm in full phases ($0\%\~90\%$) and for patient $\#$2, it was reduced to 2.3 mm in treatment phases ($30\%\~70\%$), while it was 11.7 mm in full phases ($0\%\~90\%$). When comparing two sets of CT images, setup errors in all the directions were within 3 mm. Conclusion : Since tumor motion was reduced less than 5 mm, the Respiratory gating system for SRS of Lung lower lobe is useful.

  • PDF

Interactive VFX System for TV Virtual Studio (TV 가상 스튜디오용 인터랙티브 VFX 시스템)

  • Byun, Hae Won
    • Journal of the Korea Computer Graphics Society
    • /
    • v.21 no.5
    • /
    • pp.21-27
    • /
    • 2015
  • In this paper, we presents visual effect(water, fire, smoke) simulation and interaction system for TV virtual studio. TV virtual studio seamlessly synthesizes CG background and a live performer standing on a TV green studio. Previous virtual studios focus on the registration of CG background and a performer in real world. In contrast to the previous systems, we can afford to make new types of TV scenes more easily by simulating interactive visual effects according to a performer. This requires the extraction of the performer motion to be transformed 3D vector field and simulate fluids by applying the vector field to Navier Stokes equation. To add realism to water VFX simulation and interaction, we also simulate the dynamic behavior of splashing fluids on the water surface. To provide real-time recording of TV programs, real-time VFX simulation and interaction is presented through a GPU programming. Experimental results show this system can be used practically for realizing water, fire, smoke VFX simulation and the dynamic behavior simulation of fish flocks inside ocean.

Development of an Offline Based Internal Organ Motion Verification System during Treatment Using Sequential Cine EPID Images (연속촬영 전자조사 문 영상을 이용한 오프라인 기반 치료 중 내부 장기 움직임 확인 시스템의 개발)

  • Ju, Sang-Gyu;Hong, Chae-Seon;Huh, Woong;Kim, Min-Kyu;Han, Young-Yih;Shin, Eun-Hyuk;Shin, Jung-Suk;Kim, Jing-Sung;Park, Hee-Chul;Ahn, Sung-Hwan;Lim, Do-Hoon;Choi, Doo-Ho
    • Progress in Medical Physics
    • /
    • v.23 no.2
    • /
    • pp.91-98
    • /
    • 2012
  • Verification of internal organ motion during treatment and its feedback is essential to accurate dose delivery to the moving target. We developed an offline based internal organ motion verification system (IMVS) using cine EPID images and evaluated its accuracy and availability through phantom study. For verification of organ motion using live cine EPID images, a pattern matching algorithm using an internal surrogate, which is very distinguishable and represents organ motion in the treatment field, like diaphragm, was employed in the self-developed analysis software. For the system performance test, we developed a linear motion phantom, which consists of a human body shaped phantom with a fake tumor in the lung, linear motion cart, and control software. The phantom was operated with a motion of 2 cm at 4 sec per cycle and cine EPID images were obtained at a rate of 3.3 and 6.6 frames per sec (2 MU/frame) with $1,024{\times}768$ pixel counts in a linear accelerator (10 MVX). Organ motion of the target was tracked using self-developed analysis software. Results were compared with planned data of the motion phantom and data from the video image based tracking system (RPM, Varian, USA) using an external surrogate in order to evaluate its accuracy. For quantitative analysis, we analyzed correlation between two data sets in terms of average cycle (peak to peak), amplitude, and pattern (RMS, root mean square) of motion. Averages for the cycle of motion from IMVS and RPM system were $3.98{\pm}0.11$ (IMVS 3.3 fps), $4.005{\pm}0.001$ (IMVS 6.6 fps), and $3.95{\pm}0.02$ (RPM), respectively, and showed good agreement on real value (4 sec/cycle). Average of the amplitude of motion tracked by our system showed $1.85{\pm}0.02$ cm (3.3 fps) and $1.94{\pm}0.02$ cm (6.6 fps) as showed a slightly different value, 0.15 (7.5% error) and 0.06 (3% error) cm, respectively, compared with the actual value (2 cm), due to time resolution for image acquisition. In analysis of pattern of motion, the value of the RMS from the cine EPID image in 3.3 fps (0.1044) grew slightly compared with data from 6.6 fps (0.0480). The organ motion verification system using sequential cine EPID images with an internal surrogate showed good representation of its motion within 3% error in a preliminary phantom study. The system can be implemented for clinical purposes, which include organ motion verification during treatment, compared with 4D treatment planning data, and its feedback for accurate dose delivery to the moving target.

Integrated Roll-Pitch-Yaw Autopilot via Equivalent Based Sliding Mode Control for Uncertain Nonlinear Time-Varying Missile

  • AWAD, Ahmed;WANG, Haoping
    • International Journal of Aeronautical and Space Sciences
    • /
    • v.18 no.4
    • /
    • pp.688-696
    • /
    • 2017
  • This paper presents an integrated roll-pitch-yaw autopilot using an equivalent based sliding mode control for skid-to-turn nonlinear time-varying missile system with lumped disturbances in its six-equations of motion. The considered missile model are developed to integrate the model uncertainties, external disturbances, and parameters perturbation as lumped disturbances. Moreover, it considers the coupling effect between channels, the variation of missile velocity and parameters, and the aerodynamics nonlinearity. The presented approach is employed to achieve a good tracking performance with robustness in all missile channels simultaneously during the entire flight envelope without demand of accurate modeling or output derivative to avoid the noise existence in the real missile system. The proposed autopilot consisting of a two-loop structure, controls pitch and yaw accelerations, and stabilizes the roll angle simultaneously. The Closed loop stability is studied. Numerical simulation is provided to evaluate performance of the suggested autopilot and to compare it with an existing autopilot in the literature concerning the robustness against the lumped disturbances, and the aforesaid considerations. Finally, the proposed autopilot is integrated in a six degree of freedom flight simulation model to evaluate it with several target scenarios, and the results are shown.

TMC (Tracker Motion Controller) Using Sensors and GPS Implementation and Performance Analysis (센서와 GPS를 이용한 TMC의 구현 및 성능 분석)

  • Ko, Jae-Hong
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.14 no.2
    • /
    • pp.828-834
    • /
    • 2013
  • In this paper, TMC (Tracker Motion Controller) as one of the many research methods for condensing efficiency improvements can be condensed into efficient solar system configuration to improve the power generation efficiency of the castle with Concentrated solar silicon and photovoltaic systems (CPV)experiments using PV systems. Microprocessor used on the solar system, tracing the development of solar altitude and latitude of each is calculated in real time. Also accept the value from the sensor, motor control and communication with the central control system by calculating the value of the current position of the sun, there is a growing burden on the applicability. Through the way the program is appropriate for solar power systems and sensors hybrid-type algorithm was implemented in the ARM core with built-in TMC, Concentrated CPV system compared to the existing PV systems, through the implementation of the TMC in the country's power generation efficiency compared and analyzed. Sensor method using existing experimental results Concentrated solar power systems to communicate the value of GPS location tracking method hybrid solar horizons in the coordinate system of the sun's azimuth and elevation angles calculated by the program in the calculations of astronomy through experimental resultslook clear day at high solar irradiation were shown to have a large difference. Stopped after a certain period of time, the sun appears in the blind spot of the sensor, the sensor error that can occur from climate change, however, do not have a cloudy and clear day solar radiation sensor does not keep track of the position of the sun, rather than the sensor of excellence could be found. It is expected that research is constantly needed for the system with ongoing research for development of solar cell efficiency increases to reduce the production cost of power generation, high efficiency condensing type according to the change of climate with the optimal development of the ability TMC.

Study of Respiration Simulating Phantom using Thermocouple-based Respiration Monitoring Mask (열전쌍마스크를 이용한 호흡모사팬톰 연구)

  • Lim, Sang-Wook;Park, Sung-Ho;Yi, Byong-Yong;Lee, Sang-Hoon;Cho, Sam-Ju;Huh, Hyun-Do;Shin, Seong-Soo;Kim, Jong-Hoon;Lee, Sang-Wook;Kwon, Soo-Il;Choi, Eun-Kyung;Ahn, Seung-Do
    • Radiation Oncology Journal
    • /
    • v.23 no.4
    • /
    • pp.217-222
    • /
    • 2005
  • Purpose: To develop the respiration simulating phantom with thermocouple for evaluating 4D radiotherapy such as gated radiotherapy breathing control radiotherapy and dynamic tumor tracking radiotherapy. Materials and Methods: The respiration monitoring mask(ReMM) with thermocouple was developed to monitor the patient's irregular respiration. The signal from ReMM controls the simulating phantom as organ motion of patients in real-time. The organ and the phantom motion were compared with its respiratory curves to evaluate the simulating phantom. ReMM was used to measure patients' respiration, and the movement of simulating phantom was measured by using $RPM^{(R)}$. The fluoroscope was used to monitor the patient's diaphragm motion. relative to the organ motion, respectively. The standard deviation of discrepancy between the respiratory curve and the organ motion was 8.52% of motion range. Conclusion: Patients felt comfortable with ReMM. The relationship between the signal from ReMM and the organ motion shows strong correlation. The phantom simulates the organ motion in real-time according to the respiratory signal from the ReMM. It is expected that the simulating phantom with ReMM could be used to verify the 4D radiotherapy.

Development of Interactive Media for Dance Education Using Motion Tracking (모션 트래킹을 활용한 무용 교육 인터랙티브 미디어 개발)

  • In-sang Kwak;Da-Young Ju
    • Science of Emotion and Sensibility
    • /
    • v.27 no.3
    • /
    • pp.3-14
    • /
    • 2024
  • This research explores the concept of dance education, which involves educators demonstrating specific movements to students in a practice environment. This study aims to contribute to the emotional development and physical health of children and adolescents and to propose the direction of educational methods through interactive content. Educators explain the movements and describe the emotional context that should be expressed during these movements. This type of education focuses on conveying emotions through movement, acknowledging that dance is more than just precise postures and motions. However, individual imagination differ, and children and adolescents, in particular, may have little experience visualizing emotions. In such limited circumstances, students may focus on physical movements and postures rather than the emotional context they should convey, resulting in dry expressions or expressions that deviate from the intended emotions. This study uses interactive content to help dancers immerse themselves in the emotions associated with specific movements. Virtual content is projected into the practice space, allowing dancers to perceive a virtual environment tailored to specific movements. A body tracking sensor installed in the space recognizes the dancer's body and movements, and real-time particle effects are used to depict the dancer's movements in the virtual graphical environment. This method encourages dancers to perform the necessary movements by immersing them in an emotional experience. This study improves emotional immersion in dance education by reducing the dancer's reliance on his or her imagination alone. It catalyzes transitioning to a different emotional dimension, thereby increasing the effectiveness of dance education. This research involved dance education, which resulted in increased student engagement and concentration. Furthermore, the students recognized the emotional situations that required expression through their body movements, and they were able to express similar emotional content. Furthermore, students demonstrated creativity by incorporating emotions into their physical movements. This research is conducted in stages, each being tested in an educational setting to determine its impact. This step-by-step approach uses validated results as the foundation for subsequent stages, allowing for content expansion and improvement of issues discovered in previous stages. This study aims to contribute to the emotional development and physical health of children and adolescents and to propose the direction of educational methods through interactive content.