• Title/Summary/Keyword: Image Motion Model

Search Result 340, Processing Time 0.03 seconds

Vision-based Target Tracking for UAV and Relative Depth Estimation using Optical Flow (무인 항공기의 영상기반 목표물 추적과 광류를 이용한 상대깊이 추정)

  • Jo, Seon-Yeong;Kim, Jong-Hun;Kim, Jung-Ho;Lee, Dae-Woo;Cho, Kyeum-Rae
    • Journal of the Korean Society for Aeronautical & Space Sciences
    • /
    • v.37 no.3
    • /
    • pp.267-274
    • /
    • 2009
  • Recently, UAVs (Unmanned Aerial Vehicles) are expected much as the Unmanned Systems for various missions. These missions are often based on the Vision System. Especially, missions such as surveillance and pursuit have a process which is carried on through the transmitted vision data from the UAV. In case of small UAVs, monocular vision is often used to consider weights and expenses. Research of missions performance using the monocular vision is continued but, actually, ground and target model have difference in distance from the UAV. So, 3D distance measurement is still incorrect. In this study, Mean-Shift Algorithm, Optical Flow and Subspace Method are posed to estimate the relative depth. Mean-Shift Algorithm is used for target tracking and determining Region of Interest (ROI). Optical Flow includes image motion information using pixel intensity. After that, Subspace Method computes the translation and rotation of image and estimates the relative depth. Finally, we present the results of this study using images obtained from the UAV experiments.

Shoulder Arthrokinematics of Collegiate Ice Hockey Athletes Based on the 3D-2D Model Registration Technique

  • Jeong, Hee Seong;Song, Junbom;Lee, Inje;Kim, Doosup;Lee, Sae Yong
    • Korean Journal of Applied Biomechanics
    • /
    • v.31 no.3
    • /
    • pp.155-161
    • /
    • 2021
  • Objective: There is a lack of studies using the 3D-2D image registration techniques on the mechanism of a shoulder injury for ice hockey players. This study aimed to analyze in vivo 3D glenohumeral joint arthrokinematics in collegiate ice hockey athletes and compare shoulder scaption with or without a hockey stick using the 3D-2D image registration technique. Method: We recruited 12 male elite ice hockey players (age, 19.88 ± 0.65 years). For arthrokinematic analysis of the common shoulder abduction movements of the injury pathogenesis of ice hockey players, participants abducted their dominant arm along the scapular plane and then grabbed a stick using the same motion under C-arm fluoroscopy with 16 frames per second. Computed tomography (CT) scans of the shoulder complex were obtained with a 0.6-mm slice pitch. Data from the humerus translation distances, scapula upward rotation, anterior-posterior tilt, internal to external rotation angles, and scapulohumeral rhythm (SHR) ratio on glenohumeral (GH) joint kinematics were outputted using a MATLAB customized code. Results: The humeral translation in the stick hand compared to the bare hand moved more anterior and more superior until the abduction angle reached 40°. When the GH joint in the stick hand was at the maximal abduction of the scapula, the scapula was externally rotated 2~5° relative to 0°. The SHR ratio relative to the abduction along the scapular plane at 40° indicated a statistically significant difference between the two groups (p < 0.05). Conclusion: With arm loading with the stick, the humeral and scapular kinematics showed a significant correlation in the initial section of the SHR. Although these correlations might be difficult in clinical settings, ice hockey athletes can lead to the movement difference of the scapulohumeral joints with inherent instability.

3D Feature Based Tracking using SVM

  • Kim, Se-Hoon;Choi, Seung-Joon;Kim, Sung-Jin;Won, Sang-Chul
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2004.08a
    • /
    • pp.1458-1463
    • /
    • 2004
  • Tracking is one of the most important pre-required task for many application such as human-computer interaction through gesture and face recognition, motion analysis, visual servoing, augment reality, industrial assembly and robot obstacle avoidance. Recently, 3D information of object is required in realtime for many aforementioned applications. 3D tracking is difficult problem to solve because during the image formation process of the camera, explicit 3D information about objects in the scene is lost. Recently, many vision system use stereo camera especially for 3D tracking. The 3D feature based tracking(3DFBT) which is on of the 3D tracking system using stereo vision have many advantage compare to other tracking methods. If we assumed the correspondence problem which is one of the subproblem of 3DFBT is solved, the accuracy of tracking depends on the accuracy of camera calibration. However, The existing calibration method based on accurate camera model so that modelling error and weakness to lens distortion are embedded. Therefore, this thesis proposes 3D feature based tracking method using SVM which is used to solve reconstruction problem.

  • PDF

Human Activity Recognition Using Spatiotemporal 3-D Body Joint Features with Hidden Markov Models

  • Uddin, Md. Zia;Kim, Jaehyoun
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.10 no.6
    • /
    • pp.2767-2780
    • /
    • 2016
  • Video-based human-activity recognition has become increasingly popular due to the prominent corresponding applications in a variety of fields such as computer vision, image processing, smart-home healthcare, and human-computer interactions. The essential goals of a video-based activity-recognition system include the provision of behavior-based information to enable functionality that proactively assists a person with his/her tasks. The target of this work is the development of a novel approach for human-activity recognition, whereby human-body-joint features that are extracted from depth videos are used. From silhouette images taken at every depth, the direction and magnitude features are first obtained from each connected body-joint pair so that they can be augmented later with motion direction, as well as with the magnitude features of each joint in the next frame. A generalized discriminant analysis (GDA) is applied to make the spatiotemporal features more robust, followed by the feeding of the time-sequence features into a Hidden Markov Model (HMM) for the training of each activity. Lastly, all of the trained-activity HMMs are used for depth-video activity recognition.

A Capturing Algorithm of Moving Object using Single Curvature Trajectory (단일곡률궤적을 이용한 이동물체의 포획 알고리즘)

  • Choi Byoung-Suk;Lee Jang-Myung
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.12 no.2
    • /
    • pp.145-153
    • /
    • 2006
  • An optimal capturing trajectory for a moving object is proposed in this paper based on the observation that a single-curvature path is more accurate than double-or triple-curvature paths. Moving distance, moving time, and trajectory error are major factors considered in deciding an optimal path for capturing the moving object. That is, the moving time and distance are minimized while the trajectory error is maintained as small as possible. The three major factors are compared for the single and the double curvature trajectories to show superiority of the single curvature trajectory. Based upon the single curvature trajectory, a kinematics model of a mobile robot is proposed to follow and capture the moving object, in this paper. A capturing scenario can be summarized as follows: 1. Motion of the moving object has been captured by a CCD camera., 2. Position of the moving object has been estimated using the image frames, and 3. The mobile robot tries to follow the moving object along the single curvature trajectory which matches positions and orientations of the moving object and the mobile robot at the final moment. Effectiveness of the single curvature trajectory modeling and capturing algorithm has been proved, through simulations and real experiments using a 2-DOF wheel-based mobile robot.

Fault Diagnosis and Analysis Based on Transfer Learning and Vibration Signals (전이 학습과 진동 신호를 이용한 설비 고장 진단 및 분석)

  • Yun, Jong Pil;Kim, Min Su;Koo, Gyogwon;Shin, Crino
    • IEMEK Journal of Embedded Systems and Applications
    • /
    • v.14 no.6
    • /
    • pp.287-294
    • /
    • 2019
  • With the automation of production lines in the manufacturing industry, the importance of real-time fault diagnosis of facility is increasing. In this paper, we propose a fault diagnosis algorithm of LM (Linear Motion)-guide based on deep learning using vibration signals. Generally, in order to guarantee the performance of the deep learning, it is necessary to have a sufficient amount of data, but in a manufacturing industry, it is often difficult to obtain enough data due to physical and time constraints. To solve this problem, we propose a convolutional neural networks (CNN) model based on transfer learning. In addition, the spectrogram image is input to the CNN to reflect the frequency characteristic of the vibration signals with time. The performance of fault diagnosis according to various load condition and transfer learning method was compared and evaluated by experiments. The results showed that the proposed algorithm exhibited an excellent performance.

UNCERTAINTIES IN AMV ESTIMATION

  • Sohn, Eun-Ha;Cho, Hee-Je;Ou, Mi-Lim;Kim, Yoon-Jae
    • Proceedings of the KSRS Conference
    • /
    • 2007.10a
    • /
    • pp.153-155
    • /
    • 2007
  • Korea Meteorological Administration (KMA) has operationally produced Atmospheric Motion Vector (AMV) from the consecutive MTSAT-1R satellite image dataset. Comparing with radiosonde data, our current AMV scheme shows more than 10 m/s RMSE. Therefore we need to improve continuously its accuracy. Many AMV producers have stated that the bad performance of the Height Assignment (HA) algorithm is the main reason of degrading the accuracy of AMV. The uncertainties in AMV HA can occur in the algorithm itself, used NWP profiles, and the performance of Radiative Transfer Model (RTM) etc. This study introduces currently operated AMV HA schemes and the impacts of NWP profile data and RTM that these schemes use were investigated. Finally we analyzed the relationship between vectors by vector tracking and heights assigned to each vector by using collocated wind profile dataset with radiosonde data. This study is a preliminary work to improve the accuracy of AMV by removing or decreasing the uncertainties in AMV estimation.

  • PDF

Grounding Line Change of Ronne Ice Shelf, West Antarctica, from 1996 to 2015 Observed by using DDInSAR

  • Han, Soojeong;Han, Hyangsun;Lee, Hoonyol
    • Korean Journal of Remote Sensing
    • /
    • v.34 no.1
    • /
    • pp.17-24
    • /
    • 2018
  • Grounding line of a glacier or ice shelf where ice bottom meets the ocean is sensitive to changes in the polar environment. Recent rapid changes of grounding lines have been observed especially in southwestern Antarctica due to global warming. In this study, ERS-1/2 and Sentinel-1A Synthetic Aperture Radar (SAR) image were interferometrically acquired in 1996 and 2015, respectively, to monitor the movement of the grounding line in the western part of Ronne Ice Shelf near the Antarctic peninsula. Double-Differential Interferometric SAR (DDInSAR) technique was applied to remove gravitational flow signal to detect grounding line from the interferometric phase due to the vertical displacement of the tide. The result showed that ERS-1/2 grounding lines are almost consistent with those from Rignot et al. (2011) which used the similar dataset, confirming the credibility of the data processing. The comparison of ERS-1/2 and Sentinle-1A DDInSAR images showed a grounding line retreat of $1.0{\pm}0.1km$ from 1996 to 2015. It is also proved that the grounding lines based on the 2004 MODIS Mosaic of Antarctica (MOA) images and digital elevation model searching for ice plain near coastal area (Scambos et al., 2017), is not accurate enough especially where there is a ice plain with no tidal motion.

Smart Target Detection System Using Artificial Intelligence (인공지능을 이용한 스마트 표적탐지 시스템)

  • Lee, Sung-nam
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2021.05a
    • /
    • pp.538-540
    • /
    • 2021
  • In this paper, we proposed a smart target detection system that detects and recognizes a designated target to provide relative motion information when performing a target detection mission of a drone. The proposed system focused on developing an algorithm that can secure adequate accuracy (i.e. mAP, IoU) and high real-time at the same time. The proposed system showed an accuracy of close to 1.0 after 100k learning of the Google Inception V2 deep learning model, and the inference speed was about 60-80[Hz] when using a high-performance laptop based on the real-time performance Nvidia GTX 2070 Max-Q. The proposed smart target detection system will be operated like a drone and will be helpful in successfully performing surveillance and reconnaissance missions by automatically recognizing the target using computer image processing and following the target.

  • PDF

Verification of Gated Radiation Therapy: Dosimetric Impact of Residual Motion (여닫이형 방사선 치료의 검증: 잔여 움직임의 선량적 영향)

  • Yeo, Inhwan;Jung, Jae Won
    • Progress in Medical Physics
    • /
    • v.25 no.3
    • /
    • pp.128-138
    • /
    • 2014
  • In gated radiation therapy (gRT), due to residual motion, beam delivery is intended to irradiate not only the true extent of disease, but also neighboring normal tissues. It is desired that the delivery covers the true extent (i.e. clinical target volume or CTV) as a minimum, although target moves under dose delivery. The objectives of our study are to validate if the intended dose is surely delivered to the true target in gRT and to quantitatively understand the trend of dose delivery on it and neighboring normal tissues when gating window (GW), motion amplitude (MA), and CTV size changes. To fulfill the objectives, experimental and computational studies have been designed and performed. A custom-made phantom with rectangle- and pyramid-shaped targets (CTVs) on a moving platform was scanned for four-dimensional imaging. Various GWs were selected and image integration was performed to generate targets (internal target volume or ITV) for planning that included the CTVs and internal margins (IM). The planning was done conventionally for the rectangle target and IMRT optimization was done for the pyramid target. Dose evaluation was then performed on a diode array aligned perpendicularly to the gated beams through measurements and computational modeling of dose delivery under motion. This study has quantitatively demonstrated and analytically interpreted the impact of residual motion including penumbral broadening for both targets, perturbed but secured dose coverage on the CTV, and significant doses delivered in the neighboring normal tissues. Dose volume histogram analyses also demonstrated and interpreted the trend of dose coverage: for ITV, it increased as GW or MA decreased or CTV size increased; for IM, it increased as GW or MA decreased; for the neighboring normal tissue, opposite trend to that of IM was observed. This study has provided a clear understanding on the impact of the residual motion and proved that if breathing is reproducible gRT is secure despite discontinuous delivery and target motion. The procedures and computational model can be used for commissioning, routine quality assurance, and patient-specific validation of gRT. More work needs to be done for patient-specific dose reconstruction on CT images.