• Title/Summary/Keyword: real time motion tracking

Search Result 234, Processing Time 0.027 seconds

Automatic Collection of Production Performance Data Based on Multi-Object Tracking Algorithms (다중 객체 추적 알고리즘을 이용한 가공품 흐름 정보 기반 생산 실적 데이터 자동 수집)

  • Lim, Hyuna;Oh, Seojeong;Son, Hyeongjun;Oh, Yosep
    • The Journal of Society for e-Business Studies
    • /
    • v.27 no.2
    • /
    • pp.205-218
    • /
    • 2022
  • Recently, digital transformation in manufacturing has been accelerating. It results in that the data collection technologies from the shop-floor is becoming important. These approaches focus primarily on obtaining specific manufacturing data using various sensors and communication technologies. In order to expand the channel of field data collection, this study proposes a method to automatically collect manufacturing data based on vision-based artificial intelligence. This is to analyze real-time image information with the object detection and tracking technologies and to obtain manufacturing data. The research team collects object motion information for each frame by applying YOLO (You Only Look Once) and DeepSORT as object detection and tracking algorithms. Thereafter, the motion information is converted into two pieces of manufacturing data (production performance and time) through post-processing. A dynamically moving factory model is created to obtain training data for deep learning. In addition, operating scenarios are proposed to reproduce the shop-floor situation in the real world. The operating scenario assumes a flow-shop consisting of six facilities. As a result of collecting manufacturing data according to the operating scenarios, the accuracy was 96.3%.

SURF based Hair Matching and VR Hair Cutting

  • Sung, Changjo;Park, Kyoungsoo;Chin, Seongah
    • International journal of advanced smart convergence
    • /
    • v.11 no.3
    • /
    • pp.49-55
    • /
    • 2022
  • Hair styling has a significant influence on human social perception. An increasing number of people are learning hair styling and obtaining hair designer licenses. However, it takes a considerable amount of money and time to learn professional hairstyle and beauty techniques for hair styling. Since COVID-19, there has been a growing need for offline and video lectures due to the decline in onsite training opportunities. This study provides a field practice environment in which real hair beauty is performed in a virtual space. Further, the hairstyle that is most similar to the user's hair taken with a webcam or mobile phone is determined through an image matching system using the speeded up robust features (SURF) method. The matching hairstyle was created into a three-dimensional (3D) hair model. The created 3D hair model uses a head-mounted display (HMD) and a controller that enables finger tracking through mapping to reproduce the haircutting scissors' motion while providing a feeling of real hair beauty.

Study on DEVS Based Development that GPS Location Tracking System (DEVS 기반의 GPS 위치추적 시스템 개발에 관한 연구)

  • Seo, Hee Suk;Ju, Seung Hwan;Lee, Eun Jung;Lee, Seung Jae
    • Journal of Korea Society of Digital Industry and Information Management
    • /
    • v.6 no.3
    • /
    • pp.1-8
    • /
    • 2010
  • Recently, the missing due to the heinous crimes occurred in succession has been the focus of attention, so measures for these are urgently needed. So, it is necessary that we need to check and take care the weak like children, women, the elderly with dementia and insane person to prevent these social problems. This study is location-based service that suggests the tracking system and way to guard a family and property from the various risk factors which are possible in our life. To acquire the location of the user who is in motion, a communications network technologies were integrated and the system will be able to be monitoring in real time through the website. So, it is convenient and safe because it is possible to use anywhere. Concretely, it was described around location-based service, GPS system, tracking system, process of the service solution and composition for the system. Also, the way to activate the system will be suggested. The final suggested system was verified the possibility through the placement. With this, i will offer effective measures which is more convenient to use and reliable.

Dynamic Speed Control of a Unicycle Robot (외바퀴 로봇의 동적 속도 제어)

  • Han, In-Woo;Hwang, Jong-Myung;Han, Seong-Ik;Lee, Jangmyung
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.19 no.1
    • /
    • pp.1-9
    • /
    • 2013
  • This paper presents a new control algorithm for dynamic control of a unicycle robot. The unicycle robot motion consists of a pitch that is controlled by an in-wheel motor and a roll that is controlled by a reaction wheel pendulum. The unicycle robot doesn't have any actuator for a yaw axis control, which makes the derivation of the dynamics relatively simple. The Euler-Lagrange equation is applied to derive the dynamic equations of the unicycle robot to implement the dynamic speed control of the unicycle robot. To achieve the real time speed control of the unicycle robot, the sliding mode control and LQ regulator are utilized to guarantee the stability while maintaining the desired speed tracking performance. In the roll controller, the sigmoid-function based sliding mode controller has been adopted to minimize the chattering by the switching function. The LQR controller has been implemented for the pitch control to drive the unicycle robot to follow the desired velocity trajectory in real time using the state variables of pitch angle, angular velocity, angle and angular velocity of the wheel. The control performance of the two control systems form a single dynamic model has been demonstrated by the real experiments.

A Study on Robust Control of Mobile Robot with Single wheel Driving Robot for Process Automation (공정 자동화를 위한 싱글 휠 드라이빙 모바일 로봇의 견실제어에 관한 연구)

  • Shin, Haeng-Bong;Cha, BO-Nam
    • Journal of the Korean Society of Industry Convergence
    • /
    • v.19 no.2
    • /
    • pp.81-87
    • /
    • 2016
  • This paper presents a new approach to control of stable motion of single wheel driving robot system of a pitch that is controlled by an in-wheel motor and a roll that is controlled by a reaction wheel. This robot doesn'thave any actuator for a yaw axis control, which makes the derivation of the dynamics relatively simple. The Lagrange equations was applied to derive the dynamic equations of the one wheel driving robot to implement the dynamic speed control of the mobile robot. To achieve the real time speed control of the unicycle robot, the sliding mode control and optical regulator are utilized to prove the reliability while maintaining the desired speed tracking performance. In the roll controller, the sigmoid-function based robust controller has been adopted to reduce the vibration by the situation function. The optimal controller has been implemented for the pitch control to drive the unicycle robot to follow the desired velocity trajectory in real time using the state variables of pitch angle, angular velocity, angle and angular velocity of the driving wheel. The control performance of the control systems from a single dynamic model has been illustrated by the real experiments.

3D Facial Landmark Tracking and Facial Expression Recognition

  • Medioni, Gerard;Choi, Jongmoo;Labeau, Matthieu;Leksut, Jatuporn Toy;Meng, Lingchao
    • Journal of information and communication convergence engineering
    • /
    • v.11 no.3
    • /
    • pp.207-215
    • /
    • 2013
  • In this paper, we address the challenging computer vision problem of obtaining a reliable facial expression analysis from a naturally interacting person. We propose a system that combines a 3D generic face model, 3D head tracking, and 2D tracker to track facial landmarks and recognize expressions. First, we extract facial landmarks from a neutral frontal face, and then we deform a 3D generic face to fit the input face. Next, we use our real-time 3D head tracking module to track a person's head in 3D and predict facial landmark positions in 2D using the projection from the updated 3D face model. Finally, we use tracked 2D landmarks to update the 3D landmarks. This integrated tracking loop enables efficient tracking of the non-rigid parts of a face in the presence of large 3D head motion. We conducted experiments for facial expression recognition using both framebased and sequence-based approaches. Our method provides a 75.9% recognition rate in 8 subjects with 7 key expressions. Our approach provides a considerable step forward toward new applications including human-computer interactions, behavioral science, robotics, and game applications.

Multiple Moving Object Detection Using Different Algorithms (이종 알고리즘을 융합한 다중 이동객체 검출)

  • Heo, Seong-Nam;Son, Hyeon-Sik;Moon, Byungin
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.40 no.9
    • /
    • pp.1828-1836
    • /
    • 2015
  • Object tracking algorithms can reduce computational cost by avoiding computation over the whole image through the selection of region of interests based on object detection. So, accurate object detection is an important task for object tracking. The background subtraction algorithm has been widely used in moving object detection using a stationary camera. However, it has the problem of object detection error due to incorrect background modeling, whereas the method of background modeling has been improved by many researches. This paper proposes a new moving object detection algorithm to overcome the drawback of the conventional background subtraction algorithm by combining the background subtraction algorithm with the motion history image algorithm that is usually used in gesture detection. Although the proposed algorithm demands more processing time because of time taken for combining two algorithms, it meet the real-time processing requirement. Moreover, experimental results show that it has higher accuracy compared with the previous two algorithms.

Feasibility Study of Robotics-based Patient Immobilization Device for Real-time Motion Compensation

  • Chung, Hyekyun;Cho, Seungryong;Cho, Byungchul
    • Progress in Medical Physics
    • /
    • v.27 no.3
    • /
    • pp.117-124
    • /
    • 2016
  • Intrafractional motion of patients, such as respiratory motion during radiation treatment, is an important issue in image-guided radiotherapy. The accuracy of the radiation treatment decreases as the motion range increases. We developed a control system for a robotic patient immobilization system that enables to reduce the range of tumor motion by compensating the tumor motion. Fusion technology, combining robotics and mechatronics, was developed and applied in this study. First, a small-sized prototype was established for use with an industrial miniature robot. The patient immobilization system consisted of an optical tracking system, a robotic couch, a robot controller, and a control program for managing the system components. A multi speed and position control mechanism with three degrees of freedom was designed. The parameters for operating the control system, such as the coordinate transformation parameters and calibration parameters, were measured and evaluated for a prototype device. After developing the control system using the prototype device, a feasibility test on a full-scale patient immobilization system was performed, using a large industrial robot and couch. The performances of both the prototype device and the realistic device were evaluated using a respiratory motion phantom, for several patterns of respiratory motion. For all patterns of motion, the root mean squared error of the corresponding detected motion trajectories were reduced by more than 40%. The proposed system improves the accuracy of the radiation dose delivered to the target and reduces the unwanted irradiation of normal tissue.

Family of smart tuned mass dampers with variable frequency under harmonic excitations and ground motions: closed-form evaluation

  • Sun, C.;Nagarajaiah, S.;Dick, A.J.
    • Smart Structures and Systems
    • /
    • v.13 no.2
    • /
    • pp.319-341
    • /
    • 2014
  • A family of smart tuned mass dampers (STMDs) with variable frequency and damping properties is analyzed under harmonic excitations and ground motions. Two types of STMDs are studied: one is realized by a semi-active independently variable stiffness (SAIVS) device and the other is realized by a pendulum with an adjustable length. Based on the feedback signal, the angle of the SAIVS device or the length of the pendulum is adjusted by using a servomotor such that the frequency of the STMD matches the dominant excitation frequency in real-time. Closed-form solutions are derived for the two types of STMDs under harmonic excitations and ground motions. Results indicate that a small damping ratio (zero damping is the best theoretically) and an appropriate mass ratio can produce significant reduction when compared to the case with no tuned mass damper. Experiments are conducted to verify the theoretical result of the smart pendulum TMD (SPTMD). Frequency tuning of the SPTMD is implemented through tracking and analyzing the signal of the excitation using a short time Fourier transformation (STFT) based control algorithm. It is found that the theoretical model can predict the structural responses well. Both the SAIVS STMD and the SPTMD can significantly attenuate the structural responses and outperform the conventional passive TMDs.

Tracking of ARPA Radar Signals Based on UK-PDAF and Fusion with AIS Data

  • Chan Woo Han;Sung Wook Lee;Eun Seok Jin
    • Journal of Ocean Engineering and Technology
    • /
    • v.37 no.1
    • /
    • pp.38-48
    • /
    • 2023
  • To maintain the existing systems of ships and introduce autonomous operation technology, it is necessary to improve situational awareness through the sensor fusion of the automatic identification system (AIS) and automatic radar plotting aid (ARPA), which are installed sensors. This study proposes an algorithm for determining whether AIS and ARPA signals are sent to the same ship in real time. To minimize the number of errors caused by the time series and abnormal phenomena of heterogeneous signals, a tracking method based on the combination of the unscented Kalman filter and probabilistic data association filter is performed on ARPA radar signals, and a position prediction method is applied to AIS signals. Especially, the proposed algorithm determines whether the signal is for the same vessel by comparing motion-related components among data of heterogeneous signals to which the corresponding method is applied. Finally, a measurement test is conducted on a training ship. In this process, the proposed algorithm is validated using the AIS and ARPA signal data received by the voyage data recorder for the same ship. In addition, the proposed algorithm is verified by comparing the test results with those obtained from raw data. Therefore, it is recommended to use a sensor fusion algorithm that considers the characteristics of sensors to improve the situational awareness accuracy of existing ship systems.