• Title/Summary/Keyword: object-based 3-D model

Search Result 334, Processing Time 0.027 seconds

Real-Time Earlobe Detection System on the Web

  • Kim, Jaeseung;Choi, Seyun;Lee, Seunghyun;Kwon, Soonchul
    • International journal of advanced smart convergence
    • /
    • v.10 no.4
    • /
    • pp.110-116
    • /
    • 2021
  • This paper proposed a real-time earlobe detection system using deep learning on the web. Existing deep learning-based detection methods often find independent objects such as cars, mugs, cats, and people. We proposed a way to receive an image through the camera of the user device in a web environment and detect the earlobe on the server. First, we took a picture of the user's face with the user's device camera on the web so that the user's ears were visible. After that, we sent the photographed user's face to the server to find the earlobe. Based on the detected results, we printed an earring model on the user's earlobe on the web. We trained an existing YOLO v5 model using a dataset of about 200 that created a bounding box on the earlobe. We estimated the position of the earlobe through a trained deep learning model. Through this process, we proposed a real-time earlobe detection system on the web. The proposed method showed the performance of detecting earlobes in real-time and loading 3D models from the web in real-time.

Construction and Effectiveness Evaluation of Multi Camera Dataset Specialized for Autonomous Driving in Domestic Road Environment (국내 도로 환경에 특화된 자율주행을 위한 멀티카메라 데이터 셋 구축 및 유효성 검증)

  • Lee, Jin-Hee;Lee, Jae-Keun;Park, Jaehyeong;Kim, Je-Seok;Kwon, Soon
    • IEMEK Journal of Embedded Systems and Applications
    • /
    • v.17 no.5
    • /
    • pp.273-280
    • /
    • 2022
  • Along with the advancement of deep learning technology, securing high-quality dataset for verification of developed technology is emerging as an important issue, and developing robust deep learning models to the domestic road environment is focused by many research groups. Especially, unlike expressways and automobile-only roads, in the complex city driving environment, various dynamic objects such as motorbikes, electric kickboards, large buses/truck, freight cars, pedestrians, and traffic lights are mixed in city road. In this paper, we built our dataset through multi camera-based processing (collection, refinement, and annotation) including the various objects in the city road and estimated quality and validity of our dataset by using YOLO-based model in object detection. Then, quantitative evaluation of our dataset is performed by comparing with the public dataset and qualitative evaluation of it is performed by comparing with experiment results using open platform. We generated our 2D dataset based on annotation rules of KITTI/COCO dataset, and compared the performance with the public dataset using the evaluation rules of KITTI/COCO dataset. As a result of comparison with public dataset, our dataset shows about 3 to 53% higher performance and thus the effectiveness of our dataset was validated.

Anti-sway and Position 3D Control of the Nonlinear Crane System using Fuzzy Algorithm

  • Lee, Tae-Young;Lee, Sang-Ryong
    • International Journal of Precision Engineering and Manufacturing
    • /
    • v.3 no.1
    • /
    • pp.66-75
    • /
    • 2002
  • The crane operation used fur transporting heavy loads causes a swinging motion with the loads due to the crane\`s acceleration and deceleration. This sway causes the suspension ropes to leave their grooves and can cause serious damage. Ideally, the purpose of a crane system is to transport loads to a goal position as soon as possible without any oscillation of the rope. Currently, cranes are generally operated based on expert knowledge alone, accordingly, the development of a satisfactory control method that can efficiently suppress object sway during transport is essential. The dynamic behavior of a crane shows nonlinear characteristics. When the length of the rope is changed, a crane becomes a time-varying system thus the design of an anti-sway controller is very difficult. In this paper, a nonlinear dynamic model is derived for an industrial overhead crane whose girder, trolley, and hoister move simultaneously. Furthermore, a fuzzy logic controller, based on expert experiments during acceleration, constant velocity, deceleration, and stop position periods is proposed to suppress the swing motion and control the position of the crane. Computer simulation is then used to test the performance of the fuzzy controller with the nonlinear crane model.

A Study on the YCbCr Color Model and the Rough Set for a Robust Face Detection Algorithm (강건한 얼굴 검출 알고리즘을 위한 YCbCr 컬러 모델과 러프 집합 연구)

  • Byun, Oh-Sung
    • Journal of the Korea Society of Computer and Information
    • /
    • v.16 no.7
    • /
    • pp.117-125
    • /
    • 2011
  • In this paper, it was segmented the face color distribution using YCbCr color model, which is one of the feature-based methods, and preprocessing stage was to be insensitive to the sensitivity for light which is one of the disadvantages for the feature-based methods by the quantization. In addition, it has raised the accuracy of image synthesis with characteristics which is selected the object of the most same image as the shape of pattern using rough set. In this paper, the detection rates of the proposed face detection algorithm was confirmed to be better about 2~3% than the conventional algorithms regardless of the size and direction on the various faces by simulation.

Spherical-Coordinate-Based Guiding System for Automatic 3D Shape Scanning (3D 형상정보 자동 수집을 위한 구면좌표계식 스캐닝 시스템)

  • Park, Sang Wook;Maeng, Hee-Young;Lee, Myoung Sang;Kwon, Kil Sun;Na, Mi-Sun
    • Transactions of the Korean Society of Mechanical Engineers A
    • /
    • v.38 no.9
    • /
    • pp.1029-1036
    • /
    • 2014
  • Several types of automatic 3D scanners are available for use in the 3D scanning industry, e.g., an automatic 3D scanner that uses a robot arm and one that uses an automatic rotary table. Specifically, these scanners are used to obtain a 3D shape using automatic assisting devices. Most of these scanners are required to perform numerous operations, such as merging, aligning, trimming, and filling holes. We are interested in developing an automatic 3D shape collection device using a spherical-coordinate-based guiding system. Then, the aim of the present study is to design an automatic guiding system that can automatically collect 3D shape data. We develop a 3D model of this system and measuring data which are collected by a personal computer. An optimal design of this system and the geometrical accuracy of the measured data are both evaluated using 3D modeling software. The developed system is then applied to an object having a highly complex shape and manifold sections. Our simulation results demonstrate that the developed system collects higher-quality 3D data than the conventional method.

A Development of a Framework for Building Knowledge based Augmented Reality System (지식기반 증강현실 시스템 구축을 위한 프레임워크 개발)

  • Woo, Chong-Woo;Lee, Doo-Hee
    • Journal of the Korea Society of Computer and Information
    • /
    • v.16 no.7
    • /
    • pp.49-58
    • /
    • 2011
  • Augmented Reality(AR) assists human's cognitive ability through the information visualization by substantiating information about virtual situation. This technology is studied in a variety of ways including education, design, industry, and so on, by various supply of information devices equipped with cameras and display monitors. Since the most of the AR system depends on limited interaction that responds to the order from user, it can not reflect diverse real world situation. In this study, we suggest a knowledge based augmented reality system, which is composed of context awareness agent that provides recognized context information, along with knowledge based component that provides intelligent capability by utilizing domain knowledges. With this capability, the augmented object can generate dynamic model intelligently by reflecting context information, and can make the interaction possible among the multiple objects. We developed rule based context awareness system along with 3D model generation, and tested interaction among the augmented objects. And we suggest a framework that can provide a convenient way of developing augmented reality system for user.

Tracking Moving Object using Hierarchical Search Method (계층적 탐색기법을 이용한 이동물체 추적)

  • 방만식;김태식;김영일
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.7 no.3
    • /
    • pp.568-576
    • /
    • 2003
  • This paper proposes a moving object tracking algorithm by using hierarchical search method in dynamic scenes. Proposed algorithm is based on two main steps: generation step of initial model from different pictures, and tracking step of moving object under the time-yawing scenes. With a series of this procedure, tracking process is not only stable under far distance circumstance with respect to the previous frame but also reliable under shape variation from the 3-dimensional(3D) motion and camera sway, and consequently, by correcting position of moving object, tracking time is relatively reduced. Partial Hausdorff distance is also utilized as an estimation function to determine the similarity between model and moving object. In order to testify the performance of proposed method, the extraction and tracking performance have tested using some kinds of moving car in dynamic scenes. Experimental results showed that the proposed algorithm provides higher performance. Namely, matching order is 28.21 times on average, and considering the processing time per frame, it is 53.21ms/frame. Computation result between the tracking position and that of currently real with respect to the root-mean-square(rms) is 1.148. In the occasion of different vehicle in terms of size, color and shape, tracking performance is 98.66%. In such case as background-dependence due to the analogy to road is 95.33%, and total average is 97%.

AI-Based Object Recognition Research for Augmented Reality Character Implementation (증강현실 캐릭터 구현을 위한 AI기반 객체인식 연구)

  • Seok-Hwan Lee;Jung-Keum Lee;Hyun Sim
    • The Journal of the Korea institute of electronic communication sciences
    • /
    • v.18 no.6
    • /
    • pp.1321-1330
    • /
    • 2023
  • This study attempts to address the problem of 3D pose estimation for multiple human objects through a single image generated during the character development process that can be used in augmented reality. In the existing top-down method, all objects in the image are first detected, and then each is reconstructed independently. The problem is that inconsistent results may occur due to overlap or depth order mismatch between the reconstructed objects. The goal of this study is to solve these problems and develop a single network that provides consistent 3D reconstruction of all humans in a scene. Integrating a human body model based on the SMPL parametric system into a top-down framework became an important choice. Through this, two types of collision loss based on distance field and loss that considers depth order were introduced. The first loss prevents overlap between reconstructed people, and the second loss adjusts the depth ordering of people to render occlusion inference and annotated instance segmentation consistently. This method allows depth information to be provided to the network without explicit 3D annotation of the image. Experimental results show that this study's methodology performs better than existing methods on standard 3D pose benchmarks, and the proposed losses enable more consistent reconstruction from natural images.

Real-Time Face Tracking Algorithm Robust to illumination Variations (조명 변화에 강인한 실시간 얼굴 추적 알고리즘)

  • Lee, Yong-Beom;You, Bum-Jae;Lee, Seong-Whan;Kim, Kwang-Bae
    • Proceedings of the KIEE Conference
    • /
    • 2000.07d
    • /
    • pp.3037-3040
    • /
    • 2000
  • Real-Time object tracking has emerged as an important component in several application areas including machine vision. surveillance. Human-Computer Interaction. image-based control. and so on. And there has been developed various algorithms for a long time. But in many cases. they have showed limited results under uncontrolled situation such as illumination changes or cluttered background. In this paper. we present a novel. computationally efficient algorithm for tracking human face robustly under illumination changes and cluttered backgrounds. Previous algorithms usually defines color model as a 2D membership function in a color space without consideration for illumination changes. Our new algorithm developed here. however. constructs a 3D color model by analysing plenty of images acquired under various illumination conditions. The algorithm described is applied to a mobile head-eye robot and experimented under various uncontrolled environments. It can track an human face more than 100 frames per second excluding image acquisition time.

  • PDF

Geometric Regualrization of Irregular Building Polygons: A Comparative Study

  • Sohn, Gun-Ho;Jwa, Yoon-Seok;Tao, Vincent;Cho, Woo-Sug
    • Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
    • /
    • v.25 no.6_1
    • /
    • pp.545-555
    • /
    • 2007
  • 3D buildings are the most prominent feature comprising urban scene. A few of mega-cities in the globe are virtually reconstructed in photo-realistic 3D models, which becomes accessible by the public through the state-of-the-art online mapping services. A lot of research efforts have been made to develop automatic reconstruction technique of large-scale 3D building models from remotely sensed data. However, existing methods still produce irregular building polygons due to errors induced partly by uncalibrated sensor system, scene complexity and partly inappropriate sensor resolution to observed object scales. Thus, a geometric regularization technique is urgently required to rectify such irregular building polygons that are quickly captured from low sensory data. This paper aims to develop a new method for regularizing noise building outlines extracted from airborne LiDAR data, and to evaluate its performance in comparison with existing methods. These include Douglas-Peucker's polyline simplication, total least-squared adjustment, model hypothesis-verification, and rule-based rectification. Based on Minimum Description Length (MDL) principal, a new objective function, Geometric Minimum Description Length (GMDL), to regularize geometric noises is introduced to enhance the repetition of identical line directionality, regular angle transition and to minimize the number of vertices used. After generating hypothetical regularized models, a global optimum of the geometric regularity is achieved by verifying the entire solution space. A comparative evaluation of the proposed geometric regulator is conducted using both simulated and real building vectors with various levels of noise. The results show that the GMDL outperforms the selected existing algorithms at the most of noise levels.