• Journal of Auto-vehicle Safety Association
• /
• v.13 no.4
• /
• pp.7-13
• /
• 2021

This paper presents an vulnerable road user (VRU) classification and tracking algorithm using vision and LiDAR sensor fusion method for urban autonomous driving. The classification and tracking for vulnerable road users such as pedestrian, bicycle, and motorcycle are essential for autonomous driving in complex urban environments. In this paper, a real-time object image detection algorithm called Yolo and object tracking algorithm from LiDAR point cloud are fused in the high level. The proposed algorithm consists of four parts. First, the object bounding boxes on the pixel coordinate, which is obtained from YOLO, are transformed into the local coordinate of subject vehicle using the homography matrix. Second, a LiDAR point cloud is clustered based on Euclidean distance and the clusters are associated using GNN. In addition, the states of clusters including position, heading angle, velocity and acceleration information are estimated using geometric model free approach (GMFA) in real-time. Finally, the each LiDAR track is matched with a vision track using angle information of transformed vision track and assigned a classification id. The proposed fusion algorithm is evaluated via real vehicle test in the urban environment.

• ETRI Journal
• /
• v.29 no.4
• /
• pp.411-420
• /
• 2007

The steady evolution of mapping technology is leading to an increasing availability of multi-sensory geo-spatial datasets, such as data acquired by single-head frame cameras, multi-head frame cameras, line cameras, and light detection and ranging systems, at a reasonable cost. The complementary nature of the data collected by these systems makes their integration to obtain a complete description of the object space. However, such integration is only possible after accurate co-registration of the collected data to a common reference frame. The registration can be carried out reliably through a triangulation procedure which considers the characteristics of the involved data. This paper introduces algorithms for a multi-primitive and multi-sensory triangulation environment, which is geared towards taking advantage of the complementary characteristics of spatial data available from the above mentioned sensors. The triangulation procedure ensures the alignment of involved data to a common reference frame. The devised methodologies are tested and proven efficient through experiments using real multi-sensory data.

• Proceedings of the Korea Contents Association Conference
• /
• 2008.05a
• /
• pp.449-452
• /
• 2008

The building heights of big cities which charged with most space are 3-D information as relative vertical distance from ground control points, but they didn't know the heights using contour with maps as lose of skyline or building heights for downtown, practically continuously developed of many technology methods for implementation of 3-D spatial earth. So, For the view as stereos of variety earth form generated 3-D spatial and made terrain perspective map, 3-D simulated of regional and urban space as aviation images. In this papers, it composited geospatial informations and images by DEM generation, and developed and presented for techniques overlay of CAD data and photos captured at our surroundings uses. Particularly, The airborne LiDAR surveying which are very interesting trend have laser scanning sensor and determine the ground heights through detecting angle and range to the grounds, and then designated 3-D spatial composite and simulation from urban areas. Therefore in this papers are suggested ease selections on the users situation by compare as various simulations that its generation of 3-D spatial image by collective for downtown space and urban sub, and the implementation methods for more accurate, more select for the best images.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.24 no.5
• /
• pp.584-590
• /
• 2020

Long-term use of digital screens in daily life can lead to computer vision syndrome including symptoms such as eye strain, dry eyes, and headaches. To prevent computer vision syndrome, it is important to limit screen usage time and take frequent breaks. There are a variety of applications that can help users know the screen usage time. However, these apps are limited because users see various screens such as desktops, laptops, and tablets as well as smartphone screens. In this paper, we propose and evaluate machine learning-based models that detect the screen device in use using color, IMU and lidar sensor data. Our evaluation shows that neural network-based models show relatively high F1 scores compared to traditional machine learning models. Among neural network-based models, the MLP and CNN-based models have higher scores than the LSTM-based model. The RF model shows the best result among the traditional machine learning models, followed by the SVM model.

• Proceedings of the KSRS Conference
• /
• 2005.10a
• /
• pp.79-82
• /
• 2005

Recently the necessity of road data is still being increased in industrial society, so there are many repairing and new constructions of roads at many areas. According to the development of government, city and region, the update and acquisition of road data for GIS (Geographical Information System) is very necessary. In this study, the fusion method with range data(3D Ground Coordinate System Data) and Intensity data in stand alone LiDAR data is used for road extraction and then digital image processing method is applicable. Up to date Intensity data of LiDAR is being studied. This study shows the possibility method for road extraction using Intensity data. Intensity and Range data are acquired at the same time. Therefore LiDAR does not have problems of multi-sensor data fusion method. Also the advantage of intensity data is already geocoded, same scale of real world and can make ortho-photo. Lastly, analysis of quantitative and quality is showed with extracted road image which compare with I: 1,000 digital map.

• Electronics and Telecommunications Trends
• /
• v.27 no.6
• /
• pp.134-143
• /
• 2012

지구과학 및 우주 탐사를 목적으로 지속적으로 발전해 온 라이다 센서 기술은 현재 항공기 및 위성에 탑재되어 정밀한 지구 지형 및 환경 관측을 위한 주요 수단으로 사용되고 있으며, 우주 정거장과 우주선의 도킹 시스템, 우주 탐사 로봇에 활용되고 있다. 지상에서는 원거리 거리 측정, 자동차 속도 위반 단속 등을 위한 간단한 형태의 라이다 센서를 비롯하여 최근에는 3차원 영상 복원을 위한 레이저 스캐너, 미래 무인자동차를 위한 3차원 영상 센서의 핵심 기술로 활용되면서 그 활용성과 중요성이 점차 증가되고 있다. 본고에서는 라이다 센서의 기본 원리 및 종류, 최근 영상 라이다 센서 기술동향, 응용 분야의 몇 가지 예를 요약하여 소개함으로써, 국내 기반 기술 및 상용화 개발이 취약한 라이다 센서에 대한 이해를 돕고자 한다.

• Proceedings of the Korean Association of Geographic Inforamtion Studies Conference
• /
• 2008.06a
• /
• pp.400-404
• /
• 2008

라이다는 데이터 획득의 신속성과 처리의 자동화라는 장점을 가지고 있어서 도시 모델의 생성, 변화탐지(Change Detection), 삼림지역의 DTM(Digital Terrain Model)의 생성, 등고선 추출, 나무의 높이 결정을 통한 산림관리, 해안 지형의 관리 등 다양한 분야에서 활용이 되고 있다. 이와 같이 라이다데이터 활용에 대한 많은 연구가 이루어지면서 다양한 처리 알고리즘이 개발되고 있다. 알고리즘을 개발하고 그 성능을 정확하게 평가를 위해서는 알고리즘을 다양한 형태의 시험데이터에 적용해 보아야 하지만, 성능평가를 위해 다양한 실측 데이터를 획득하기는 어려운 실정이다. 본 연구에서는 개발된 알고리즘의 성능평가를 위한 다양한 모의데이터를 실제 DEM으로부터 시뮬레이션을 통해 생성하는 방법을 제안한다 라이다 시스템에 대한 기하학적 모델링하여 센서방정식을 유도하고, 이를 기반으로 DEM상에서 플랫폼의 이동경로에 따라 취득되는 모의 라이다데이터를 생성한다. 본 연구에서 제안하는 시뮬레이션을 이용하면 라이터데이터를 이용하는 다양한 활용 알고리즘 개발과 경제적이고 정확한 성능평가에 도움이 될 것이다.

• Journal of the Korea Institute of Military Science and Technology
• /
• v.20 no.6
• /
• pp.733-742
• /
• 2017

LADARs are used for important sensors in various applications, for example, terrain information sensors in self driving cars, safety sensors for factory automation, and 3D map constructions. This study develop important component technologies to improve the performance of a LADAR system under development in Korea. The component technologies include diode temperature regulation, reducing distance error in outdoor environment, and signal processing technique for better detection of distant objects. This paper explains the suggested component technologies and experimental results of the developed LADAR system. Also, the developed system is operated and tested an a single axis driving platform to acquire 3D information from 2D LADAR.

• Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
• /
• v.37 no.5
• /
• pp.315-322
• /
• 2019

DSM (Digital Surface Model) is a digital representation of ground surface topography or terrain that is widely used for hydrology, slope analysis, and urban planning. Aerial photogrammetry and LiDAR (Light Detection And Ranging) are main technology for urban DSM generation but high-resolution satellite imagery is the only ingredient for remote inaccessible areas. Traditional automated DSM generation method is based on correlation-based methods but recent study shows that a modern pixelwise image matching method, SGM (Semi-Global Matching) can be an alternative. Therefore this study investigated the application of SGM for Kompsat satellite data of KARI (Korea Aerospace Research Institute). Firstly, the sensor modeling was carried out for precise ground-to-image computation, followed by the epipolar image resampling for efficient stereo processing. Secondly, SGM was applied using different parameterizations. The generated DSM was evaluated with a reference DSM generated by the first pulse returns of the LIDAR reference dataset.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2022.11a
• /
• pp.884-886
• /
• 2022

본 논문에서는 GPS 기반의 자율주행 군사로봇에 사용된 각종 센서들의 융합(Sensor Fusion)에 대하여 다루고 있다. GPS 를 통한 자율주행의 경우 GPS 의 성능에 따라 정확도 차이는 있으나 특별한 지형지물 없이 로봇의 현재 위치를 파악할 수 있다는 장점이 있다. 하지만 GPS 만 이용하여 자율주행 알고리즘을 구성하는 경우 로봇의 진행 방향을 특정하지 못한다는 문제점이 발생한다. 이를 해결하기 위하여 본 논문에서는 RTK GPS 와 Lidar, IMU 센서를 ROS 환경에서 Robot_Localization 과 EKF(Extended Kalman Filter)를 이용하여 융합하는 방법에 대하여 다루었다.