• The Journal of Korea Robotics Society
• /
• v.16 no.3
• /
• pp.245-249
• /
• 2021

In this paper, we present novel simulation contents for drone racing and autonomous flight of drone. With Depth camera and SLAM, we conducted mapping 3 dimensional environment through RTAB-map. The 3 dimensional map is represented by point cloud data. After that we recovered this data in Unreal Engine. This recovered raw data reflects real data that includes noise and outlier. Also we built drone racing contents like gate and obstacles for evaluating drone flight in Unreal Engine. Then we implemented both HITL and SITL by using AirSim which offers flight controller and ROS api. Finally we show autonomous flight of drone with ROS and AirSim. Drone can fly in real place and sensor property so drone experiences real flight even in the simulation world. Our simulation framework increases practicality than other common simulation that ignore real environment and sensor.

• Journal of Broadcast Engineering
• /
• v.15 no.6
• /
• pp.723-730
• /
• 2010

Recently, diverse 3D image processing technologies have been applied in industries. Among them, stereoscopic conversion is a technology to generate a stereoscopic image from a conventional 2D image. The technology can be applied to movie and broadcasting contents and the viewer can watch 3D stereoscopic contents. Further the stereoscopic conversion is required to be applied to other fields. Following such trend, the aim of this paper is to apply the stereoscopic conversion to medical fields. The medical images can deliver more detailed 3D information with a stereoscopic image compared with a 2D plane image. This paper presents a novel methodology for converting a 2D medical image into a 3D stereoscopic image. For this, mean shift segmentation, edge detection, intensity analysis, etc are utilized to generate a final depth map. From an image and the depth map, left and right images are constructed. In the experiment, the proposed method is performed on a medical image such as CT (Computed Tomograpy). The stereoscopic image displayed on a 3D monitor shows a satisfactory performance.

• Korean Journal of Remote Sensing
• /
• v.39 no.6_1
• /
• pp.1245-1254
• /
• 2023

Significant research has been conducted on the W-band synthetic aperture radar (SAR) system that utilizes the 77 GHz frequency modulation continuous wave (FMCW) radar. To reconstruct the high-resolution W-band SAR image, it is necessary to transform the point cloud acquired from the stereo cameras or the LiDAR in the direction of 6 degrees of freedom (DOF) and apply them to the SAR signal processing. However, there are difficulties in matching images due to the different geometric structures of images acquired from different sensors. In this study, we present the method to extract an optimized depth map by obtaining 6 DOF of the point cloud using a gradient descent method based on the entropy of the SAR image. An experiment was conducted to reconstruct a tree, which is a major road environment object, using the constructed W-band SAR system. The SAR image, reconstructed using the entropy-based gradient descent method, showed a decrease of 53.2828 in mean square error and an increase of 0.5529 in the structural similarity index, compared to SAR images reconstructed from radar coordinates.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2009.11a
• /
• pp.77-80
• /
• 2009

3차원 영상 처리 기술과 3차원 디스플레이의 발전은 3차원 영상 시장의 빠른 발전을 가져왔고 차세대 방송 기술로 큰 관심을 받고 있다. 하지만 3차원 영상은 시청할 때 눈의 피로, 어지럼증과 같은 현상이 일어날 수 있으며, 왜곡된 3차원 영상이 인체에 해로운 영향을 미칠 수도 있다. 이는 3차원 영상 산업의 활성화를 위해서 가장 시급히 해결되어야 할 문제이다. 현재 3차원 디스플레이는 스테레오 방식과 함께 1view 1depth 다시점 방식이 개발되었다. 특히 1view 1depth 다시점 디스플레이에서 깊이 영상의 공간적/시간적으로 복잡한 정도는 피로감을 일으키는 주요 요소이며 이는 1view 1depth 영상을 통해 직접 연구할 수 있다. 본 논문에서는 1view 1depth 디스플레이에서 주관적인 피로도와 큰 상관도를 가지는 깊이 영상의 특성 측정 방법을 제안한다. 1view 1depth 디스플레이에서 view 영상은 양호한 화질을 가정하였으며 피로감에 큰 영향을 미치는 깊이 영상 정보만 사용하여 공간적, 시간적인 특성을 분석한다. 공간적 복잡도는 각 프레임에 대하여 깊이 영상 내 화소 값의 분산 값을 취하여 공간적으로 깊이 값의 분포와 구조의 복잡한 정도를 측정하고, 시간적 복잡도는 연속적인 프레임에 대하여 동일한 화소위치에서 화소 값 차이의 분산 값을 사용한다. 또한 공간적/시간적 평균값의 측정하여 피로감에 영향을 주는 요인으로 사용하였다. 결과적으로 측정한 값들을 바탕으로 주관적인 피로도 평가와 유사성을 가지도록 모델링하여 3차원 영상의 피로도를 예측한다.

• Journal of Broadcast Engineering
• /
• v.19 no.4
• /
• pp.533-546
• /
• 2014

This paper presents a method for a hybrid (color and depth) camera system construction using a photogrammetric technology. A TOF depth camera is efficient since it measures range information of objects in real-time. However, there are some problems of the TOF depth camera such as low resolution and noise due to surface conditions. Therefore, it is essential to not only correct depth noise and distortion but also construct the hybrid camera system providing a high resolution texture map for generating a 3D model using the depth camera. We estimated geometry of the hybrid camera using a traditional relative orientation algorithm and performed texture mapping using backward mapping based on a condition of collinearity. Other algorithm was compared to evaluate performance about the accuracy of a model and texture mapping. The result showed that the proposed method produced the higher model accuracy.

• Journal of Biosystems Engineering
• /
• v.41 no.4
• /
• pp.304-312
• /
• 2016

Purpose: Soil strength has been measured using a cone penetrometer, which is making it difficult to obtain the spatial data required for precision agriculture. Our objectives were to evaluate real-time horizontal soil strength (RHSS) to measure soil strength in real time while moving across the field. Using the RHSS data, the tillage depth was determined, and the power consumption of a tractor and rotavators were compared. Methods: The horizontal soil-strength index (HSSI) obtained by the RHSS was compared with the cone index (CI), which was measured using a cone penetrometer. Comparison analysis in accordance with the measurement depth that increased at 5-cm interval was conducted using kriged maps at six sensing depths. For tillage control and evaluation of the power consumption, the system was installed with a potentiometer for tillage depth, a torque sensor from the rear axle, and a power take-off (PTO) shaft. Results: The HSSI was lower than the CI, but they were the same at 54.81% of the total grids for the 5-cm depth and at 3.85% for the 10-cm depth. In accordance with the recommended tillage map, tillage operations between 0 and 15 cm left 2.3% and 7% residue cover on the soil, and that between 20 and 10 cm covered a wider utilization of 3% and 18.4%, respectively. When the tillage depth was 15 cm, the comparison result of the power requirements between the PTO and rear axle in terms of control performance revealed that the maximum power requirements of the axle and PTO were 44.63 and 23.24 kW, respectively. Conclusions: An HSSI measurement system was evaluated by comparison with the conventional soil strength measurement system (CI) and applied to a tractor to compare the tillage power consumption. Further study is needed on its application to various farm works using a tractor for precision agriculture.

• JSTS:Journal of Semiconductor Technology and Science
• /
• v.12 no.2
• /
• pp.127-138
• /
• 2012

In this paper, we propose a real-time virtual re-convergence hardware platform especially to reduce the visual fatigue caused by stereoscopy. Our unique idea to reduce visual fatigue is to utilize the virtual re-convergence based on the optimized disparity-map that contains more depth information in the negative disparity area than in the positive area. Our virtual re-convergence hardware platform, which consists of image rectification, disparity estimation, depth post-processing, and virtual view control, is realized in real time with 60 fps on a single Xilinx Virtex-5 FPGA chip.

• The Journal of Korea Robotics Society
• /
• v.12 no.3
• /
• pp.249-257
• /
• 2017

This paper proposes a method to segment urban scenes semantically based on location prior information. Since major scene elements in urban environments such as roads, buildings, and vehicles are often located at specific locations, using the location prior information of these elements can improve the segmentation performance. The location priors are defined in special 2D coordinates, referred to as road-normal coordinates, which are perpendicular to the orientation of the road. With the help of depth information to each element, all the possible pixels in the image are projected into these coordinates and the learned prior information is applied to those pixels. The proposed location prior can be modeled by defining a unary potential of a conditional random field (CRF) as a sum of two sub-potentials: an appearance feature-based potential and a location potential. The proposed method was validated using publicly available KITTI dataset, which has urban images and corresponding 3D depth measurements.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2016.06a
• /
• pp.228-230
• /
• 2016

In this paper, we introduce new FRUC method for Multi-View Video based on DIBR (Depth Image based Rendering, DIBR). In the proposed method, we divide each block to sub-regions using depth map. Then, we reconstruct occlusion region information at each sub-regions by using other views. With reconstructed occlusion region information, we estimate and compensate each sub-regions' motion. The proposed method estimates more accurate motion compared to the conventional methods in occlusion region.

• Journal of Korea Multimedia Society
• /
• v.15 no.4
• /
• pp.501-507
• /
• 2012

Human body motion is a non-verbal part for interaction or movement that can be used to involves real world and virtual world. In this paper, we explain a study on natural user interface (NUI) in human hand motion recognition using RGB color information and depth information by Kinect camera from Microsoft Corporation. To achieve the goal, hand tracking and gesture recognition have no major dependencies of the work environment, lighting or users' skin color, libraries of particular use for natural interaction and Kinect device, which serves to provide RGB images of the environment and the depth map of the scene were used. An improved Camshift tracking algorithm is used to tracking hand motion, the experimental results show out it has better performance than Camshift algorithm, and it has higher stability and accuracy as well.