• The Journal of the Korea institute of electronic communication sciences
• /
• v.18 no.6
• /
• pp.1307-1312
• /
• 2023

In this paper, we propose a hybrid camera system that combines cameras with different focal lengths and LiDAR (Light Detection and Ranging) sensors to address the core components of autonomous driving perception technology, which include object recognition and distance measurement. We extract objects within the scene and generate precise location and distance information for these objects using the proposed hybrid camera system. Initially, we employ the YOLO7 algorithm, widely utilized in the field of autonomous driving due to its advantages of fast computation, high accuracy, and real-time processing, for object recognition within the scene. Subsequently, we use multi-focal cameras to create depth maps to generate object positions and distance information. To enhance distance accuracy, we integrate the 3D distance information obtained from LiDAR sensors with the generated depth maps. In this paper, we introduce not only an autonomous vehicle platform capable of more accurately perceiving its surroundings during operation based on the proposed hybrid camera system, but also provide precise 3D spatial location and distance information. We anticipate that this will improve the safety and efficiency of autonomous vehicles.

• 한국HCI학회:학술대회논문집
• /
• 2009.02a
• /
• pp.620-624
• /
• 2009

In this paper, we present a new camera system combining a high-quality 3-D scanner and hybrid camera system to generate a multiview video-plus-depth. In order to get the 3-D video using the hybrid camera system and 3-D scanner, we first obtain depth information for background region from the 3-D scanner. Then, we get the depth map for foreground area from the hybrid camera system. Initial depths of each view image are estimated by performing 3-D warping with the depth information. Thereafter, multiview depth estimation using the initial depths is carried out to get each view initial disparity map. We correct the initial disparity map using a belief propagation algorithm so that we can generate the high-quality multiview disparity map. Finally, we refine depths of the foreground boundary using extracted edge information. Experimental results show that the proposed depth maps generation method produces a 3-D video with more accurate multiview depths and supports more natural 3-D views than the previous works.

• Journal of the Institute of Electronics Engineers of Korea SC
• /
• v.49 no.1
• /
• pp.1-7
• /
• 2012

This paper presents a method for 3D image construction using the hybrid (color and depth) camera system, in which the drawbacks of each camera can be compensated for. Prior to an image generation, intrinsic parameters and extrinsic parameters of each camera are extracted through experiments. The geometry between two cameras is established with theses parameters so as to match the color and depth images. After the preprocessing step, the relation between depth information and distance is derived experimentally as a simple linear function, and 3D image is constructed by coordinate transformations of the matched images. The present scheme has been realized using the Microsoft hybrid camera system named Kinect, and experimental results of 3D image and the distance measurements are given to evaluate the method.

• Journal of Broadcast Engineering
• /
• v.19 no.4
• /
• pp.533-546
• /
• 2014

This paper presents a method for a hybrid (color and depth) camera system construction using a photogrammetric technology. A TOF depth camera is efficient since it measures range information of objects in real-time. However, there are some problems of the TOF depth camera such as low resolution and noise due to surface conditions. Therefore, it is essential to not only correct depth noise and distortion but also construct the hybrid camera system providing a high resolution texture map for generating a 3D model using the depth camera. We estimated geometry of the hybrid camera using a traditional relative orientation algorithm and performed texture mapping using backward mapping based on a condition of collinearity. Other algorithm was compared to evaluate performance about the accuracy of a model and texture mapping. The result showed that the proposed method produced the higher model accuracy.

• Journal of Broadcast Engineering
• /
• v.13 no.5
• /
• pp.596-601
• /
• 2008

In this paper, we propose a new scheme to generate region-of-interest (ROI) enhanced depth maps in the hybrid camera system, which is composed of a low-resolution depth camera and a high-resolution stereoscopic camera. The proposed method creates an ROI depth map for the left image by carrying out a three-dimensional (3-D) warping operation onto the depth information obtained from the depth camera. Then, we generate a background depth map for the left image by applying a stereo matching algorithm onto the left and right images captured by the stereoscopic camera. Finally, we merge the ROI map with the background one to create the final depth map. The proposed method provides higher quality depth information on ROI than the previous methods.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.26 no.3B
• /
• pp.302-314
• /
• 2001

많은 비전 응용에서 카메라의 광축은 영상 평면과 직교한다는 가정을 한다. 그러나 가정아래 전통적인 왜곡 영상 보정 방법은 렌즈의 방사(radial) 왜곡과 이탈(decentering) 왜곡만을 고려하고 있다. 그러나 렌즈의 광축(optical axis)과 영상 켈리브레이션 평면이 직교하지 않을 경우는 평면 투명 변환과 카메라 자체의 렌즈 왜곡이 복합되어 나타나게 되므로 기존 방법만으로는 이러한 복합왜곡을 보정할 수 없다. 본 논문에서는 일방 방사왜곡 뿐만 나이라 평면 투명변환과 렌즈왜곡이 동시 존재하는 영상 시스템에서도 적용 가능한 왜곡 영상 자동 보정 방법을 제한한다. 제안한 복합 왜곡 모델은 평면 투명 변환 모델과 렌즈의 방사 왜곡 모델로부터 유도하고, 계수 추출 알고리듬은 비 선형 최소화 기법인 Levenberg-Marquart 방법에 기반을 둔다. 실험은 이상형 격자 영상에 임의 왜곡 계수를 적용한 영상과 WebCam 카메라의 실제 왜곡 영상을 가지고 실시하였고, 기존 방법과 제안한 방법의 보정율을 비교 평가하였다. 실험결과 제안한 방법은 렌즈 왜곡만 있는 경우에도 기존 방법보다 우수하였으며, 복합왜곡 환경에서도 97% 이상의 보정율로 아주 견고하게 적용 가능한 것으로 나타났다.

• Journal of Digital Convergence
• /
• v.11 no.10
• /
• pp.359-366
• /
• 2013

Due to the development and market expansion of image analysis and recognition technology, video security such as CCTV cameras and digital storage devices, are required for real-time monitoring systems and intelligent video security systems. This includes the development of more advanced technologies. A rotatable PTZ camera, in a CCTV camera system, has a zoom function so you can acquire a precise picture. However it can cause blind spots, and can not monitor two or more moving objects at the same time. This study concerns, the intelligent tracking of multiple moving objects, CCTV systems, and methods of video surveillance. An intelligent video surveillance system is proposed. It can accurately shoot broad areas and track multiple objects at the same time, much more effectively than using one fixed camera for an entire area or two or more PTZ cameras.

• Journal of Digital Convergence
• /
• v.15 no.3
• /
• pp.195-200
• /
• 2017

The purpose of this study is to provide a virtual CG - based image production system for a simulator camera. The video production system proposed in this study is designed to synchronize the virtual camera of the graphic tool with the simulator camera at the shooting site and the CG application image editing, And can be easily and easily performed through a graphic tool by being controlled virtually through a control interface. Blaze Knights, an animation created by Dongseo University, was used to illustrate the superiority of the research results by comparing the progress and the amount of work before and after the application of the system. According to the results of the research, the CG artist's work efficiency is increased, while the physical constraint is minimized when the scene of the CG application image is minimized. It is possible to produce various scenes and minimize the re- We expect the contribution to the industry to be high.

• Journal of the Institute of Electronics Engineers of Korea SP
• /
• v.48 no.6
• /
• pp.8-17
• /
• 2011

Recently, fusion camera systems that consist of depth sensors and color cameras have been widely developed with the advent of a new type of sensor, time-of-flight (TOF) depth sensor. The physical limitation of depth sensors usually generates low resolution images compared to corresponding color images. Therefore, the pre-processing module, such as camera calibration, three dimensional warping, and hole filling, is necessary to generate the high resolution depth map that is placed in the image plane of the color image. However, the result of the pre-processing step is usually inaccurate due to errors from the camera calibration and the depth measurement. Therefore, in this paper, we present a depth map upsampling method robust these errors. First, the confidence of the measured depth value is estimated by the interrelation between the color image and the pre-upsampled depth map. Then, the detailed depth map can be generated by the modified kernel regression method which exclude depth values having low confidence. Our proposed algorithm guarantees the high quality result in the presence of the camera calibration errors. Experimental comparison with other data fusion techniques shows the superiority of our proposed method.

• Journal of the Korean Society for Aeronautical & Space Sciences
• /
• v.45 no.5
• /
• pp.417-428
• /
• 2017

In this paper, we describe the architectural design, unit component hardware design and core software design(Helmet Pose Tracking Software and Terrain Elevation Data Correction Software) of IHDS(Intelligent Helmet Display System), and describe the results of unit test and integration test. According to the trend of the latest helmet display system, the specifications which includes 3D map display, FLIR(Forward Looking Infra-Red) display, hybrid helmet pose tracking, visor reflection type of binocular optical system, NVC(Night Vision Camera) display, lightweight composite helmet shell were applied to the design. Especially, we proposed unique design concepts such as the automatic correction of altitude error of 3D map data, high precision image registration, multi-color lighting optical system, transmissive image emitting surface using diffraction optical element, tracking camera minimizing latency time of helmet pose estimation and air pockets for helmet fixation on head. After completing the prototype of all system components, unit tests and system integration tests were performed to verify the functions and performance.