• Title/Summary/Keyword: Image Sensor Module

Search Result 133, Processing Time 0.03 seconds

A CPU-GPU Hybrid System of Environment Perception and 3D Terrain Reconstruction for Unmanned Ground Vehicle

  • Song, Wei;Zou, Shuanghui;Tian, Yifei;Sun, Su;Fong, Simon;Cho, Kyungeun;Qiu, Lvyang
    • Journal of Information Processing Systems
    • /
    • v.14 no.6
    • /
    • pp.1445-1456
    • /
    • 2018
  • Environment perception and three-dimensional (3D) reconstruction tasks are used to provide unmanned ground vehicle (UGV) with driving awareness interfaces. The speed of obstacle segmentation and surrounding terrain reconstruction crucially influences decision making in UGVs. To increase the processing speed of environment information analysis, we develop a CPU-GPU hybrid system of automatic environment perception and 3D terrain reconstruction based on the integration of multiple sensors. The system consists of three functional modules, namely, multi-sensor data collection and pre-processing, environment perception, and 3D reconstruction. To integrate individual datasets collected from different sensors, the pre-processing function registers the sensed LiDAR (light detection and ranging) point clouds, video sequences, and motion information into a global terrain model after filtering redundant and noise data according to the redundancy removal principle. In the environment perception module, the registered discrete points are clustered into ground surface and individual objects by using a ground segmentation method and a connected component labeling algorithm. The estimated ground surface and non-ground objects indicate the terrain to be traversed and obstacles in the environment, thus creating driving awareness. The 3D reconstruction module calibrates the projection matrix between the mounted LiDAR and cameras to map the local point clouds onto the captured video images. Texture meshes and color particle models are used to reconstruct the ground surface and objects of the 3D terrain model, respectively. To accelerate the proposed system, we apply the GPU parallel computation method to implement the applied computer graphics and image processing algorithms in parallel.

The Design of the Integrated Module to Cope with Sudden Unintended Acceleration (자동차 급발진을 대비하기 위한 통합 모듈 설계)

  • Cha, Jea-Hui;Jang, Jong-Wook
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2016.10a
    • /
    • pp.221-223
    • /
    • 2016
  • Currently in the automobile market, models with many convenient functions combined with IT have been released. This change has a strength that there could be many convenient and useful functions related to driving while flaws of vehicles caused by malfunctions of these electronic equipments could trigger serious incidents. Among them, the sudden unintended acceleration considered as the most serious is a serious flaw that could threaten driver's life. However, the causes for sudden acceleration incidents have not been clearly investigated with no coping measures. As manufacturers shift the responsibility to drivers' carelessness, drivers' burden is continuously increasing. Thus, this paper designed the system to cope with sudden acceleration incidents by changing conditions of controlling parts like accelerator and brake, and internal image of the driver's seat into data through the integrated module.

  • PDF

Smart Emotion Lighting Control System Based on Android Platform (안드로이드 플랫폼 기반의 스마트 감성조명 제어 시스템)

  • Jo, Eun-Ja;Lin, Chi-Ho
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.14 no.3
    • /
    • pp.147-153
    • /
    • 2014
  • In this paper, we propose smart emotional lighting control system based on the android platform. The proposed smart emotional lighting control system be configure android platform and sensibility lighting equipment, expansion device, zigbee module. Smart emotional lighting control system based on the android platform is automatic control possible using the illumination sensor, and by selecting the desired lighting partial control can be designed. The experimental results of the proposed smart emotional lighting control sensitivity than conventional lighting control system decreased the power consumption and efficient lighting control was possible. Office acts will be suitable conditions to control the color and brightness, so they can be controlled from the improves concentration and ability to work.

Auto Exposure control system for Compact Image Sensor Module (콤팩트 이미지 센서모듈을 위한 자동 노출제어 시스템)

  • Kim, Hyun-Sik;Jang, Won-Woo;Song, Jin-Gun;Kim, Kang-Joo;Kang, Bong-Soon
    • Proceedings of the Korea Institute of Convergence Signal Processing
    • /
    • 2006.06a
    • /
    • pp.13-16
    • /
    • 2006
  • 사진을 찍을 때 카메라는 보기 좋은 사진을 얻을 수 있도록 많은 기능을 제공하고 있다. 대표적인 기능으로 자동 초점거리 조정(Auto Focus), 자동 색온도 보정(Auto White Balance), 자동 노출 조정(Auto Exposure)이 있다. 본 논문에서는 편리한 기능들 중 하나로써 자동 노출제어 시스템을 구현하였다. 본 논문에서 제안하는 자동 노출제어 시스템은 가변 시상수(Variable Time Constant)를 가지는 IIR 필터를 이용한다. Zone System에서 보여주는 사물의 휘도정보를 바탕으로 하여 이상적인 영상의 휘도 특성 그래프를 얻어내고, 이와 현재의 노출설정에서 휘도와 비교하여 적정 노출을 찾는다. 제안하는 자동 노출제어 시스템은 적정 노출을 얻을 수 있는 위치로 이동하기 위하여 기존의 마이크로 콘트롤러 등을 이용하여 구현하는 방법과 달리 간단한 구성을 가지는 IIR 필터를 이용한다. 제안하는 자동 노출제어 시스템은 간단한 구성을 가지므로 콤팩트 이미지 센서를 구성하기 위하여 사용 할 수 있다.

  • PDF

Development of Human Detection Technology with Heterogeneous Sensors for use at Disaster Sites (재난 현장에서 이종 센서를 활용한 인명 탐지 기술 개발)

  • Seo, Myoung Kook;Yoon, Bok Joong;Shin, Hee Young;Lee, Kyong Jun
    • Journal of Drive and Control
    • /
    • v.17 no.3
    • /
    • pp.1-8
    • /
    • 2020
  • Recently, a special purpose machine with two manipulators and quadruped crawler system has been developed for rapid life-saving and initial restoration work at disaster sites. This special purpose machine provides the driver with various environmental recognition functions for accurate and rapid task determination. In particular, the human detection technology assists the driver in poor working conditions such as low-light, dust, water vapor, fog, rain, etc. to prevent secondary human accidents when moving and working. In this study, a human detection module is developed to be mounted on a special purpose machine. A thermal sensor and CCD camera were used to detect victims and nearby workers in response to the difficult environmental conditions present at disaster sites. The performance of various AI-based life detection algorithm were verified and then applied to the task of detecting various objects with different postures and exposure conditions. In addition, image visibility improvement technology was applied to further improve the accuracy of human detection.

Reliable Autonomous Reconnaissance System for a Tracked Robot in Multi-floor Indoor Environments with Stairs (다층 실내 환경에서 계단 극복이 가능한 궤도형 로봇의 신뢰성 있는 자율 주행 정찰 시스템)

  • Juhyeong Roh;Boseong Kim;Dokyeong Kim;Jihyeok Kim;D. Hyunchul Shim
    • The Journal of Korea Robotics Society
    • /
    • v.19 no.2
    • /
    • pp.149-158
    • /
    • 2024
  • This paper presents a robust autonomous navigation and reconnaissance system for tracked robots, designed to handle complex multi-floor indoor environments with stairs. We introduce a localization algorithm that adjusts scan matching parameters to robustly estimate positions and create maps in environments with scarce features, such as narrow rooms and staircases. Our system also features a path planning algorithm that calculates distance costs from surrounding obstacles, integrated with a specialized PID controller tuned to the robot's differential kinematics for collision-free navigation in confined spaces. The perception module leverages multi-image fusion and camera-LiDAR fusion to accurately detect and map the 3D positions of objects around the robot in real time. Through practical tests in real settings, we have verified that our system performs reliably. Based on this reliability, we expect that our research team's autonomous reconnaissance system will be practically utilized in actual disaster situations and environments that are difficult for humans to access, thereby making a significant contribution.

Interactive ADAS development and verification framework based on 3D car simulator (3D 자동차 시뮬레이터 기반 상호작용형 ADAS 개발 및 검증 프레임워크)

  • Cho, Deun-Sol;Jung, Sei-Youl;Kim, Hyeong-Su;Lee, Seung-gi;Kim, Won-Tae
    • Journal of IKEEE
    • /
    • v.22 no.4
    • /
    • pp.970-977
    • /
    • 2018
  • The autonomous vehicle is based on an advanced driver assistance system (ADAS) consisting of a sensor that collects information about the surrounding environment and a control module that determines the measured data. As interest in autonomous navigation technology grows recently, an easy development framework for ADAS beginners and learners is needed. However, existing development and verification methods are based on high performance vehicle simulator, which has drawbacks such as complexity of verification method and high cost. Also, most of the schemes do not provide the sensing data required by the ADAS directly from the simulator, which limits verification reliability. In this paper, we present an interactive ADAS development and verification framework using a 3D vehicle simulator that overcomes the problems of existing methods. ADAS with image recognition based artificial intelligence was implemented as a virtual sensor in a 3D car simulator, and autonomous driving verification was performed in real scenarios.

Real-Time Object Detection System Based on Background Modeling in Infrared Images (적외선영상에서 배경모델링 기반의 실시간 객체 탐지 시스템)

  • Park, Chang-Han;Lee, Jae-Ik
    • Journal of the Institute of Electronics Engineers of Korea CI
    • /
    • v.46 no.4
    • /
    • pp.102-110
    • /
    • 2009
  • In this paper, we propose an object detection method for real-time in infrared (IR) images and PowerPC (PPC) and H/W design based on field programmable gate array (FPGA). An open H/W architecture has the advantages, such as easy transplantation of HW and S/W, support of compatibility and scalability for specification of current and previous versions, common module design using standardized design, and convenience of management and maintenance. Proposed background modeling for an open H/W architecture design decreases size of search area to construct a sparse block template of search area in IR images. We also apply to compensate for motion compensation when image moves in previous and current frames of IR sensor. Separation method of background and objects apply to adaptive values through time analysis of pixel intensity. Method of clutter reduction to appear near separated objects applies to median filter. Methods of background modeling, object detection, median filter, labeling, merge in the design embedded system execute in PFC processor. Based on experimental results, proposed method showed real-time object detection through global motion compensation and background modeling in the proposed embedded system.

A Study on the CMOS Camera robust to radiation environments (방사선 환경에 강인한 CMOS카메라에 관한 연구)

  • Baek, Dong-Hyun;Kim, Bae-Hoon
    • The Journal of Korea Institute of Information, Electronics, and Communication Technology
    • /
    • v.13 no.1
    • /
    • pp.27-34
    • /
    • 2020
  • Human access is restricted to environment where radiation sources are used, however observation equipment should be radiation-resistant as it is exposed. Therefore, if tungsten with the highest specific gravity and melting point and the lowest lead were selected to reduce the dose to the Cobalt 60 radiation source to 1/8, Tu had a volume of 432.6cm3, a thickness of 2.4cm, and Pb had a volume of 961cm3,, a thickness of 3.6cm. By applying this method, produced a radiation resistant CMOS camera with a camera module using a CMOS Image sensor and a radiation shielding structured housing. As a result of applying the head detachable 2M AHD camera (No. ①) that survived the experiment to select the optimal shielding thickness, when shielding the associated equipment such as cameras, adapters, etc. is achieved, it was confirmed that the design of the structure is appropriate by operating well at doses higher than 1.88×106rad. Therefore, it is expected to secure the camera technology and business feasibility that can be applied to high radiation environments.

System Design and Performance Analysis of 3D Imaging Laser Radar for the Mapping Purpose (맵핑용 3차원 영상 레이저 레이다의 시스템 설계 및 성능 분석)

  • La, Jongpil;Ko, Jinsin;Lee, Changjae
    • Journal of the Korea Institute of Military Science and Technology
    • /
    • v.17 no.1
    • /
    • pp.90-95
    • /
    • 2014
  • The system design and the system performance analysis of 3D imaging laser radar system for the mapping purpose is addressed in this article. For the mapping, a push-bloom scanning method is utilized. The pulsed fiber laser with high pulse energy and high pulse repetition rate is used for the light source of laser radar system. The high sensitive linear mode InGaAs avalanche photo-diode is used for the laser receiver module. The time-of-flight of laser pulse from the laser to the receiver is calculated by using high speed FPGA based signal processing board. To reduce the walk error of laser pulse regardless of the intensity differences between pulses, the time of flight is measured from peak to peak of laser pulses. To get 3D image with a single pixel detector, Risley scanner which stirs the laser beam in an ellipsoidal pattern is used. The system laser energy budget characteristics is modeled using LADAR equation, from which the system performances such as the pulse detection probability, false alarm and etc. are analyzed and predicted. The test results of the system performances are acquired and compared with the predicted system performance. According to test results, all the system requirements are satisfied. The 3D image which was acquired by using the laser radar system is also presented in this article.