• 제목/요약/키워드: RGB sensor

검색결과 144건 처리시간 0.026초

실시간 햅틱 렌더링 기술을 통한 시각 장애인을 위한 원격현장감(Telepresence) 로봇 기술 (Telepresence Robotic Technology for Individuals with Visual Impairments Through Real-time Haptic Rendering)

  • 박정혁;아야나 하워드
    • 로봇학회논문지
    • /
    • 제8권3호
    • /
    • pp.197-205
    • /
    • 2013
  • This paper presents a robotic system that provides telepresence to the visually impaired by combining real-time haptic rendering with multi-modal interaction. A virtual-proxy based haptic rendering process using a RGB-D sensor is developed and integrated into a unified framework for control and feedback for the telepresence robot. We discuss the challenging problem of presenting environmental perception to a user with visual impairments and our solution for multi-modal interaction. We also explain the experimental design and protocols, and results with human subjects with and without visual impairments. Discussion on the performance of our system and our future goals are presented toward the end.

전자 나침반과 적외선 광원 추적을 이용한 이동로봇용 위치 인식 시스템 (Localization System for Mobile Robot Using Electric Compass and Tracking IR Light Source)

  • 손창우;이승희;이민철
    • 제어로봇시스템학회논문지
    • /
    • 제14권8호
    • /
    • pp.767-773
    • /
    • 2008
  • This paper presents a localization system based on the use of electric compass and tracking IR light source. Digital RGB(Red, Green, Blue)signal of digital CMOS Camera is sent to CPLD which converts the color image to binary image at 30 frames per second. CMOS camera has IR filter and UV filter in front of CMOS cell. The filters cut off above 720nm light source. Binary output data of CPLD is sent to DSP that rapidly tracks the IR light source by moving Camera tilt DC motor. At a robot toward north, electric compass signals and IR light source angles which are used for calculating the data of the location system. Because geomagnetic field is linear in local position, this location system is possible. Finally, it is shown that position error is within ${\pm}1.3cm$ in this system.

시각장애인을 위한 스테레오 영상기반 보행환경정보안내 단말 플랫폼 개발 (An Implementation of Stereo Image Based Sighted Guiding Device Platform for the Visually Impaired)

  • 오봉진;박상헌;김주완
    • 대한임베디드공학회논문지
    • /
    • 제13권2호
    • /
    • pp.73-81
    • /
    • 2018
  • This paper describes a device platform which the blind can wear to keep path and to get surrounding information during their independent walking. Compared to the existing technologies, the proposed device could be used indoors and outdoors, and maps need not be provided in advance. It is composed of a glasses type device equipped with image sensors, and a portable device that analyzes sensor data for sighted guiding. RGB images and depth images are extracted to generate a walking map based on feature points. It also can cope with the risk of collision with bollard, color cone by applying vertical obstacle detection technology based on floor detection.

CMOS 이미지 센서용 효과적인 Effect 구현 (Implementation of Efficient Effect of CMOS Image Sensor)

  • 송형돈;이동훈;손승일
    • 한국정보통신학회:학술대회논문집
    • /
    • 한국해양정보통신학회 2005년도 춘계종합학술대회
    • /
    • pp.999-1003
    • /
    • 2005
  • 본 논문에서는 영상 입력 장치 또는 카메라 이미지 센서로부터 얻은 이미지 데이터에 대하여 Bayer입력 포맷을 우리가 디스플레이 장치로 보는 영상으로 출력하기 위해 전처리 작업을 수행한 후 이미지 이펙트를 수행한다. 본 논문에서는 연산량과 레지스터의 수를 줄이고 칩의 성능을 향상시키기 위해 이미지 이펙트를 RGB에 적용하지 하지 않고 YCbCr을 이용하여 이미지 이펙트를 수행한다. 이를 구현하기위해 원본 이미지 사이즈를 640${\times}$480으로 입력 데이터를 사용하고, 소프트웨어로 전처리하여 이미지 결과를 확인한 후, 최적화된 알고리즘를 적용하여 VHDL설계언어를 이용한 하드웨어 설계 후, ModelSim 6.0a를 이용하여 데이터를 검증한다.

  • PDF

COMS이미지 센서용 효과적인 White Balance 구현 (Implementation of Efficient White Balance of CMOS Image Sensor)

  • 송형돈;이동훈;손승일
    • 한국정보통신학회:학술대회논문집
    • /
    • 한국해양정보통신학회 2005년도 추계종합학술대회
    • /
    • pp.607-610
    • /
    • 2005
  • 상황에 따라 조명의 밝기나 종류 등에 영향으로 CMOS 이미지 카메라 센서로부터 입력 받은 영상의 색상은 원색과 차이가 있다. 이러한 왜곡된 색상을 Red, Green, Blue와 휘도를 이용하여 원래의 색으로 표현하는 과정이 White Balance이다. 사람은 색이 눈으로 입사되는 물리적인 자극 외에 대뇌의 작용으로 광원이 바뀌어도 같은 색으로 인지하는 특징이 있다. 따라서 이러한 과정이 없을 시에는 우리의 눈으로 보는 것과 영상장치를 통해서 모니터에 표시되는 영상의 색상과 차이가 생긴다. 본 논문에서는 RGB와 휘도를 이용하는 방법과 논문에서 제안한 히스토그램을 이용하는 방법에 대해 소프트웨어를 사용하여 각각의 상황에 따라 알고리즘을 적용하여 WB를 수행한 결과에 대하여 PSNR을 구하여 비교 분석한 후 최적화된 알고리즘을 이용하여 하드웨어 설계 언어인 VHDL을 사용하여 구현하고, ModelSim6.0a를 이용하여 데이터를 검증한다.

  • PDF

The Research about Aerial photographing system(PKNU No.2) development

  • Kim, Ho-Yong;Choi, Chul-Uong;Lee, Eun-Khung;Jun, Sung-Woo
    • 대한원격탐사학회:학술대회논문집
    • /
    • 대한원격탐사학회 2003년도 Proceedings of ACRS 2003 ISRS
    • /
    • pp.110-112
    • /
    • 2003
  • The researchers, who seek geological and environmental information, depend on the remote sensing and aerial photographic datum from various commercial satellites and aircraft. However, the adverse weather conditions and the expensive equipment can restrict that the researcher can collect their data anywhere and any time. To allow for better flexibility, we have developed a compact, a multispectral automatic Aerial photographic system. This system's Multi-spectral camera can catch the visible (RGB) and infrared (NIR) bands (3032${\ast}$2008 pixel) image. Our system consists of a thermal infrared camera and automatic balance control, and it managed and controlled by a palm-top computer. And it includes a camera gimbals system, GPS receiver, weather sensor and etc. As a result, we have successfully tested its ability to acquire aerial photography, weather data, as well as GPS data, making it a very flexible tool for environmental data monitoring.

  • PDF

비전시스템을 이용한 자율주행량의 차선내 차량의 변위 검출에 관한 연구 (A Study on Detection of Lane and Displacement of Obstacle for AGV using Vision System)

  • 이진우;최성욱;이창훈;이영진;이권순
    • 대한전기학회:학술대회논문집
    • /
    • 대한전기학회 2001년도 하계학술대회 논문집 D
    • /
    • pp.2202-2205
    • /
    • 2001
  • This paper is composed of two parts. One is image preprocessing part to measure the condition of the lane and vehicle. This finds the information of lines using RGB ratio cutting algorithm, the edge detection and Hough transform. The other obtains the situation of other vehicles using the image processing and viewport. At first, 2 dimension image information derived from vision sensor is interpreted to the 3 dimension information by the angle and position of the CCD camera. Through these processes, if vehicle knows the driving conditions which are lane angle, distance error and real position of other vehicles, we should calculate the reference steering angle by steering controller.

  • PDF

A New Approach of Intensity Predictio in Copper Electroplating Monitoring Using Hybrid HSMM and ANN

  • Wang, Li;Hwan, Ahn-Jong;Lee, Ho-Jae;Hong, Sang-Jeen
    • 한국진공학회:학술대회논문집
    • /
    • 한국진공학회 2009년도 제38회 동계학술대회 초록집
    • /
    • pp.137-137
    • /
    • 2010
  • Copper electroplating is a very popular and important technology for depositing high-quality conductor interconnections, especially in through silicon via (TSV). As this advanced packaging technique developing, a mass of copper and chemical solution are used, so attention to these chemical materials into the utilization and costs can not be ignored. An economical and practical real-time chemical solution monitoring has not been achieved yet. Either Red-green-blue (RGB) or optical emission spectroscopy (OES) color sensor can successfully monitor the color condition of solution during the process. The reaction rate, uniformity and quality can map onto the color changing. Hidden Semi Markov model (HSMM) can establish mapping from the color change to upper indicators, and artificial neural network (ANN) can be integrated to comprehensively determine its targets, whether the solution inside the container can continue to use.

  • PDF

발광다이오드를 이용한 디지틀 캔들 개발 (Development on the Digital Candle Using LED)

  • 소병문;강성준;오성훈;이동휘
    • 한국산학기술학회논문지
    • /
    • 제11권11호
    • /
    • pp.4291-4295
    • /
    • 2010
  • 본 논문은 독립적으로 발광다이오드의 캔들 컬러를 제어하는 발광다이오드 조명 데코레이션 시스템을 제안한다. 적색, 녹색, 청색 발광다이오드를 사용하여 발광다이오드 캔들 제어에 제안된 프로세스를 적용하였으며 캔들에 발광다이오드와 광섬유를 적용하여 스위치 부품을 사용하지 않고 캔들 내부의 광원을 발광시키는것이 가능하여 개발 결과를 상용화 하고자 한다.

차량 안전 제어를 위한 파티클 필터 기반의 강건한 다중 인체 3차원 자세 추정 (Particle Filter Based Robust Multi-Human 3D Pose Estimation for Vehicle Safety Control)

  • 박준상;박형욱
    • 자동차안전학회지
    • /
    • 제14권3호
    • /
    • pp.71-76
    • /
    • 2022
  • In autonomous driving cars, 3D pose estimation can be one of the effective methods to enhance safety control for OOP (Out of Position) passengers. There have been many studies on human pose estimation using a camera. Previous methods, however, have limitations in automotive applications. Due to unexplainable failures, CNN methods are unreliable, and other methods perform poorly. This paper proposes robust real-time multi-human 3D pose estimation architecture in vehicle using monocular RGB camera. Using particle filter, our approach integrates CNN 2D/3D pose measurements with available information in vehicle. Computer simulations were performed to confirm the accuracy and robustness of the proposed algorithm.