• Title/Summary/Keyword: 3D image sensor

Search Result 335, Processing Time 0.028 seconds

Neural Network Approach to Sensor Fusion System for Improving the Recognition Performance of 3D Objects (3차원 물체의 인식 성능 향상을 위한 감각 융합 신경망 시스템)

  • Dong Sung Soo;Lee Chong Ho;Kim Ji Kyoung
    • The Transactions of the Korean Institute of Electrical Engineers D
    • /
    • v.54 no.3
    • /
    • pp.156-165
    • /
    • 2005
  • Human being recognizes the physical world by integrating a great variety of sensory inputs, the information acquired by their own action, and their knowledge of the world using hierarchically parallel-distributed mechanism. In this paper, authors propose the sensor fusion system that can recognize multiple 3D objects from 2D projection images and tactile informations. The proposed system focuses on improving recognition performance of 3D objects. Unlike the conventional object recognition system that uses image sensor alone, the proposed method uses tactual sensors in addition to visual sensor. Neural network is used to fuse the two sensory signals. Tactual signals are obtained from the reaction force of the pressure sensors at the fingertips when unknown objects are grasped by four-fingered robot hand. The experiment evaluates the recognition rate and the number of learning iterations of various objects. The merits of the proposed systems are not only the high performance of the learning ability but also the reliability of the system with tactual information for recognizing various objects even though the visual sensory signals get defects. The experimental results show that the proposed system can improve recognition rate and reduce teeming time. These results verify the effectiveness of the proposed sensor fusion system as recognition scheme for 3D objects.

Comparison of detection rates Area sensors and 3D spatial division multiple sensors for detecting obstacles in the screen door (스크린도어의 장애물 검지를 위한 Area센서와 다중공간분할 3D센서의 검지율 비교 분석)

  • Yoo, Bong-Seok;Lee, Hyun-Su;Jin, Ju-Hyun;Kim, Jong-Sik
    • The Journal of the Korea institute of electronic communication sciences
    • /
    • v.11 no.6
    • /
    • pp.561-566
    • /
    • 2016
  • A subway platform is equipped with screen doors in oder to avoid accidents of passengers, where Area sensors are installed for detecting obstacles in the screen doors. However, there exist frequent operating errors in screen doors due to dusts, sunlight, snow, and bugs. It is required to develope a detection device which reduces errors and elaborates detection function. In this paper, we compared the detection rates of the Area sensor the 3D sensor using CCTV-based image data with installing sensors at the screen door in Munyang station Daegu, where 3D sensor is applied with the space division multiple detection algorithms. It is measured that the detection rate of 3D sensor and Area sensor is approximately 89.61% and 78.88%, respectively. The results confirmed that 3D senor has higher detection rate compared with Area sensor with the rate of 6.87~9.79%, and 3D sensor has benefit in the aspect of installation fee.

duoPIXTM X-ray Imaging Sensor Composing of Multiple Thin Film Transistors in a Pixel for Digital X-ray Detector (픽셀내 다수의 박막트랜지스터로 구성된 듀오픽스TM 엑스선 영상센서 제작)

  • Seung Ik, Jun;Bong Goo, Lee
    • Journal of the Korean Society of Radiology
    • /
    • v.16 no.7
    • /
    • pp.969-974
    • /
    • 2022
  • In order to maximize dynamic range and to minimize image lag in digital X-ray imaging, diminishing residual parasitic capacitance in photodiode in pixels is critically necessary. These requirements are more specifically requested in dynamic X-ray imaging with high frame rate and low image lag for industrial 2D/3D automated X-ray inspection and medical CT imaging. This study proposes duoPIXTM X-ray imaging sensor for the first time that is composed of reset thin film transistor, readout thin film transistor and photodiode in a pixel. To verify duoPIXTM X-ray imaging sensor, designing duoPIXTM pixel and imaging sensor was executed first then X-ray imaging sensor with 105 ㎛ pixel pitch, 347 mm × 430 mm imaging area and 3300 × 4096 pixels (13.5M pixels) was fabricated and evaluated by using module tester and image viewer specifically for duoPIXTM imaging sensor.

Optical Resonance-based Three Dimensional Sensing Device and its Signal Processing (광공진 현상을 이용한 입체 영상센서 및 신호처리 기법)

  • Park, Yong-Hwa;You, Jang-Woo;Park, Chang-Young;Yoon, Heesun
    • Proceedings of the Korean Society for Noise and Vibration Engineering Conference
    • /
    • 2013.10a
    • /
    • pp.763-764
    • /
    • 2013
  • A three-dimensional image capturing device and its signal processing algorithm and apparatus are presented. Three dimensional information is one of emerging differentiators that provides consumers with more realistic and immersive experiences in user interface, game, 3D-virtual reality, and 3D display. It has the depth information of a scene together with conventional color image so that full-information of real life that human eyes experience can be captured, recorded and reproduced. 20 Mega-Hertz-switching high speed image shutter device for 3D image capturing and its application to system prototype are presented[1,2]. For 3D image capturing, the system utilizes Time-of-Flight (TOF) principle by means of 20MHz high-speed micro-optical image modulator, so called 'optical resonator'. The high speed image modulation is obtained using the electro-optic operation of the multi-layer stacked structure having diffractive mirrors and optical resonance cavity which maximizes the magnitude of optical modulation[3,4]. The optical resonator is specially designed and fabricated realizing low resistance-capacitance cell structures having small RC-time constant. The optical shutter is positioned in front of a standard high resolution CMOS image sensor and modulates the IR image reflected from the object to capture a depth image (Figure 1). Suggested novel optical resonator enables capturing of a full HD depth image with depth accuracy of mm-scale, which is the largest depth image resolution among the-state-of-the-arts, which have been limited up to VGA. The 3D camera prototype realizes color/depth concurrent sensing optical architecture to capture 14Mp color and full HD depth images, simultaneously (Figure 2,3). The resulting high definition color/depth image and its capturing device have crucial impact on 3D business eco-system in IT industry especially as 3D image sensing means in the fields of 3D camera, gesture recognition, user interface, and 3D display. This paper presents MEMS-based optical resonator design, fabrication, 3D camera system prototype and signal processing algorithms.

  • PDF

Image Restoration in Digital Radiography Using Dual Sensor Wiener Filer (이중센서 위너필터를 이용한 디지탈 라디오 그라피 영상 복원)

  • Lee, Tae-Soo;Park, Kwang-Suk;Min, Byoumg-Goo;Lim, Jeong-Gee;Han, Man-Chung
    • Journal of Biomedical Engineering Research
    • /
    • v.10 no.3
    • /
    • pp.293-302
    • /
    • 1989
  • A Dual Sensor Wiener Filter technique was used to improve the image quality of the scanning type digital radiographic system (resolution and SNR). In this method, two images were acquried simultaneously using two sensors with high and low resolution and SNR values. Using the cross Power spectrum between dual sensor outputs of the same chest radiographic image. we design a new type of Wiener Filter and implement it with fast algorithm. We compared the performance of this new dual sensor filter with conventional single sensor filters (Wiener Filter and Parametric Projec- tion Filter) . In simulation studies, it is shown that this new method has SNR improvement of 1-3 dB better than conventional filters.

  • PDF

Development of multi-line laser vision sensor and welding application (멀티 라인 레이저 비전 센서를 이용한 고속 3차원 계측 및 모델링에 관한 연구)

  • 성기은;이세헌
    • Proceedings of the Korean Society of Precision Engineering Conference
    • /
    • 2002.05a
    • /
    • pp.169-172
    • /
    • 2002
  • A vision sensor measure range data using laser light source. This sensor generally use patterned laser which shaped single line. But this vision sensor cannot satisfy new trend which feeds foster and more precise processing. The sensor's sampling rate increases as reduced image processing time. However, the sampling rate can not over 30fps, because a camera has mechanical sampling limit. If we use multi line laser pattern, we will measure multi range data in one image. In the case of using same sampling rate camera, number of 2D range data profile in one second is directly proportional to laser line's number. For example, the vision sensor using 5 laser lines can sample 150 profiles per second in best condition.

  • PDF

A Remote Control of 6 d.o.f. Robot Arm Based on 2D Vision Sensor (2D 영상센서 기반 6축 로봇 팔 원격제어)

  • Hyun, Woong-Keun
    • The Journal of the Korea institute of electronic communication sciences
    • /
    • v.17 no.5
    • /
    • pp.933-940
    • /
    • 2022
  • In this paper, the algorithm was developed to recognize hand 3D position through 2D image sensor and implemented a system to remotely control the 6 d.o.f. robot arm by using it. The system consists of a camera that acquires hand position in 2D, a computer that controls robot arm that performs movement by hand position recognition. The image sensor recognizes the specific color of the glove putting on operator's hand and outputs the recognized range and position by including the color area of the glove as a shape of rectangle. We recognize the velocity vector of end effector and control the robot arm by the output data of the position and size of the detected rectangle. Through the several experiments using developed 6 axis robot, it was confirmed that the 6 d.o.f. robot arm remote control was successfully performed.

Development of Retina Photographing System and 16 Channels Image Acquisition System (망막 촬영 장치 및 16 채널 영상 획득 장치 개발)

  • 양근호
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.8 no.1
    • /
    • pp.96-101
    • /
    • 2004
  • In order to measure the retina thickness, there are to need the 3-D retina photographing and the high speed signal processing system. In this paper, we introduced the retina photographing system and the 16-channel high speed image data acquisition system. There are able to measure the retina thickness with sensing image the returned laser signal to APD sensor after there were projected the HeNe laser on retina. We developed the laser projection system to sense a reflected image of the retina using APD sensor, the 16-channel high speed A/D converter and PCI master interface card for image transmission into computer.

Coordination of dual arm robot using 3-D vision sensor

  • Yoshioka, Izuru;Taguchi, Nobuyoshi;Yeol, Beak-Ju;Wang, Honbo;Ishimatsu, Takakazu
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1995.10a
    • /
    • pp.400-403
    • /
    • 1995
  • A robot system is proposed to realize coordinated motion of two arm robot. Due to a 3-D vision sensor, precise coordinated motions could be realized. Using a sophisticated IC chip, real time image processing could be executed using a simple circuit.

  • PDF

Correction of Photometric Distortion of a Micro Camera-Projector System for Structured Light 3D Scanning

  • Park, Go-Gwang;Park, Soon-Yong
    • Journal of Sensor Science and Technology
    • /
    • v.21 no.2
    • /
    • pp.96-102
    • /
    • 2012
  • This paper addresses photometric distortion problems of a compact 3D scanning sensor which is composed of a micro-size and inexpensive camera-projector system. Recently, many micro-size cameras and projectors are available. However, erroneous 3D scanning results may arise due to the poor and nonlinear photometric properties of the sensors. This paper solves two inherent photometric distortions of the sensors. First, the response functions of both the camera and projector are derived from the least squares solutions of passive and active calibration, respectively. Second, vignetting correction of the vision camera is done by using a conventional method, however the projector vignetting is corrected by using the planar homography between the image planes of the projector and camera, respectively. Experimental results show that the proposed technique enhances the linear properties of the phase patterns that are generated by the sensor.