• Title/Summary/Keyword: Stereo cameras

Search Result 208, Processing Time 0.029 seconds

The Obstacle Size Prediction Method Based on YOLO and IR Sensor for Avoiding Obstacle Collision of Small UAVs (소형 UAV의 장애물 충돌 회피를 위한 YOLO 및 IR 센서 기반 장애물 크기 예측 방법)

  • Uicheon Lee;Jongwon Lee;Euijin Choi;Seonah Lee
    • Journal of Aerospace System Engineering
    • /
    • v.17 no.6
    • /
    • pp.16-26
    • /
    • 2023
  • With the growing demand for unmanned aerial vehicles (UAVs), various collision avoidance methods have been proposed, mainly using LiDAR and stereo cameras. However, it is difficult to apply these sensors to small UAVs due to heavy weight or lack of space. The recently proposed methods use a combination of object recognition models and distance sensors, but they lack information on the obstacle size. This disadvantage makes distance determination and obstacle coordination complicated in an early-stage collision avoidance. We propose a method for estimating obstacle sizes using a monocular camera-YOLO and infrared sensor. Our experimental results confirmed that the accuracy was 86.39% within the distance of 40 cm. In addition, the proposed method was applied to a small UAV to confirm whether it was possible to avoid obstacle collisions.

Patient Setup Aid with Wireless CCTV System in Radiation Therapy (무선 CCTV 시스템을 이용한 환자 고정 보조기술의 개발)

  • Park, Yang-Kyun;Ha, Sung-Whan;Ye, Sung-Joon;Cho, Woong;Park, Jong-Min;Park, Suk-Won;Huh, Soon-Nyung
    • Radiation Oncology Journal
    • /
    • v.24 no.4
    • /
    • pp.300-308
    • /
    • 2006
  • $\underline{Purpose}$: To develop a wireless CCTV system in semi-beam's eye view (BEV) to monitor daily patient setup in radiation therapy. $\underline{Materials\;and\;Methods}$: In order to get patient images in semi-BEV, CCTV cameras are installed in a custom-made acrylic applicator below the treatment head of a linear accelerator. The images from the cameras are transmitted via radio frequency signal (${\sim}2.4\;GHz$ and 10 mW RF output). An expected problem with this system is radio frequency interference, which is solved utilizing RF shielding with Cu foils and median filtering software. The images are analyzed by our custom-made software. In the software, three anatomical landmarks in the patient surface are indicated by a user, then automatically the 3 dimensional structures are obtained and registered by utilizing a localization procedure consisting mainly of stereo matching algorithm and Gauss-Newton optimization. This algorithm is applied to phantom images to investigate the setup accuracy. Respiratory gating system is also researched with real-time image processing. A line-laser marker projected on a patient's surface is extracted by binary image processing and the breath pattern is calculated and displayed in real-time. $\underline{Results}$: More than 80% of the camera noises from the linear accelerator are eliminated by wrapping the camera with copper foils. The accuracy of the localization procedure is found to be on the order of $1.5{\pm}0.7\;mm$ with a point phantom and sub-millimeters and degrees with a custom-made head/neck phantom. With line-laser marker, real-time respiratory monitoring is possible in the delay time of ${\sim}0.17\;sec$. $\underline{Conclusion}$: The wireless CCTV camera system is the novel tool which can monitor daily patient setups. The feasibility of respiratory gating system with the wireless CCTV is hopeful.

Head Motion Detection and Alarm System during MRI scanning (MRI 영상획득 중의 피험자 움직임 감지 및 알림 시스템)

  • Pae, Chong-Won;Park, Hae-Jeong;Kim, Dae-Jin
    • Investigative Magnetic Resonance Imaging
    • /
    • v.16 no.1
    • /
    • pp.55-66
    • /
    • 2012
  • Purpose : During brain MRI scanning, subject's head motion can adversely affect MRI images. To minimize MR image distortion by head movement, we developed an optical tracking system to detect the 3-D movement of subjects. Materials and Methods: The system consisted of 2 CCD cameras, two infrared illuminators, reflective sphere-type markers, and frame grabber with desktop PC. Using calibration which is the procedure to calculate intrinsic/extrinsic parameters of each camera and triangulation, the system was desiged to detect 3-D coordinates of subject's head movement. We evaluated the accuracy of 3-D position of reflective markers on both test board and the real MRI scans. Results: The stereo system computed the 3-D position of markers accurately for the test board and for the subject with glasses with attached optical reflective marker, required to make regular head motion during MRI scanning. This head motion tracking didn't affect the resulting MR images even in the environment varying magnetic gradient and several RF pulses. Conclusion: This system has an advantage to detect subject's head motion in real-time. Using the developed system, MRI operator is able to determine whether he/she should stop or intervene in MRI acquisition to prevent more image distortions.

A Comparison of Korea Standard HD Map for Actual Driving Support of Autonomous Vehicles and Analysis of Application Layers (자율주행자동차 실주행 지원을 위한 표준 정밀도로지도 비교 및 활용 레이어 분석)

  • WON, Sang-Yeon;JEON, Young-Jae;JEONG, Hyun-Woo;KWON, Chan-Oh
    • Journal of the Korean Association of Geographic Information Studies
    • /
    • v.23 no.3
    • /
    • pp.132-145
    • /
    • 2020
  • By coming of the 4th industrial revolution era, HD map have became a key infrastructure for determining precise location of autonomous driving in areas of futuristic cars, logistics and robots. Autonomous vehicles have became more dependent on HD map to determine the exact location of objects detected by various sensors such as LiDAR, GNSS, Radar, and stereo cameras as well as self-location decisions. By actualizing autonomous driving and C-ITS technologies, the demand for precise information on HD map have increased. And also the demand for the creation of new information based on the convergence of various changes and real-time information have increased. In this study, domestic and international HD map standards and related environments have analyzed. Based on this, usability has researched which comparison with standard HD map established by various institutions. Additionally, usability of standard HD map have studied for applying actual autonomous vehicles by reworking HD map. By the result of study, standard HD map have well established to use by various institutions. If further research about layer classification and definition by institutions will carried out based on this study, it has expected that and efficient establishment and renewal of HD map will take place.

Parcel Boundary Demarcation in Agricultural Area Using High Resolution Aerial Images and Aerial Targets (고해상도 항공영상과 항공타겟을 이용한 농경지 필지경계 설정에 관한 연구)

  • PARK, Chi-Young;LEE, Jae-One
    • Journal of the Korean Association of Geographic Information Studies
    • /
    • v.19 no.1
    • /
    • pp.80-93
    • /
    • 2016
  • Parcel boundary demarcation in agricultural area is commonly performed by terrestrial surveying methods, which have been pointed out as drawbacks to require consuming too much time and heavy expenditure. With the developments of high performance digital aerial cameras, however, studies on cadastral boundary demarcation with an aerial photogrammetric method attract a great attention in recent years. In this paper, an approach is presented to rapidly demarcate parcel boundaries coinciding with real ground ones in agricultural areas by extracting boundaries from the high resolution aerial orthoimages based on aerial targets. In order to investigate the feasibility of the proposed method, the accuracy of coordinates and area of parcel boundaries extracted from the aerial targets appeared in orthoimages compared with that of terrestrial boundary surveying results over the selected two test agricultural areas. Aerial image data were processed taken by a ADS80 digital camera with a GSD of 8cm in Changwon region, and by a DMCII camera with a GSD of 5cm in Suwon respectively. The result shows that the accuracy of parcel demarcation using aerial images is within the tolerance limits of coordinates and areas compared with that of terrestrial surveying. The proposed method using aerial target-based high resolution aerial images is therefore expected to be usefully applied in the agricultural parcel demarcation.

The GEO-Localization of a Mobile Mapping System (모바일 매핑 시스템의 GEO 로컬라이제이션)

  • Chon, Jae-Choon
    • Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
    • /
    • v.27 no.5
    • /
    • pp.555-563
    • /
    • 2009
  • When a mobile mapping system or a robot is equipped with only a GPS (Global Positioning System) and multiple stereo camera system, a transformation from a local camera coordinate system to GPS coordinate system is required to link camera poses and 3D data by V-SLAM (Vision based Simultaneous Localization And Mapping) to GIS data or remove the accumulation error of those camera poses. In order to satisfy the requirements, this paper proposed a novel method that calculates a camera rotation in the GPS coordinate system using the three pairs of camera positions by GPS and V-SLAM, respectively. The propose method is composed of four simple steps; 1) calculate a quaternion for two plane's normal vectors based on each three camera positions to be parallel, 2) transfer the three camera positions by V-SLAM with the calculated quaternion 3) calculate an additional quaternion for mapping the second or third point among the transferred positions to a camera position by GPS, and 4) determine a final quaternion by multiplying the two quaternions. The final quaternion can directly transfer from a local camera coordinate system to the GPS coordinate system. Additionally, an update of the 3D data of captured objects based on view angles from the object to cameras is proposed. This paper demonstrated the proposed method through a simulation and an experiment.

Development of DirectX-based Stereoscopic Image Authoring Tool for Immersive e-Book Production (몰입형 e-Book 제작을 위한 DirectX기반 입체 영상 저작도구 개발)

  • Lee, Keunhyung;Park, Jinwoo;Kim, Jinmo
    • Journal of Digital Contents Society
    • /
    • v.17 no.1
    • /
    • pp.23-31
    • /
    • 2016
  • This study aims to develop a stereoscopic image authoring tool to effectively produce e-Book content that enhances user's sense of immersion in 3D environments. The proposed authoring tool consists of three core systems; 3D object editing, stereoscopic image, and image media production systems. First, the object editing system arranges and produces diverse objects that constitute virtual 3D spaces to fit the purpose of the content. In this case, commercial graphic authoring tools are utilized to design efficient data structures that can include produced external models. In addition, the material and textures of objects are made to be revisable and editable into the form wanted by the user. Thereafter, a stereoscopic image system will be implemented to produce the generated virtual scenes into stereoscopic images. This study uses the Anaglyph method so that the user can implement and use stereoscopic image scenes more easily. This method include functions to change the color of stereo cameras and control depth scaling. Finally, an image media production system will be implemented that will enable producing the produced stereoscopic images into single images or videos so that they can be effectively utilized in e-Book content.

Entropy-Based 6 Degrees of Freedom Extraction for the W-band Synthetic Aperture Radar Image Reconstruction (W-band Synthetic Aperture Radar 영상 복원을 위한 엔트로피 기반의 6 Degrees of Freedom 추출)

  • Hyokbeen Lee;Duk-jin Kim;Junwoo Kim;Juyoung Song
    • Korean Journal of Remote Sensing
    • /
    • v.39 no.6_1
    • /
    • pp.1245-1254
    • /
    • 2023
  • Significant research has been conducted on the W-band synthetic aperture radar (SAR) system that utilizes the 77 GHz frequency modulation continuous wave (FMCW) radar. To reconstruct the high-resolution W-band SAR image, it is necessary to transform the point cloud acquired from the stereo cameras or the LiDAR in the direction of 6 degrees of freedom (DOF) and apply them to the SAR signal processing. However, there are difficulties in matching images due to the different geometric structures of images acquired from different sensors. In this study, we present the method to extract an optimized depth map by obtaining 6 DOF of the point cloud using a gradient descent method based on the entropy of the SAR image. An experiment was conducted to reconstruct a tree, which is a major road environment object, using the constructed W-band SAR system. The SAR image, reconstructed using the entropy-based gradient descent method, showed a decrease of 53.2828 in mean square error and an increase of 0.5529 in the structural similarity index, compared to SAR images reconstructed from radar coordinates.