• Title/Summary/Keyword: Optical flow algorithm

Search Result 189, Processing Time 0.034 seconds

Attitudes Estimation for the Vision-based UAV using Optical Flow (광류를 이용한 영상기반 무인항공기의 자세 추정)

  • Jo, Seon-Yeong;Kim, Jong-Hun;Kim, Jung-Ho;Cho, Kyeum-Rae;Lee, Dae-Woo
    • Journal of the Korean Society for Aeronautical & Space Sciences
    • /
    • v.38 no.4
    • /
    • pp.342-351
    • /
    • 2010
  • UAV (Unmanned Aerial Vehicle) have an INS(Inertial Navigation System) equipment and also have an electro-optical Equipment for mission. This paper proposes the vision based attitude estimation algorithm using Kalman Filter and Optical flow for UAV. Optical flow is acquired from the movie of camera which is equipped on UAV and UAV's attitude is measured from optical flow. In this paper, Kalman Filter has been used for the settlement of the low reliability and estimation of UAV's attitude. Algorithm verification was performed through experiments. The experiment has been used rate table and real flight video. Then, this paper shows the verification result of UAV's attitude estimation algorithm. When the rate table was tested, the error was in 2 degree and the tendency was similar with AHRS measurement states. However, on the experiment of real flight movie, maximum yaw error was 21 degree and Maximum pitch error was 7.8 degree.

An Omnidirectional Vision-Based Moving Obstacle Detection in Mobile Robot

  • Kim, Jong-Cheol;Suga, Yasuo
    • International Journal of Control, Automation, and Systems
    • /
    • v.5 no.6
    • /
    • pp.663-673
    • /
    • 2007
  • This paper presents a new moving obstacle detection method using an optical flow in mobile robot with an omnidirectional camera. Because an omnidirectional camera consists of a nonlinear mirror and CCD camera, the optical flow pattern in omnidirectional image is different from the pattern in perspective camera. The geometry characteristic of an omnidirectional camera has influence on the optical flow in omnidirectional image. When a mobile robot with an omnidirectional camera moves, the optical flow is not only theoretically calculated in omnidirectional image, but also investigated in omnidirectional and panoramic images. In this paper, the panoramic image is generalized from an omnidirectional image using the geometry of an omnidirectional camera. In particular, Focus of expansion (FOE) and focus of contraction (FOC) vectors are defined from the estimated optical flow in omnidirectional and panoramic images. FOE and FOC vectors are used as reference vectors for the relative evaluation of optical flow. The moving obstacle is turned out through the relative evaluation of optical flows. The proposed algorithm is tested in four motions of a mobile robot including straight forward, left turn, right turn and rotation. The effectiveness of the proposed method is shown by the experimental results.

Obstacle Avoidance for a Mobile Robot Using Optical Flow (광류 정보를 이용한 이동 로봇의 장애물 회피 항법)

  • Lee, Han-Sik;Baek, Jun-Geol;Jang, Dong-Sik
    • Journal of Korean Institute of Industrial Engineers
    • /
    • v.28 no.1
    • /
    • pp.25-35
    • /
    • 2002
  • This paper presents a heuristic algorithm that a mobile robot avoids obstacles using optical flow. Using optical flow, the mobile robot can easily avoid static obstacles without a prior position information as well as moving obstacles with unknown trajectories. The mobile robot in this paper is able to recognize the locations or routes of obstacles, which can be detected by obtaining 2-dimensional optical flow information from a CCD camera. It predicts the possibilities of crash with obstacles based on the comparison between planned routes and the obstacle routes. Then it modifies its driving route if necessary. Driving acceleration and angular velocity of mobile robot are applied as controlling variables of avoidance. The corresponding simulation test is performed to verify the effectiveness of these factors. The results of simulation show that the mobile robot can reach the goal with avoiding obstacles which have variable routes and speed.

Digital Image Stabilization Based on Edge Detection and Lucas-Kanade Optical Flow (Edge Detection과 Lucas-Kanade Optical Flow 방식에 기반한 디지털 영상 안정화 기법)

  • Lee, Hye-Jung;Choi, Yun-Won;Kang, Tae-Hun;Lee, Suk-Gyu
    • The Journal of Korea Robotics Society
    • /
    • v.5 no.2
    • /
    • pp.85-92
    • /
    • 2010
  • In this paper, we propose a digital image stabilization technique using edge detection and Lucas-Kanade optical flow in order to minimize the motion of the shaken image. The accuracy of motion estimation based on block matching technique depends on the size of search window, which results in long calculation time. Therefore it is not applicable to real-time system. In addition, since the size of vector depends on that of block, it is difficult to estimate the motion which is bigger than the block size. The proposed method extracts the trust region using edge detection, to estimate the motion of some critical points in trust region based on Lucas-Kanade optical flow algorithm. The experimental results show that the proposed method stabilizes the shaking of motion image effectively in real time.

Robust Viewpoint Estimation Algorithm for Moving Parallax Barrier Mobile 3D Display (이동형 패럴랙스 배리어 모바일 3D 디스플레이를 위한 강인한 시청자 시역 위치 추정 알고리즘)

  • Kim, Gi-Seok;Cho, Jae-Soo;Um, Gi-Mun
    • Journal of Broadcast Engineering
    • /
    • v.17 no.5
    • /
    • pp.817-826
    • /
    • 2012
  • This paper presents a robust viewpoint estimation algorithm for Moving Parallax Barrier mobile 3D display in sudden illumination changes. We analyze the previous viewpoint estimation algorithm that consists of the Viola-Jones face detector and the feature tracking by the Optical-Flow. The sudden changes in illumination decreases the performance of the Optical-flow feature tracker. In order to solve the problem, we define a novel performance measure for the Optical-Flow tracker. The overall performance can be increased by the selective adoption of the Viola-Jones detector and the Optical-flow tracker depending on the performance measure. Various experimental results show the effectiveness of the proposed method.

The Implementing a Color, Edge, Optical Flow based on Mixed Algorithm for Shot Boundary Improvement (샷 경계검출 개선을 위한 칼라, 엣지, 옵티컬플로우 기반의 혼합형 알고리즘 구현)

  • Park, Seo Rin;Lim, Yang Mi
    • Journal of Korea Multimedia Society
    • /
    • v.21 no.8
    • /
    • pp.829-836
    • /
    • 2018
  • This study attempts to detect a shot boundary in films(or dramas) based on the length of a sequence. As films or dramas use scene change effects a lot, the issues regarding the effects are more diverse than those used in surveillance cameras, sports videos, medical care and security. Visual techniques used in films are focused on the human sense of aesthetic therefore, it is difficult to solve the errors in shot boundary detection with the method employed in surveillance cameras. In order to define the errors arisen from the scene change effects between the images and resolve those issues, the mixed algorithm based upon color histogram, edge histogram, and optical flow was implemented. The shot boundary data from this study will be used when analysing the configuration of meaningful shots in sequences in the future.

Vision-Based Indoor Localization Using Artificial Landmarks and Natural Features on the Ceiling with Optical Flow and a Kalman Filter

  • Rusdinar, Angga;Kim, Sungshin
    • International Journal of Fuzzy Logic and Intelligent Systems
    • /
    • v.13 no.2
    • /
    • pp.133-139
    • /
    • 2013
  • This paper proposes a vision-based indoor localization method for autonomous vehicles. A single upward-facing digital camera was mounted on an autonomous vehicle and used as a vision sensor to identify artificial landmarks and any natural corner features. An interest point detector was used to find the natural features. Using an optical flow detection algorithm, information related to the direction and vehicle translation was defined. This information was used to track the vehicle movements. Random noise related to uneven light disrupted the calculation of the vehicle translation. Thus, to estimate the vehicle translation, a Kalman filter was used to calculate the vehicle position. These algorithms were tested on a vehicle in a real environment. The image processing method could recognize the landmarks precisely, while the Kalman filter algorithm could estimate the vehicle's position accurately. The experimental results confirmed that the proposed approaches can be implemented in practical situations.

Optical Flow for Motion Images with Large Displacement by Functional Expansion

  • Kim, Jin-Woo
    • Journal of Korea Multimedia Society
    • /
    • v.7 no.12
    • /
    • pp.1680-1691
    • /
    • 2004
  • One of the representative methods of optical flow is a gradient method which estimates the movement of an object based on the differential of image brightness. However, the method is ineffective for large displacement of the object and many improved methods have been proposed to copy with such limitations. One of these improved techniques is the multigrid processing, which is used in many optical flow algorithms. As an alternative novel technique we have been proposing an orthogonal functional expansion method, where whole displacements are expanded from low frequency terms. This method is expected to be applicable to flow estimation with large displacement and deformation including expansion and contraction, which are difficult to cope with by conventional optical flow methods. In the orthogonal functional expansion method, the apparent displacement field is calculated iteratively by a projection method which utilizes derivatives of the invariant constraint equations of brightness constancy. One feature of this method is that differentiation of the input image is not necessary, thereby reducing sensitivity to noise. In this paper, we apply our method to several real images in which the objects undergo large displacement and/or deformation including expansion. We demonstrate the effectiveness of the orthogonal functional expansion method by comparing with conventional methods including our optimally scaled multigrid optical flow algorithm.

  • PDF

Design and Implementation of Optical Flow Estimator for Moving Object Detection in Advanced Driver Assistance System (첨단운전자보조시스템용 이동객체검출을 위한 광학흐름추정기의 설계 및 구현)

  • Yoon, Kyung-Han;Jung, Yong-Chul;Cho, Jae-Chan;Jung, Yunho
    • Journal of Advanced Navigation Technology
    • /
    • v.19 no.6
    • /
    • pp.544-551
    • /
    • 2015
  • In this paper, the design and implementation results of the optical flow estimator (OFE) for moving object detection (MOD) in advanced driver assistance system (ADAS). In the proposed design, Brox's algorithm with global optimization is considered, which shows the high performance in the vehicle environment. In addition, Cholesky factorization is applied to solve Euler-Lagrange equation in Brox's algorithm. Also, shift register bank is incorporated to reduce memory access rate. The proposed optical flow estimator was designed with Verilog-HDL, and FPGA board was used for the real-time verification. Implementation results show that the proposed optical flow estimator includes the logic slices of 40.4K, 155 DSP48s, and block memory of 11,290Kbits.

Applicability of Optical Flow Information for UAV Navigation under GNSS-denied Environment (위성항법 불용 환경에서의 무인비행체 항법을 위한 광류 정보 활용)

  • Kim, Dongmin;Kim, Taegyun;Jeaong, Hoijo;Suk, Jinyoung;Kim, Seungkeun;Kim, Younsil;Han, Sanghyuck
    • Journal of Advanced Navigation Technology
    • /
    • v.24 no.1
    • /
    • pp.16-27
    • /
    • 2020
  • This paper investigates the applicability of optical flow information for unmanned aerial vehicle (UAV) navigation under environments where global navigation satellite system (GNSS) is unavailable. Since the optical flow information is one of important measurements to estimate horizontal velocity and position, accuracy of the optical flow information must be guaranteed. So a navigation algorithm, which can estimate and cancel biases that the optical flow information may have, is suggested to improve the estimation performance. In order to apply and verify the proposed algorithm, an integrated simulation environment is built by designing a guidance, navigation, and control (GNC) system. Numerical simulations are implemented to analyze the navigation performance using this environment.