• Title/Summary/Keyword: Optical flow estimation

Search Result 123, Processing Time 0.025 seconds

Digital Image Stabilization Based on Edge Detection and Lucas-Kanade Optical Flow (Edge Detection과 Lucas-Kanade Optical Flow 방식에 기반한 디지털 영상 안정화 기법)

  • Lee, Hye-Jung;Choi, Yun-Won;Kang, Tae-Hun;Lee, Suk-Gyu
    • The Journal of Korea Robotics Society
    • /
    • v.5 no.2
    • /
    • pp.85-92
    • /
    • 2010
  • In this paper, we propose a digital image stabilization technique using edge detection and Lucas-Kanade optical flow in order to minimize the motion of the shaken image. The accuracy of motion estimation based on block matching technique depends on the size of search window, which results in long calculation time. Therefore it is not applicable to real-time system. In addition, since the size of vector depends on that of block, it is difficult to estimate the motion which is bigger than the block size. The proposed method extracts the trust region using edge detection, to estimate the motion of some critical points in trust region based on Lucas-Kanade optical flow algorithm. The experimental results show that the proposed method stabilizes the shaking of motion image effectively in real time.

Enhanced Real-Time Intermediate Flow Estimation for Video Frame Interpolation

  • Minseop Kim;Haechul Choi
    • Journal of Web Engineering
    • /
    • v.20 no.8
    • /
    • pp.2413-2432
    • /
    • 2021
  • Recently, the demand for high-quality video content has rapidly been increasing, led by the development of network technology and the growth in video streaming platforms. In particular, displays with a high refresh rate, such as 120 Hz, have become popular. However, the visual quality is only enhanced if the video stream is produced at the same high frame rate. For the high quality, conventional videos with a low frame rate should be converted into a high frame rate in real time. This paper introduces a bidirectional intermediate flow estimation method for real-time video frame interpolation. A bidirectional intermediate optical flow is directly estimated to predict an accurate intermediate frame. For real-time processing, multiple frames are interpolated with a single intermediate optical flow and parts of the network are implemented in 16-bit floating-point precision. Perceptual loss is also applied to improve the cognitive performance of the interpolated frames. The experimental results showed a high prediction accuracy of 35.54 dB on the Vimeo90K triplet benchmark dataset. The interpolation speed of 84 fps was achieved for 480p resolution.

Attitudes Estimation for the Vision-based UAV using Optical Flow (광류를 이용한 영상기반 무인항공기의 자세 추정)

  • Jo, Seon-Yeong;Kim, Jong-Hun;Kim, Jung-Ho;Cho, Kyeum-Rae;Lee, Dae-Woo
    • Journal of the Korean Society for Aeronautical & Space Sciences
    • /
    • v.38 no.4
    • /
    • pp.342-351
    • /
    • 2010
  • UAV (Unmanned Aerial Vehicle) have an INS(Inertial Navigation System) equipment and also have an electro-optical Equipment for mission. This paper proposes the vision based attitude estimation algorithm using Kalman Filter and Optical flow for UAV. Optical flow is acquired from the movie of camera which is equipped on UAV and UAV's attitude is measured from optical flow. In this paper, Kalman Filter has been used for the settlement of the low reliability and estimation of UAV's attitude. Algorithm verification was performed through experiments. The experiment has been used rate table and real flight video. Then, this paper shows the verification result of UAV's attitude estimation algorithm. When the rate table was tested, the error was in 2 degree and the tendency was similar with AHRS measurement states. However, on the experiment of real flight movie, maximum yaw error was 21 degree and Maximum pitch error was 7.8 degree.

Algorithm for Arbitrary Point Tracking using Pyramidal Optical Flow (피라미드 기반 광류 추정을 이용한 영상 내의 임의의 점 추적 알고리즘)

  • Lee, Jae-Kwang;Park, Chang-Joon
    • Journal of Korea Multimedia Society
    • /
    • v.10 no.11
    • /
    • pp.1407-1416
    • /
    • 2007
  • This paper describes an algorithm for arbitrary point tracking using pyramidal optical flow. The optical flow is calculated based on the Lucas-Kanade's optical flow estimation in this paper. The image pyramid is employed to calculate a big motion while being sensitive to a small motion. Furthermore, a rectification process is proposed to reduce the error which is increased as it goes down to the lower level of the image pyramid. The accuracy of the optical flow estimation was increased by using some constraints and sub-pixel interpolation of the optical flow and this makes our algorithm to track points in which they do not have features such as edges or corners. The proposed algorithm is implemented and primary results are shown in this paper.

  • PDF

Spatial Multilevel Optical Flow Architecture-based Dynamic Motion Estimation in Vehicular Traffic Scenarios

  • Fuentes, Alvaro;Yoon, Sook;Park, Dong Sun
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.12 no.12
    • /
    • pp.5978-5999
    • /
    • 2018
  • Pedestrian detection is a challenging area in the intelligent vehicles domain. During the last years, many works have been proposed to efficiently detect motion in images. However, the problem becomes more complex when it comes to detecting moving areas while the vehicle is also moving. This paper presents a variational optical flow-based method for motion estimation in vehicular traffic scenarios. We introduce a framework for detecting motion areas with small and large displacements by computing optical flow using a multilevel architecture. The flow field is estimated at the shortest level and then successively computed until the largest level. We include a filtering parameter and a warping process using bicubic interpolation to combine the intermediate flow fields computed at each level during optimization to gain better performance. Furthermore, we find that by including a penalization function, our system is able to effectively reduce the presence of outliers and deal with all expected circumstances in real scenes. Experimental results are performed on various image sequences from Daimler Pedestrian Dataset that includes urban traffic scenarios. Our evaluation demonstrates that despite the complexity of the evaluated scenes, the motion areas with both moving and static camera can be effectively identified.

Optical Flow Based Vehicle Counting and Speed Estimation in CCTV Videos (Optical Flow 기반 CCTV 영상에서의 차량 통행량 및 통행 속도 추정에 관한 연구)

  • Kim, Jihae;Shin, Dokyung;Kim, Jaekyung;Kwon, Cheolhee;Byun, Hyeran
    • Journal of Broadcast Engineering
    • /
    • v.22 no.4
    • /
    • pp.448-461
    • /
    • 2017
  • This paper proposes a vehicle counting and speed estimation method for traffic situation analysis in road CCTV videos. The proposed method removes a distortion in the images using Inverse perspective Mapping, and obtains specific region for vehicle counting and speed estimation using lane detection algorithm. Then, we can obtain vehicle counting and speed estimation results from using optical flow at specific region. The proposed method achieves stable accuracy of 88.94% from several CCTV images by regional groups and it totally applied at 106,993 frames, about 3 hours video.

An Adaptive Block Matching Motion Estimation Method Using Optical Flow (광류를 이용한 적응적인 블록 정합 움직임 추정 기법)

  • Kim, Kyoung-Kyoo;Park, Kyung-Nam
    • Journal of Korea Society of Industrial Information Systems
    • /
    • v.13 no.1
    • /
    • pp.57-67
    • /
    • 2008
  • In this paper, we present an adaptive block matching motion estimation using optical flow. In the proposed algorithm, we calculate the temporal and spatial gradient value for each pixel value from tile differential filter, and estimate the optical flow which is used to decide the location and the size of the search region from the gradient values by least square optical flow algorithm. In particular, the proposed algorithm showed a excellent performance with fast and complex motion sequences. From the computer simulation for various motion characteristic sequences. The proposed algorithm shows a significant enhancement of PSNR over previous blocking matching algorithms.

  • PDF

Use of Optical Flow Information with three Cameras for Robot Navigation (로봇 주행을 위한 세개의 카메라를 사용한 광류 정보 활용)

  • Lee, Soo-Yong
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.18 no.2
    • /
    • pp.110-117
    • /
    • 2012
  • This paper describes a new design of optical flow estimation system with three cameras. Optical flow provides useful information of camera movement; however a unique solution is not usually available for unknowns including the depth information. A camera and two tilted cameras are used to have different view of angle and direction of movement to the camera axis. Geometric analysis is performed for cases of several independent movements. The ideas of taking advantage of the extra information for robot navigation are discussed with experimental results.

The Estimation of Blood Velocity from Heart in Medical Images using Regional Segmentation (영상분할을 이용한 의학영상에서의 심장혈류 측정)

  • 정철곤;김중규;김경섭
    • Proceedings of the IEEK Conference
    • /
    • 1999.11a
    • /
    • pp.517-520
    • /
    • 1999
  • In this paper, we propose a non-invasive method to estimate blood velocity from the real medical images. To measure the magnitude and direction components associated with the blood velocity, we apply the optical flow analysis algorithm. It is demonstrated that the accuracy of the blood velocity estimate could possibly be increased by segmenting the optical flow region. We call this the Region Optical Flow(ROF) algorithm. We carried out some preliminary experiments using the aorta medical images, and corresponding regional optical flow diagrams are provided.

  • PDF

Robust Viewpoint Estimation Algorithm for Moving Parallax Barrier Mobile 3D Display (이동형 패럴랙스 배리어 모바일 3D 디스플레이를 위한 강인한 시청자 시역 위치 추정 알고리즘)

  • Kim, Gi-Seok;Cho, Jae-Soo;Um, Gi-Mun
    • Journal of Broadcast Engineering
    • /
    • v.17 no.5
    • /
    • pp.817-826
    • /
    • 2012
  • This paper presents a robust viewpoint estimation algorithm for Moving Parallax Barrier mobile 3D display in sudden illumination changes. We analyze the previous viewpoint estimation algorithm that consists of the Viola-Jones face detector and the feature tracking by the Optical-Flow. The sudden changes in illumination decreases the performance of the Optical-flow feature tracker. In order to solve the problem, we define a novel performance measure for the Optical-Flow tracker. The overall performance can be increased by the selective adoption of the Viola-Jones detector and the Optical-flow tracker depending on the performance measure. Various experimental results show the effectiveness of the proposed method.