• Title/Summary/Keyword: frame interpolation method

Search Result 93, Processing Time 0.026 seconds

Research of Phase Correlation Method for Identifying Quantitative Similarity in Adjacent Real-time Streaming Frame

  • Cho, Yongjin;Yun, Yeji;Lee, Kyou-seung;Oh, Jong-woo;Lee, DongHoon
    • Proceedings of the Korean Society for Agricultural Machinery Conference
    • /
    • 2017.04a
    • /
    • pp.157-157
    • /
    • 2017
  • To minimize the damage by wild birds and acquire the benefits such as protection against weeds and maintenance of water content in soil, the mulching black color vinyl after seeding should be carried out. Non-contact and non-destructive methods that can continuously determine the locations are necessary. In this study, a crop position detection method was studied that uses infrared thermal image sensor to determine the cotyledon position under vinyl mulch. The moving system for acquiring image arrays has been developed for continuously detecting crop locations under plastic mulching on the field. A sliding mechanical device was developed to move the sensor, which were arranged in the form of a linear array, perpendicular to the array using a micro-controller integrated with a stepping motor. The experiments were conducted while moving 4.00 cm/s speed of the IR sensor by the rotational speed of the stepping motor based on a digital pulse width modulation signal from the micro-controller. The acquired images were calibrated with the spatial image correlation. The collected data were processed using moving averaging on interpolation to determine the frame where the variance was the smallest in resolution units of 1.02 cm. Non-linear integral interpolation was one of method for analyzing the frequency using the normalization image and then arbitrarily increasing the limited data value of $16{\times}4pixels$ in one frame. It was a method to relatively reduce the size of overlapping pixels by arbitrarily increasing the limited data value. The splitted frames into 0.1 units instead of 1 pixel can propose more than 10 times more accurate and original method than the existing correction method. The non-integral calibration method was conducted by applying the subdivision method to the pixels to find the optimal correction resolution based on the first reversed frequency. In order to find a correct resolution, the expected location of the first crop was indicated on near pixel 4 in the inversion frequency. For the most optimized resolution, the pixel was divided by 0.4 pixel instead of one pixel to find out where the lowest frequency exists.

  • PDF

Improving transformer-based speech recognition performance using data augmentation by local frame rate changes (로컬 프레임 속도 변경에 의한 데이터 증강을 이용한 트랜스포머 기반 음성 인식 성능 향상)

  • Lim, Seong Su;Kang, Byung Ok;Kwon, Oh-Wook
    • The Journal of the Acoustical Society of Korea
    • /
    • v.41 no.2
    • /
    • pp.122-129
    • /
    • 2022
  • In this paper, we propose a method to improve the performance of Transformer-based speech recognizers using data augmentation that locally adjusts the frame rate. First, the start time and length of the part to be augmented in the original voice data are randomly selected. Then, the frame rate of the selected part is changed to a new frame rate by using linear interpolation. Experimental results using the Wall Street Journal and LibriSpeech speech databases showed that the convergence time took longer than the baseline, but the recognition accuracy was improved in most cases. In order to further improve the performance, various parameters such as the length and the speed of the selected parts were optimized. The proposed method was shown to achieve relative performance improvement of 11.8 % and 14.9 % compared with the baseline in the Wall Street Journal and LibriSpeech speech databases, respectively.

Development of Standard Golf Swing Motion Modeling System (골프 표준 스윙 자세 구현 시스템 개발)

  • 이지홍;조복기;김기웅;심형원;유병욱
    • Proceedings of the IEEK Conference
    • /
    • 2002.06e
    • /
    • pp.121-124
    • /
    • 2002
  • This paper explains the system which finds the data of the joint of Wire Frame(that express the body structure of the golfer) from standard golf swing movie. Also, this paper used interpolation and the method which modify the distance between a joint and a close joint to general new joint data. Last this paper explains the system that make a standard golf swing attitude by continuous display the static attitude(which are formed with Wire Frame) of golf swing operations.

  • PDF

Efficient Motion Compensated Extrapolation Technique Using Forward and Backward Motion Estimation (순방향과 역방향 움직임 추정을 이용한 효율적인 움직임 보상 외삽 기법)

  • Kwon, Hye-Gyung;Lee, Chang-Woo
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.36 no.4C
    • /
    • pp.207-216
    • /
    • 2011
  • Motion compensated extrapolation (MCE) techniques show inferior performance compared to motion compensated interpolation techniques, since only past frames are used in MCE. MCE techniques are used for the reconstruction of corrupted frames, the up-conversion of frame rates and the generation of side information in the distributed video coding system. In this paper, the performance of various MCE techniques are evaluated and an efficient MCE technique using the forward and backward motion estimation is proposed. In the proposed technique, the present frame is extrapolated by averaging two frames which are generated by forward and backward motion estimation respectively. It is shown that the proposed method produces better PSNR results and less blocking phenomena than conventional methods.

Implementation of Text-to-Audio Visual Speech Synthesis Using Key Frames of Face Images (키프레임 얼굴영상을 이용한 시청각음성합성 시스템 구현)

  • Kim MyoungGon;Kim JinYoung;Baek SeongJoon
    • MALSORI
    • /
    • no.43
    • /
    • pp.73-88
    • /
    • 2002
  • In this paper, for natural facial synthesis, lip-synch algorithm based on key-frame method using RBF(radial bases function) is presented. For lips synthesizing, we make viseme range parameters from phoneme and its duration information that come out from the text-to-speech(TTS) system. And we extract viseme information from Av DB that coincides in each phoneme. We apply dominance function to reflect coarticulation phenomenon, and apply bilinear interpolation to reduce calculation time. At the next time lip-synch is performed by playing the synthesized images obtained by interpolation between each phonemes and the speech sound of TTS.

  • PDF

A Study on the analysis of in-cylinder flow fields using PTV (PTV를 이용한 실린더내 유동장 해석에 관한 연구)

  • Jeong, Hwan-Su;Choi, Su-Jin;Jeon, Chung-Hwan;Chang, Young-June
    • Proceedings of the KSME Conference
    • /
    • 2000.04b
    • /
    • pp.692-697
    • /
    • 2000
  • In Particle Tracking Velocimetry, the analysis of double-exposed photographic plate can be carried out either by means of Young's fringe analysis or by a digital image processing technique. In this study, we used digital image processing to two images in one frame far analyzing in-cylinder flow fields, and compared PTV with PSV(Particle Streak Velocimetry). Additionally, this technique was verified by two different calibration method. One is interpolation by invert distance, the other is interpolation by area ratio. Finally, the results between two interpolation methods were similar in whole flow fields.

  • PDF

Frame Rate Up-Conversion with Occlusion Detection Function (폐색영역탐지 기능을 갖는 프레임율 변환)

  • Kim, Nam-Uk;Lee, Yung-Lyul
    • Journal of Broadcast Engineering
    • /
    • v.20 no.2
    • /
    • pp.265-272
    • /
    • 2015
  • A new technology on video frame rate up-conversion (FRUC) is presented by combining the median filter and motion estimation (ME) with an occlusion detection (OD) method. First, ME is performed to have a motion vector. Then, the OD method is used to refine motion vector in the occlusion region. Since the wrong motion vector can be obtained with high possibility in the occluded area, a median filtering that less depends on the motion vector is applied to that area, and since the motion vector is continuous and robust in the non-occluded area, BDMC(Bi-Directional Motion Compensated interpolation) is applied to obtain interpolated image in that area. BDMC using the bi-directional motion vectors achieves good results when continuity and robustness of the motion vector is higher. Experimental results show that the proposed algorithm provides better performance than the conventional approach. The average gain of PSNR (Peak Signal to Noise Ratio) is approximately 0.16 dB in the test sequences compared with BDMC.

Error Concealment Using Intra-Mode Information Included in H.264/AVC-Coded Bitstream

  • Kim, Dong-Hyung;Jeong, Se-Yoon;Choi, Jin-Soo;Jeon, Gwang-Gil;Kim, Seung-Jong;Jeong, Je-Chang
    • ETRI Journal
    • /
    • v.30 no.4
    • /
    • pp.506-515
    • /
    • 2008
  • The H.264/AVC standard has adopted new coding tools such as intra-prediction, variable block size, motion estimation with quarter-pixel-accuracy, loop filter, and so on. The adoption of these tools enables an H.264/AVC-coded bitstream to have more information than was possible with previous standards. In this paper, we propose an effective spatial error concealment method with low complexity in H.264/AVC intra-frame. From information included in an H.264/AVC-coded bitstream, we use prediction modes of intra-blocks to recover a damaged block. This is because the prediction direction in each prediction mode is highly correlated to the edge direction. We first estimate the edge direction of a damaged block using the prediction modes of the intra-blocks adjacent to a damaged block and classify the area inside the damaged block into edge and flat areas. Our method then recovers pixel values in the edge area using edge-directed interpolation, and recovers pixel values in the flat area using weighted interpolation. Simulation results show that the proposed method yields better video quality than conventional approaches.

  • PDF

Advanced Frame Rate Conversion without Halo and judder effect for 120Hz LCD Displays

  • Lim, Kyoung-Won;Kim, Han-Soo;Noh, Hyun-Chul;Shin, Hyun-Chul;Jung, Woo-Chul;Koo, Gun-Jae;Park, Ryuk
    • 한국정보디스플레이학회:학술대회논문집
    • /
    • 2008.10a
    • /
    • pp.1397-1400
    • /
    • 2008
  • Frame rate conversion became key technology due to recent advances in LCD panel refresh rates. Although many FRC algorithms have been developed and applied for LCD TV sets, they still suffer from well-known halo artifact. This paper discusses about the artifacts and method to handle them.

  • PDF

Temporal interpolator based on spatial filtering (공간 필터링에 근거한 시간축 내삽기)

  • 김종훈
    • Journal of the Korean Institute of Telematics and Electronics B
    • /
    • v.33B no.8
    • /
    • pp.60-67
    • /
    • 1996
  • In this paper, we propose a new temporal interpolation method based on spatial filtering. Compared with the conventional method, the proposed one may use a few adjacent frames and apply temporal lowpass filtering. To develop this method, we follow the basic approach of sampling rate conversion. Additionally, we use some assumption of video sequence : moving object has constant velocity rigid translational motion. From them, spatial filtering for temporal sampling rate conversion is described. This method has a lot of noise immunity on a motion vector and doesn't make a great difference from the original frame. The interpolated frame shows moderate change even there is a great time difference. This method has exactly same description of motion adaptive spatial filter which has an efficient temporal band-limiting characteristics. It imposes the possibility to make video sequence with good pictural quality.

  • PDF