• Title/Summary/Keyword: Video Frames

Search Result 885, Processing Time 0.027 seconds

A Design of Fractional Motion Estimation Engine with 4×4 Block Unit of Interpolator & SAD Tree for 8K UHD H.264/AVC Encoder (8K UHD(7680×4320) H.264/AVC 부호화기를 위한 4×4블럭단위 보간 필터 및 SAD트리 기반 부화소 움직임 추정 엔진 설계)

  • Lee, Kyung-Ho;Kong, Jin-Hyeung
    • Journal of the Institute of Electronics and Information Engineers
    • /
    • v.50 no.6
    • /
    • pp.145-155
    • /
    • 2013
  • In this paper, we proposed a $4{\times}4$ block parallel architecture of interpolation for high-performance H.264/AVC Fractional Motion Estimation in 8K UHD($7680{\times}4320$) video real time processing. To improve throughput, we design $4{\times}4$ block parallel interpolation. For supplying the $10{\times}10$ reference data for interpolation, we design 2D cache buffer which consists of the $10{\times}10$ memory arrays. We minimize redundant storage of the reference pixel by applying the Search Area Stripe Reuse scheme(SASR), and implement high-speed plane interpolator with 3-stage pipeline(Horizontal Vertical 1/2 interpolation, Diagonal 1/2 interpolation, 1/4 interpolation). The proposed architecture was simulated in 0.13um standard cell library. The gate count is 436.5Kgates. The proposed H.264/AVC Fractional Motion Estimation can support 8K UHD at 30 frames per second by running at 187MHz.

Low-complexity Adaptive Loop Filters Depending on Transform-block Region (변환블럭의 영역에 따른 저복잡도 적응 루프 필터)

  • Lim, Woong;Nam, Jung-Hak;Sim, Dong-Gyu;Jung, Kwang-Soo;Cho, Dae-Sung;Choi, Byung-Doo
    • Journal of the Institute of Electronics Engineers of Korea SP
    • /
    • v.48 no.5
    • /
    • pp.46-54
    • /
    • 2011
  • In this paper, we propose a low-complexity loop filtering method depending on transform-block regions. Block adaptive loop filter (BALF) was developed to improve about 10% in compression performance for the next generation video coding. The BALF employs the Wiener filter that makes reconstructed frames close to the original ones and transmits filter-related information. However, the BALF requires high computational complexity, while it can achieve high compression performance because the block adaptive loop filter is applied to all the pixels in blocks. The proposed method is a new loop filter that classifies pixels in a block into inner and boundary regions based on the characteristics of the integer transform and derives optimum filters for each region. Then, it applies the selected filters for the inner and/or boundary regions. The decoder complexity can be adjusted by selecting region-dependent filter to be used in the decoder side. We found that the proposed algorithm can reduce 35.5% of computational complexity with 2.56% of compression loss, in case that only boundary filter is used.

A Study on the Sequence Analysis Technique of Urban Landscape Color and Urban Color Characteristics in accordance with Spatial Openness - Focusing on the View of the Daegu Monorail - (도시 경관색채의 시퀀스 분석기법과 공간 개방도에 따른 도시색채 특성연구 - 대구광역시 지상철 조망을 중심으로 -)

  • Koo, Min-Ah
    • Journal of the Korean Institute of Landscape Architecture
    • /
    • v.44 no.6
    • /
    • pp.120-136
    • /
    • 2016
  • This study, views the color of scenery not as a static state, but rather as a continuous sequence of perceptions that incorporates the concept of time. This study derived techniques to quantitatively analyze the flow and data from this sequence. By utilizing this, urban color trends can be based on openness. This is very close to what would be experienced by an actual viewer: it extracted color data and visual amount from frames at 2-second intervals by shooting a video of the color sequence of the city as seen from both the left and right sides from the inside of the monorail (line 3 of the Daegu urban railway). These images were classified by color group, brightness, chroma, high chroma distribution derived techniques such as openness of space, brightness level, clarity level, high-chroma distribution and code, advantage of visual amount, dominant factor exposure, hot and cold color image and dynamic of sequence rhythm. During the derived sequence, the data determines the openness in the visual amount of sky and it was found that the tendency of the colors of the city was opening regression analysis. The more colorful the city is opening the brightness is lowered, the chroma increased slightly, cold colors significantly increased, which also had a very deep relationship with Lynch enclosed proportion, color change of the city trends through the actual scenery could grasp in more detail.

De-interlacing Algorithm based on Motion Compensation Reliability (움직임 보상의 신뢰도에 기반 한 순차주사화 알고리즘)

  • Chang, Joon-Young;Kim, Young-Duk;Kang, Moon-Gi
    • Journal of the Institute of Electronics Engineers of Korea SP
    • /
    • v.46 no.6
    • /
    • pp.102-111
    • /
    • 2009
  • In this paper, we propose a de-interlacing algorithm that combines a motion compensation (MC) method and the vertical-temporal filter with motion compensation (MC V-T filter) according to motion compensation reliability. The MC method represent one of the best ways of improving the resolution of de-interlaced frames, but it may introduce motion compensation artifacts in regions with incorrect motion information. In these regions, the MC V-T filter that is very robust to motion vector errors can be used to correct motion compensation artifacts. The combination between two methods is controlled by the motion compensation reliability that is measured by analyzing the estimated motion vectors and the results of MC. The motion compensation reliability contains information about motion compensation artifacts of MC results and determines the combination weight according to this information. Therefore, the combination rule of the proposed method is more accurate than those of the conventional methods and it enables the proposed method to provide high quality video sequences without producing any visible artifacts. Experimental results with various test sequences show that the proposed algorithm outperforms conventional algorithms in terms of both visual and numerical criteria.

A Design of 4×4 Block Parallel Interpolation Motion Compensation Architecture for 4K UHD H.264/AVC Decoder (4K UHD급 H.264/AVC 복호화기를 위한 4×4 블록 병렬 보간 움직임보상기 아키텍처 설계)

  • Lee, Kyung-Ho;Kong, Jin-Hyeung
    • Journal of the Institute of Electronics and Information Engineers
    • /
    • v.50 no.5
    • /
    • pp.102-111
    • /
    • 2013
  • In this paper, we proposed a $4{\times}4$ block parallel architecture of interpolation for high-performance H.264/AVC Motion Compensation in 4K UHD($3840{\times}2160$) video real time processing. To improve throughput, we design $4{\times}4$ block parallel interpolation. For supplying the $9{\times}9$ reference data for interpolation, we design 2D cache buffer which consists of the $9{\times}9$ memory arrays. We minimize redundant storage of the reference pixel by applying the Search Area Stripe Reuse scheme(SASR), and implement high-speed plane interpolator with 3-stage pipeline(Horizontal Vertical 1/2 interpolation, Diagonal 1/2 interpolation, 1/4 interpolation). The proposed architecture was simulated in 0.13um standard cell library. The maximum operation frequency is 150MHz. The gate count is 161Kgates. The proposed H.264/AVC Motion Compensation can support 4K UHD at 72 frames per second by running at 150MHz.

A Study on FPGA Design for Rotating LED Display Available Video Output (동영상 표출이 가능한 회전 LED 전광판을 위한 FPGA 설계에 관한 연구)

  • Lim, Young-Sik;Lee, Seung-Ho
    • Journal of IKEEE
    • /
    • v.19 no.2
    • /
    • pp.168-175
    • /
    • 2015
  • In this paper, we propose FPGA design technique for rotating LED display device which is capable of displaying videos with the use of the afterimage effect. The proposed technique is made up of image data correction process based on inverse gamma correction and error diffusion, block interleaving process, and data serial output process. The data correction process based on inverse gamma correction and error diffusion is an image data correction step in which image data received are corrected by inverse gamma correction process to convert the data into linear brightness characteristics, and by error diffusion process to reduce the brightness reduction phenomenon in low-gray-level which is caused by inverse gamma correction. In the block interleaving process, the data of the frames entered transversely are first saved in accordance with entrance order, and then only the longitudinal image data are read. The data serial output process is applied to convert the parallel data in a rotating location into serial data and send them to LED Driver IC, in order to send data which will be displayed on high-speedy rotating LED Bar. To evaluate the accuracy of the proposed FPGA design technique, this paper used XC6SLX45-FG484, a Spartan 6 family of Xilinx, as FPGA, and ISE 14.5 as a design tool. According to the evaluation analysis, it was found that goal values were consistent with simulation values in terms of accurate operation of inverse gamma and error diffusion correction, block interleaving operation, and serialized operation of image data.

An Intra Prediction Method and Fast Intra Prediction Method in Inter Frames using Block Content and Dependency Probabilities on neighboring Block Modes in H.264|AVC (영상 내용 특성과 주위 블록 모드 상관성을 이용한 H.264|AVC 화면 간 프레임에서의 화면 내 예측 부호화 결정 방법과 화면 내 예측 고속화 방법)

  • Na, Tae-Young;Lee, Bum-Shik;Hahm, Sang-Jin;Park, Chang-Seob;Park, Keun-Soo;Kim, Mun-Churl
    • Journal of Broadcast Engineering
    • /
    • v.12 no.6
    • /
    • pp.611-623
    • /
    • 2007
  • The H.264|AVC standard incorporates an intra prediction tool into inter frame coding. However, this leads to excessive amount of increase in encoding time, thus resulting in the difficulty in real-time implementation of software encoders. In this paper, we first propose an early decision on intra prediction coding and a fast intra prediction method using the characteristics of block contents and the context of neighboring block modes for the intra prediction in the inter frame coding of H.264/AVC. Basically, the proposed methods determine a skip condition on whether the $4{\times}4$ intra prediction is to be used in the inter frame coding by considering the content characteristics of each block to be encoded and the context of its neighboring blocks. The performance of our proposed methods is compared with the Joint Model reference software version 11.0 of H.264|AVC. The experimental results show that our proposed methods allow for 41.63% reduction in the total encoding time with negligible amounts of PSNR drops and bitrate increases, compared to the original Joint Model reference software version 11.0.

Kinematic Characteristics Based on Proficiency In Geoduepyeopchagi in Taekwondo Poomsae Koryo

  • So, Jae Moo;Kang, Sung-Sun;Hong, AhReum;Jung, Jong Min;Kim, Jai Jeong
    • Korean Journal of Applied Biomechanics
    • /
    • v.26 no.4
    • /
    • pp.343-351
    • /
    • 2016
  • Objective: The purpose of this study was to help improve game performance and provide preliminary data to enhance the efficiency of the kick and stability of the support foot by comparing the kinematic characteristics of the repeated side kick (geodeupyeopchagi) in poomsaeKoryo between expert and non-expert groups. Method: The subjects were divided into 2 groups according to proficiency in Taekwondo, an expert group and a non-expert group (n = 7 in each group), to observe the repeated side-kick technique. Four video cameras were set at a speed of 60 frames/sec and exposure time of 1/500 sec to measure the kinematic factors of the 2 groups. The Kwon3D XPprogramas used to collect and analyze three-dimensional spatial coordinates. Ground reaction force data were obtained through a force plate with a 1.200-Hz frequency. An independent samplesttest was performed, and statistical significance was defined as .05. The SPSS 18.0 software was used to calculate the mean and standard deviation of the kinematic factors and to identify the difference between the experts and non-experts. Results: The angular displacement of the hip joint in both the expert and non-expert groups showed statistical significance on E1 and E4 of the left support foot and E5 of the right foot (p<.05). The angle displacement of the knee joint in both groups showed statistical significance on E4 of the left support foot, and E1 and E2 of the right foot (p<.05). The angular velocity of the lower leg in both groups showed no statistical significance on the left support foot but showed statistical significance on E2 and E6 of the right foot (p<.05). The angular velocity of the foot in both groups showed no statistical significance on the left support foot but showed statistical significance on E2 of the right foot (p<.05). The vertical ground reaction force in both groups showed statistical significance on E2 (p<.05). The center of pressure in all directions in both groups showed statistical significance (p<.5). Conclusion: While performing the repeated side kick (geodeupyeopchagi), the experts maintainedconsistency and stability of the angle of the support leg while the kick foot moved high and fast. On the other hand, the angle of the support foot of non-experts appeared inconsistent, and the kick foot was raised, relying on the support leg, resulting in unstable and inaccurate movement.

Optimizing a Multimedia File System for Streaming Severs (스트리밍 서버를 위한 멀티미디어 파일 시스템 최적화)

  • 박진연;김두한;원유집;류연승
    • Journal of KIISE:Computer Systems and Theory
    • /
    • v.31 no.5_6
    • /
    • pp.268-278
    • /
    • 2004
  • In this paper, we describe our experience in the design and implementation of the SMART file system to handle multimedia workload. Our work has three design objectives: (ⅰ) efficient support for sequential workload, (ⅱ) avoiding disk fragmentation, (ⅲ) logical unit based file access. To achieve these three objectives, we develop a file system where a file consists of linked list of Data Unit Group. Instead of tree like structure of the legacy Unix file system, we use single level file structure. Our file system can also access the file based upon the logical unit which can be video frame or audio samples. Data Unit Group is a group of logical data units which is allocated continuous disk blocks. At the beginning of each Data Unit Group, there exists an index array. Each index points to the beginning of logical data units, e.g. frames in the Data Unit Group. This index array enables the random access and sequencial access of semantic data units. SMART file system is elaborately tailored to effectively support multimedia workload. We perform physical experiments and compare the performance of SMART file system with EXT2 file system and SGI XFS file system. In this experiment, SMART file system exhibits superior performance under streaming workload.

Development on Identification Algorithm of Risk Situation around Construction Vehicle using YOLO-v3 (YOLO-v3을 활용한 건설 장비 주변 위험 상황 인지 알고리즘 개발)

  • Shim, Seungbo;Choi, Sang-Il
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.20 no.7
    • /
    • pp.622-629
    • /
    • 2019
  • Recently, the government is taking new approaches to change the fact that the accident rate and accident death rate of the construction industry account for a high percentage of the whole industry. Especially, it is investing heavily in the development of construction technology that is fused with ICT technology in line with the current trend of the 4th Industrial Revolution. In order to cope with this situation, this paper proposed a concept to recognize and share the work situation information between the construction machine driver and the surrounding worker to enhance the safety in the place where construction machines are operated. In order to realize the part of the concept, we applied image processing technology using camera based on artificial intelligence to earth-moving work. Especially, we implemented an algorithm that can recognize the surrounding worker's circumstance and identify the risk situation through the experiment using the compaction equipment. and image processing algorithm based on YOLO-v3. This algorithm processes 15.06 frames per second in video and can recognize danger situation around construction machine with accuracy of 90.48%. We will contribute to the prevention of safety accidents at the construction site by utilizing this technology in the future.