• Title/Summary/Keyword: Future Video Coding

Search Result 34, Processing Time 0.024 seconds

Visual-Attention-Aware Progressive RoI Trick Mode Streaming in Interactive Panoramic Video Service

  • Seok, Joo Myoung;Lee, Yonghun
    • ETRI Journal
    • /
    • v.36 no.2
    • /
    • pp.253-263
    • /
    • 2014
  • In the near future, traditional narrow and fixed viewpoint video services will be replaced by high-quality panorama video services. This paper proposes a visual-attention-aware progressive region of interest (RoI) trick mode streaming service (VA-PRTS) that prioritizes video data to transmit according to the visual attention and transmits prioritized video data progressively. VA-PRTS enables the receiver to speed up the time to display without degrading the perceptual quality. For the proposed VA-PRTS, this paper defines a cutoff visual attention metric algorithm to determine the quality of the encoded video slice based on the capability of visual attention and the progressive streaming method based on the priority of RoI video data. Compared to conventional methods, VA-PRTS increases the bitrate saving by over 57% and decreases the interactive delay by over 66%, while maintaining a level of perceptual video quality. The experiment results show that the proposed VA-PRTS improves the quality of the viewer experience for interactive panoramic video streaming services. The development results show that the VA-PRTS has highly practical real-field feasibility.

ETRI AI Strategy #3: Leading Future Technologies of Network, Media, and Content (ETRI AI 실행전략 3: 네트워크 및 미디어·콘텐츠 미래기술 선도)

  • Kim, S.M.;Yeon, S.J.
    • Electronics and Telecommunications Trends
    • /
    • v.35 no.7
    • /
    • pp.23-35
    • /
    • 2020
  • In this paper, we introduce ETRI AI Strategy #3, "Leading Future Technologies of Network, Media, and Content." Its first goal is "to innovate AI service technology to overcome the current limitations of AI technologies." Artificial intelligence (AI) services, such as self-driving cars and robots, are combinations of computing, network, AI algorithms, and other technologies. To develop AI services, we need to develop different types of network, media coding, and content creation technologies. Moreover, AI technologies are adopted in ICT technologies. Self-planning and self-managing networks and automatic content creation technologies using AI are being developed. This paper introduces the two directions of ETRI's ICT technology development plan for AI: ICT for AI and ICT by AI. The area of ICT for AI has only recently begun to develop. ETRI, the ICT leader, hopes to have opportunities for leadership in the second wave of AI services.

LCU-Level Rate Control for HEVC Considering Hierarchical Coding Structure (HEVC의 계층적 부호화 구조를 고려한 LCU 단위의 비트율 제어 기법)

  • Park, Dong-Il;Kim, Jae-Gon;Lim, Sung-Chang;Kim, Jong-Ho;Kim, Hui-Yong
    • Journal of Broadcast Engineering
    • /
    • v.16 no.5
    • /
    • pp.762-772
    • /
    • 2011
  • In this paper, a method of rate control for constant bitrate (CBR) coding of High Efficiency Video Coding (HEVC) is addressed. The existing rate control of H.264/AVC may not provide exact rate control in the case of hierarchical coding structure since it doesn't consider the characteristics of the hierarchical coding structure. It is expected that a rate control is added to the reference software called HM for CBR encoding in the near future. More accurate rate control may be required in a hierarchical structure of random access (RA) mode defined in the common test condition of HM. In this paper, we propose a method of rate control based on quadratic Rate-Distortion (R-D) model considering temporal layers and frame types in hierarchical coding structure for efficient rate control. In the consideration of the trade-off relationship between the bit fluctuation and the average PSNR, both of frame and coding unit (CU) are set as the basic unit of rate control. The performance of the proposed rate control method is verified by simulations along with the trade-off relationships for the both cases of basic unit.

Transmission Rate Decision of Live Video Based on Coding Information (부호화 정보에 기반한 라이브 비디오의 전송률 결정)

  • Lee Myeong-jin
    • Journal of Korea Multimedia Society
    • /
    • v.8 no.9
    • /
    • pp.1216-1226
    • /
    • 2005
  • In this paper, a preventive transmission rate decision algorithm, called PTRD, is proposed for the transmission of live video over networks with dynamic bandwidth allocation capability. Frame analyzer predicts the bit-rates of future frames before encoding by analyzing the source information such as spatial variances and the degree of scene changes. By using the predicted bit-rates, transmission rate bounds are derived from the constraints of encoder and decoder buffers. To resolve the problem of renegotiation cost increment due to frequent renegotiations, the PTRD algorithm is presented to decide transmission rates considering the elapsed time after the recent renegotiation and the perceived video quality. From the simulation results, compared to the normalized LMS based method, PTRD is shown to achieve high channel utilization with low renegotiation cost and no delay violation.

  • PDF

A Study of Inter Prediction using Template Matching (Template Matching을 이용한 화면 간 예측에 대한 연구)

  • Lim, Sung-won;Moon, Joo-hee
    • Proceedings of the Korean Society of Broadcast Engineers Conference
    • /
    • 2016.06a
    • /
    • pp.204-206
    • /
    • 2016
  • 본 논문에서는 template matching을 이용한 PMMVD(Pattern Matched Motion Vector Derivation)기술에 대해 움직임 추정 방식에 따라 복잡도를 분석한다. PMMVD 기술은 HEVC의 화면 간 예측 기술과는 다르게 움직임과 관련된 정보를 부호화하지 않으며, 복호화기에서 움직임 벡터를 추정하는 방식이다. 따라서 종래의 기술 대비 높은 효율이 발생하지만 복호화기의 복잡도는 급격히 증가하게 된다. 이러한 이유로 다양한 움직임 추정 방식에 따라 성능을 분석하여 최적의 조합을 찾는 것은 매우 중요한 이슈임을 알 수 있다. 이를 위하여 현재 JVET(Joint Video Exploration Team)에서 FVC(Future Video Coding)를 위해 발표한 참조 소프트웨이인 JEM 2.0(Joint Exploration Test Model 2)을 이용하여 실험을 수행하고 향후 연구 방향을 논의한다.

  • PDF

A Case Study on the Pre-service Math Teacher's Development of AI Literacy and SW Competency (예비수학교사의 AI 소양과 SW 역량 계발에 관한 사례 연구)

  • Kim, Dong Hwa;Kim, Seung Ho
    • East Asian mathematical journal
    • /
    • v.39 no.2
    • /
    • pp.93-117
    • /
    • 2023
  • The aim of this study is to explore the pre-service math teachers' characteristics of education to develop their AI literacy and SW competency, and to derive some implications. We conducted a 14-hours AI and SW education program for pre-service teachers with theory and practice, and an analysis on class observation data, video frames of classes and interview, Python programming assignments and papers. The results of this case study for 3 pre-service teachers are as follows. First, two students understood artificial neural network and deep learning system accurately, furthermore, all students conducted a couple of explorations related with performance improvement of deep learning system with interest. Second, coding and exploration activities using Python improved students' computational thinking as well as SW competency, which help them give convergence education in the future. Third, they responded positively to the necessity of AI literacy and SW competency development, and to applying coding to math class. Lastly, it's necessary to endeavor to give a coding education to the student's eye level according to his or her prerequisite and to ease the burden of student's studying AI technology.

Unequal Error Protection: Survey and Standardization Prospect (비균등 오류정정기법의 연구 동향과 표준화 전망)

  • Park, Ki-Hyeon;Nam, Mi-Young;Park, Jin-Soo;Song, Hong-Yeop
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.37C no.11
    • /
    • pp.1054-1063
    • /
    • 2012
  • In this paper, we introduce basic theories, effects and applications of the unequal error protection (UEP) system that is expected to play a major role in the future multi-layered broadcast system. Also we show results of surveys on the various previous studies and standards about the UEP systems, and we give prospects of standardizations and future applications of UEP based on the surveys.

Efficient Local Decoding Using Bit Stream Map for High Resolution Video (비트 스트림 지도를 이용한 고해상도 영상의 효율적인 지역복호화)

  • Park Sungwon;Won Jongwoo;Lee Sunyoung;Kim Wookjoong;Kim Kyuheon;Jang Euee S
    • Journal of Broadcast Engineering
    • /
    • v.9 no.4 s.25
    • /
    • pp.391-401
    • /
    • 2004
  • In this paper, we introduce a novel coding method to efficiently enable spatial random access for high resolution video. In terms of resolution and display size, standard display devices (such as cathode-ray tubes. monitors. PDAs, and LCDs) do not sufficiently support high resolution video such as digital cinema and panoramic video. Currently, users have no choice but to view video at lower resolution as a result of down-sampling, or only a partial region of the video due to display size limitations. Our proposed method. which we call the B-map, represents the set of starting locations of the coded segments in a picture frame. This information, or B-map, is first sent to the decoder prior to the coded data stream of the frame and is then used for fast local decoding. To test our method, we compare our B-map with JPEG tiling and the JPEG Resynchronization marker. Experimental results show that the proposed coding method requires less overhead than existing methods during the same decoding time. The results show promise for future panoramic or digital cinema applications.

A qualitative case study of computer programming and unfolding creative processes: focusing on NetLogo-based computational thinking (컴퓨터 프로그래밍과 창의성 발현 활동에 관한 질적 사례 연구: NetLogo 기반의 계산적 사고 중심으로)

  • Jun, Young-Cook
    • The Journal of Korean Association of Computer Education
    • /
    • v.18 no.3
    • /
    • pp.1-14
    • /
    • 2015
  • The aim of this paper is to explore and understand the gifted student's characteristics such as NetLogo programming patterns, attitudes, his/her interest in problems solving. Based on transcripts and coding video frames, we explored the meaningful scenes to come up with thinking patterns, NetLogo programming patterns, attitudes, behaviors on tasks such as drawing regular starlike shapes. This case study contrasts with two other students revealing their unique characteristics both in computational thinking patterns and coding activities. The participant reveals his own ways of finding a clue and elaborating it further for coming up with concise NetLogo coding. This paper provides cross-case discussion and future research direction on how to improve gifted education in terms of problem solving in creative ways.

A study of Development of Transmission Systems for Terrestrial Single Channel Fixed 4K UHD & Mobile HD Convergence Broadcasting by Employing FEF (Future Extension Frame) Multiplexing Technique (FEF (Future Extension Frame) 다중화 기법을 이용한 지상파 단일 채널 고정 4K UHD & 이동 HD 융합방송 전송시스템 개발에 관한 연구)

  • Oh, JongGyu;Won, YongJu;Lee, JinSeop;Kim, JoonTae
    • Journal of Broadcast Engineering
    • /
    • v.20 no.2
    • /
    • pp.310-339
    • /
    • 2015
  • In this paper, the possibility of a terrestrial fixed 4K UHD (Ultra High Definition) and mobile HD (High Definition) convergence broadcasting service through a single channel employing the FEF (Future Extension Frame) multiplexing technique in DVB (Digital Video Broadcasting)-T2 (Second Generation Terrestrial) systems is examined. The performance of such a service is also investigated. FEF multiplexing technology can be used to adjust the FFT (fast Fourier transform) and CP (cyclic prefix) size for each layer, whereas M-PLP (Multiple-Physical Layer Pipe) multiplexing technology in DVB-T2 systems cannot. The convergence broadcasting service scenario, which can provide fixed 4K UHD and mobile HD broadcasting through a single terrestrial channel, is described, and transmission requirements of the SHVC (Scalable High Efficiency Video Coding) technique are predicted. A convergence broadcasting transmission system structure is described by employing FEF and transmission technologies in DVB-T2 systems. Optimized transmission parameters are drawn to transmit 4K UHD and HD convergence broadcasting by employing a convergence broadcasting transmission structure, and the reception performance of the optimized transmission parameters under AWGN (additive white Gaussian noise), static Brazil-D, and time-varying TU (Typical Urban)-6 channels is examined using computer simulations to find the TOV (threshold of visibility). From the results, for the 6 and 8 MHz bandwidths, reliable reception of both fixed 4K UHD and mobile HD layer data can be achieved under a static fixed and very fast fading multipath channel.