DOI QR코드

DOI QR Code

A Study on the Latest Trends of Video Bit-Rate Control Technology and Prospects for the Development of Bit-Rate Control Technology in Defense and Aerospace Imaging Systems

비디오 비트율 제어 기술의 최신 동향 분석과 국방 및 항공우주 영상시스템의 비트율 제어 기술 발전 방향 전망

  • Myunghan Hyun (Control and Robot Engineering, Gyeongsang National University)
  • 현명한 (경상국립대학교 제어로봇공학과)
  • Received : 2024.08.19
  • Accepted : 2024.11.04
  • Published : 2024.12.05

Abstract

Video bit-rate control techniques are essential for efficiently transmitting videos over communication networks. These techniques have been pivotal in broadcasting and internet streaming services, and they could significantly enhance defense capabilities if applied to defense and aerospace imaging systems. Therefore, this paper first reviews the history and standard technologies of video coding, then describes the standard trends of the latest video coding technologies. Finally, it outlines the features of the latest video bit-rate control techniques and discusses their applicability in the defense and aerospace fields.

Keywords

References

  1. Use cases and requirements for Video Coding for Machines, ISO/IEC JTC1/SC29/WG2 N190, 2022.04 
  2. B. Bross, J. Chen, S. Liu, and Y. Wang, "Versatile video coding editorial refinements on draft 10," in Proc. 20th Meeting, Teleconference, pp. 1-114, 2020. 
  3. MPEG-2 Test Model 5, ISO/IEC JTC1/SC29 WG11/93-400, 1993. 
  4. T. Wiegand, G. J. Sullivan, G. BjOntegaard, and A. Luthra, "Overview of the H.264/AVC video coding standard," IEEE Trans. Circuits Syst. Video Technol., Vol. 13, No. 7, pp. 560-576, Jul. 2003. 
  5. G. J. Sullivan, J.-R. Ohm, W.-J. Han, and T. Wiegand, "Overview of the high efficiency video coding(HEVC) standard," IEEE Trans. Circuits Syst. Video Technol., Vol. 22, No. 12, pp. 1649-1668, Dec. 2012. 
  6. B. Bross et al., "Overview of the versatile video coding(VVC) standard and its applications," IEEE Trans. Circuits Syst. Video Technol., Vol. 31, No. 10, pp. 3736-3764, Oct. 2021. 
  7. M. H. Hyun, "A study on particle filtering based prediction for rates and distortions of video coding and an application to rate control," Ph.D. dissertation, Dept. of Elec. Engine., KAIST, Daejeon, Republic of Korea, 2021. 
  8. J. Balle, V. Laparra, and E. P. Simoncelli, "End-to-end optimized image compression," arXiv:1611.01704v3. 2017. 
  9. G. Lu, W. Ouyang, D. Xu, X. Zhang, C. Cai, and Z. Gao, "Dvc: An end-to-end deep video compression framework," Proceedings of the IEEE/CVF CVPR, 2019. 
  10. G. Bang, "Neural network video representation technology and MPEG-INVR standardization trends," Broadcast and Media Magazine, Vol. 28, No. 3, pp. 45-54, 2023. 
  11. W. Bailer, et al., "Text of ISO/IEC FDIS 15938-17 Compression of neural networks for multimedia content description and analysis," ISO/IEC JTC1/SC29/WG4, N20331, Jun. 2021. 
  12. T. Chiang and Y.-Q. Zhang, "A new rate control scheme using quadratic rate distortion model," IEEE Trans. Circuits Syst. Video Technol., Vol. 7, No. 1, pp. 246-250, Feb. 1997. 
  13. Y. Chang and M. Kim, "Hybrid codec-based intraframe joint rate control for stereoscopic video," IEEE Signal Process. Lett., Vol. 18, No. 10, pp. 543-546, Oct. 2011. 
  14. X. Jing, L. P. Chau, and W. C. Siu, "Frame complexity-based rate-quantization model for H.264/AVC intraframe rate control," IEEE Signal Process. Lett., vol. 15, pp. 373-376, Mar. 2008. 
  15. M. H. Wang, K. N. Ngan, and H. L. Li, "An efficient frame-content based intra frame rate control for high efficiency video coding," IEEE Signal Process. Lett., Vol. 22, No. 7, pp. 896-900, Jul. 2015. 
  16. M. Karczewicz and X. Wang, "Intra frame rate control based on SATD," JCTVC-M0257, 13th meeting, Incheon, KR, 2013. 
  17. B. Yan and M. H. Wang, "Adaptive distortion-based intra-rate estimation for H.264/AVC rate control," IEEE Signal Procss. Lett., Vol. 16, No. 1-3, pp. 145-148, Mar. 2009. 
  18. E. Y. Lam and J. W. Goodman, "A mathematical analysis of the DCT coefficient distribution for images," IEEE Trans. Image Process., Vol. 9, No. 10, pp. 1661-1666, Oct. 2000. 
  19. N. Kamaci, Y. Altunbasak, and R. Mersereau, "Frame bit allocation for the H.264/AVC video coder via Cauchy-density-based rate and distortion models," IEEE Trans. Circuits Syst. Video Technol., Vol. 15, No. 8, pp. 994-1006, Aug. 2005. 
  20. Z. He and S. K. Mitra, "Optimum bit allocation and accurate rate control for video coding via ρ-domain source modeling," IEEE Trans. Circuits Syst. Video Technol., Vol. 12, No. 10, pp.840-849, Oct. 2002. 
  21. H. Choi, J. Yoo, J. Nam, D. Sim, and I. V. Bajic, "Pixel-wise unified rate-quantization model for multi-level rate control," IEEE J. Sel. Topics Signal Process., Vol. 7, No. 6, pp. 1112-1123, Dec. 2013. 
  22. B. Lee and M. Kim, "Modeling rates and distortions based on a mixture of Laplacian distributions for inter-predicted residues in quadtree coding of HEVC," IEEE Signal Process. Lett., Vol. 18, No. 10, pp. 571-574, Oct. 2011. 
  23. B. Lee, M. Kim, T. Q. Nguyen, "A frame level rate control scheme based on texture and nontexture rate models for high efficiency video coding," IEEE Trans. Circuits Syst. Video Technol., Vol. 24, No. 3, pp. 465-479, Mar. 2014. 
  24. C. W. Seo, J. H. Moon, and J. K. Han, "Rate control for consistent objective quality in high efficiency video coding," IEEE Trans. Image Process., Vol. 22, No. 6, pp. 2442-2454, Jun. 2013. 
  25. Z. W. Zhang, T. Jing, J. N. Han, Y. W. Xu, and F. Zhang, "A new rate control scheme for video coding based on region of interest," IEEE Access, Vol. 5, pp. 13677-13688, Mar. 2017. 
  26. W. Gao, S. Kwong, H. Yuan, and X. Wang, "DCT coefficient distribution modeling and quality dependency analysis based frame-level bit allocation for HEVC," IEEE Trans. Circuits Syst. Video Technol., Vol. 26, No. 1, pp. 139-153, Jan. 2016. 
  27. B. Li, H. Li, L. Li, and J. Zhang, "λ domain rate control algorithm for high efficiency video coding," IEEE Trans. Image Process., Vol. 23, No. 9, pp. 3841-3854, Sep. 2014. 
  28. B. Li, D. Zhang, H. Li, and J. Xu, QP determination by lambda value, document JCTVC-I0426, Geneva, CH, May 2012. 
  29. B. Li, H. Li, L. Li, and J. Zhang, rate control by R-lambda model for HEVC, document JCTVC-K0103, Shanghai, China, Oct. 2012. 
  30. G. J. Sullivan and T. Wiegand, "Rate-distortion optimization for video compression," IEEE Signal Process. Magazine, Vol. 15, No. 6, pp. 74-90, Nov. 1998. 
  31. S. Boyd and L. Vandenberghe, "Unconstrained minimization," in Convex Optimization, 7th ed., NY, USA: Cambridge University Press, pp. 457-520, 2009. 
  32. S. Mallat and F. Falzon, "Analysis of low bit rate image transform coding," IEEE Trans. Signal Process., Vol. 46, No. 4, pp. 1027-1042, Apr. 1998. 
  33. M. H. Hyun, B. Lee, and M. Kim, "A VVC intra rate control with small bit fluctuations using a Lagrange multiplier adjustment," IEEE Trans. Multimedia, Vol. 26, pp. 6811-6821, Jan. 2024. 
  34. A. Browne, Y. Ye, and S. Kim, "Algorithm description for versatile video coding and test model 16(VTM16)," in Proc. 25th Meeting, Teleconference, pp. 1-256, 2022. 
  35. M. H. Hyun, B. Lee, and M. Kim, "A frame-level constant bit-rate control using recursive bayesian estimation for versatile video coding," IEEE Access, Vol. 8, pp. 227255-227269, 2020. 
  36. Y. Chen et al., "Intra frame rate control for versatile video coding with quadratic rate-distortion modelling," in Proc. IEEE Int. Conf. Acoust., Speech Signal Process., pp. 4422-4426, 2020.