• Title/Summary/Keyword: video enhancement

Search Result 273, Processing Time 0.02 seconds

Error-Resilience Enhancement based on Polyphase Down Sampling for the H.264 Video Coding Technology (에러 강인성 향상을 위한 다상 다운 샘플링 적용 H.264 동영상 부호화 기술)

  • Jung, Eun Ku;Jia, Jie;Kim, Hae Kwang;Choi, Hae Chul;Kim, Jae Gon
    • Journal of Broadcast Engineering
    • /
    • v.10 no.3
    • /
    • pp.340-347
    • /
    • 2005
  • This paper presents a polyphase down sampling based multiple description coding applied to H.264 video coding standard. For a given macroblock, a residual macroblock is calculated by motion estimation, and before applying DCT, quantization and entrophy coding of the H.264 coding process, the polyphase down sampling is applied to the residual macroblock to code in four separate descriptions. Experiments were performed for all the 9 test sequences of JVT SVC standardization in various packet loss patterns. Experimental results show that the proposed one gives 0.5 to 5 dB enhancement over an error-concealment based on the slice group map technolgoy.

Context Aware Feature Selection Model for Salient Feature Detection from Mobile Video Devices (모바일 비디오기기 위에서의 중요한 객체탐색을 위한 문맥인식 특성벡터 선택 모델)

  • Lee, Jaeho;Shin, Hyunkyung
    • Journal of Internet Computing and Services
    • /
    • v.15 no.6
    • /
    • pp.117-124
    • /
    • 2014
  • Cluttered background is a major obstacle in developing salient object detection and tracking system for mobile device captured natural scene video frames. In this paper we propose a context aware feature vector selection model to provide an efficient noise filtering by machine learning based classifiers. Since the context awareness for feature selection is achieved by searching nearest neighborhoods, known as NP hard problem, we apply a fast approximation method with complexity analysis in details. Separability enhancement in feature vector space by adding the context aware feature subsets is studied rigorously using principal component analysis (PCA). Overall performance enhancement is quantified by the statistical measures in terms of the various machine learning models including MLP, SVM, Naïve Bayesian, CART. Summary of computational costs and performance enhancement is also presented.

The Effects of Information Types and Players in Everyday Vlogs on Viewers' Empathy, Social Presence and Self-Enhancement (일상 브이로그의 정보 속성과 출연자 유형에 따른 시청 몰입 및 자기향상 태도의 차이)

  • Chen, Nuo;Na, Eunkyung
    • The Journal of the Convergence on Culture Technology
    • /
    • v.8 no.4
    • /
    • pp.277-287
    • /
    • 2022
  • Recent trends in sharing online video contents show that vlogging on everyday life can cause meaningful changes in viewers' perception of mediated characters and their own lifestyles. We explored that flourishing everyday life video contents online are intertwined with viewers' psychological engagement such as empathy and social presence, let alone self-enhancing motivations such as self-reflection and psychological empowerment. Survey analysis results suggest that between contents types of vlog (everyday life vs. in-depth information), watching in-depth information videos significantly affected viewers' psychological engagement and self-enhancing motivations. Compared to celebrity's online videos, daily videos starring laypeople showed significantly positive impacts on viewers' engagement such as empathy, social presence, and self-enhancement such as self-reflection, psychological empowerment.

Video Coding Method Using Visual Perception Model based on Motion Analysis (움직임 분석 기반의 시각인지 모델을 이용한 비디오 코딩 방법)

  • Oh, Hyung-Suk;Kim, Won-Ha
    • Journal of Broadcast Engineering
    • /
    • v.17 no.2
    • /
    • pp.223-236
    • /
    • 2012
  • We develop a video processing method that allows the more advanced human perception oriented video coding. The proposed method necessarily reflects all influences by the rate-distortion based optimization and the human visual perception that is affected by the visual saliency, the limited space-time resolution and the regional moving history. For reflecting the human perceptual effects, we devise an online moving pattern classifier using the Hedge algorithm. Then, we embed the existing visual saliency into the proposed moving patterns so as to establish a human visual perception model. In order to realize the proposed human visual perception model, we extend the conventional foveation filtering method. Compared to the conventional foveation filter only smoothing less stimulus video signals, the developed foveation filter can locally smooth and enhance signals according to the human visual perception without causing any artifacts. Due to signal enhancement, the developed foveation filter more efficiently transfers the bandwidth saved at smoothed signals to the enhanced signals. Performance evaluation verifies that the proposed video processing method satisfies the overall video quality, while improving the perceptual quality by 12%~44%.

Overlay Text Graphic Region Extraction for Video Quality Enhancement Application (비디오 품질 향상 응용을 위한 오버레이 텍스트 그래픽 영역 검출)

  • Lee, Sanghee;Park, Hansung;Ahn, Jungil;On, Youngsang;Jo, Kanghyun
    • Journal of Broadcast Engineering
    • /
    • v.18 no.4
    • /
    • pp.559-571
    • /
    • 2013
  • This paper has presented a few problems when the 2D video superimposed the overlay text was converted to the 3D stereoscopic video. To resolve the problems, it proposes the scenario which the original video is divided into two parts, one is the video only with overlay text graphic region and the other is the video with holes, and then processed respectively. And this paper focuses on research only to detect and extract the overlay text graphic region, which is a first step among the processes in the proposed scenario. To decide whether the overlay text is included or not within a frame, it is used the corner density map based on the Harris corner detector. Following that, the overlay text region is extracted using the hybrid method of color and motion information of the overlay text region. The experiment shows the results of the overlay text region detection and extraction process in a few genre video sequence.

Complexity and Performance Analysis of SVC(Scalable Video Coding) Encoder Models for T-DMB/AT-DMB Video Service (T-DMB/AT-DMB 비디오 서비스를 위한 스케일러블 부호화기 모델에 따른 복잡도 및 성능 분석)

  • Kim, Kyu-Seok;Kim, Pil-Joong;Kim, Jin-Soo;Lee, Si-Woong;Kim, Jae-Gon;Choi, Hae-Chul
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2007.10a
    • /
    • pp.123-126
    • /
    • 2007
  • This paper presents the SVC (Scalable Video Coding) scheme which enables the AT-DMB (Advanced Terrestrial - DMB) video service in enhancement layer, while keeping the current T-DMB video service in base layer. But, it is very complicate to implement the SVC encoder and so it is necessary to analyze the complexity and performance for SVC encoder's structures and coding parameters. In this paper, through computer simulations, SVC coding parameters are tested and then, based on these results, three types of SVC encoder models are compared from the viewpoint of the complexity and performance.

  • PDF

A Robust Mobile Video Streaming in Heterogeneous Emerging Wireless Systems

  • Oh, Hayoung
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.6 no.9
    • /
    • pp.2118-2135
    • /
    • 2012
  • With the rapid development of heterogeneous emerging wireless technologies and numerous types of mobile devices, the need to support robust mobile video streaming based on the seamless handover in Future Internet is growing. To support the seamless handover, several IP-based mobility management protocols such as Mobile IPv6 (MIPv6), fast handover for the MIPv6 (FMIPv6), Hierarchical MIPv6 (HMIPv6) and Proxy Mobile IPv6 (PMIPv6) were developed. However, MIPv6 depreciates the Quality-of-Service (QoS) and FMIPv6 is not robust for the video services in heterogeneous emerging wireless networks when the Mobile Node (MN) may move to another visited network in contrast with its anticipation. In Future Internet, the possibility of mobile video service failure is more increased because mobile users consisting of multiple wireless network interfaces (WNICs) can frequently change the access networks according to their mobility in heterogeneous wireless access networks such as 3Generation (3G), Wireless Fidelity (Wi-Fi), Worldwide Interoperability for Microwave Access (WiMax) and Bluetooth co-existed. And in this environment, seamless mobility is coupled according to user preferences, enabling mobile users to be "Always Best Connected" (ABC) so that Quality of Experience is optimised and maintained. Even though HMIPv6 and PMIPv6 are proposed for the location management, handover latency enhancement, they still have limit of local mobility region. In this paper, we propose a robust mobile video streaming in Heterogeneous Emerging Wireless Systems. In the proposed scheme, the MN selects the best-according to an appropriate metric-wireless technology for a robust video streaming service among all wireless technologies by reducing the handover latency and initiation time when handover may fail. Through performance evaluation, we show that our scheme provides more robust mechanism than other schemes.

The Improved Deblocking Filter for Low-bit Rate H.264/AVC Video (저해상도 H.264/AVC 비디오를 위한 개선된 디블럭킹 필터)

  • Kwon, Dong-Jin;Ryu, Sung-Pil;Kwak, Nae-Joung;Ahn, Jae-Hyeong
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.18 no.2
    • /
    • pp.284-289
    • /
    • 2008
  • H.264/AVC among moving picture compression standard is the standard format for high compression rate and reliable video transimission. It generates blocking effects in video due to compressing video using block-based DCT and includes de-blocking filter to reduce blocking effect. Therefore, the filter makes the video over-smoothing and the quality of it is reduced. In this paper, we propose a improved de-blocking filter to solve the demerit. The proposed de-blocking filter redetermine the block boundary strength and apply the comer filtering to eliminate artifacts in low frequency domain. To evaluate the performance, we apply the proposed deblocking filter and exiting method to various video and evaluated the quality of image subjectively and objectively by analyzing the result. The simulation result shows the proposed method preserves the edge of video, reduces blocking effects and improves PSNR than the existing method.

Complexity and Performance Analysis of SVC(Scalable Video Coding) Encoder Models for T-DMB/AT-DMB Video Service (T-DMB/AT-DMB 비디오 서비스를 위한 스케일러블 부호화기 모델에 따른 복잡도 및 성능 분석)

  • Kim, Jin-Soo;Kim, Kyu-Seok;Kim, Pil-Joong;Lee, Si-Woong;Kim, Jae-Gon;Choi, Hae-Chul
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.11 no.11
    • /
    • pp.2015-2020
    • /
    • 2007
  • This paper presents the SVC(Scalable Video Coding) scheme which enables the AT-DMB(Advanced Terrestrial-DMB) video service in enhancement layer, while keeping the current T-DMB video service in base layer. But, it is very complicate to implement the SVC encoder and so it is necessary to analyze the complexity and performance for SVC encoder#s structures and coding parameters. In this paper, through computer simulations, SVC coding parameters are tested and then, based on these results, three types of SVC encoder models are compared from the viewpoint of the complexity and performance.

Scalable Video Coding using Super-Resolution based on Convolutional Neural Networks for Video Transmission over Very Narrow-Bandwidth Networks (초협대역 비디오 전송을 위한 심층 신경망 기반 초해상화를 이용한 스케일러블 비디오 코딩)

  • Kim, Dae-Eun;Ki, Sehwan;Kim, Munchurl;Jun, Ki Nam;Baek, Seung Ho;Kim, Dong Hyun;Choi, Jeung Won
    • Journal of Broadcast Engineering
    • /
    • v.24 no.1
    • /
    • pp.132-141
    • /
    • 2019
  • The necessity of transmitting video data over a narrow-bandwidth exists steadily despite that video service over broadband is common. In this paper, we propose a scalable video coding framework for low-resolution video transmission over a very narrow-bandwidth network by super-resolution of decoded frames of a base layer using a convolutional neural network based super resolution technique to improve the coding efficiency by using it as a prediction for the enhancement layer. In contrast to the conventional scalable high efficiency video coding (SHVC) standard, in which upscaling is performed with a fixed filter, we propose a scalable video coding framework that replaces the existing fixed up-scaling filter by using the trained convolutional neural network for super-resolution. For this, we proposed a neural network structure with skip connection and residual learning technique and trained it according to the application scenario of the video coding framework. For the application scenario where a video whose resolution is $352{\times}288$ and frame rate is 8fps is encoded at 110kbps, the quality of the proposed scalable video coding framework is higher than that of the SHVC framework.