• Journal of Broadcast Engineering
• /
• v.17 no.2
• /
• pp.223-236
• /
• 2012

We develop a video processing method that allows the more advanced human perception oriented video coding. The proposed method necessarily reflects all influences by the rate-distortion based optimization and the human visual perception that is affected by the visual saliency, the limited space-time resolution and the regional moving history. For reflecting the human perceptual effects, we devise an online moving pattern classifier using the Hedge algorithm. Then, we embed the existing visual saliency into the proposed moving patterns so as to establish a human visual perception model. In order to realize the proposed human visual perception model, we extend the conventional foveation filtering method. Compared to the conventional foveation filter only smoothing less stimulus video signals, the developed foveation filter can locally smooth and enhance signals according to the human visual perception without causing any artifacts. Due to signal enhancement, the developed foveation filter more efficiently transfers the bandwidth saved at smoothed signals to the enhanced signals. Performance evaluation verifies that the proposed video processing method satisfies the overall video quality, while improving the perceptual quality by 12%~44%.

• Journal of Broadcast Engineering
• /
• v.18 no.1
• /
• pp.31-42
• /
• 2013

This paper proposes a photogrammetric rectification method based on Bayesian approach as a method that eliminates vertical parallax between stereo images to minimize visual fatigue of 3D contents. The image rectification consists of two phases; geometry estimation and epipolar transformation. For geometry estimation, coplanarity-based relative orientation algorithm was used in this paper. To ensure robustness for mismatch and localization error occurred by automation of tie point extraction, Bayesian approach was applied by introducing several prior constraints. As epipolar transformation perspective transformation was used based on condition of collinearity to minimize distortion of result images and modification for input images. Other algorithms were compared to evaluate performance. For geometry estimation, traditional relative orientation algorithm, 8-points algorithm and stereo calibration algorithm were employed. For epipolar transformation, Hartley algorithm and Bouguet algorithm were employed. The evaluation results showed that the proposed algorithm produced results with high accuracy, robustness about error sources and minimum image modification.

• Journal of Broadcast Engineering
• /
• v.21 no.6
• /
• pp.889-898
• /
• 2016

Virtual Bass System (VBS) is widely used to extend the lower frequency limit of small loudspeakers, which generates harmonics of a fundamental frequency. The perceptual quality of the VBS is highly dependent on the harmonic weighting strategy. There have been several weighting methods, including exponential attenuation and timbre matching. However, it is essential to match phases between harmonics in the original signal and generate harmonics to precisely convey the weighting strategy. This paper shows the limitations of the previous harmonic weighting schemes and proposes a new harmonic weighting scheme. The proposed weighting scheme proposes phase matching between the original and generated harmonics and varies the slope of the attenuation weighting dynamically according to the missing fundamental frequency. Objective and subjective tests show that the proposed harmonic weighting scheme provides more natural and effective bass perception in a limited situation than the conventional schemes, which implies that the phase matching is essential for the high quality bass enhancement.

• Journal of Broadcast Engineering
• /
• v.23 no.3
• /
• pp.409-420
• /
• 2018

In this paper, we propose a Motion Vector-based Particle Filter(MVPF) for object tracking on bitstreams and a object tracking system using the MVPF. The MVPF uses motion vectors to both the transition and the observation models of a general particle filter to improve the accuracy while maintaining the number of particles. In the proposed object tracking system, the state of the target object can be predicted using the histogram of motion vectors extracted from the bitstream. In terms of precision, F-measure and IOU(Intersection Of Union), the proposed method is about 30%, 17%, and 17% better on average, respectively, in MPEG test sequences and VOT2013 sequences. Furthermore, When the tracking results are displayed in box form for subjective performance evaluation, the proposed method can track moving objects more robust than the conventional methods in all test sequences.

• Journal of Broadcast Engineering
• /
• v.23 no.3
• /
• pp.345-350
• /
• 2018

CNN (convolution neural network) has become the most popular artificial intelligence technique and shows remarkable performance in image classification task. In this paper, we propose a CNN-based classification method for various street images as well as a method of evaluating the safety score for the street. The proposed method consists of learning four types of street images using CNN and classifying input street images using the learned CNN model followed by evaluating the safety score. During the learning process, four types of street images are collected and augmented, and then CNN learning is performed. It is shown that learned CNN model classifies input images correctly and the safety scores are evaluated quantitatively by combining the probabilities of different street types.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2009.11a
• /
• pp.77-80
• /
• 2009

3차원 영상 처리 기술과 3차원 디스플레이의 발전은 3차원 영상 시장의 빠른 발전을 가져왔고 차세대 방송 기술로 큰 관심을 받고 있다. 하지만 3차원 영상은 시청할 때 눈의 피로, 어지럼증과 같은 현상이 일어날 수 있으며, 왜곡된 3차원 영상이 인체에 해로운 영향을 미칠 수도 있다. 이는 3차원 영상 산업의 활성화를 위해서 가장 시급히 해결되어야 할 문제이다. 현재 3차원 디스플레이는 스테레오 방식과 함께 1view 1depth 다시점 방식이 개발되었다. 특히 1view 1depth 다시점 디스플레이에서 깊이 영상의 공간적/시간적으로 복잡한 정도는 피로감을 일으키는 주요 요소이며 이는 1view 1depth 영상을 통해 직접 연구할 수 있다. 본 논문에서는 1view 1depth 디스플레이에서 주관적인 피로도와 큰 상관도를 가지는 깊이 영상의 특성 측정 방법을 제안한다. 1view 1depth 디스플레이에서 view 영상은 양호한 화질을 가정하였으며 피로감에 큰 영향을 미치는 깊이 영상 정보만 사용하여 공간적, 시간적인 특성을 분석한다. 공간적 복잡도는 각 프레임에 대하여 깊이 영상 내 화소 값의 분산 값을 취하여 공간적으로 깊이 값의 분포와 구조의 복잡한 정도를 측정하고, 시간적 복잡도는 연속적인 프레임에 대하여 동일한 화소위치에서 화소 값 차이의 분산 값을 사용한다. 또한 공간적/시간적 평균값의 측정하여 피로감에 영향을 주는 요인으로 사용하였다. 결과적으로 측정한 값들을 바탕으로 주관적인 피로도 평가와 유사성을 가지도록 모델링하여 3차원 영상의 피로도를 예측한다.

• Journal of Broadcast Engineering
• /
• v.15 no.6
• /
• pp.853-867
• /
• 2010

Recently, thumbnail techniques are required to index a high-performance video at digital convergence-based multimedia service like IPTV and DMB. Therefore a thumbnail extraction method in H.264/AVC bitstreams has been proposed. However, thumbnail quality deterioration problem at converting the general equation of spatial domain to frequency domain which is generated by not considering about H.264/AVC transform and quantization processing and rounding-off operation in intra prediction. In this paper, we propose a new thumbnail extraction method in H.264/AVC bitstreams. The proposed scheme is based on H.264/AVC core-transform for a thumbnail extraction in frequency domain, and probability theory, intra rounding-off error compensation. Through the implementation and performance evaluation, the subjective quality difference between the output of our scheme and the output of reference decoder is negligible and better than the conventional method, and moreover PSNR gain by up to 8.66 dB.

• Journal of Broadcast Engineering
• /
• v.17 no.3
• /
• pp.459-470
• /
• 2012

In this paper, we propose a method to upsample a low-resolution depth map to a high-resolution version. While conventional camera sensors produce high-resolution color images, the sizes of the depth maps of range/depth sensors are usually low. In this paper, we consider the utilization of high-frequency components to the conventional depth map interpolation methods such as bilinear, bicubic, and bilateral. The proposed method is composed of the three steps: high-frequency component extraction, high-frequency component application, and interpolation. Two objective evaluation measures such as sharpness degree and blur metric are used to examine the performance. Experimental results show that the proposed method significantly outperforms other conventional methods by a factor of 2 in terms of sharpness degree. As well, a blur metric is reduced by a factor of 14 %.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.35 no.2B
• /
• pp.345-351
• /
• 2010

It has been growing interests that convergence services of broadcasting and telecommunication services such as DMB 2.0 and Mobile IPTV etc. Unicast type is difficult to service broadcasting due to limits of capacity and poor receiving environments, WiBro supports broadcast service with MBS. MBS is transmission method that base stations belong to same the MBS zone transmit the all users who request broadcasting service. Terminals are received resources from all base station in the MBS zone and SINR can be improved because of macro diversity. If terminals are located at edge of the MBS zone, complement algorithm are needed beacause received SINR is very low. In this paper, MIMO STBC, Relay and FFR are introduced to improve the throughputs using high MCS. The basic simulation environment is assumed to be SISO. Transparent relay and FFR applicable on MBS are divided by SISO and MIMO STBC environment and evaluate the performance.

• Journal of the Korea Society of Computer and Information
• /
• v.17 no.1
• /
• pp.203-209
• /
• 2012

Recently, k-nearest neighbors query methods based on wireless broadcasting environment are actively studied. The advantage of wireless broadcasting environment is the scalability that enables collective query processing for unspecified users connected to the server. However, in case existing k-NN query is applied in wireless broadcasting environment, there can be a disadvantage that backtracking may occur and consequently the query processing time is increasing. In this paper proposes a hierarchical bitmap-based spatial index in order to efficiently process the k-NN queries in wireless broadcasting environment. HBI reduces the bitmap size using such bitmap information and tree structure. As a result, reducing the broadcast cycle can reduce the client's tuning time and query processing time. In addition, since the locations of all the objects can be detected using bitmap information, it is possible to tune to necessary data selectively. For this paper, a test was conducted implementing HBI to k-NN query and the proposed technique was proved to be excellent by a performance evaluation.