• The Journal of the Korea Contents Association
• /
• v.9 no.7
• /
• pp.159-170
• /
• 2009

It is very important to extract the expression data and capture a face image from a video for online-based 3D face animation. In recently, there are many researches on vision-based approach that captures the expression of an actor in a video and applies them to 3D face model. In this paper, we propose an automatic data extraction system, which extracts and traces a face and expression data from realtime video inputs. The procedures of our system consist of three steps: face detection, face feature extraction, and face tracing. In face detection, we detect skin pixels using YCbCr skin color model and verifies the face area using Haar-based classifier. We use the brightness and color information for extracting the eyes and lips data related facial expression. We extract 10 feature points from eyes and lips area considering FAP defined in MPEG-4. Then, we trace the displacement of the extracted features from continuous frames using color probabilistic distribution model. The experiments showed that our system could trace the expression data to about 8fps.

• Proceedings of the Korea Contents Association Conference
• /
• 2004.11a
• /
• pp.333-338
• /
• 2004

Today CCTV can be come across easily in public institutions, banks and etc. These CCTV plays very important roles for preventing many kinds of crimes and resolving those crime affairs. But in the case of recording a image of a specific person far from the CCTV, the original image needs to be enlarged and recovered in order to identify the person more obviously. The interpolation is usually used for the enlargement and recovery of the image. This interpolation has a certain limitation. As the magnification of enlargement is getting bigger, the quality of the original image can be worse than before. This paper uses FDP(Face Definition Parameter) of MPEG-4 SNHC FBA group and introduces a new algorithm that the face outline of a face image using Vector Descriptor based on the FDP makes possible better image recovery than the known methods until now.

• Journal of KIISE:Computing Practices and Letters
• /
• v.10 no.3
• /
• pp.251-258
• /
• 2004

The XMT standard is MPEG-4 Scene Description of textual format. It can be utilized to edit the audio/video media for broadcasting and develop the user oriented media contents. This paper proposes XMT authoring system that supports exchange among contents in various presentation environment. The XMT authoring system creates two levels of textual syntax and semantics: XMT-$\alpha$ format and XMT-$\Omega$ format. Because XMT-$\alpha$ and XMT-$\Omega$ have different expression method about an object, the authoring tool offers interface for them. the authoring tool offers interface for them. Also, it defines interior data structure that can support two file formats, and offers the function that transforms XMT-$\alpha$ into BIFS and transforms XMT-$\Omega$ into SMIL or XMT-$\alpha$. It offers interoperability among multimedia data in various environment that is XMT's characteristic.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.33 no.11A
• /
• pp.1117-1123
• /
• 2008

Applications for mobile multimedia are testing the performance limits of present day CPUs with variety. However, hardwired solutions are inflexible and expensive to develop. CPUs with flexibility have limitation of performance. So, the requirement for both ASIC-like performance and CPU-like flexibility has led to reconfigurable processor. Mobile systems require low power and high performance concurrently. In this paper, we propose reconfigurable processor for mobile multimedia with high energy efficiency. Reconfigurable processor with 121MOPS/mW is developed by 130nm CMOS technology. And the processor was simulated for energy efficiency with 539MOPS/mW by 90nm CMOS technology and effective use of instructions. And we tested its applications for multimedia field. We tested the case of inverse MDCT for MP3 and DF for MPEG4 and ME for H.264.

• Journal of the Institute of Electronics Engineers of Korea SP
• /
• v.48 no.3
• /
• pp.106-111
• /
• 2011

This paper presents an ASIP (Application-specific Instruction Processor) for motion estimation that employs specific IME instructions and its programmable and reconfigurable hardware architecture for various video codecs, such as H.264/AVC, MPEG4, etc. With the proposed specific instructions and hardware accelerator, it can handle the real-time processing requirement of High Definition (HD) video. With the parallel operations and SAD unit control using pattern information, the proposed IME instruction supports not only full search algorithm but also other fast search algorithms. The hardware size is 77K gates for each Processing Element Group (PEG) which has 256 SAD PEs. The proposed ASIP runs at 160MHz with sixteen PEGs and it can handle 1080p@30 frame in real time.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.14 no.4
• /
• pp.418-423
• /
• 2004

The motion estimation algorithm based block matching is a widely used in the international standards related to video compression, such as the MPEG series and H.26x series. Full search algorithm(FA) ones of this block matching algorithms is usually impractical because of the large number of computations required for large search region. Fast search algorithms and conventional binary block matching algorithms reduce computational complexity and data processing time but this algorithms have disadvantages that is less performance than full search algorithm. This paper presents new Boolean matching algorithm, called BCBM(Bit Converted Boolean Matching). Proposed algorithm has performance closed to the FA by Boolean only block matching that may be very efficiently implemented in hardware for real time video communication. Simulation results show that the PSNR of the proposed algorithm is about 0.08㏈ loss than FA but is about 0.96∼2.02㏈ gain than fast search algorithm and conventional Boolean matching algorithm.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.31 no.12C
• /
• pp.1232-1239
• /
• 2006

In video standards such as MPEG-1/2/4 and H.264/AVC, motion estimation / compensation(ME/MC) process causes the most encoding complexity of video encoder. The full search method, which is used in general video codecs, exhausts much encoding time because it compares current macroblock with those at all positions within search window for searching a matched block. For the alleviation of this problem, the fast search methods such as TSS, NTSS, DS and HEXBS are exploited at first. Thereafter, DS based MVFAST, PMVFAST, MAS and FAME, which utilize temporal or spacial correlation characteristics of motion vectors, are developed. But there remain the problems of image quality degradation and algorithm complexity increase. In this thesis, the proposed algorithm maximizes search speed and minimizes the degradation of image quality by determining initial search point correctly and using simple one-dimension search patterns considering motion characteristics of each frame.

• Journal of Broadcast Engineering
• /
• v.12 no.5
• /
• pp.491-502
• /
• 2007

In this parer, we propose an efficient intra prediction mode decision scheme in Scalable Video Coding(SVC) which is an emerging video coding standard as an extension of H.264/MPEG-4 AVC(Advanced Video Coding). The proposed method in base on the characteristic of macroblock smoothness follows the statistical analysis of intra prediction mode in an enhancement layer and it decides a candidate intra prediction mode. We also propose an early termination scheme for Intra_BL mode decision where the RD cost value of Intra_BL is utilized. Simulation results show that the proposed method reduces 54.67% of the computation complexity of intra prediction coding, while the degradation in video quality is negligible; for low QP values, the average PSNR loss is very negligible, equivalently the bit rate increases by 0.011%. For high QP values, the average PSNR loss is less than 0.01dB, which equals to 0.249% increase in bitrate.

• Journal of Broadcast Engineering
• /
• v.13 no.6
• /
• pp.905-914
• /
• 2008

The paper studied the scheme of applying the MPEG-4 SVC signal to the Ka band satellite broadcasting system through the JSCC system to resolve the rain fading problem generated when providing the Ka band HDTV satellite broadcasting service. The Ka band satellite broadcasting system is based on the VCM mode of the DVB-S2, and the SVC signal is considered as one of the spatial scalability, the SNR scalability and the temporal scalability. The JSCC system jointed all the layers of the source coding system and the channel coding system, and allocated bit rate to source coding and channel coding for each layer to get the optimum receiving quality. The layers are consists of a base layer and an enhancement layer, and the bit rate of each layer is affected by the SVC signal. The applicability of the three SVC signals to the Ka band satellite broadcasting service is analyzed with respect to the rain fading, and the scheme of applying the most excellent SVC to the service is considered.

• Journal of the Institute of Electronics Engineers of Korea SP
• /
• v.40 no.5
• /
• pp.303-311
• /
• 2003

Since the MPEG-4 visual standard enables content-based functionalities, it is necessary to extract video object from natural video sequences. Segmentation algorithms can largely be classified into automatic segmentation and user-assisted segmentation. In this paper, we propose a user-assisted VOP generation method based on the geometric active contour. Since the geometric active contour, unlike the parametric active contour, employs the level set method to evolve the curve, we can draw the initial curve independent of the shape of the object. In order to generate the edge function from a smoothed image, we propose a vector-valued diffusion process in the LUV color space. We also present a discrete 3-D diffusion model for easy implementation. By combining the curve shrinkage in the vector field space with the curve expansion in the empty vector space, we can make accurate extraction of visual objects from video sequences.