• Journal of KIISE:Databases
• /
• v.30 no.5
• /
• pp.494-506
• /
• 2003

Recently, explosive popularity of multimedia information has triggered the need for retrieving multimedia contents efficiently from the database including audio, video and images. In this paper, we propose an XML-based retrieval scheme and a data model that complement the weak aspects of annotation and conent based retrieval methods. The Property and hierarchy structure of image and video data are represented and manipulated based on the Multimedia Description Schema (MDS) that conforms to the MPEG-7 standard. For audio contents, pitch contours extracted from their acoustic features are converted into UDR string. Especially, to improve the retrieval performance, user's access pattern and frequency are utilized in the construction of an index. We have implemented a prototype system and evaluated its performance through various experiments.

• The KIPS Transactions:PartB
• /
• v.9B no.5
• /
• pp.541-548
• /
• 2002

This paper proposes an XML based Multimedia Annotation and Retrieval System, which can represent and retrieve video data efficiently using XML. The system provides a graphical user interface for annotating, searching, and browsing multimedia data. It is Implemented based on the hierarchical metadata model to represent multimedia information. The metadata about video is organized based on multimedia description schema using XML Schema that basically conforms to the MPEG-7 standard. Also, for the effective indexing and retrieval of multimedia data, video segments are annotated and categorized using the closed caption.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 1998.06b
• /
• pp.116-121
• /
• 1998

As digital audio video data compression and transmission techniques are matured, huge amount of digital multimedia material is produced and delivered via broadcasting, digital storage media and world-wide web(WWW). Thus it became very important to provide a standardized way of multimedia data content description, so that efficient and effective access and reuse of valuable multimedia information can be possible. In this paper, enabling core technologies and our research directions on this are presented with brief introduction on the scope of the multimedia content description interface, called MPEG-7, in terms of objective, application and requirements.

• Journal of Broadcast Engineering
• /
• v.7 no.2
• /
• pp.96-106
• /
• 2002

We introduce a novel scheme to characterize and index events in TV golf programs using MPEG-7 descriptors. Our goal is to identify and localize the golf events of interest to facilitate highlight-based video indexing and summarization. In particular, we analyze multiple (low-level) visual features using domain-specific model to create a perceptual relation for semantically meaningful(high-level) event identification. Furthermore, we summarize a TV golf program with TV-Anytime segmentation metadata, a standard form of an XML-based metadata description, in which the golf events are represented by temporally localized segments and segment groups of highlights. Experimental results show that our proposed technique provides reasonable performance for identifying a variety of golf events.

• Journal of Broadcast Engineering
• /
• v.20 no.5
• /
• pp.778-781
• /
• 2015

The paper presents a new way of visual descriptor for deformable object retrieval on the basis of partition based description. The proposed descriptor technology partitions a given object into boundary area and interior area and extracts a descriptor from each area. The final descriptor combines these descriptors. From a given image, deformable object is segmented. The center position of the deformable object is calculated. The object is partitioned into N × N blocks on the basis of the given center position. Blocks are classified as boundary area and interior area depending on the pixels in the block. The proposed descriptor consists of extracted MPEG-7 dominant descriptors from both the boundary and interior area. The performance of proposed method is tested on a database of 1,973 handbag images constructed with view point changes. ARR (Average Retrieval Rate) is used for the retrieval accuracy of the proposed algorithm, compared with MPEG-7 dominant color descriptor.

• The KIPS Transactions:PartD
• /
• v.14D no.6
• /
• pp.573-584
• /
• 2007

As multimedia information recently increases fast, various types of retrieval of multimedia data are becoming issues of great importance. For the efficient multimedia data processing, semantics based retrieval techniques are required that can extract the meaning contents of multimedia data. Existing retrieval methods of multimedia data are annotation-based retrieval, feature-based retrieval and annotation and feature integration based retrieval. These systems take annotator a lot of efforts and time and we should perform complicated calculation for feature extraction. In addition. created data have shortcomings that we should go through static search that do not change. Also, user-friendly and semantic searching techniques are not supported. This paper proposes to develop S-MARS(Semantic Metadata-based Multimedia Annotation and Retrieval System) which can represent and extract multimedia data efficiently using MPEG-7. The system provides a graphical user interface for annotating, searching, and browsing multimedia data. It is implemented on the basis of the semantic metadata model to represent multimedia information. The semantic metadata about multimedia data is organized on the basis of multimedia description schema using XML schema that basically comply with the MPEG-7 standard. In conclusion. the proposed scheme can be easily implemented on any multimedia platforms supporting XML technology. It can be utilized to enable efficient semantic metadata sharing between systems, and it will contribute to improving the retrieval correctness and the user's satisfaction on embedding based multimedia retrieval algorithm method.

• Journal of KIISE:Computer Systems and Theory
• /
• v.33 no.9
• /
• pp.574-584
• /
• 2006

Recently, ISO/IEC 23000 (also known as 'MPEG-A') has proposed a new file format called 'MAF(Multimedia Application File Format)[1]' which provides a capability of integrating/storing the widely-used compression standards for audio and video and the metadata in MPEG-7 form into a single file format. However, it is still very hard to verify the usefulness of MPEG-A in the real applications because there is still no real system that fully implements this standard. In this thesis, a design and implementation of a multimedia retrieval system based on MPEG-A standard on PC and mobile device is presented. Furthermore, an extension of MPEG-A for describing the metadata for video is also proposed. It is selected and defined as a subset of MPEG-7 MDS[4] and TV-anytime[5] for video that is useful and manageable in the mobile environments. In order to design the multimedia retrieval system based on MPEG-A, we define the system requirements in terms of portability, extensibility, compatibility, adaptability, efficiency. Based on these requirements, we design the system which composed of 3 layers: Application Layer, Middleware Layer, Platform Layer. The proposed system consists of two sub-parts, client-part and server-part. The client-part consists of MAF authoring tool, MAP player tool and MAF searching tool which allow users to create, play and search the MAF files, respectively. The server-part is composed of modules to store and manage the MAF files and metadata extracted from MAF files. We show the usefulness of the proposed system by implementing the client system both on MS-Windows platform on desk-top computer and WIPI platform on mobile phone, and validate whether it to satisfy all the system requirements. The proposed system can be used to verify the specification in the MPEG-A, and to proves the usefulness of MPEG-A in the real application.

• Journal of Broadcast Engineering
• /
• v.7 no.2
• /
• pp.114-125
• /
• 2002

Although there have been a lot of researches on a video abstraction algorithm, the video abstraction tool is necessary to correctly pick up some important shots in a video because the important shots might vary on the person's subjectivity. This paper proposes a video abstraction and search system for making a video abstraction automatically or manually. Proposed system has two main components, server and client. The server generates the Metadata and makes a video abstraction file. The description for video abstraction file is based on MPEG-7. Since proposed system has a function to manually correct the results of each step, the author could produce a good video abstraction easily and efficiently. The proposed system could be used to build a digital video library.

• Proceedings of the Korean Information Science Society Conference
• /
• 2004.10b
• /
• pp.175-177
• /
• 2004

이 논문에서는 상이한 형식의 멀티미디어 메타데이터를 통합하기 위해서 통합 메타데이터를 정의하기 위해서 기존의 표준 멀티미디어 정보에 대한 다루고 있는 MPEG-7 MDS(Multimedia Description Scheme)와 TV-Anytime을 비교 분석하였다. 이렇게 정의한 메타데이터는 분산된 이종의 멀티미디어 자원을 의미적으로 통합하는 데에 사용될 수 있다. 아울러 이 메타데이터를 기반으로 향후 온톨로지를 정의하고 이를 기반으로 한 추론을 가능하게 해 상황인지 기반 멀티미디어 서비스를 지원하는 데에도 활용될 수 있다.

• Proceedings of the Korea Multimedia Society Conference
• /
• 2000.11a
• /
• pp.77-80
• /
• 2000

멀티미디어 데이터의 생산속도가 급증함에 따라 멀티미디어 데이터를 쉽고, 빠르며, 효율적으로 검색할 수 있는 방법이 필요하게 되었다. MPEG-7 표준화에 관련하여 영상의 특성추출, 기술(description), 검색엔진의 구성에 관련된 연구가 진행중에 있다. 본 논문에서는 영상의 여러 낮은 단계 특성을 추출하여, 이를 바탕으로 영상 분류를 통해 영상의 의미 정보를 얻는다. 분류를 통해 검색의 공간을 줄일 수 있었다. 그리고, 자바 애플릿을 이용하여 웹브라우저 상에서 스케치를 통한 검색을 함으로써, 보다 적극적인 검색이 가능하다.