• Journal of the Institute of Electronics Engineers of Korea CI
• /
• v.41 no.4
• /
• pp.95-102
• /
• 2004

In order to process video data effectively, it is required that the content information of video data is loaded in database and semantic-based retrieval method can be available for various query of users. Currently existent contents-based video retrieval systems search by single method such as annotation-based or feature-based retrieval, and show low search efficiency md requires many efforts of system administrator or annotator because of imperfect automatic processing. In this paper, we propose semantics-based video retrieval system which support semantic retrieval of various users by feature-based retrieval and annotation-based retrieval of massive video data. By user's fundamental query and selection of image for key frame that extracted from query, the agent gives the detail shape for annotation of extracted key frame. Also, key frame selected by user become query image and searches the most similar key frame through feature based retrieval method and optimized comparison area extracting that propose. Therefore, we propose the system that can heighten retrieval efficiency of video data through semantics-based retrieval.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.7 no.6
• /
• pp.1129-1133
• /
• 2006

In this thesis, we propose a semantics-based video retrieval system which supports semantics-retrieval for various users of massive video data. Proposed system automatically processes the extraction of contents information which video data has and retrieval process using agent which integrate annotation-based retrieval and feature-based retrieval. From experiment, the designed and implemented system shows increase of recall rate and precision rate for video data scene retrieval in performance assessment.

• Journal of KIISE:Databases
• /
• v.30 no.2
• /
• pp.145-156
• /
• 2003

Most of the content-based image retrieval systems focuses on similarity-based retrieval of natural picture images by utilizing color. shape, and texture features. For the neuroscience image databases, we found that retrieving similar images based on global average features is meaningless to pathological researchers. To realize the practical content-based retrieval on images in neuroscience databases, it is essential to represent internal contents or semantics of images in detail. In this paper, we present how to represent image contents and their related concepts to support more useful retrieval on such images. We also describe the operational semantics to support these advanced retrievals by using object-oriented message path expressions. Our schemes are flexible and extensible, enabling users to incrementally add more semantics on image contents for more enhanced content searching.

• Journal of information and communication convergence engineering
• /
• v.22 no.1
• /
• pp.56-63
• /
• 2024

Despite the rapid strides in content-based image retrieval, a notable disparity persists between the visual features of images and the semantic features discerned by humans. Hence, image retrieval based on the association of semantic similarities recognized by humans with visual similarities is a difficult task for most image-retrieval systems. Our study endeavors to bridge this gap by refining image semantics, aligning them more closely with human perception. Deep learning techniques are used to semantically classify images and retrieve those that are semantically similar to personalized images. Moreover, we introduce a keyword-based image retrieval, enabling automatic labeling of images in mobile environments. The proposed approach can improve the performance of a mobile device with limited resources and bandwidth by performing retrieval based on the visual features and keywords of the image on the mobile device.

• The KIPS Transactions:PartB
• /
• v.11B no.6
• /
• pp.701-708
• /
• 2004

Existing contents-based video retrieval systems search by using a single method such as annotation-based or feature-based retrieval. Hence, it not only shows low search efficiency, but also requires many efforts to provide system administrator or annotator with a perfect automatic processing. Tn this paper, we propose an agent-based, and automatic and unified semantics-based video retrieval system, which support various semantics-retrieval of the massive video data by integrating the feature-based retrieval and the annotation-based retrieval. The indexing agent embodies the semantics about annotation of extracted key frames by analyzing a fundamental query of a user and by selecting a key-frame image that is ed by a query. Also, a key frame selected by user takes a query image of the feature-based retrieval and the indexing agent searches and displays the most similar key-frame images after comparing query images with key frames in the database by using the color-multiple-partition histogram techniques. Furthermore, it is shown that the performance of the proposed system can be significantly improved.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.12 no.8
• /
• pp.3790-3803
• /
• 2018

Content-based image retrieval is an approach used to query images based on their semantics. Semantic based retrieval has its application in all fields including medicine, space, computing etc. Semantically generated binary hash codes can improve content-based image retrieval. These semantic labels / binary hash codes can be generated from unlabeled data using convolutional autoencoders. Proposed approach uses semi-supervised deep hashing with semantic learning and binary code generation by minimizing the objective function. Convolutional autoencoders are basis to extract semantic features due to its property of image generation from low level semantic representations. These representations of images are more effective than simple feature extraction and can preserve better semantic information. Proposed activation and loss functions helped to minimize classification error and produce better hash codes. Most widely used datasets have been used for verification of this approach that outperforms the existing methods.

• The Journal of the Korea Contents Association
• /
• v.7 no.1
• /
• pp.1-9
• /
• 2007

Semantic photo retrieval has been an important role in reducing the semantic gap between the simple visual features and the abundant semantics delivered by a photo. Effective photo retrieval using semantics is one of the major challenges in photo retrieval. And we propose a new event semantic photo retrieval method by using photo annotation user interface. In this paper, A photo album management system that facilitates photo management and semantic retrieval, which fully relies on the MPEG-7 standard as an information base and a native XML database, has been designed and implemented.

• The Journal of the Korea Contents Association
• /
• v.7 no.7
• /
• pp.50-59
• /
• 2007

This paper describes a question analysis and expansion based on semantics for on efficient information retrieval. Results of all information retrieval systems include many non-relevant documents because the index cannot naturally reflect the contents of documents and because queries used in information retrieval systems cannot represent enough information in user's question. To solve this problem, we analyze user's question semantically, determine the answer type, and extract semantic features. And then we expand user's question using them and syntactic structures which are used to represent the answer. Our similarity is to rank documents which include expanded queries in high position. Especially, we found that an efficient document retrieval is possible by a question analysis and expansion based on semantics on natural language questions which are comparatively short but fully expressing the information demand of users.

• Journal of Korea Multimedia Society
• /
• v.19 no.8
• /
• pp.1498-1504
• /
• 2016

The progress of mobile computing technology is bringing a large amount of multimedia contents such as image. Thus, we need an image retrieval system which searches semantically relevant image. In this paper, we propose a semantic image annotation and retrieval in mobile environments. Previous mobile-based annotation approaches cannot fully express the semantics of image due to the limitation of current form (i.e., keyword tagging). Our approach allows mobile devices to annotate the image automatically using the context-aware information such as temporal and spatial data. In addition, since we annotate the image using RDF(Resource Description Framework) model, we are able to query SPARQL for semantic image retrieval. Our system implemented in android environment shows that it can more fully represent the semantics of image and retrieve the images semantically comparing with other image annotation systems.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2004.05a
• /
• pp.35-38
• /
• 2004

기존의 내용기반 이미지 검색 시스템은 색상, 질감, 모양등과 같은 특징 벡터를 추출하여 검색하는 방법이 많이 연구되어 왔다. 특히 색상 정보는 이미지를 검색하기 위하여 중요한 정보로 사용되고 있다. 따라서 색상 이미지를 검색하기 위해서 평균 RGB, HSI값을 이용하거나 히스토그램을 이용하는 방식이 많이 사용 되어왔다. 본 논문에서는 사람이 시각적으로 보고 느끼는 색상(H), 채도(S), 명도(I) 방식을 이용한 HSI값을 사용하여 색상 의미를 이용한 지능적 이미지 검색 기법을 제안하고 알고리즘을 설명한다. 색상 의미(Color Semantics)란 사람의 시각적인 특징을 기반으로 칼라 이미지에 적용하여 감성 형용사 기반으로 검색할 수 있는 방법이다. 색상 의미를 이용한 지능적 이미지 검색은 색상-기반 질의(color-based retrieval)를 제공할 뿐만 아니라 인간의 감성이나 느낌에 의한 의미-기반 질의(semantic-based retrieval)방식을 가능하게 한다. 즉, "시원한 이미지" 혹은 "부드러운 이미지"를 검색하는 방식이다. 따라서 사용자의 검색 의도를 보다 정확하게 표현할 수 있으며, 검색의 결과에 대한 만족도를 향상 시킬 수 있다.