• 제목/요약/키워드: Ontology Evaluation

검색결과 89건 처리시간 0.025초

온톨로지 모듈화 평가 프레임워크 (Ontology Modularization Evaluation Framework)

  • 오선주
    • 지능정보연구
    • /
    • 제16권1호
    • /
    • pp.1-16
    • /
    • 2010
  • 최근 온톨로지 모듈을 이용하여 효과적으로 온톨로지를 구축하려는 시도들이 증가하고 있으며 이에 따라 다양한 온톨로지 모듈화 기법들이 제안되어왔다. 이들 기법들은 각각의 모듈화 목표와 기준을 바탕으로 개발되어 왔으나 모듈화 기법들을 평가할 수 있는 공통된 기준 및 평가 프레임워크가 정립되지 않아 서로 비교하기 어려운 실정이다. 또한 온톨로지와 관련된 평가에 대한 연구들이 지금까지 활발히 이루어져 왔지만 주로 온톨로지 단위의 평가가 중심이 되어왔으며 온톨로지 모듈화 기법의 평가에 대한 가시적인 연구들이 부족하다. 그러나 획일적이고 대용량인 온톨로지 사용의 문제점과 모듈화 필요성에 대한 인식과 함께 온톨로지를 모듈화하는 작업에 대한 평가 필요성이 제기되고 있다. 그러므로 본 연구에서는 온톨로지 모듈화 작업 과정과 모듈화 결과물인 모듈 그리고 모듈화 도구에 대한 총괄적인 평가를 제공하는 프레임워크를 제안한다. 또한, 본 연구에서 제시한 평가 프레임워크를 실증적 실험을 통해 SWOOP, PATO, Prompt 등 모듈화 기법에 적용하였다. 본 연구의 결과를 통하여 온톨로지 엔지니어들이 온톨로지 모듈화 작업의 품질을 개선시킬 수 있고 온톨로지 사용자들이 사용 목적에 맞는 온톨로지 모듈화 기법을 선택할 수 있도록 한다.

온톨로지 품질평가를 위한 평가항목 추출에 관한 연구 (Extracting Evaluation Criteria for Evaluating Ontology Quality)

  • 김성훈;오삼균
    • 정보관리학회지
    • /
    • 제32권2호
    • /
    • pp.193-219
    • /
    • 2015
  • 온톨로지의 평가는 잘 구축된 기존 온톨로지와 비교하는 방법, 활용될 애플리케이션에 적용해보는 방법, 원천데이터와의 적합성 관련성을 판단해보는 방법을 통해 이뤄지고 있다. 이와 같은 방법론은 온톨로지를 통해 얻게 된 결과에 치중되어 온톨로지의 체계, 의미표현, 상호운용성과 같은 내재적인 영역의 평가에 어려움이 있다. 본 연구는 온톨로지 전문가를 통해 온톨로지 품질평가를 위한 항목을 도출하였다. 문헌조사를 통해 온톨로지의 내재적 평가를 위한 범주를 추출하였고, 각 범주에 대한 평가항목을 델파이조사를 통해 전문가들에게 수집한 뒤, 수집된 평가항목을 재검증하였다. 그 결과, 처음 수집된 70개의 평가 항목에서 최종적으로 53개의 평가항목을 선정하였다. 또한 수집된 평가항목을 온톨로지 평가에 활용하여 봄으로써 평가항목의 신뢰도를 측정하였다.

Design and Implementation of Ontology for Identifying of Maladjustment Soldiers

  • Nam, Jihee;Kang, Dongsu
    • 한국컴퓨터정보학회논문지
    • /
    • 제24권10호
    • /
    • pp.195-203
    • /
    • 2019
  • 군 내 복무 부적응 병사들로 인한 병영사고는 비전투력 손실에 따른 전투력 약화, 대군 신뢰도 저하 등 많은 문제를 유발한다. 군은 복무 부적응 병사들을 사전에 식별하고 사고를 예방하기 위한 심리검사체계로 신인성검사를 개발, 적용하고 있다. 본 논문에서는 사고 우려자를 식별하기 위해 부적응 병사의 행동 패턴과 증상을 온톨로지로 구현하기 위한 온톨로지 설계 프로세스를 제안한다. 온톨로지 설계 프로세스에 따라 설계한 온톨로지의 성능 평가 결과, 적합성 및 효과성이 검증되었다. 온톨로지 설계를 통해 부적응 병사를 식별하기 위한 군 내 객관적인 기준을 제시하고 사고 우려자에 관한 정보를 공유함으로써 사고 예방에 효과적인 역할을 할 것으로 기대된다.

온톨로지 자동추출도구의 기능적 성능 평가를 위한 평가지표의 개발 및 적용 (Measurement Criteria for Ontology Extraction Tools)

  • 박진수;조원진;노상규
    • 지능정보연구
    • /
    • 제14권4호
    • /
    • pp.69-87
    • /
    • 2008
  • 이제 인터넷은 시맨틱 웹(Semantic Web)의 형태로 진화 발전하고 있다. 그 결과 시맨틱 웹의 지식을 표현하는 백본 인 온톨로지가 매우 중요하게 인식되고 있다. 그러나 온톨로지를 구축하는 것은 많은 시간과 자원을 필요로 하는 작업이다. 이로 인해 온톨로지 추출도구(ontology extraction tool)에 대한 개발의 필요성이 지난 십여 년간 제기되어 왔으며, 온톨로지를 자동으로 추출하거나 온톨로지 구축을 돕는 도구들이 개발되었다. 그러나 여러 온톨로지 자동추출도구들 중에 구축하고자 하는 온톨로지의 사용자 요구사항에 적합한 자동추출도구를 선택하기 위해서는 이런 도구들에 대한 평가지표가 필요하다. 하지만, 현재 이런 도구들을 평가하기 위한 포괄적인 평가 프레임워크(comprehensive evaluation framework)가 존재하지 않는다. 본 연구에서는, 문헌연구를 수행하여 온톨로지 자동추출도구가 갖춰야 할 핵심 요소들을 찾고, 온톨로지 추출도구들을 평가하기 위한 일련의 평가지표들을 개발했다. 또한 본 연구에서 제안하는 평가지표에 따라 온톨로지 자동추출도구인 OntoLT, Text-To-Onto, TERMINAE, OntoBuilder를 평가해 보았다.

  • PDF

Using the METHONTOLOGY Approach to a Graduation Screen Ontology Development: An Experiential Investigation of the METHONTOLOGY Framework

  • Park, Jin-Soo;Sung, Ki-Moon;Moon, Se-Won
    • Asia pacific journal of information systems
    • /
    • 제20권2호
    • /
    • pp.125-155
    • /
    • 2010
  • Ontologies have been adopted in various business and scientific communities as a key component of the Semantic Web. Despite the increasing importance of ontologies, ontology developers still perceive construction tasks as a challenge. A clearly defined and well-structured methodology can reduce the time required to develop an ontology and increase the probability of success of a project. However, no reliable knowledge-engineering methodology for ontology development currently exists; every methodology has been tailored toward the development of a particular ontology. In this study, we developed a Graduation Screen Ontology (GSO). The graduation screen domain was chosen for the several reasons. First, the graduation screen process is a complicated task requiring a complex reasoning process. Second, GSO may be reused for other universities because the graduation screen process is similar for most universities. Finally, GSO can be built within a given period because the size of the selected domain is reasonable. No standard ontology development methodology exists; thus, one of the existing ontology development methodologies had to be chosen. The most important considerations for selecting the ontology development methodology of GSO included whether it can be applied to a new domain; whether it covers a broader set of development tasks; and whether it gives sufficient explanation of each development task. We evaluated various ontology development methodologies based on the evaluation framework proposed by G$\acute{o}$mez-P$\acute{e}$rez et al. We concluded that METHONTOLOGY was the most applicable to the building of GSO for this study. METHONTOLOGY was derived from the experience of developing Chemical Ontology at the Polytechnic University of Madrid by Fern$\acute{a}$ndez-L$\acute{o}$pez et al. and is regarded as the most mature ontology development methodology. METHONTOLOGY describes a very detailed approach for building an ontology under a centralized development environment at the conceptual level. This methodology consists of three broad processes, with each process containing specific sub-processes: management (scheduling, control, and quality assurance); development (specification, conceptualization, formalization, implementation, and maintenance); and support process (knowledge acquisition, evaluation, documentation, configuration management, and integration). An ontology development language and ontology development tool for GSO construction also had to be selected. We adopted OWL-DL as the ontology development language. OWL was selected because of its computational quality of consistency in checking and classification, which is crucial in developing coherent and useful ontological models for very complex domains. In addition, Protege-OWL was chosen for an ontology development tool because it is supported by METHONTOLOGY and is widely used because of its platform-independent characteristics. Based on the GSO development experience of the researchers, some issues relating to the METHONTOLOGY, OWL-DL, and Prot$\acute{e}$g$\acute{e}$-OWL were identified. We focused on presenting drawbacks of METHONTOLOGY and discussing how each weakness could be addressed. First, METHONTOLOGY insists that domain experts who do not have ontology construction experience can easily build ontologies. However, it is still difficult for these domain experts to develop a sophisticated ontology, especially if they have insufficient background knowledge related to the ontology. Second, METHONTOLOGY does not include a development stage called the "feasibility study." This pre-development stage helps developers ensure not only that a planned ontology is necessary and sufficiently valuable to begin an ontology building project, but also to determine whether the project will be successful. Third, METHONTOLOGY excludes an explanation on the use and integration of existing ontologies. If an additional stage for considering reuse is introduced, developers might share benefits of reuse. Fourth, METHONTOLOGY fails to address the importance of collaboration. This methodology needs to explain the allocation of specific tasks to different developer groups, and how to combine these tasks once specific given jobs are completed. Fifth, METHONTOLOGY fails to suggest the methods and techniques applied in the conceptualization stage sufficiently. Introducing methods of concept extraction from multiple informal sources or methods of identifying relations may enhance the quality of ontologies. Sixth, METHONTOLOGY does not provide an evaluation process to confirm whether WebODE perfectly transforms a conceptual ontology into a formal ontology. It also does not guarantee whether the outcomes of the conceptualization stage are completely reflected in the implementation stage. Seventh, METHONTOLOGY needs to add criteria for user evaluation of the actual use of the constructed ontology under user environments. Eighth, although METHONTOLOGY allows continual knowledge acquisition while working on the ontology development process, consistent updates can be difficult for developers. Ninth, METHONTOLOGY demands that developers complete various documents during the conceptualization stage; thus, it can be considered a heavy methodology. Adopting an agile methodology will result in reinforcing active communication among developers and reducing the burden of documentation completion. Finally, this study concludes with contributions and practical implications. No previous research has addressed issues related to METHONTOLOGY from empirical experiences; this study is an initial attempt. In addition, several lessons learned from the development experience are discussed. This study also affords some insights for ontology methodology researchers who want to design a more advanced ontology development methodology.

한의진단 Ontology 구축과 평가 (Development and Evaluation of Ontology for Diagnosis in Oriental Medicine)

  • 신상우;정길산;박경모;김선호;박종현
    • 동의생리병리학회지
    • /
    • 제20권1호
    • /
    • pp.202-208
    • /
    • 2006
  • The goal of this study is to develop knowledge representation method for the construction and evaluation of ontology for diagnosis in oriental medicine. To develop the expert system for decision making on diagnosis and treatment, the systematic and structural knowledge which can be processible in EMR(Electronic Medical Record) must be precedent, and the Computational Process which control the system as well. This study set up an ontology as a trial model to represent the oriental medical knowledge into the machine processible one. Protege 2.1 has been used to build the ontology, and the serialization format of our ontology is the XML document based on OWL. The components of oriental medical diagnosis was arranged with the combination of symptoms which belong to the certain symptom patterns. Then natural language which expresses the oriental medical diagnosis components were converted into the logical sentence, and individual characteristic symptoms into each values of specific properties. In addition to the study, the diagnosis software for oriental medicine was developed and it used the ontology which we developed. Sequently, we tested the software to confirm the appropriateness of ontology. The result of the test shows that diagnostic questions are automatically formulated according to the diagnosis components of this ontology and that as such diagnostic results are induced. Therefore, the ontology system in this study will be efficient to develop the diagnosis program and useful as a tool for doctors to make decision. But, it is not recommendable to apply the system to the clinical environment until the clear diagnosis standards are introduced, and the more reliable diagnosis program can be developed based on the more appropriate ontology mentioned above.

Development of Ontology for Thai Country Songs

  • Thunyaluk, Jaitiang;Malee, Kabmala;Wirapong, Chansanam
    • Journal of Information Science Theory and Practice
    • /
    • 제11권1호
    • /
    • pp.79-88
    • /
    • 2023
  • This study aimed to develop an ontology for Thai country songs by using the seven steps of an ontology development process. Hozo-Ontology Editor software and Ontology Application Management Framework were tools used in this study. Nine classes of ontology were identified: song, singer, emotion, author, language used, language type, song style, original, and content, and it was found that the song class had a relationship with all of the other classes. The developed ontology was evaluated by seeking opinions from experts in the field of Thai country songs, who agreed that the ontology was highly effective. Additionally, the evaluation employed the knowledge retrieval concept, and the precision, recall, and overall effectiveness were measured, with a precision of 92.59%, a recall of 86.21%, and an overall effectiveness (F-measure) of 89.28%. These results indicate that the developed ontology is highly effective in describing the scope of knowledge of Thai country songs.

새마을운동 기록물의 개체기반 온톨로지 검색시스템 설계 및 평가 (Design and Evaluation of an Individual Instance-based Ontology Retrieval System for Archival Records of the "Saemaul Movement")

  • 이병길;김희섭
    • 한국기록관리학회지
    • /
    • 제13권3호
    • /
    • pp.67-97
    • /
    • 2013
  • 본 연구의 목적은 새마을운동 기록물을 위한 개체기반 온톨로지 검색시스템의 설계와 그 성능평가이다. 개체기반 온톨로지 설계를 위하여 Protege editor4.1을 사용하였고, 새롭게 구현된 검색시스템의 성능은 단문5개, 장문10개의 질의유형으로 기존 나라기록의 키워드 기반 검색시스템과 정확률과 재현율을 비교하여 분석하였다. 분석결과 개체기반 온톨로지 검색시스템이 정확률과 재현율 모두 키워드 기반 시스템보다 우수한 성능을 보였다.

Evaluating Service Description to Guarantee Quality of U-service Ontology

  • Lee, Mee-Yeon;Lee, Jung-Won;Kim, Kyung-Ah;Park, Seung-Soo
    • Journal of Information Processing Systems
    • /
    • 제7권2호
    • /
    • pp.287-298
    • /
    • 2011
  • Efficient service description and modeling methodologies are essential for dynamic service composition to provide autonomous services for users in ubiquitous computing environments. In our previous research, we proposed a 'u-service' ontology which is an abstract and structured concept for device operations in ubiquitous environments. One of the problems that we faced during the design process was that there are not enough standards to analyze the effectiveness of a u-service ontology. In this paper, we propose a quality evaluation model to facilitate the design process of a uservice ontology. We extract modeling goals and evaluation indicators based on the uservice description specification. We also present quality metrics to quantify each of the design properties. The experiment result of the proposed quality model shows that we can use it to analyze the design of u-service ontology from various angles. Also, it shows that the model can provide a guideline, and offer appropriate recommendations for improvements.

상황인식 서비스의 안정적 운영을 위한 온톨로지 추론 엔진 선택을 위한 사례기반추론 접근법 (A Case-Based Reasoning Approach to Ontology Inference Engine Selection for Robust Context-Aware Services)

  • 심재문;권오병
    • 한국경영과학회지
    • /
    • 제33권2호
    • /
    • pp.27-44
    • /
    • 2008
  • Owl-based ontology is useful to realize the context-aware services which are composed of the distributed and self-configuring modules. Many ontology-based inference engines are developed to infer useful information from ontology. Since these engines show the uniqueness in terms of speed and information richness, it's difficult to ensure stable operation in providing dynamic context-aware services, especially when they should deal with the complex and big-size ontology. To provide a best inference service, the purpose of this paper is to propose a novel methodology of context-aware engine selection in a contextually prompt manner Case-based reasoning is applied to identify the causality between context and inference engined to be selected. Finally, a series of experiments is performed with a novel evaluation methodology to what extent the methodology works better than competitive methods on an actual context-aware service.