• Title/Summary/Keyword: Ontology Evaluation

Search Result 88, Processing Time 0.027 seconds

Ontology Modularization Evaluation Framework (온톨로지 모듈화 평가 프레임워크)

  • Oh, Sun-Ju
    • Journal of Intelligence and Information Systems
    • /
    • v.16 no.1
    • /
    • pp.1-16
    • /
    • 2010
  • Several techniques and methods for ontology modularization have been proposed recently. However, there are few ontology evaluation frameworks to evaluate these techniques and methods. Most researches on ontology modularization have not been focused on ontology modularization evaluation but ontology modularization process itself. In this paper, we devise a novel ontology modularization evaluation framework to measure the quality of ontology modules, logical integrity during modularization process and modularization tools. Experiments were conducted to validate the proposed framework. Three representative modularization approaches SWOOP, Prompt, and PATO were chosen and used to partition or extract modules from an ontology. Then the proposed evaluation framework is applied to these modules. The experiment results indicate that the modularization framework works well. The proposed framework would help ontology engineers improve ontology module quality, anticipate and reduce future maintenance as well as help ontology users to choose ontology modules that best meet their requirements.

Extracting Evaluation Criteria for Evaluating Ontology Quality (온톨로지 품질평가를 위한 평가항목 추출에 관한 연구)

  • Kim, Seonghun;Oh, Sam Gyun
    • Journal of the Korean Society for information Management
    • /
    • v.32 no.2
    • /
    • pp.193-219
    • /
    • 2015
  • The focus of traditional evaluations of ontologies is largely performance-based. A comparison of a new ontology with well-established ones, testing of ontologies in different applications, as well as any judgment of an ontology's appropriateness and relatedness to source data heavily rely on what results that ontology seems to manifest. This study, on the other hand, is an attempt to evaluate the quality of a particular ontology as manifested by its structure, representation, and interoperability. To that end, major categories of quality evaluations were first identified through an extensive survey of literature. Evaluation questions were formulated from these categories using the Delphi method and were validated by ontology experts. The entire process produced a set of 53 evaluation questions, which was then employed to test the quality of a newly-developed smartphone ontology.

Design and Implementation of Ontology for Identifying of Maladjustment Soldiers

  • Nam, Jihee;Kang, Dongsu
    • Journal of the Korea Society of Computer and Information
    • /
    • v.24 no.10
    • /
    • pp.195-203
    • /
    • 2019
  • Inadequate military soldiers cause military fatigue and rejection such as reduced confidence in the military and combat power. The military developed and applied a self-adopting test as a psychological test system to identify soldiers who are not fit to serve in the military in advance and prevent accidents. In this paper, we propose the ontology design process to be used for identifying accident concerns and implement the behavioral patterns and symptoms of maladjustment soldiers as ontology. The ontology design process is validated consistency and suitability as a result of the performance evaluation of ontology implemented. Through ontology design for identifying maladjustment soldiers, it is expected to play an effective role in preventing accidents by providing objective criteria and sharing of information on accident concerns.

Measurement Criteria for Ontology Extraction Tools (온톨로지 자동추출도구의 기능적 성능 평가를 위한 평가지표의 개발 및 적용)

  • Park, Jin-Soo;Cho, Won-Chin;Rho, Sang-Kyu
    • Journal of Intelligence and Information Systems
    • /
    • v.14 no.4
    • /
    • pp.69-87
    • /
    • 2008
  • The Web is evolving toward the Semantic Web. Ontologies are considered as a crucial component of the Semantic Web since it is the backbone of knowledge representation for this Web. However, most of these ontologies are still built manually. Manual building of an ontology is time-consuming activity which requires many resources. Consequently, the need for automatic ontology extraction tools has been increased for the last decade, and many tools have been developed for this purpose. Yet, there is no comprehensive framework for evaluating such tools. In this paper, we proposed a set of criteria for evaluating ontology extraction tools and carried out an experiment on four popular ontology extraction tools (i.e., OntoLT, Text-To-Onto, TERMINAE, and OntoBuilder) using our proposed evaluation framework. The proposed framework can be applied as a useful benchmark when developers want to develop ontology extraction tools.

  • PDF

Using the METHONTOLOGY Approach to a Graduation Screen Ontology Development: An Experiential Investigation of the METHONTOLOGY Framework

  • Park, Jin-Soo;Sung, Ki-Moon;Moon, Se-Won
    • Asia pacific journal of information systems
    • /
    • v.20 no.2
    • /
    • pp.125-155
    • /
    • 2010
  • Ontologies have been adopted in various business and scientific communities as a key component of the Semantic Web. Despite the increasing importance of ontologies, ontology developers still perceive construction tasks as a challenge. A clearly defined and well-structured methodology can reduce the time required to develop an ontology and increase the probability of success of a project. However, no reliable knowledge-engineering methodology for ontology development currently exists; every methodology has been tailored toward the development of a particular ontology. In this study, we developed a Graduation Screen Ontology (GSO). The graduation screen domain was chosen for the several reasons. First, the graduation screen process is a complicated task requiring a complex reasoning process. Second, GSO may be reused for other universities because the graduation screen process is similar for most universities. Finally, GSO can be built within a given period because the size of the selected domain is reasonable. No standard ontology development methodology exists; thus, one of the existing ontology development methodologies had to be chosen. The most important considerations for selecting the ontology development methodology of GSO included whether it can be applied to a new domain; whether it covers a broader set of development tasks; and whether it gives sufficient explanation of each development task. We evaluated various ontology development methodologies based on the evaluation framework proposed by G$\acute{o}$mez-P$\acute{e}$rez et al. We concluded that METHONTOLOGY was the most applicable to the building of GSO for this study. METHONTOLOGY was derived from the experience of developing Chemical Ontology at the Polytechnic University of Madrid by Fern$\acute{a}$ndez-L$\acute{o}$pez et al. and is regarded as the most mature ontology development methodology. METHONTOLOGY describes a very detailed approach for building an ontology under a centralized development environment at the conceptual level. This methodology consists of three broad processes, with each process containing specific sub-processes: management (scheduling, control, and quality assurance); development (specification, conceptualization, formalization, implementation, and maintenance); and support process (knowledge acquisition, evaluation, documentation, configuration management, and integration). An ontology development language and ontology development tool for GSO construction also had to be selected. We adopted OWL-DL as the ontology development language. OWL was selected because of its computational quality of consistency in checking and classification, which is crucial in developing coherent and useful ontological models for very complex domains. In addition, Protege-OWL was chosen for an ontology development tool because it is supported by METHONTOLOGY and is widely used because of its platform-independent characteristics. Based on the GSO development experience of the researchers, some issues relating to the METHONTOLOGY, OWL-DL, and Prot$\acute{e}$g$\acute{e}$-OWL were identified. We focused on presenting drawbacks of METHONTOLOGY and discussing how each weakness could be addressed. First, METHONTOLOGY insists that domain experts who do not have ontology construction experience can easily build ontologies. However, it is still difficult for these domain experts to develop a sophisticated ontology, especially if they have insufficient background knowledge related to the ontology. Second, METHONTOLOGY does not include a development stage called the "feasibility study." This pre-development stage helps developers ensure not only that a planned ontology is necessary and sufficiently valuable to begin an ontology building project, but also to determine whether the project will be successful. Third, METHONTOLOGY excludes an explanation on the use and integration of existing ontologies. If an additional stage for considering reuse is introduced, developers might share benefits of reuse. Fourth, METHONTOLOGY fails to address the importance of collaboration. This methodology needs to explain the allocation of specific tasks to different developer groups, and how to combine these tasks once specific given jobs are completed. Fifth, METHONTOLOGY fails to suggest the methods and techniques applied in the conceptualization stage sufficiently. Introducing methods of concept extraction from multiple informal sources or methods of identifying relations may enhance the quality of ontologies. Sixth, METHONTOLOGY does not provide an evaluation process to confirm whether WebODE perfectly transforms a conceptual ontology into a formal ontology. It also does not guarantee whether the outcomes of the conceptualization stage are completely reflected in the implementation stage. Seventh, METHONTOLOGY needs to add criteria for user evaluation of the actual use of the constructed ontology under user environments. Eighth, although METHONTOLOGY allows continual knowledge acquisition while working on the ontology development process, consistent updates can be difficult for developers. Ninth, METHONTOLOGY demands that developers complete various documents during the conceptualization stage; thus, it can be considered a heavy methodology. Adopting an agile methodology will result in reinforcing active communication among developers and reducing the burden of documentation completion. Finally, this study concludes with contributions and practical implications. No previous research has addressed issues related to METHONTOLOGY from empirical experiences; this study is an initial attempt. In addition, several lessons learned from the development experience are discussed. This study also affords some insights for ontology methodology researchers who want to design a more advanced ontology development methodology.

Development and Evaluation of Ontology for Diagnosis in Oriental Medicine (한의진단 Ontology 구축과 평가)

  • Shin Sang-Woo;Jung Gil-San;Park Kyung-Mo;Kim Seon-Ho;Park Jong-Hyun
    • Journal of Physiology & Pathology in Korean Medicine
    • /
    • v.20 no.1
    • /
    • pp.202-208
    • /
    • 2006
  • The goal of this study is to develop knowledge representation method for the construction and evaluation of ontology for diagnosis in oriental medicine. To develop the expert system for decision making on diagnosis and treatment, the systematic and structural knowledge which can be processible in EMR(Electronic Medical Record) must be precedent, and the Computational Process which control the system as well. This study set up an ontology as a trial model to represent the oriental medical knowledge into the machine processible one. Protege 2.1 has been used to build the ontology, and the serialization format of our ontology is the XML document based on OWL. The components of oriental medical diagnosis was arranged with the combination of symptoms which belong to the certain symptom patterns. Then natural language which expresses the oriental medical diagnosis components were converted into the logical sentence, and individual characteristic symptoms into each values of specific properties. In addition to the study, the diagnosis software for oriental medicine was developed and it used the ontology which we developed. Sequently, we tested the software to confirm the appropriateness of ontology. The result of the test shows that diagnostic questions are automatically formulated according to the diagnosis components of this ontology and that as such diagnostic results are induced. Therefore, the ontology system in this study will be efficient to develop the diagnosis program and useful as a tool for doctors to make decision. But, it is not recommendable to apply the system to the clinical environment until the clear diagnosis standards are introduced, and the more reliable diagnosis program can be developed based on the more appropriate ontology mentioned above.

Development of Ontology for Thai Country Songs

  • Thunyaluk, Jaitiang;Malee, Kabmala;Wirapong, Chansanam
    • Journal of Information Science Theory and Practice
    • /
    • v.11 no.1
    • /
    • pp.79-88
    • /
    • 2023
  • This study aimed to develop an ontology for Thai country songs by using the seven steps of an ontology development process. Hozo-Ontology Editor software and Ontology Application Management Framework were tools used in this study. Nine classes of ontology were identified: song, singer, emotion, author, language used, language type, song style, original, and content, and it was found that the song class had a relationship with all of the other classes. The developed ontology was evaluated by seeking opinions from experts in the field of Thai country songs, who agreed that the ontology was highly effective. Additionally, the evaluation employed the knowledge retrieval concept, and the precision, recall, and overall effectiveness were measured, with a precision of 92.59%, a recall of 86.21%, and an overall effectiveness (F-measure) of 89.28%. These results indicate that the developed ontology is highly effective in describing the scope of knowledge of Thai country songs.

Design and Evaluation of an Individual Instance-based Ontology Retrieval System for Archival Records of the "Saemaul Movement" (새마을운동 기록물의 개체기반 온톨로지 검색시스템 설계 및 평가)

  • Lee, Byung Gil;Kim, Heesop
    • Journal of Korean Society of Archives and Records Management
    • /
    • v.13 no.3
    • /
    • pp.67-97
    • /
    • 2013
  • The purpose of this study is to design and evaluate an individual instance-based ontology retrieval system for archival records of the "Saemaul Movement". We used Protege editor 4.1 to design an individual instance-based ontology. To evaluate the proposed ontology retrieval system, five short queries and ten narrative queries were used and compared their precision and recall against the NARA keyword-based retrieval system. The performance results showed that the individual-based ontology retrieval system outperformed the keyword-based retrieval system in terms of the measurement of precision and recall.

Evaluating Service Description to Guarantee Quality of U-service Ontology

  • Lee, Mee-Yeon;Lee, Jung-Won;Kim, Kyung-Ah;Park, Seung-Soo
    • Journal of Information Processing Systems
    • /
    • v.7 no.2
    • /
    • pp.287-298
    • /
    • 2011
  • Efficient service description and modeling methodologies are essential for dynamic service composition to provide autonomous services for users in ubiquitous computing environments. In our previous research, we proposed a 'u-service' ontology which is an abstract and structured concept for device operations in ubiquitous environments. One of the problems that we faced during the design process was that there are not enough standards to analyze the effectiveness of a u-service ontology. In this paper, we propose a quality evaluation model to facilitate the design process of a uservice ontology. We extract modeling goals and evaluation indicators based on the uservice description specification. We also present quality metrics to quantify each of the design properties. The experiment result of the proposed quality model shows that we can use it to analyze the design of u-service ontology from various angles. Also, it shows that the model can provide a guideline, and offer appropriate recommendations for improvements.

A Case-Based Reasoning Approach to Ontology Inference Engine Selection for Robust Context-Aware Services (상황인식 서비스의 안정적 운영을 위한 온톨로지 추론 엔진 선택을 위한 사례기반추론 접근법)

  • Shim, Jae-Moon;Kwon, Oh-Byung
    • Journal of the Korean Operations Research and Management Science Society
    • /
    • v.33 no.2
    • /
    • pp.27-44
    • /
    • 2008
  • Owl-based ontology is useful to realize the context-aware services which are composed of the distributed and self-configuring modules. Many ontology-based inference engines are developed to infer useful information from ontology. Since these engines show the uniqueness in terms of speed and information richness, it's difficult to ensure stable operation in providing dynamic context-aware services, especially when they should deal with the complex and big-size ontology. To provide a best inference service, the purpose of this paper is to propose a novel methodology of context-aware engine selection in a contextually prompt manner Case-based reasoning is applied to identify the causality between context and inference engined to be selected. Finally, a series of experiments is performed with a novel evaluation methodology to what extent the methodology works better than competitive methods on an actual context-aware service.