• Title/Summary/Keyword: Evaluation studies as topic

Search Result 81, Processing Time 0.027 seconds

An analysis of domestic research trends of mathematics curriculum research through topic modeling: Focused on domestic journals published from 1997 to 2019 (토픽모델링을 활용한 국내 수학과 교육과정 연구 동향 분석 : 1997년부터 2019년까지 게재된 국내 수학교육 학술지 논문을 중심으로)

  • Son, Taekwon;Lee, Kwangho
    • The Mathematical Education
    • /
    • v.59 no.3
    • /
    • pp.201-216
    • /
    • 2020
  • This study analyzed 493 domestic mathematics curriculum articles published in KCI's listings from 1997 to 2019 using LDA topic modeling. As a result, domestic mathematics curriculum research could be categorized into eight topics such as 'context in a curriculum', 'analysis a curriculum by the mathematical concept', 'form, system, meaning, and character of a curriculum', 'instruction and application of a curriculum', 'implementation and evaluation of a curriculum', 'tasks in a curriculum', 'analysis of a curriculum based on ability', 'compare and analysis curriculum and textbook'. The topic 'implementation and evaluation of a curriculum' was identified with the lowest proportion. Also, we performed the simple regression analysis with the weight of topics in the application period of the curriculum, and 'analysis of a curriculum based on ability' appeared as a 'hot topic'. Furthermore, topics appeared differently depending on the application period of the curriculum. Some of the appeared topics showed a tendency to match the emphasis of the highlight in a mathematics curriculum. Based on the results, future studies should develop frameworks for mathematics curriculum studies and extend the field of mathematical curriculum studies to make progress. Furthermore, future studies are needed to examine the enactment, feedback, and competency evaluation in the mathematical curriculum.

Counting Research Publications, Citations, and Topics: A Critical Assessment of the Empirical Basis of Scientometrics and Research Evaluation

  • Wolfgang G. Stock;Gerhard Reichmann;Isabelle Dorsch;Christian Schlogl
    • Journal of Information Science Theory and Practice
    • /
    • v.11 no.2
    • /
    • pp.37-66
    • /
    • 2023
  • Scientometrics and research evaluation describe and analyze research publications when conducting publication, citation, and topic analyses. However, what exactly is a (scientific, academic, scholarly or research) publication? This article demonstrates that there are many problems when it comes to looking in detail at quantitative publication analyses, citation analyses, altmetric analyses, and topic analyses. When is a document a publication and when is it not? We discuss authorship and contribution, formally and informally published documents, as well as documents in between (preprints, research data) and the characteristics of references, citations, and topics. What is a research publication? Is there a commonly accepted criterion for distinguishing between research and non-research? How complete and unbiased are data sources for research publications and sources for altmetrics? What is one research publication? What is the unit of a publication that causes us to count it as "1?" In this regard, we report problems related to multi-author publications and their counting, weighted document types, the unit and weighting of citations and references, the unit of topics, and counting problems-not only at the article and individual researcher level (micro-level), but also at the meso-level (e.g., institutions) and macro-level (e.g., countries). Our results suggest that scientometric counting units are not reliable and clear. Many scientometric and research evaluation studies must therefore be used with the utmost caution.

Response Evaluation of Chemotherapy for Lung Cancer

  • Hwang, Ki-Eun;Kim, Hak-Ryul
    • Tuberculosis and Respiratory Diseases
    • /
    • v.80 no.2
    • /
    • pp.136-142
    • /
    • 2017
  • Assessing response to therapy allows for prospective end point evaluation in clinical trials and serves as a guide to clinicians for making decisions. Recent prospective and randomized trials suggest the development of imaging techniques and introduction of new anti-cancer drugs. However, the revision of methods, or proposal of new methods to evaluate chemotherapeutic response, is not enough. This paper discusses the characteristics of the Response Evaluation Criteria In Solid Tumor (RECIST) version 1.1 suggested in 2009 and used widely by experts. It also contains information about possible dilemmas arising from the application of response assessment by the latest version of the response evaluation method, or recently introduced chemotherapeutic agents. Further data reveals the problems and limitations caused by applying the existing RECIST criteria to anti-cancer immune therapy, and the application of a new technique, immune related response criteria, for the response assessment of immune therapy. Lastly, the paper includes a newly developing response evaluation method and suggests its developmental direction.

A Case Study of Source Selection and Evaluation by Using the Analytic Hierarchy Process

  • Lee, Nam-Yong
    • Proceedings of the CALSEC Conference
    • /
    • 2000.08a
    • /
    • pp.207-214
    • /
    • 2000
  • Over the last several decades, the topic of the source selection and evaluation has gained a great attention in the information systems community as an effective tool to acquire information systems in an organization. The source selection and evaluation process is a multiple-criteria decision-making problem associated with several evaluation issues. In this case study, evaluation issues include management, technologies, logistics, and cost. This case study was conducted to compare a new source selection and evaluation process by using the analytic hierarchy process with the traditional approach. This study provides useful insight about how to apply the analytic hierarchy process technique to the traditional approach.

  • PDF

Text Analysis on the Research Trends of Nature Restoration in Korea (텍스트 분석을 활용한 국내 자연환경복원 연구동향 분석)

  • Lee, Gil-sang;Jung, Yee-rim;Song, Young-keun;Lee, Sang-hyuk;Son, Seung-Woo
    • Journal of the Korean Society of Environmental Restoration Technology
    • /
    • v.27 no.2
    • /
    • pp.29-42
    • /
    • 2024
  • As a global response to climate and biodiversity challenges, there is an emphasis on the conservation and restoration of ecosystems that can simultaneously reduce carbon emissions and enhance biodiversity. This study comprised a text analysis and keyword extraction of 1,100 research papers addressing nature restoration in Korea, aiming to provide a quantative and systematic evaluation of domestic research trends in this field. To discern the major research topics of these papers, topic modeling was applied and correlations were established through network analysis. Research on nature restoration exhibited a mainly upward trend in 2002-2022 but with a slight recent decline. The most common keywords were "species," "forest," and "water". Research topics were broadly classified into (1) predictions of habitat size and species distribution, (2) the conservation and utilization of natural resources in urban areas, (3) ecosystems and landscape managements in protected areas, (4) the planting and growth of vegetation, and (5) habitat formation methods. The number of studies on nature restoration are increasing across various domains in Korea, with each domain experiencing professional development.

Airline Service Quality Evaluation Based on Customer Review Using Machine Learning Approach and Sentiment Analysis (머신러닝과 감성분석을 활용한 고객 리뷰 기반 항공 서비스 품질 평가)

  • Jeon, Woojin;Lee, Yebin;Geum, Youngjung
    • The Journal of Society for e-Business Studies
    • /
    • v.26 no.4
    • /
    • pp.15-36
    • /
    • 2021
  • The airline industry faces with significant competition due to the rise of technology innovation and diversified customer needs. Therefore, continuous quality management is essential to gain competitive advantages. For this reason, there have been various studies to measure and manage service quality using customer reviews. However, previous studies have focused on measuring customer satisfaction only, neglecting systematic management between customer expectations and perception based on customer reviews. In response, this study suggests a framework to identify relevant criteria for service quality management, measure the importance, and assess the customer perception based on customer reviews. Machine learning techniques, topic models, and sentiment analysis are used for this study. This study can be used as an important strategic tool for evaluating service quality by identifying important factors for airline customer satisfaction while presenting a framework for identifying each airline's current service level.

A New Approach to Evaluation of Industrial Informatization (차세대 기업 정보화수준 평가 시스템에 관한 연구)

  • Leem, Choon-Seong;Yu, Eun-Jung;Kim, Byeong-Wan;Shin, Seon-Do;Lee, Byeong-Ryul;Cha, Jeong-Hoon
    • The Journal of Society for e-Business Studies
    • /
    • v.13 no.4
    • /
    • pp.125-144
    • /
    • 2008
  • Recently, the main concerns of enterprise management activities is how to strengthen the competitiveness to quickly respond to changes and sustain the growth in business environment. As IT(Information Technology) has become to be viewed as a key driver for the business competitiveness, new paradigms, such as business and IT alignment, IT-driven product/service innovation and so on, are regarded as the hot topic in many industries. However, previous studies related to IT evaluation, which is more critical than any other IT activities, have focused on quantitative IT deployment, utilization and its economical effects. Therefore, this study presents the newly-developed evaluation domains and items based on four pairs of relative concepts in industrial informatization, and their multi-dimensional analysis methodology which explains various types of IT characteristics of enterprises. And finally, pilot tests at 2 companies in financial service sector will be performed in order to verify the practicality of the evaluation system.

  • PDF

A Topic Modeling-based Recommender System Considering Changes in User Preferences (고객 선호 변화를 고려한 토픽 모델링 기반 추천 시스템)

  • Kang, So Young;Kim, Jae Kyeong;Choi, Il Young;Kang, Chang Dong
    • Journal of Intelligence and Information Systems
    • /
    • v.26 no.2
    • /
    • pp.43-56
    • /
    • 2020
  • Recommender systems help users make the best choice among various options. Especially, recommender systems play important roles in internet sites as digital information is generated innumerable every second. Many studies on recommender systems have focused on an accurate recommendation. However, there are some problems to overcome in order for the recommendation system to be commercially successful. First, there is a lack of transparency in the recommender system. That is, users cannot know why products are recommended. Second, the recommender system cannot immediately reflect changes in user preferences. That is, although the preference of the user's product changes over time, the recommender system must rebuild the model to reflect the user's preference. Therefore, in this study, we proposed a recommendation methodology using topic modeling and sequential association rule mining to solve these problems from review data. Product reviews provide useful information for recommendations because product reviews include not only rating of the product but also various contents such as user experiences and emotional state. So, reviews imply user preference for the product. So, topic modeling is useful for explaining why items are recommended to users. In addition, sequential association rule mining is useful for identifying changes in user preferences. The proposed methodology is largely divided into two phases. The first phase is to create user profile based on topic modeling. After extracting topics from user reviews on products, user profile on topics is created. The second phase is to recommend products using sequential rules that appear in buying behaviors of users as time passes. The buying behaviors are derived from a change in the topic of each user. A collaborative filtering-based recommendation system was developed as a benchmark system, and we compared the performance of the proposed methodology with that of the collaborative filtering-based recommendation system using Amazon's review dataset. As evaluation metrics, accuracy, recall, precision, and F1 were used. For topic modeling, collapsed Gibbs sampling was conducted. And we extracted 15 topics. Looking at the main topics, topic 1, top 3, topic 4, topic 7, topic 9, topic 13, topic 14 are related to "comedy shows", "high-teen drama series", "crime investigation drama", "horror theme", "British drama", "medical drama", "science fiction drama", respectively. As a result of comparative analysis, the proposed methodology outperformed the collaborative filtering-based recommendation system. From the results, we found that the time just prior to the recommendation was very important for inferring changes in user preference. Therefore, the proposed methodology not only can secure the transparency of the recommender system but also can reflect the user's preferences that change over time. However, the proposed methodology has some limitations. The proposed methodology cannot recommend product elaborately if the number of products included in the topic is large. In addition, the number of sequential patterns is small because the number of topics is too small. Therefore, future research needs to consider these limitations.

Who knows what and to what extent - modeling the knowledge of the narrative agent

  • Hochang Kwon
    • Trans-
    • /
    • v.14
    • /
    • pp.65-92
    • /
    • 2023
  • The knowledge of the narrative agent not only constitutes the content and meaning of the narrative itself, but is also closely related to the emotional response of the recipient. Also, the disparity of knowledge between narrative agents is an important factor in making a narrative richer and more interesting. But It tends to be treated as a sub-topic of narration theory or genre/style studies rather than an independent subject of narrative studies or criticism. In this paper, I propose a model that can systematically and quantitatively analyze the knowledge of narrative agents. The proposed model consists of the knowledge structure that represents a narrative, the knowledge state that expresses the knowledge of narrative agent as a degree of belief, and the knowledge flow that means changes in the knowledge state according to the development of events. In addition, the formal notation of the knowledge structure and a probabilistic inference model that could obtain the state of knowledge were proposed, and the knowledge structure and knowledge flow were analyzed by applying the model to the actual narrative. It is expected that the proposed model will be of practical help in the creation and evaluation of narratives.

Analysis of Research Trends on Archival Information Services Using Text Mining (텍스트마이닝을 활용한 국내외 기록서비스 연구동향 분석)

  • Seohee Park;Hye-Eun Lee
    • Journal of Korean Society of Archives and Records Management
    • /
    • v.24 no.1
    • /
    • pp.89-109
    • /
    • 2024
  • The study analyzed the research trends of domestic and international record information services from 2003 to 2022. A total of 136 academic papers registered in the Korea Citation Index (KCI) and 74 from the Library, Information Science & Technology Abstracts (LISTA) were examined by quantitative and qualitative content analysis to understand the research status of 20 years from various angles, such as publication year, research type, researcher type, subject, and purpose. Frequency analysis, co-occurrence frequency analysis, centrality analysis, and topic modeling were performed by applying text mining techniques. Results showed that domestic papers demonstrated a research flow focused on specific institutions or records, and user-centered satisfaction surveys and content-centered studies were conducted. Moreover, foreign papers confirmed various evaluation-oriented and information provision studies, such as data, resources, and collections, along with the research trend focusing on the relationship between archivists and users. The management of information resources was identified as a common topic in both domestic and foreign papers, but it is possible to identify that domestic research focuses on maintaining the quality of domestic information resources, while foreign research focuses on the storage and retrieval of information.