• Title/Summary/Keyword: Meta Evaluation

Search Result 362, Processing Time 0.023 seconds

Developments of Evaluation System in Agricultural R&D Program by Rural Development Agency (농촌진흥청 연구개발 평가체계의 성과지향적 발전 방향)

  • Yi, Chan-Goo
    • Journal of Korea Technology Innovation Society
    • /
    • v.14 no.4
    • /
    • pp.937-964
    • /
    • 2011
  • The research question of this work comes from that there have been disputes for the governance and roles of the Rural Development Agency (RDA), despite of rather excellence performances of Agricultural R&D program supported by RDA. For this reason, I meta-evaluated the internal evaluation system of Agricultural R&D program in RDA, in terms of the four meta-evaluation components such as evaluation paradigm, evaluation resources, evaluation execution and evaluation utilization. The result shows that the most serious problem is rather lower level of evaluation. Object, one of the evaluation paradigms in the R&D evaluation system of the RDA. So, this work suggested the policy alternatives which may lead the R&D evaluation system of the RDA to be developed for the performance-oriented R&D management system.

  • PDF

The evaluation of methodological quality of meta-analysis studies in speech language pathology using AMSTAR (AMSTAR에 기반한 국내 언어치료 분야 메타분석 논문의 방법론적 질평가)

  • Han, Minju;Byeon, Haewon
    • Journal of the Korea Convergence Society
    • /
    • v.11 no.2
    • /
    • pp.161-165
    • /
    • 2020
  • Although research using meta-analysis is increasing in the field of rehabilitation science, not all meta-analytical papers are of the same quality. In particular, although meta-analysis is a research method with the highest level of evidence, it may be possible to derive distorted conclusions or alternatives by simply integrating representative values without considering heterogeneity among individual studies. This study analyzed the current status of meta-analysis papers on the subject of language arbitration published in Korea from January 2010 to June 2019, and used A Measurement Tool to Assess the Methodological Quality of Systematic Review (AMSTAR). As a result of evaluating the methodological quality of the final five papers, the average of 7.4 points out of 11 points was found above average. In order to raise the qualitative level of Meta-analysis in speech-language pathology in the future, it is necessary to include verification of publication bias and specification of conflicts of interest.

A Meta-Evaluation of the Evaluation Project at the Family Support Center (가족센터 평가사업에 대한 메타평가)

  • Kang, bogjoeng
    • Journal of Family Resource Management and Policy Review
    • /
    • v.28 no.2
    • /
    • pp.27-38
    • /
    • 2024
  • The purpose of this study was to identify issues in the family support center evaluation project by analyzing the differences in perception between evaluators and the family Support center using a meta-evaluation analysis model and seeking improvement alternatives. The results revealed a significant difference in group average: the evaluator group scored 4.21 out of 5 points, and the family center group scored 3.20 points. The improvement alternatives for each meta-evaluation item are as follows. In the evaluation environment, it is necessary to specify the purpose and utilization of evaluation within the guidelines of the Ministry of Gender Equality and Family. Evaluation input required the establishment of an evaluation support organization within the Korean Institute for Healthy Family. During the evaluation process, it was necessary to improve the use of the integrated family support information system and diversify communication channels. The evaluation results required the strengthening of follow-up education for family centers. In terms of evaluation utilization, it was necessary to strengthen support for various incentives and subcenters. This study provides implications for improving the evaluation system for various policy service delivery systems.

Aspects of Meta-affect in Problem-Solving Process of Mathematically Gifted Children (수학 영재아의 문제해결 과정에 나타나는 메타정의의 특성)

  • Do, Joowon;Paik, Suckyoon
    • Journal of Elementary Mathematics Education in Korea
    • /
    • v.23 no.1
    • /
    • pp.59-74
    • /
    • 2019
  • According to previous studies, it shows that the metacognitive ability that makes the positive element of the problem solver positively affects the problem-solving process of mathematics. In order to accurately grasp causality, this study investigates the specific characteristics of the meta-affect factor in the process of problem-solving. To do this, we analyzed the types and frequency of data collected from collaborative problem-solving situations composed of 4th~6th grade mathematically gifted children in small group of two. As a result, it can be seen that the type of meta-affect in the problem-solving process of mathematically gifted children is related to the correctness rate of the problem. First, regardless of the success or failure of the problem-solving, the meta-affect appeared relatively frequently in the meta-affect types in which the cognitive factors related to the context of problem-solving appeared first, and acted as the meta-functional type of the evaluation and attitude. Especially, in the case of successful problem-solving of mathematically gifted children, meta-affect showed a very active function as meta-functional type of evaluation.

  • PDF

A Popularity-driven Cache Management and its Performance Evaluation in Meta-search Engines (메타 검색 엔진을 위한 인기도 기반 캐쉬 관리 및 성능 평가)

  • Hong, Jin-Seon;Lee, Sang-Ho
    • Journal of KIISE:Databases
    • /
    • v.29 no.2
    • /
    • pp.148-157
    • /
    • 2002
  • Caching in meta-search engines can improve the response time of users' request. We describe the cache scheme in our meta-search engine in terms of its architecture and operational flow. In particular, we propose a popularity-driven cache algorithm that utilizes popularities of queries to determine cached data to be purged. The popularity is a value that represents the normalized occurrence frequency of user queries. This paper presents how to collect popular queries and how to calculate query popularities. An empirical performance evaluation of the popularity-driven caching with the traditional schemes (i.e., least recently used (LRU) and least frequently used (LFU)) has been carried out on a collection of real data. In almost all cases, the proposed replacement policy outperforms LRU and LFU.

Meta-analysis on the Effects of Fashion Product Evaluation Attributes in Korea (국내 연구의 패션상품 평가속성 효과에 대한 메타분석연구)

  • Lee, Jung-Woo;Kim, Mi Young
    • Journal of the Korean Society of Clothing and Textiles
    • /
    • v.40 no.6
    • /
    • pp.1150-1163
    • /
    • 2016
  • This study makes use of meta-analysis to statistically integrate the quantitative results of individual research on the influence of fashion product attributes on purchase; in addition, this study utilizes the effect sizes of correlation coefficients. This study was based on 24 individual studies from January 2000 to March 2015. The meta-analysis analyzed 91 effect sizes and 24 studies and calculated the correlation coefficient effect sizes. A random effect model was employed for meta-analysis because the results for the homogeneity test indicated that the effect sizes of each research were heterogeneous. The analysis results are as follows. First, when the total effect sizes of the fashion product attributes that influence clothing purchase decisions were calculated as .256; this indicated that the effect size is slightly below the mid-sized level. Second, upon examining the effect sizes of the categorized fashion product attributes, the intrinsic attributes yielded .222, extrinsic factors yielded .235, and the compiled attributes yielded .420; this demonstrated that the compiled attributes have a larger effect size than individual attributes. Third, when they were measured by the characteristics of study targets, they were larger for a mixed-gender group than women as well as for ordinary citizens than university students. When the effect sizes were measured based on the characteristics of fashion products as suggested in the study, there were significant differences with respect to sportswear, followed by SPA brand clothing, general clothing, fashion accessories, and designer clothing. The cases where the clothing were purchased in non-retail stores were found to have a slightly larger effect size than those of offline retail stores when the effect sizes were measured based on purchase routes; however, the difference was not statistically significant. Next, an investigation of the trend of effect sizes based on published year via the meta regression analysis indicated slightly larger effect sizes as shown in more recent publications, but this was not statistically significant.

XRCC1 Gene Polymorphisms and Breast Cancer Risk: A Systematic Review and Meta-analysis Study

  • Moghaddam, Ali Sanjari;Nazarzadeh, Milad;Moghaddam, Hossein Sanjari;Bidel, Zeinab;Karamatinia, Aliasghar;Darvish, Hossein;Jarrahi, Alireza Mosavi
    • Asian Pacific Journal of Cancer Prevention
    • /
    • v.17 no.sup3
    • /
    • pp.323-335
    • /
    • 2016
  • Breast cancer risk assessment has developed during years and evaluation of genetic factor affecting risk of breast cancer is an important component of this risk assessment. The aim of this meta-analysis was to investigate the role of XRCC1 polymorphisms (Arg194Trp, Arg280His and Arg399Gln) in risk of breast cancer among different population and categories of menopausal status.PubMed, Medline, Web of Science, and PubMed Central were systematically searched to identify studies evaluating association between breast cancer and XRCC1 gene polymorphisms (Arg194Trp, Arg280His and Arg399Gln). Two authors independently extracted required information. Odds Ratios were pooled for four genetic inheritance models using both fixed and the DerSimonian and Laird random-effect models. Egger's test and contour-enhanced funnel plot was used to evaluate publication bias and small study effect. Additional subgroup analysis was performed for menopausal status, ethnicity, and source of controls. After evaluation and applying inclusion criteria on extracted studies, fifty three studies were included in this meta-analysis. For polymorphisms of Arg194Trp and Arg280His, no significant association was observed in all genetic models. Arg194Trp had a protective effect in post-menopausal status only in homozygote model (OR=0.57 [0.37-0.88]). Arg399Gln showed significant association with breast cancer in homozygote (OR=1.21 [1.10-1.34]), dominant (OR=1.09 [1.03-1.15]) and recessive (OR=1.21 [1.09- 1.35]) genetic models. Arg399Gln was associated with higher risk in post-menopausal status for homozygote and heterozygote models. Our findings suggest that XRCC1 gene polymorphisms modify breast cancer risk in different populations and different categories of menopausal status.

Convergence Effect of Virtual Reality Program on Activities of Daily Living Ability in Stroke Patients : Meta-Analysis (가상현실 프로그램이 뇌졸중 환자의 일상생활활동 능력에 미치는 융합적 효과 : 메타분석)

  • Choi, Ki-Bok;Cho, Sung-Hyoun
    • Journal of the Korea Convergence Society
    • /
    • v.11 no.8
    • /
    • pp.63-70
    • /
    • 2020
  • This study was designed to test the convergence effectiveness of virtual reality programs for patients with stroke by using meta-analysis. Based on the PICOS criteria, we searched domestic literature and selected the final 9 studies in relation to 'stroke' and 'virtual reality programs'. Evaluation of the risk of bias in individual studies was conducted using evaluation tools according to the design of each study. The effect size of the meta-analysis was calculated using CMA program. The mediating effect analysis was conducted by sub-group analysis and meta-regression analysis. The overall effect size of the virtual reality program on the activities of daily living ability was Hedges's g=0.302(95% CI: 0.064~0.540), Therefore, virtual reality programs can increase the activities of daily living in stroke patients and have a positive impact on the medical industry that the convergence of virtual reality industry and healthcare industry.

A Meta-analysis of the Effectiveness of Acupuncture for the Treatment of Essential Tremors (본태성 떨림의 침치료 효과에 대한 메타분석)

  • Sohn, Yu-jin;Jung, Seo-yoon;Kang, Ki-wan;Jeong, Min-jeong;Jang, In-soo
    • The Journal of Internal Korean Medicine
    • /
    • v.38 no.4
    • /
    • pp.419-432
    • /
    • 2017
  • Objectives: This study provides an evaluation of the effectiveness of acupuncture for the treatment of essential tremors (ETs) using randomized controlled trials (RCTs). Methods: Nine databases (PubMed, CINAHL, EMBASE, OASIS, NDSL, CNKI, Wanfang, J-STAGE, and CiNii) and the keywords "Essential tremor", "Benign tremor", "Familial tremor", and "Acupuncture" were used to compile RCTs that used acupuncture to treat ETs. Studies that were not RCTs, such as case studies, reviews, and essays, were excluded. The methodological quality of each RCT was assessed using the Cochrane risk-of-bias tool, and where appropriate, meta-analyses were performed. Results: Initially, 819 studies were found, but 773 were excluded after title and abstract screening. After further screening of the resulting 46 papers, eight RCTs were selected that had been published between 2003 and 2016, and the total effective rate (TER) was used as the primary evaluation method for all eight studies. It was found that the TER was significantly higher in treatment groups (83.33-96.7%) than in control groups (56.5-80.0%), and seven studies included in the meta-analysis showed positive results for acupuncture for ETs (Risk Ratio: 1.43, 95% Confidence Interval: 1.21-1.69, P<0.0001) Confidence Interval. Conclusions: This meta-analysis of clinical trials suggests that acupuncture is effective for treating ET patients; however, further studies are needed or larger populations to prove its effectiveness.

Meta-Analysis: Effects of Neurofeedback Training Programme in Korea (뉴로피드백 훈련 프로그램(생기능자기조절 훈련) 효과에 대한 메타분석 - 국내 연구를 중심으로)

  • Cheong, Moon Joo;Chae, EunYoung;Kang, Hyung Won
    • Journal of Oriental Neuropsychiatry
    • /
    • v.27 no.3
    • /
    • pp.157-167
    • /
    • 2016
  • Objectives: This study was undertaken to evaluate the effectiveness of the Neurofeedback training programme (NFT), and systematically search for factors related to the NFT.Methods: This study applied meta-analysis to thesis and journal articles published in Korea. A total of 42 papers published between 2001 to August in 2015 were evaluated, which were selected through a database search.Results: Summarizing the evaluation, the quality of results was low. The meta-analysis revealed that the effect size of the neurofeedback programme training was 0.691, over the median. Also, the variables were statistically significant to the neurofeedback programme training effect, and were consistent with the subject characteristics, their disabilities/non disabilities, and level of education. The results were also statistically significant to the neuro-feedback programme training effect according to the research method (training method), the sessions per a week, total sessions, and training time.Conclusions: The RoBANS result of 42 studies is at a risk of being highly biased. However, statistically, the meta-analysis result of the factors evaluated is significantly high.