• ETRI Journal
• /
• v.46 no.1
• /
• pp.106-117
• /
• 2024

Large language models (LLMs) have revolutionized various applications in natural language processing and exhibited proficiency in generating programming code. We propose a framework for evaluating the code generation ability of LLMs and introduce a new metric, pass-ratio@n, which captures the granularity of accuracy according to the pass rate of test cases. The framework is intended to be fully automatic to handle the repetitive work involved in generating prompts, conducting inferences, and executing the generated codes. A preliminary evaluation focusing on the prompt detail, problem publication date, and difficulty level demonstrates the successful integration of our framework with the LeetCode coding platform and highlights the applicability of the pass-ratio@n metric.

• Nutrition Research and Practice
• /
• v.7 no.2
• /
• pp.96-102
• /
• 2013

Obesity, an intractable metabolic disease, currently has no medical treatment without side effects, so studies have been actively carried out to find natural compounds that have anti-obesity activity with minimum side effects. In this study, the anti-obesity effects of water extracts of seven Capsicum annuum L. varieties being Putgochu (Pca), Oyee gochu (Oca), Kwari putgochu (Kca), Green pepper (Gca), Yellow paprika (Yca), Red paprika (Rca) and Cheongyang gochu (Cca), were examined through the evaluation of lipoprotein lipase (LPL) mRNA expression level in 3T3-L1 cells (mouse pre-adipocytes). After capsaicin elimination by chloroform defatting, freeze-dried powder of Cca was treated to 3T3-L1 cells and anti-obesity effects were examined by determining the LPL mRNA level using the RT-PCR method. Of the primary fractions, only proven fractions underwent secondary and tertiary refractionating to determine anti-obesity effects. From seven different Capsicum annuum L., there was a significant decrease of the LPL mRNA expression level of 50.9% in Cca treatment compared to the control group. A significant decrease of the LPL mRNA expression level was shown in primary fractions (Fr) 5 (36.2% decrease) and 6 (30.5% decrease) of the Cca water extracts. Due to the impurities checked by UPLC chromatography, Fr 5 and 6 were refractionated to determine the LPL mRNA expression level. Treatment of Fr 6-6 (35.8% decrease) and Fr 5-6 (35.3% decrease) showed a significant decrease in the LPL mRNA expression level. When analyzed using UPLC, major compounds of Fr 6-6 and Fr 5-6 were very similar. Subsequently, we refractionated Fr 6-6 and Fr 5-6 to isolate the major peak for structure elucidation. Treatment of Fr 5-6-1 (26.6% decrease) and Fr 6-6-1 (29.7% decrease) showed a significant decrease in the LPL mRNA expression level. Consequently, the fractions may have a possibility to ameliorate obesity through the decrease of the LPL mRNA expression level.

• Journal of the Korea Institute of Military Science and Technology
• /
• v.15 no.1
• /
• pp.28-35
• /
• 2012

We propose the live fire test process model based on systems engineering which consists of 4 phases i.e., review, setup, conduct and result. We also suggest the 4 phases acquisition model consisting of planning, execution, evaluation and disposal for test infrastructure. CMMI, TMMi and PMBOK are referred and hierarchial analysis method are adopted in developing the models. Thus, the detailed sub-processes are designed after defining higher level processes first. The higher level processes are defined by extracting common areas of all the test types. The low level processes for each specific test are designed by tailoring the higher level processes. By applying the proposed test process models into collaboration tool and information system, effective and systematic test processes for weapon systems are established.

• Journal of Information Technology Services
• /
• v.20 no.1
• /
• pp.81-92
• /
• 2021

As the degree of economic development of society increases, the maintenance issues on the existing social overhead capital becomes essential. Accordingly, the adaptation of the concept of Level of service in highway maintenance is indispensable. It is also crucial to manage and perform the service level such as road assets to provide universal services to users. In this regards, the purpose of this study is to improve the maintenance service rating model and to focus on the assessment items and weights among the improvements. Particularly, in determining weights, an Analytic Hierarchy Process (AHP) is performed based on the survey response results. After then, this study conducts unsupervised neural network models such as Self-Organizing Map (SOM) and Davies-Bouldin (DB) Index to divide proper sub-groups and determine priorities. This paper identifies similar cases by grouping the results of the responses based on the similarity of the survey responses. This can effectively support decision making in general situations where many evaluation factors need to be considered at once, resulting in reasonable policy decisions. It is the process of using advanced technology to find optimized management methods for maintenance.

• Journal of the Korean Society of Safety
• /
• v.33 no.2
• /
• pp.124-131
• /
• 2018

In consideration of limitations of the classic economic approach to risk evaluation and the psychometric analysis of risk perception, this study applies a facilitated modeling technique to a group of college students in Korea. In this group activities, researchers did not provide a pre-selected list of risk items. Instead, 35 participants had group discussions to generate 63 risk items, to rate their risk level and to evaluate their characteristics in terms of the level of knowledge and dreadfulness. This study also analyzes the influence of mass media, online news papers in particular, on risk perception by counting the number of news articles covering key word corresponding risk items generated. The results show that there are significant differences between the rank order of risk items generated by students and that of statistical or objective risk. Psychometric analyses find that the levels of knowledge and dreadfulness have meaningful correlations with risk level. A well known or a dreadful risk demonstrates a high level of risk. Correlation analyses of media coverage and the risk level also re-confirms strong positive relations. The larger number of news articles a risk issue was covered by, the higher level of risk it showed. It means that college students generated risk items on the basis of what they were exposed by media. The role of mass media in risk perception and the importance of risk communication in risk evaluation are underlined. Implications of research findings and future research are discussed as well.

• Asia-Pacific Journal of Business Venturing and Entrepreneurship
• /
• v.4 no.4
• /
• pp.1-25
• /
• 2009

The Government is putting efforts to enhance efficiency and productivity of performances of National R&D Programs by enacting 'Law on Evaluation and Management of Performances of National R&D Program'. This study is the result of development of evaluation model and indices for analysis of efficiency through meta evaluation method for the specific evaluation among evaluation systems for National R&D Program that are being carried out at government-wide level. Meta evaluation model for analysis of efficiency of evaluation system for National R&D Program designed evaluation indices by categorizing compositional factors into 5 categories, namely, evaluation context factor, evaluation resources factor, evaluation process factor, evaluation result factor and evaluation utilization factor. Furthermore, the result of verification of reliability on evaluation composition factors and evaluation indices analyzed to select evaluation items displayed Cronbach' $\alpha$ coefficient of 0.933, thereby illustrating that there is no major problem in the evaluation index system. In addition, computation of weight for each evaluation composition factor and evaluation index was analyzed by using analytical hierarchy process (AHP) technique. The result of analysis displayed overall consistency index of less than 0.1 for the investigators, thereby enabling analysis that there is consistency in investigators.

• Journal of the Korean Society for information Management
• /
• v.22 no.4 s.58
• /
• pp.39-59
• /
• 2005

This study is aimed to evaluate the undergraduate students' information literacy, examine the current level of their capability of using information, and make a evaluation model to develop information literacy. Information literacy consists of six fields information resources, information needs, information search, information analysis, information technology and presentation, and Information ethics. Based on the result of statistic factor analysis, the integrated evaluation model of information literacy, evaluation factor, and evaluation procedure can be suggested based on the instruction guidance.

• Transactions of Materials Processing
• /
• v.33 no.3
• /
• pp.169-177
• /
• 2024

Recently, hydrogen energy has been widely used because of strict regulations on greenhouse gas emissions. For using the hydrogen energy, it is required to supply hydrogen through a tube trailer. However hydrogen tube trailer can have excessive load problems during transportation due to reasons such as road shape and driving method, which may lead a risk of hydrogen leakage. So it is necessary to secure a high level of safety. The purpose of this study is to evaluate structural safety for the conservative design of hydrogen tube trailer. First, finite element(FE) modeling of the designed hydrogen tube trailer was performed. After that, safety evaluation method was established through static structural simulation based on the standard GC207 conditions. In addition, effectiveness of the designed model was confirmed through the results of the structural safety evaluation. Finally, driving simulation was used to derive acceleration graph according to time, which was considered as a dynamic property for the evaluation of conservative tube trailer safety evaluation. And dynamic structural simulation was conducted as a condition for actual transportation of tube trailer by applying dynamic properties. As a results, conservative safety was evaluated through dynamic structural simulation and the safety of hydrogen tube trailer was confirmed through satisfaction of the safety rate.

• Journal of Biosystems Engineering
• /
• v.34 no.2
• /
• pp.120-126
• /
• 2009

The purpose of this study was to develop a visibility evaluation system for cabin type combine. Human's field of view was classified into five levels (perceptive, effective, stable gaze, induced, and auxiliary) depending on rotation of human's head and eye. Divider, reaper lever, gearshift, dashboard, and conveying part were considered as major viewpoints of combine. Visibilities of combine was evaluated quantitatively using the viewpoints and the human's field of view levels. The visibility evaluation system for cabin type combine was consisted of a laser pointer, stepping motors to control the direction of view, gyro sensors to measure horizontal and vertical angle, and I/O interface to acquire the signals. Tests were conducted with different postures ('sitting straight', 'sitting with $15^{\circ}$ tilt', 'standing straight', and 'standing with $15^{\circ}$ tilt'). The LSD (least significant difference) multiple comparison tests showed that the visibilities of viewpoints were different significantly as the operator's postures were changed. The results showed that the posture at standing with $15^{\circ}$ tilt provided the best visibility for operators. The divider of the combine was invisible due to blocking with the cabin frame at many postures. The reaper lever showed good visibilities at the postures of sitting or standing with $15^{\circ}$ tilt. The gearshift, the dashboard, and the conveying part had reasonable visibilities at the posture of sitting with $15^{\circ}$ tilt. However, most viewpoints of the combine were out of the stable gaze field of view level. Modifications of the combine design will be required to enhance the visibility during harvesting operation for farmers' safety and convenience.

• Transactions of the Korean Society of Automotive Engineers
• /
• v.19 no.2
• /
• pp.105-110
• /
• 2011

Through this study, the performance evaluation on the addition of low-pressure loop EGR(Exhaust Gas Recirculation) in a 6.0 L commercial diesel engine was carried out using WAVE modeling and simulation. Since the key technology of advanced diesel engine combustion such as low-temperature combustion is to steadily supply high rates of EGR in a wide operating range, the current study could be effectively contribute to the design and development processes of up-to-date diesel engine systems as real-world reference data. The current simulation results show that the system in which low-pressure loop EGR is added shows almost 2.3 times increase in maximum EGR rate at 1000 rpm as well as almost 1.6 times increase at 2200 and 1600 rpm in comparison with an engine system employing high-pressure loop EGR only. Also, both turbocharger axis speed and charging pressure level did not deteriorate due to the addition of low-pressure loop EGR at 2200 and 1000 rpm, but they were fairly decreased at 1600 rpm.