• The Journal of Bigdata
• /
• v.7 no.2
• /
• pp.11-29
• /
• 2022

Pre-trained language models are the most important and widely used tools in natural language processing tasks. Since those have been pre-trained for a large amount of corpus, high performance can be expected even with fine-tuning learning using a small number of data. Since the elements necessary for implementation, such as a pre-trained tokenizer and a deep learning model including pre-trained weights, are distributed together, the cost and period of natural language processing has been greatly reduced. Transformer variants are the most representative pre-trained language models that provide these advantages. Those are being actively used in other fields such as computer vision and audio applications. In order to make it easier for researchers to understand the pre-trained language model and apply it to natural language processing tasks, this paper describes the definition of the language model and the pre-learning language model, and discusses the development process of the pre-trained language model and especially representative Transformer variants.

• Journal of Korean Society of Industrial and Systems Engineering
• /
• v.46 no.3
• /
• pp.123-138
• /
• 2023

The Fourth Industrial Revolution and sensor technology have led to increased utilization of sensor data. In our modern society, data complexity is rising, and the extraction of valuable information has become crucial with the rapid changes in information technology (IT). Recurrent neural networks (RNN) and long short-term memory (LSTM) models have shown remarkable performance in natural language processing (NLP) and time series prediction. Consequently, there is a strong expectation that models excelling in NLP will also excel in time series prediction. However, current research on Transformer models for time series prediction remains limited. Traditional RNN and LSTM models have demonstrated superior performance compared to Transformers in big data analysis. Nevertheless, with continuous advancements in Transformer models, such as GPT-2 (Generative Pre-trained Transformer 2) and ProphetNet, they have gained attention in the field of time series prediction. This study aims to evaluate the classification performance and interval prediction of remaining useful life (RUL) using an advanced Transformer model. The performance of each model will be utilized to establish a health index (HI) for cutting blades, enabling real-time monitoring of machine health. The results are expected to provide valuable insights for machine monitoring, evaluation, and management, confirming the effectiveness of advanced Transformer models in time series analysis when applied in industrial settings.

• The Korea Journal of Herbology
• /
• v.39 no.1
• /
• pp.11-21
• /
• 2024

Objectives : This study aims to analyze the anti-obesity effect of Syzygium aromaticum L. (SA) in obese mice made by a 60% high-fat diet (HFD). Methods : The antioxidant activities of SA were evaluated in vitro. To assess the anti-obesity effect of SA, male C57BL/6 mice were divided into five groups: Normal, Control, GC100 (Garcinia cambogia 100 mg/kg/day), SA100 (SA 100 mg/kg/day), SA200 (SA 200 mg/kg/day). All groups underwent a 6-week regimen of HFD and oral administration, except for the Normal group. Subsequently, we performed blood analysis, western blotting, and histopathological staining. Results : SA demonstrated effectiveness in antioxidant measurements. SA treatment resulted in a significant decrease in body weight gain, along with reductions in liver and epididymal fat weights. Serum triglyceride (TG), total cholesterol (TC), glutamic oxaloacetic transaminase (GOT), glutamic pyruvic transaminase (GPT), and leptin levels were reduced with SA treatment. Moreover, in the SA100 group, the reduction of both TG and TC synthesis was caused by inhibiting the sterol regulatory element-binding transcription factor 1 (SREBP-1) and sterol regulatory element-binding transcription factor 2 (SREBP-2) through the Sirtuin 1 (Sirt1)/phospho-AMP-activated protein kinase (p-AMPK) pathway. Furthermore, SA treatment at a dose of 100 mg/kg reduced the accumulation of lipid droplets in the liver and the adipocyte size of the epididymal fat. Conclusion : Our research reveals the anti-obesity effects of SA by demonstrating its ability to inhibit body weight gain and lipid accumulation, suggesting that SA might be promising for obesity treatment.

• The Journal of the Institute of Internet, Broadcasting and Communication
• /
• v.24 no.2
• /
• pp.79-86
• /
• 2024

In this paper, we propose a virtual learning platform based on various interactions that occur during real class activities, rather than the existing content delivery-oriented learning metaverse platform. In this study, we provide a learning environment that combines AI and a virtual environment to solve problems by talking to real-time AI. Also, we applied G-learning techinques to improve class immersion. The Virtual Edu platform developed through this study provides an effective learning experience combining self-directed learning, simulation of interest through games, and PBL teaching method. And we propose a new educational method that improves student participation learning effectiveness. Experiment, we test performance on learninng activity based on real-time video classroom. As a result, it was found that the class progressing stably.

• Herbal Formula Science
• /
• v.32 no.3
• /
• pp.263-275
• /
• 2024

Background : Recent studies have shown that stress fundamentally influences the functional modulation of organ and stress-related disease causes high morbidity and mortality rates. Objective : The present research investigated the effect of restraint stress on psychological and physiological responses. Results : Body weight and food intake were changed in stress group. Body weight has continuously decreased, and food intake has been slightly altered. As a result of measuring each tissue's weight, the liver and kidney's weight loss was greater than that of other organs. The lipid profile of stressed animals showed significant increases in cholesterol (TC), triglyceride (TG), low-density lipoprotein (LDL), and high-density lipoprotein (HDL) levels compared to control. As hepatic marker enzymes, serum glutamic pyruvic transaminase (GPT; alanine aminotransferase), glutamic oxalacetic transaminase (GOT; aspartate aminotransferase), and lactic dehydrogenase (LDH) were increased in the stress group. However, levels of serum cortisol and corticosterone did not affect. Results of the behavioral tests show that the stress group has increased activity, sluggish movements, and anxiety in the central part compared with the control group through the open field test. In the forced swim test, the stress group models had a longer duration of slowing movement, and its rate also increased. Also, in immunoblotting, stress increased the inflammatory factors Inducible Nitric Oxide Synthase (iNOS), cyclooxygenase-2 (COX-2) and activated the mitogen-activated protein kinase (MAPK) pathway. Conclusions : We observed that mouse model were affected behavioral response and liver injury when exposed to restraint stress, indicating the importance of the restraint stress in the development of psychological and physiological processes.

• Journal of the Korean Society of Food Science and Nutrition
• /
• v.42 no.4
• /
• pp.587-594
• /
• 2013

The hypoglycemic and hypolipidemic effects from Wa-song (Orostachys japonicus) extracts with mixtures of medicinal herbs (such as Baekbokyung, Changchul and Sa-in) were evaluated in the streptozotocin (STZ)-induced diabetic rats. Thirty-five Sprague-Dawley rats were assigned to five groups; normal, diabetic control (D-control), a group fed a medicinal herbs mixture (D-MH), and a group fed composites of O. japonicus with mixtures of medicinal herbs (1:1, D-MHOA and 3:1, D-MHOB). All were fed on their diet for 4 weeks. After 4 weeks, the body weight of all experimental groups increased compared to the diabetic control group, with the D-MHOB group having a significantly higher increase. Fasting glucose levels in all experimental groups (compared to the D-control group) significantly decreased after 2 weeks, but between 2~3 weeks, the levels in the D-MH group were similar to the D-MHOA group. After 4 weeks, the fasting glucose level of the D-MHOB group was the lowest compared to the other groups. In a test of oral glucose tolerance, blood glucose levels were highest 60 minutes after feeding glucose; however this level improved significantly in the groups fed an experimental diet compared to the D-control group. Glycosylated hemoglobin levels were 1.9 times higher in the D-control group than the normal (3.9%), but levels in the experimental groups were significantly decreased in D-MHOA and D-MHOB groups compared to the D-MH group. In the high amounts of O. japonicus to medicinal herbs mixture, total lipids and cholesterol significantly decreased in the serum, while HDL-C levels increased. GPT activity was significantly lower in the D-MHOB group compared to the other groups. Lipid peroxide levels decreased in the D-MHOA and D-MHOB groups compared to the D-MH group. Antioxidant activity was higher depending on the dose of O. japonicus. Overall, O. japonicus exhibited effective hypoglycemic and hypolipidemic actions enhanced by a combination of medicinal herbs.

• Journal of the Korean Society of Food Science and Nutrition
• /
• v.42 no.4
• /
• pp.570-576
• /
• 2013

The purpose of this study was to investigate the effect of turmeric on antioxidative systems and oxidative damage in rats fed a high fat and cholesterol diet. A total 40 rats were divided into four experimental groups: a normal diet group (N), a high fat and cholesterol diet group (HF), a high fat and cholesterol diet group supplemented with 2.5% turmeric powder (TPA group) and a high fat and cholesterol diet group supplemented with 5% turmeric powder (TPB group). The serum glutamate oxaloacetate transaminase (GOT) and glutamate pyruvate transaminase (GPT) activity of the turmeric supplemented groups were decreased compared to the HF group. The GPT activity of the TPB group was especially and significantly decreased compared to the HF group. Hepatic superoxide dismutase (SOD) of the TPB group was significantly increased compared to the HF group. However, there were no significant differences in the activities of hepatic glutathione peroxidase (GSHpx) and catalase (CAT) among all experimental groups. Hepatic glutathione S-transferase (GST) activity in the TPA and TPB groups were increased compared to the HF group. Hepatic superoxide radical content in mitochondria of the 5% turmeric supplemented group was significantly decreased compared to the HF group. Hepatic hydrogen peroxide content in the cytosol and mitochondria of the turmeric-supplemented groups were decreased compared to the HF group. Hepatic carbonyl values in the mitochondria of the turmeric supplemented groups were significantly decreased compared to the HF group. Thiobarbituric acid reaction substance (TBARS) values in the liver were significantly reduced in turmeric supplemented groups compared to the HF group. These result suggest that turmeric powder may reduce oxidative damage through the activation of antioxidative defense systems in rats fed high fat and cholesterol diets.

• Korean Journal of Community Nutrition
• /
• v.17 no.4
• /
• pp.450-462
• /
• 2012

We analyzed data from the combined 2008~2009 Korean National Health and Nutrition Examination Survey (KNHANES) to compare the health factors related to menopausal stages in 45~60 year old Korean women. In this study, we classified the subjects into a premenopausal group (n = 439) and a postmenopausal group (n = 683). In the postmenopausal group, age was higher (p < 0.001), monthly income (p < 0.01) and education levels (p < 0.001) were significantly lower than in the premenopausal group. Body fat % and waist circumferences were also higher in the postmenopausal group than in the premenopausal group. The serum glucose (p < 0.05), total cholesterol (p < 0.001), LDL-cholesterol (p < 0.001), triglyceride (p < 0.001), GOT (p < 0.001), GPT (p < 0.001) in the postmenopausal group were higher than in the premenopausal group. The postmenopausal group showed a significantly lower quality of life compared to the premenopausal group (p < 0.01). With regard to dietary quality, nutrient adequacy ratio (NAR) of vitamin A, vitamin $B_1$, vitamin $B_2$ and niacin in the postmenopausal group were significantly lower than in the premenopausal group. The levels of glucose, total cholesterol, LDL-cholesterol, and triglyceride showed a significantly positive correlation with age, waist circumferences, body fat % and BMI. The 45~60 year old Korean women in this study showed high levels of obesity and serum lipids. Also, intakes of the vitamins and minerals of the women did not meet the level of Dietary reference intakes for Koreans. Therefore, nutritional risk may be high in the women, especially in postmenopausal women. In order to prevent the health risk, women's health care including the quality of the meal should be considered.

• Journal of Sasang Constitutional Medicine
• /
• v.8 no.1
• /
• pp.349-376
• /
• 1996

In orther to find the characteristics of each constitution, the examinee of Kyung Hee medical center was diagnosed constitution, and resulted body measures and diagnosis. That was considered and the results are as follows 1. The Diagnosis result of Sa-sang Constitutional Medicine is that there are 110 persons of Taeum-In(56. 1%), 58 persons of Soum-In(29.6%), 28 persons of Soyang-In(14. 3%). 2. The distribution of occupation, there are many of Taeum-In who are engaged in business, administeration, and management and many of Soeum-In who are engaged in reserch. 3. QSCC(I) has a tendency that other constitutions diagnose to Taeyang-In, the quastionare 1 has the accuracy of 76. 4% to diagnose Soeum-In. 4. Taeum-In sweats easily but Soeum-In doesn't sweat easily, Taeum-In has a good appetite and likes cold food and digests well, but Soeum-In has a poor appetite and like hot food and digest poorly. 5. The degree of obesity is the highest in Taeum-In. 6. The systoric blood pressure and diastolic blood pressure is high in Taeum-In and the high blood pressure are frequent in Taeum-In. 7. Triglyceride is the highest in Taeum-In and the Hyperlipidemia is the most frequent in Taeum-In, but Total cholesterol has no difference among constitutions. 8. GPT GGT is higher in Taeum-In than Soyang-In, but GOT has no difference among constitutions. 9. The frequency of fatty liver is the highest in Taeum-In.

• Journal of Life Science
• /
• v.12 no.6
• /
• pp.661-668
• /
• 2002

We investigated the effect of tea fungus/kombucha beverage(TF) on the body weights, the blood glucose levels, lipid and protein concentrations, and enzyme activities in diabetic female rats. Sprague-Dawley rats were fed drinking water supplemented with 20% or 40% TF groups, respectively for 7 weeks. The female rats (mean weight 155.5$\pm$9.3 g) were assigned to one control and three diabetic groups. Diabetic groups were divided into diabetic control (TF free water), 20% or 40% TFD groups (20% or 40% TF in water) according to the levels of TF supplementation. Diabetes was experimentally induced by intraperitonially administration of streptozotocin in citrate buffer(pH 4.3) after 2 weeks feeding of four experimental water. Animals were sacrificed at the 5 weeks of diabetic state. The diabetic groups showed significantly decrease of body weight(6.8-7.5 g) compared with the control group(48.3 g). The hepatic, kidney and pancreatic weights of 20% or 40% TFD groups were not significantly different with D-control group. The fasting serum glucose level were higher in all diabetic groups than that of the control group. The concentrations of serum triglyceride in 40% TFD group and serum LDL-cholesterol in 20% TFD group were significantly decreased compared with the D-control group. The concentrations of serum total cholesterol and HDL-cholesterol, HDL-cholesterol/total cholesterol ratio, and atherogenic index in 20% or 40% TFD groups were similar to those in D-control group. The concentrations of hepatic triglyceride in 20% or 40% TFD groups were significantly decreased compared with the D-control group, but the concentrations of hepatic cholesterol and phospholipid were similar to all diabetic groups. The concentrations of serum and hepatic total protein, serum albumin, and the activities of GOT, GPT and LDH in the serum were the same levels of all diabetic groups.