• Title/Summary/Keyword: KoAlpaca

Search Result 2, Processing Time 0.011 seconds

Generating Sponsored Blog Texts through Fine-Tuning of Korean LLMs (한국어 언어모델 파인튜닝을 통한 협찬 블로그 텍스트 생성)

  • Bo Kyeong Kim;Jae Yeon Byun;Kyung-Ae Cha
    • Journal of Korea Society of Industrial Information Systems
    • /
    • v.29 no.3
    • /
    • pp.1-12
    • /
    • 2024
  • In this paper, we fine-tuned KoAlpaca, a large-scale Korean language model, and implemented a blog text generation system utilizing it. Blogs on social media platforms are widely used as a marketing tool for businesses. We constructed training data of positive reviews through emotion analysis and refinement of collected sponsored blog texts and applied QLoRA for the lightweight training of KoAlpaca. QLoRA is a fine-tuning approach that significantly reduces the memory usage required for training, with experiments in an environment with a parameter size of 12.8B showing up to a 58.8% decrease in memory usage compared to LoRA. To evaluate the generative performance of the fine-tuned model, texts generated from 100 inputs not included in the training data produced on average more than twice the number of words compared to the pre-trained model, with texts of positive sentiment also appearing more than twice as often. In a survey conducted for qualitative evaluation of generative performance, responses indicated that the fine-tuned model's generated outputs were more relevant to the given topics on average 77.5% of the time. This demonstrates that the positive review generation language model for sponsored content in this paper can enhance the efficiency of time management for content creation and ensure consistent marketing effects. However, to reduce the generation of content that deviates from the category of positive reviews due to elements of the pre-trained model, we plan to proceed with fine-tuning using the augmentation of training data.

Early Result of Surgical Management of the Anomalous Origin of the Left Coronary Artery from the Pulmonary Artery (관상동맥-폐동맥 이상 기시증에 대한 수술의 조기 결과)

  • Yoon Yoo Sang;Park Jeong Jun;Yun Tae Jin;Kim Young Hwue;Ko Jae Kon;Park In Sook;Seo Dong Man
    • Journal of Chest Surgery
    • /
    • v.39 no.1 s.258
    • /
    • pp.18-27
    • /
    • 2006
  • Background: Anomalous origin of the left coronary artery from the pulmonary artery (ALCAPA) is a rare congenital anomaly, but is one of the most common causes of myocardial ischemia which would result in high mortality within the first year of life. This is our early result of the surgical management for these patients. Material and Method: From June 1989 to July 2003, 6 patients with ALCAPA and one patient with ARCAPA (Anomalous origin of the Right coronary artery from the pulmonary artery) underwent surgical repair. We have reviewed the all medical records, electrocardiogram, chest X-ray and echocardiography retrospectively. Result: Three of the patients were boys and four were girls. The median age at the operation was 5.4 months (Range: 3$\∼$33 months). The average body weight of at the operation was 6.7 kg (Range: 3.7$\∼$11.3 kg). A mean follow up period was 18 months. Only 3 patients were initially diagnosed as ALCAPA. And 3 patients had moderate mitral regurgitation. Immediate coronary artery reimplantation on diagnosis with the aim of restoring a two-coronary system circulation was done. The average bypass time was 114$\pm$37 minutes, and the average aortic cross clamping time was 55$\pm$22 minutes. The average stay of intensive care unit was 5$\pm$3 days, the mean mechanical ventilator time was 38$\pm$45 hours and the hospital stay after operation was 12$\pm$5 days. There were significant improvements in electrocardiogram and chest X-ray of the all patients except one late death patient. The ventricular function showed almost normal recovery after operation; the EF (Ejection Fraction) increased from 41.2$\pm$ 10.3$\%$ to 60.5$\pm$ 15.8$\%$ within 1 month and to 59.8$\pm$13.9$\%$ within 1 year after operation, the SF (Shortening Fraction) increased from 23.6$\pm$4.7$\%$ to 38.6$\pm$8.4$\%$ within 1 month and to 37.4$\pm$7.9$\%$ within 1 year after operation, LVEDDI (Left Ventricular End-diastolic Dimension Index) decreased from 100.8$\pm$25.6 mm/$m^{2}$ to 90.3$\pm$ 19.2 mm/$m^{2}$ within f month and to 79.3$\pm$ 15.8 mm/$m^{2}$ within 1 year after operation. Concomitant mitral repair was done in two patients with anterior mitral leaflet prolapse. In every patient, mitral valve showed less than mild regurgitation during follow up. One late death occurred in which patient Dor procedure was applied 10 months after initial operation due to the dilated cardiomyopathy Conclusion: In the management of this rare and could be fatal Anomalous origin of the left coronary artery from the pulmonary artery (ALCAPA), early suspicion and correct diagnosis is of most important. But, after diagnosis, immediate restoration of 2 coronary systems could result in good outcome.