• 한국IT서비스학회지
• /
• 제19권5호
• /
• pp.83-91
• /
• 2020

Language Models such as BERT has been an important factor of deep learning-based natural language processing. Pre-training the transformer-based language models would be computationally expensive since they are consist of deep and broad architecture and layers using an attention mechanism and also require huge amount of data to train. Hence, it became mandatory to do fine-tuning large pre-trained language models which are trained by Google or some companies can afford the resources and cost. There are various techniques for fine tuning the language models and this paper examines three techniques, which are data augmentation, tuning the hyper paramters and partly re-constructing the neural networks. For data augmentation, we use no-answer augmentation and back-translation method. Also, some useful combinations of hyper parameters are observed by conducting a number of experiments. Finally, we have GRU, LSTM networks to boost our model performance with adding those networks to BERT pre-trained model. We do fine-tuning the pre-trained korean-based language model through the methods mentioned above and push the F1 score from baseline up to 89.66. Moreover, some failure attempts give us important lessons and tell us the further direction in a good way.

• 대한정형도수물리치료학회지
• /
• 제25권1호
• /
• pp.29-36
• /
• 2019

Background: This study was conducted to investigate the effect of leg lift difference on the serratus anterior muscle and the upper trapezius muscle when a subject with winged scapula performs a scapula protraction exercise in a four-leg crawling posture. Method: Twenty normal adults and 20 subjects with winged scapula participated in the experiment. Surface EMG recordings were collected from serratus anterior muscle and back trapezius muscle during scapula protraction exercises. Scapular winging is measured with the lifting distance of scapula retraction to the back using an electronic digital caliper. In two groups of four-leg crawling posture, the two legs support, the dominant leg lifting, and the non-dominant leg lifting, including the scapula protraction, were performed. To examine the difference between groups in the variance analysis, the Bonferroni correction was used (significance level ${\alpha}=.017$). Statistical significance level ${\alpha}$ was .05. Results: There was a significant difference in serratus anterior muscle and upper trapezius muscle during push-up plus exercise in leg lifting in four-leg crawling posture, but there were no significant differences in muscle activity between serratus anterior muscle and upper trapezius muscle, and there was no significant difference according to the presence or absence of scapular winging. Conclusion: For the shoulder stability of the ipsilateral side with the serratus anterior muscle, the leg-lifting posture is effective in the four-leg crawling, and also when a subject with winged scapula chooses an exercise, lifting the ipsilateral side of leg with scapula protraction exercises at the same time may have a positive effect on scapula dysfunction.

• 대한구순구개열학회지
• /
• 제7권1호
• /
• pp.25-34
• /
• 2004

본 연구는 선천성 구개열 환자에서 구개성형술후 구개 길이가 어느 정도 연장되는지 알아보기 위하여 시행되었다. 199i년 4월부터 2004년 4월까지 10년동안 전남대학교병원 구강악안면외과에서 치료 받은 구개열 환자 중 추적조사가 가능한 112명을 대상으로 역학적 특성, 사용된 구개성형술식, 구개 길이의 연장 정도 및 술후 합병증에 대하여 임상기록을 조사하고 분석하였다. 불완전구개열 및 완전구개열 환자의 비는 1.6:1이었다. 성별분포는 완전구개열에서는 남자가 2.1배 많았고, 불완전구개열에서는 여자가 1.2배 많았다. 불완전구개열에서는 Dorrance법과 Wardill법을, 완전구개 열에서는 Wardill법과 Furlow법, two flap법, Perko법을 많이 사용하였다. 구개열 형태별 구개 길이의 연장 정도는 불완전구개열에서 평균 5.84 m(11.295) 연장되어 완전구개열에서의 평균 4.71 w(9.f%)보다 1.13 mm(1.6%) 더 많이 연장되었으나 통계학적 유의성은 없었다. 구개성형술식에 따른 구개 길이의 연장 정도는 Furlow법에서 5.70 m(10.9%) 연장되어 push back법에서의 5.33 in(10.7%)보다0.37 mm(0.2%) 더 많이 연장되었으나 역시 통계학적 유의성은 없었다. 술후 합병증으로 구개누공이 27예(24%b)로 가장 많이 발생하였다. 이상의 결과에서 구개성형술후 구개 길이가 3.5%부터 24.0%까지 평균 10.8% 연장되어 언어 기능에 기여함을 알 수 있다.

• Maxillofacial Plastic and Reconstructive Surgery
• /
• 제28권4호
• /
• pp.295-309
• /
• 2006

The present study was aimed to evaluate the incidence, etiological factors, and management of cleft lip and palate. Two hundred and twenty patients with cleft lip and/or cleft palate who were treated at Department of Oral and Maxillofacial Surgery, Chonnam National University Hospital, during the period between January 1994 and December 2003 were reviewed. The ratios of cleft lip : cleft lip with cleft palate : and cleft palate were 0.4:1.1:1. Males were more common than females in cleft lip (1.3:1) and cleft lip and palate (2.5:1), while females were more common than males in cleft palate (1:1.3). In the cleft side, left clefts were more prevalent than right clefts (cleft lip 1.3:1, cleft lip and palate 1.6:1). Unilateral clefts were more common than bilateral clefts in cleft lip (79:21). Cleft lip and cleft palate were more common in those with blood type A (34.5%) than those with other types. There was no significant relationship between birth season and frequency of clefts. The clefts were common in the first-born (48.8%), and in mothers aged between 25 and 29 (51.7%). Medication (24.7%) and stress (16.7%) during the first trimester were noted. Positive familial history was noted in 13 cases (5.9%). Thirty-two cases (15%) were associated with other congenital anomalies, in which tonguetie (40.6%) and congenital heart disease (21.9%) were most common. Among 100 patients with cleft palate, 77 patients had middle ear disease (77%), which occurred predominently in the incomplete cleft palate. Seventy-six among the 77 patients received myringotomy and ventilation tube insertion, and the remaining one received antibiotic medication only. Cleft lips were treated primarily at 3 to 6 months, and cleft palates were at 1 to 2 years. Treatment regimens included modified Millard method mainly in the cleft lip, and Wardill V-Y, Dorrance method, and Furlow method in the cleft palate. The percentage of palatal lengthening as type of cleft palate was greater in the incomplete cleft palate group (11.2%) than in the complete cleft palate group (9.6%). The percentage of palatal lengthening as operating method was no difference between the Furlow method (10.9%) and the push back method (10.7%). As postoperative complications, hypertrophic scar was most frequent in the cleft lip, and oronasal fistula in the cleft palate. In summary, it was shown that medication and stress during the first trimester of pregnancy were frequently associated with cleft lip and cleft palate, adequate timing and selection of method of operation are important factors to obtain morphologically and functionally good results. Furthermore prevention and treatment of middle ear disease are important in cleft palate patients because of its high co-occurrence.