• Title/Summary/Keyword: 학습효과

Search Result 6,368, Processing Time 0.032 seconds

Korean Sentence Generation Using Phoneme-Level LSTM Language Model (한국어 음소 단위 LSTM 언어모델을 이용한 문장 생성)

  • Ahn, SungMahn;Chung, Yeojin;Lee, Jaejoon;Yang, Jiheon
    • Journal of Intelligence and Information Systems
    • /
    • v.23 no.2
    • /
    • pp.71-88
    • /
    • 2017
  • Language models were originally developed for speech recognition and language processing. Using a set of example sentences, a language model predicts the next word or character based on sequential input data. N-gram models have been widely used but this model cannot model the correlation between the input units efficiently since it is a probabilistic model which are based on the frequency of each unit in the training set. Recently, as the deep learning algorithm has been developed, a recurrent neural network (RNN) model and a long short-term memory (LSTM) model have been widely used for the neural language model (Ahn, 2016; Kim et al., 2016; Lee et al., 2016). These models can reflect dependency between the objects that are entered sequentially into the model (Gers and Schmidhuber, 2001; Mikolov et al., 2010; Sundermeyer et al., 2012). In order to learning the neural language model, texts need to be decomposed into words or morphemes. Since, however, a training set of sentences includes a huge number of words or morphemes in general, the size of dictionary is very large and so it increases model complexity. In addition, word-level or morpheme-level models are able to generate vocabularies only which are contained in the training set. Furthermore, with highly morphological languages such as Turkish, Hungarian, Russian, Finnish or Korean, morpheme analyzers have more chance to cause errors in decomposition process (Lankinen et al., 2016). Therefore, this paper proposes a phoneme-level language model for Korean language based on LSTM models. A phoneme such as a vowel or a consonant is the smallest unit that comprises Korean texts. We construct the language model using three or four LSTM layers. Each model was trained using Stochastic Gradient Algorithm and more advanced optimization algorithms such as Adagrad, RMSprop, Adadelta, Adam, Adamax, and Nadam. Simulation study was done with Old Testament texts using a deep learning package Keras based the Theano. After pre-processing the texts, the dataset included 74 of unique characters including vowels, consonants, and punctuation marks. Then we constructed an input vector with 20 consecutive characters and an output with a following 21st character. Finally, total 1,023,411 sets of input-output vectors were included in the dataset and we divided them into training, validation, testsets with proportion 70:15:15. All the simulation were conducted on a system equipped with an Intel Xeon CPU (16 cores) and a NVIDIA GeForce GTX 1080 GPU. We compared the loss function evaluated for the validation set, the perplexity evaluated for the test set, and the time to be taken for training each model. As a result, all the optimization algorithms but the stochastic gradient algorithm showed similar validation loss and perplexity, which are clearly superior to those of the stochastic gradient algorithm. The stochastic gradient algorithm took the longest time to be trained for both 3- and 4-LSTM models. On average, the 4-LSTM layer model took 69% longer training time than the 3-LSTM layer model. However, the validation loss and perplexity were not improved significantly or became even worse for specific conditions. On the other hand, when comparing the automatically generated sentences, the 4-LSTM layer model tended to generate the sentences which are closer to the natural language than the 3-LSTM model. Although there were slight differences in the completeness of the generated sentences between the models, the sentence generation performance was quite satisfactory in any simulation conditions: they generated only legitimate Korean letters and the use of postposition and the conjugation of verbs were almost perfect in the sense of grammar. The results of this study are expected to be widely used for the processing of Korean language in the field of language processing and speech recognition, which are the basis of artificial intelligence systems.

Study on Acknowledge and State of Clinical Experience for 3-years Dental Technology Department (3년제 치기공과 임상실습에 대한 인식 및 실태조사 - 일부 치과기공소 소장을 중심으로 -)

  • Park, Myung-Ja
    • Journal of Technologic Dentistry
    • /
    • v.17 no.1
    • /
    • pp.41-57
    • /
    • 1995
  • This study was conducted to collect and analyze previous information in order to manage efficience, improve experience effect and promote employment rate. The questionnaire interview with 27 chief of dental Laboratory refered clinical experience in technology department about clinical experience in 14 Jumior colleges were also investigated. The results were summarried as follows : The portion of age of 35-39 among chief of dental Laboratory was 40.7% which was the highest, that of male was 96.3%, that of junior college graduate was 97.5%, that of 10years experience was 92.6% and that of ceramic technician was 85.2%, 63.0% dental laboratory for clinical experience was a bore space of 30pyong. Aspect of dental laboratory management, manufacturing all part of prosthetic restoration was 29.6%, othodontic appliance and ceramic restoration was 7.4%, 3.8%, each. The percentage of 40.7 was having connection with 30-3a dental clinics and referring case per day was 10-19 cases(40.7%), manufacturing time of referred prosthetic restoration was 3-4 days(77.8%), places preparing seminar room for education was 29.6%, above a place of 40pyong was 11.1% 30-34 pyong and 35-39 pyong was 7.4% each. During training of 2 years education course student, 18.5% was rack of thorough occupational career. While 44.4% will want the more salary among 3years education course student, 74.1% will expect the more dental techmicians would engaged in their field, 51.9% will hope improve of their theory and practice, 29.6% be expected better skill and 14.8% be expected better theory. Attitude of clinical experience places was distributed by 59.3% of offering only experience chance, 25.9% of wasting time and 29.0% of annoying. The big emphasis of climical experience was thorough occupational career(44.4%). The clinical experience places of our college were selected after direct visiting, so their condition of management was not that bad but most of dental laboratory were poor in management state and working environment. Therefore it is difficult to choose appropriate places and dental Laboratory are also limited manpower and time as suppliers. So that it recommended to induce flexible management of experience period by interval and rotation of experience places among college and to applicate intern-system for employment ant industry-college cooperation aspect.

  • PDF

Investigation of Food Safety Knowledge, Attitudes, and Behavior for Analyzing Food Safety Risk Factors in the Elderly (노인들의 식품안전 위험요인 규명을 위한 식품위생 지식, 태도, 행동 조사)

  • Choi, Jung-Hwa;Lee, Yoon-Jin;Lee, Eun-Sil;Lee, Hye-Sang;Chang, Hye-Ja;Lee, Kyung-Eun;Yi, Na-Young;Kwak, Tong-Kyung
    • Journal of the Korean Society of Food Science and Nutrition
    • /
    • v.45 no.5
    • /
    • pp.746-756
    • /
    • 2016
  • The purpose of this study was to investigate food safety knowledge, food safety attitudes, and handling behavior in the elderly. The survey was conducted on 358 individuals over 65 years old in urban and rural areas. Data were analyzed with descriptive analysis and ${\chi}^2$ test analysis of variance using SPSS. From the results on elderly's food safety knowledge, the item 'tangerines should be washed before eating' was correctly answered by urban subjects (75.4%) than rural subjects (49.7%). 'Is it okay to cook meat left on the sink since afternoon in the evening' showed the lowest correct answer rate in both urban (23.1%) and rural (31.9%) subjects. For the item related to food keeping, 'Bacterial cells do not multiply in Samgyetang when it is kept in a refrigerator right after boiling thoroughly', 58.5% of urban and 54.6% of rural elderly answered correctly. Most elderly people showed a tendency to think that boiled foods might be safe to eat. Secondly, for food safety attitudes, urban elderly had more proper attitude regarding the item, 'Namul is very tasty only when mixed with bare hands' (disagree rate 34.9%) than rural elderly (P<0.05)'. On the other hand, rural elderly had more positive attitudes regarding the store principle "first in, first out" compared to urban elderly (P<0.001). Thirdly, regarding food safety behaviors, only 67.9% of urban and 58.7% of rural elderly responded that they washed their hands right after answering the telephone while cooking. Exactly 33.8% of urban and 39.6% of rural older people replied 'defrost meat on top of sink or table' as the defrost method for frozen foods, showing that elderly did not recognize the risk of foodborne illness during improper defrosting at room temperature.

Operation and Perception on Dietary Life Education and Nutrition Counseling of Elementary School in Chungbuk Province (충북지역 초등학교 영양교사의 식생활 교육과 영양상담 운영실태 및 인식)

  • Kim, Myoung-Sil;Kim, Hye Jin;Lee, Young Eun
    • Journal of the Korean Society of Food Science and Nutrition
    • /
    • v.42 no.12
    • /
    • pp.2049-2067
    • /
    • 2013
  • The purpose of this study is to present a more effective nutrition education activation plan. As a result of investigating the dietary education operating situation, 58.9% underwent direct education, and 89.5% underwent food life education through traditional food culture succeeding business operation. The results from investigating the recognition regarding dietary education are as follows. The activation level by education types was as low as 2.24 points, the necessity was as high as 4.54 points, the difficult point in performing food life education was 'overwork' with 4.43 points, and the teaching activity ability level was 'can effectively prepare a teaching guidance plan' at 2.96 points. As a result of investigating the nutrition consultation operating situations, 62.8% underwent it and all of the students as well as some parents and teachers performed it. The consumed time per consultation for effective nutrition consultation was 10~20 minutes, the required education equipment and data were 'consultation program' with 40.3%, and the important content during consultation was 'contents related to eating habits' with 70.5%, which was recognized as the most important.

A Comparative Study on Awareness of Middle School Students, School Parents, and Human Resources Directors in Industrial Institutions about Admission into Specialized High Schools and Career after Graduating from Specialized High Schools (특성화고 진학 및 졸업 후 진로에 대한 중학생, 학부모, 산업체 인사 담당자의 인식 비교 연구)

  • Lee, Byung-Wook;Ahn, Jae-Yeong;Lee, Chan-Joo;Lee, Sang-Hyun
    • 대한공업교육학회지
    • /
    • v.38 no.2
    • /
    • pp.48-67
    • /
    • 2013
  • This study tried to suggest implications about operation direction of specialized high schools (SHS) by researching awareness of middle school students (MSS), school parents (SP), human resources directors in industrial institutions (HRDII) who will be the main users of SHS education, about entering SHS and career after graduating from SHS. Seniors of middle school, SP and HRDII in Asan, Chungnam were the subject of this survey research. The summary of the result of this study is as follow: First, MSS and SP usually hoped to enter general high schools rather than vocational education schools such as SHS, meister high schools, and MSS considered school records and SP considered aptitude and talent for the factors to choose high school. Second, MSS, SP, and HRDII recognized purposes of SHS as improvement of talent and aptitude, and getting a job. As for positive images of SHS, they recognized it as applying talent and aptitude to life early, getting good jobs easily, fast independence after graduation, and learning excellent technologies, and as for negative images of SHS, they recognized it as social prejudices and discrimination, students with bad school records enter them, disadvantages about promotion and wages, and being unfavorable for entering universities. They also recognized education of SHS as being effective for improvement of basic and executive ability and key competency, development of creative human resources, and improvement of right personality and courteous manners. Third, many MSS and SP showed intention to enter SHS if it is established in Asan. They wished to enter SHS because they would like to apply their aptitude and talent to life early, learn excellent skill, and hope for early employment, on the other hand, they did not wish to enter SHS because it was not suited for their aptitude and talent, awareness about SHS is low, it is unfavorable to enter universities, and there were social prejudices and discrimination. They also similarly hoped for getting jobs and entering universities after graduating from SHS. And the reason they wanted to get a job was usually because they want to be successful by advancing into society early, or because it is still hard to get a job even after graduate from the university, on the other hand, the reason they want to enter university is because is usually in-depth education about major and social discrimination about level of education. The ability to perform duties forms the greatest part of the employment standard that MSS, SP, and HRDII aware. MSS and SP usually hoped for industrial, home economics and housework and commercial majors in SHS, and considered aptitude and talent, the promising future, and being favorable for employment for choosing major. The reason HRDII hire SHS student was to develop student into talent of industrial institution, ability of student, and need for manpower with high school graduation level, and there were also partial answer that they can hire SHS student if they have ability to perform duties. The proposals about operation direction of SHS according to the results above are as follow: SHS should diversify major and curriculum to meet various requirements of student and parents, establish SHS admission system based on career guidance, and improve student's ability to perform duties by establishing work-based learning. The Government should organize work-to-school policy to enable practical career development of students from SHS, and promote relevant policy to reinforcing SHS education rather than quantitative evaluation such as employment rate, and cooperative support from each government departments is required to make manpower with skill related to SHS to get proper evaluation and treatment.

An Intelligent Decision Support System for Selecting Promising Technologies for R&D based on Time-series Patent Analysis (R&D 기술 선정을 위한 시계열 특허 분석 기반 지능형 의사결정지원시스템)

  • Lee, Choongseok;Lee, Suk Joo;Choi, Byounggu
    • Journal of Intelligence and Information Systems
    • /
    • v.18 no.3
    • /
    • pp.79-96
    • /
    • 2012
  • As the pace of competition dramatically accelerates and the complexity of change grows, a variety of research have been conducted to improve firms' short-term performance and to enhance firms' long-term survival. In particular, researchers and practitioners have paid their attention to identify promising technologies that lead competitive advantage to a firm. Discovery of promising technology depends on how a firm evaluates the value of technologies, thus many evaluating methods have been proposed. Experts' opinion based approaches have been widely accepted to predict the value of technologies. Whereas this approach provides in-depth analysis and ensures validity of analysis results, it is usually cost-and time-ineffective and is limited to qualitative evaluation. Considerable studies attempt to forecast the value of technology by using patent information to overcome the limitation of experts' opinion based approach. Patent based technology evaluation has served as a valuable assessment approach of the technological forecasting because it contains a full and practical description of technology with uniform structure. Furthermore, it provides information that is not divulged in any other sources. Although patent information based approach has contributed to our understanding of prediction of promising technologies, it has some limitations because prediction has been made based on the past patent information, and the interpretations of patent analyses are not consistent. In order to fill this gap, this study proposes a technology forecasting methodology by integrating patent information approach and artificial intelligence method. The methodology consists of three modules : evaluation of technologies promising, implementation of technologies value prediction model, and recommendation of promising technologies. In the first module, technologies promising is evaluated from three different and complementary dimensions; impact, fusion, and diffusion perspectives. The impact of technologies refers to their influence on future technologies development and improvement, and is also clearly associated with their monetary value. The fusion of technologies denotes the extent to which a technology fuses different technologies, and represents the breadth of search underlying the technology. The fusion of technologies can be calculated based on technology or patent, thus this study measures two types of fusion index; fusion index per technology and fusion index per patent. Finally, the diffusion of technologies denotes their degree of applicability across scientific and technological fields. In the same vein, diffusion index per technology and diffusion index per patent are considered respectively. In the second module, technologies value prediction model is implemented using artificial intelligence method. This studies use the values of five indexes (i.e., impact index, fusion index per technology, fusion index per patent, diffusion index per technology and diffusion index per patent) at different time (e.g., t-n, t-n-1, t-n-2, ${\cdots}$) as input variables. The out variables are values of five indexes at time t, which is used for learning. The learning method adopted in this study is backpropagation algorithm. In the third module, this study recommends final promising technologies based on analytic hierarchy process. AHP provides relative importance of each index, leading to final promising index for technology. Applicability of the proposed methodology is tested by using U.S. patents in international patent class G06F (i.e., electronic digital data processing) from 2000 to 2008. The results show that mean absolute error value for prediction produced by the proposed methodology is lower than the value produced by multiple regression analysis in cases of fusion indexes. However, mean absolute error value of the proposed methodology is slightly higher than the value of multiple regression analysis. These unexpected results may be explained, in part, by small number of patents. Since this study only uses patent data in class G06F, number of sample patent data is relatively small, leading to incomplete learning to satisfy complex artificial intelligence structure. In addition, fusion index per technology and impact index are found to be important criteria to predict promising technology. This study attempts to extend the existing knowledge by proposing a new methodology for prediction technology value by integrating patent information analysis and artificial intelligence network. It helps managers who want to technology develop planning and policy maker who want to implement technology policy by providing quantitative prediction methodology. In addition, this study could help other researchers by proving a deeper understanding of the complex technological forecasting field.

A Study on Searching for Export Candidate Countries of the Korean Food and Beverage Industry Using Node2vec Graph Embedding and Light GBM Link Prediction (Node2vec 그래프 임베딩과 Light GBM 링크 예측을 활용한 식음료 산업의 수출 후보국가 탐색 연구)

  • Lee, Jae-Seong;Jun, Seung-Pyo;Seo, Jinny
    • Journal of Intelligence and Information Systems
    • /
    • v.27 no.4
    • /
    • pp.73-95
    • /
    • 2021
  • This study uses Node2vec graph embedding method and Light GBM link prediction to explore undeveloped export candidate countries in Korea's food and beverage industry. Node2vec is the method that improves the limit of the structural equivalence representation of the network, which is known to be relatively weak compared to the existing link prediction method based on the number of common neighbors of the network. Therefore, the method is known to show excellent performance in both community detection and structural equivalence of the network. The vector value obtained by embedding the network in this way operates under the condition of a constant length from an arbitrarily designated starting point node. Therefore, it has the advantage that it is easy to apply the sequence of nodes as an input value to the model for downstream tasks such as Logistic Regression, Support Vector Machine, and Random Forest. Based on these features of the Node2vec graph embedding method, this study applied the above method to the international trade information of the Korean food and beverage industry. Through this, we intend to contribute to creating the effect of extensive margin diversification in Korea in the global value chain relationship of the industry. The optimal predictive model derived from the results of this study recorded a precision of 0.95 and a recall of 0.79, and an F1 score of 0.86, showing excellent performance. This performance was shown to be superior to that of the binary classifier based on Logistic Regression set as the baseline model. In the baseline model, a precision of 0.95 and a recall of 0.73 were recorded, and an F1 score of 0.83 was recorded. In addition, the light GBM-based optimal prediction model derived from this study showed superior performance than the link prediction model of previous studies, which is set as a benchmarking model in this study. The predictive model of the previous study recorded only a recall rate of 0.75, but the proposed model of this study showed better performance which recall rate is 0.79. The difference in the performance of the prediction results between benchmarking model and this study model is due to the model learning strategy. In this study, groups were classified by the trade value scale, and prediction models were trained differently for these groups. Specific methods are (1) a method of randomly masking and learning a model for all trades without setting specific conditions for trade value, (2) arbitrarily masking a part of the trades with an average trade value or higher and using the model method, and (3) a method of arbitrarily masking some of the trades with the top 25% or higher trade value and learning the model. As a result of the experiment, it was confirmed that the performance of the model trained by randomly masking some of the trades with the above-average trade value in this method was the best and appeared stably. It was found that most of the results of potential export candidates for Korea derived through the above model appeared appropriate through additional investigation. Combining the above, this study could suggest the practical utility of the link prediction method applying Node2vec and Light GBM. In addition, useful implications could be derived for weight update strategies that can perform better link prediction while training the model. On the other hand, this study also has policy utility because it is applied to trade transactions that have not been performed much in the research related to link prediction based on graph embedding. The results of this study support a rapid response to changes in the global value chain such as the recent US-China trade conflict or Japan's export regulations, and I think that it has sufficient usefulness as a tool for policy decision-making.

Legal Issues on the Collection and Utilization of Infectious Disease Data in the Infectious Disease Crisis (감염병 위기 상황에서 감염병 데이터의 수집 및 활용에 관한 법적 쟁점 -미국 감염병 데이터 수집 및 활용 절차를 참조 사례로 하여-)

  • Kim, Jae Sun
    • The Korean Society of Law and Medicine
    • /
    • v.23 no.4
    • /
    • pp.29-74
    • /
    • 2022
  • As social disasters occur under the Disaster Management Act, which can damage the people's "life, body, and property" due to the rapid spread and spread of unexpected COVID-19 infectious diseases in 2020, information collected through inspection and reporting of infectious disease pathogens (Article 11), epidemiological investigation (Article 18), epidemiological investigation for vaccination (Article 29), artificial technology, and prevention policy Decision), (3) It was used as an important basis for decision-making in the context of an infectious disease crisis, such as promoting vaccination and understanding the current status of damage. In addition, medical policy decisions using infectious disease data contribute to quarantine policy decisions, information provision, drug development, and research technology development, and interest in the legal scope and limitations of using infectious disease data has increased worldwide. The use of infectious disease data can be classified for the purpose of spreading and blocking infectious diseases, prevention, management, and treatment of infectious diseases, and the use of information will be more widely made in the context of an infectious disease crisis. In particular, as the serious stage of the Disaster Management Act continues, the processing of personal identification information and sensitive information becomes an important issue. Information on "medical records, vaccination drugs, vaccination, underlying diseases, health rankings, long-term care recognition grades, pregnancy, etc." needs to be interpreted. In the case of "prevention, management, and treatment of infectious diseases", it is difficult to clearly define the concept of medical practicesThe types of actions are judged based on "legislative purposes, academic principles, expertise, and social norms," but the balance of legal interests should be based on the need for data use in quarantine policies and urgent judgment in public health crises. Specifically, the speed and degree of transmission of infectious diseases in a crisis, whether the purpose can be achieved without processing sensitive information, whether it unfairly violates the interests of third parties or information subjects, and the effectiveness of introducing quarantine policies through processing sensitive information can be used as major evaluation factors. On the other hand, the collection, provision, and use of infectious disease data for research purposes will be used through pseudonym processing under the Personal Information Protection Act, consent under the Bioethics Act and deliberation by the Institutional Bioethics Committee, and data provision deliberation committee. Therefore, the use of research purposes is recognized as long as procedural validity is secured as it is reviewed by the pseudonym processing and data review committee, the consent of the information subject, and the institutional bioethics review committee. However, the burden on research managers should be reduced by clarifying the pseudonymization or anonymization procedures, the introduction or consent procedures of the comprehensive consent system and the opt-out system should be clearly prepared, and the procedure for re-identifying or securing security that may arise from technological development should be clearly defined.