• Title/Summary/Keyword: Q learning

Search Result 426, Processing Time 0.029 seconds

MCMC Algorithm for Dirichlet Distribution over Gridded Simplex (그리드 단체 위의 디리슐레 분포에서 마르코프 연쇄 몬테 칼로 표집)

  • Sin, Bong-Kee
    • KIISE Transactions on Computing Practices
    • /
    • v.21 no.1
    • /
    • pp.94-99
    • /
    • 2015
  • With the recent machine learning paradigm of using nonparametric Bayesian statistics and statistical inference based on random sampling, the Dirichlet distribution finds many uses in a variety of graphical models. It is a multivariate generalization of the gamma distribution and is defined on a continuous (K-1)-simplex. This paper presents a sampling method for a Dirichlet distribution for the problem of dividing an integer X into a sequence of K integers which sum to X. The target samples in our problem are all positive integer vectors when multiplied by a given X. They must be sampled from the correspondingly gridded simplex. In this paper we develop a Markov Chain Monte Carlo (MCMC) proposal distribution for the neighborhood grid points on the simplex and then present the complete algorithm based on the Metropolis-Hastings algorithm. The proposed algorithm can be used for the Markov model, HMM, and Semi-Markov model for accurate state-duration modeling. It can also be used for the Gamma-Dirichlet HMM to model q the global-local duration distributions.

A Study on the Structural Equation Model for Factors Affecting Academic Achievement in Non-Face-to-Face Class (비대면수업에서 학습성취도에 미치는 요인에 대한 구조방정식 모형 연구)

  • Suh, Hyesun
    • The Journal of the Convergence on Culture Technology
    • /
    • v.6 no.4
    • /
    • pp.157-164
    • /
    • 2020
  • In 2020, due to COVID-19, all universities in Korea were conducting non-face-to-face classes. The purpose of this study is to study what factors affect academic achievement under such non-face-to-face instruction, especially for engineering students where practical training is important. Validity of the statistical hypothesis defined in this study by applying a structural equation model using questionnaires about academic achievement for engineering students at University D for this study. In addition, I would like to suggest what factors should be considered in non-face-to-face classes, especially in engineering colleges. As a result of the study, it was found that students' Q&A, feedback and e-learning system had a direct influence on academic achievement. In addition, it was confirmed that they had an indirect influence on academic achievement through the parameters of theory class and practical class.

Development of EEG Signals Measurement and Analysis Method based on Timbre (음색 기반 뇌파측정 및 분석기법 개발)

  • Park, Seung-Min;Lee, Young-Hwan;Ko, Kwang-Eun;Sim, Kwee-Bo
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.20 no.3
    • /
    • pp.388-393
    • /
    • 2010
  • Cultural Content Technology(CT, Culture Technology) for the development of cultural industry and the commercialization of technology, cultural contents, media, mount, pass the value chain process and increase the added value of cultural products that are good for all forms of intangible technology. In the field of Culture Technology, Music by analyzing the characteristics of the development of a variety of applications has been studied. Associated with EEG measures and the results of their research in response to musical stimuli are used to detect and study is getting attention. In this paper, the musical stimuli in EEG signals by amplifying the corresponding reaction to the averaging method, ERP (Event-Related Potentials) experiments based on the process of extracting sound methods for removing noise from the ICA algorithm to extract the tone and noise removal according to the results are applied to analyze the characteristics of EEG.

Smart Anti-jamming Mobile Communication for Cloud and Edge-Aided UAV Network

  • Li, Zhiwei;Lu, Yu;Wang, Zengguang;Qiao, Wenxin;Zhao, Donghao
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.14 no.12
    • /
    • pp.4682-4705
    • /
    • 2020
  • The Unmanned Aerial Vehicles (UAV) networks consisting of low-cost UAVs are very vulnerable to smart jammers that can choose their jamming policies based on the ongoing communication policies accordingly. In this article, we propose a novel cloud and edge-aided mobile communication scheme for low-cost UAV network against smart jamming. The challenge of this problem is to design a communication scheme that not only meets the requirements of defending against smart jamming attack, but also can be deployed on low-cost UAV platforms. In addition, related studies neglect the problem of decision-making algorithm failure caused by intermittent ground-to-air communication. In this scheme, we use the policy network deployed on the cloud and edge servers to generate an emergency policy tables, and regularly update the generated policy table to the UAVs to solve the decision-making problem when communications are interrupted. In the operation of this communication scheme, UAVs need to offload massive computing tasks to the cloud or the edge servers. In order to prevent these computing tasks from being offloaded to a single computing resource, we deployed a lightweight game algorithm to ensure that the three types of computing resources, namely local, edge and cloud, can maximize their effectiveness. The simulation results show that our communication scheme has only a small decrease in the SINR of UAVs network in the case of momentary communication interruption, and the SINR performance of our algorithm is higher than that of the original Q-learning algorithm.

Development of Artificial Intelligence-based Legal Counseling Chatbot System

  • Park, Koo-Rack
    • Journal of the Korea Society of Computer and Information
    • /
    • v.26 no.3
    • /
    • pp.29-34
    • /
    • 2021
  • With the advent of the 4th industrial revolution era, IT technology is creating new services that have not existed by converging with various existing industries and fields. In particular, in the field of artificial intelligence, chatbots and the latest technologies have developed dramatically with the development of natural language processing technology, and various business processes are processed through chatbots. This study is a study on a system that provides a close answer to the question the user wants to find by creating a structural form for legal inquiries through Slot Filling-based chatbot technology, and inputting a predetermined type of question. Using the proposal system, it is possible to construct question-and-answer data in a more structured form of legal information, which is unstructured data in text form. In addition, by managing the accumulated Q&A data through a big data storage system such as Apache Hive and recycling the data for learning, the reliability of the response can be expected to continuously improve.

A Study on the Factors Affecting the Intention of Continuous Use of Intelligent Government Administrative Services (지능형 정부 행정서비스 지속사용의도에 영향을 미치는 요인에 대한 연구)

  • Lee, Se-Ho;Han, Seung-jo;Park, Kyung-Hye
    • Journal of Digital Convergence
    • /
    • v.19 no.11
    • /
    • pp.85-93
    • /
    • 2021
  • The government is pursuing plans to create new e-government services. In terms of improving business procedures, dBrain (finance), e-people (personnel), and Onnara (electronic payment and business management) have achieved considerable results, and are currently making efforts to improve existing administrative services using newly emerged ICT. Among them, this paper attempted to study whether self-learning-based intelligent administrative services are efficient in the work process of public officials promoting actual work and affect their continued use. Based on individual perceptions and attitudes toward advanced ICTs such as AI, big data, and blockchain, public officials' influences on administrative services were identified and verified using UTAUT variables. They believe that the establishment and introduction of innovative administrative services can be used more efficiently, and they have high expectations for the use and provision of services as ICT develops. In the future, a model will be also applied to citizens

The gene expression programming method for estimating compressive strength of rocks

  • Ibrahim Albaijan;Daria K. Voronkova;Laith R. Flaih;Meshel Q. Alkahtani;Arsalan Mahmoodzadeh;Hawkar Hashim Ibrahim;Adil Hussein Mohammed
    • Geomechanics and Engineering
    • /
    • v.36 no.5
    • /
    • pp.465-474
    • /
    • 2024
  • Uniaxial compressive strength (UCS) is a critical geomechanical parameter that plays a significant role in the evaluation of rocks. The practice of indirectly estimating said characteristics is widespread due to the challenges associated with obtaining high-quality core samples. The primary aim of this study is to investigate the feasibility of utilizing the gene expression programming (GEP) technique for the purpose of forecasting the UCS for various rock categories, including Schist, Granite, Claystone, Travertine, Sandstone, Slate, Limestone, Marl, and Dolomite, which were sourced from a wide range of quarry sites. The present study utilized a total of 170 datasets, comprising Schmidt hammer (SH), porosity (n), point load index (Is(50)), and P-wave velocity (Vp), as the effective parameters in the model to determine their impact on the UCS. The UCS parameter was computed through the utilization of the GEP model, resulting in the generation of an equation. Subsequently, the efficacy of the GEP model and the resultant equation were assessed using various statistical evaluation metrics to determine their predictive capabilities. The outcomes indicate the prospective capacity of the GEP model and the resultant equation in forecasting the unconfined compressive strength (UCS). The significance of this study lies in its ability to enable geotechnical engineers to make estimations of the UCS of rocks, without the requirement of conducting expensive and time-consuming experimental tests. In particular, a user-friendly program was developed based on the GEP model to enable rapid and very accurate calculation of rock's UCS, doing away with the necessity for costly and time-consuming laboratory experiments.

Anatomical Studies of Major Tree Barks Grown in Korea - II. Anatomy of Quercus Barks (한국산(韓國産) 주요수피(主要樹皮)의 해부학적(解剖學的) 연구(硏究) - 제2보(第二報) 참나무속(屬) 수피(樹皮)의 해부(解剖))

  • Lee, Hwa-Hyoung;Lee, Phil-Woo
    • Journal of the Korean Wood Science and Technology
    • /
    • v.5 no.1
    • /
    • pp.3-8
    • /
    • 1977
  • A bark comprises about 10 to 20 percents of a typical log by volume, and is generally considered as an unwanted residue rather than a potentially valuable resource. As the world has been confronted with decreasing forest resources, natural resources pressure dictate that a bark should be a raw material instead of a waste. The utilization of the largely wasted bark of genus Quercus grown in Korea can be enhanced by learning its anatomical structure and properties. In this paper, bark characteristics of Quercus grown in Korea are described. In bark anatomy, general features such as color of rhytidome, exfoliating form, color of periderm, arrangement of periderm, and thickness of the inner and outer hark. etc., arc discussed. Studies on the microscopic structure include sieve tube, companion cell, parenchyma, pholem fiber, ray, periderm(phelloderm, phelloogen, phellem), sclereid, and crystal, etc. The results may be summarized as follows: 1. In general characteristics of rhytidomes, exfoliating is not easy and sclereids are distint to the naked eye. Inner bark is thicker than that of outer bark except in case of Q. variabilis. 2. It is not clear to distinguish between phelloderm and phellogen in Quercus bark. The phellem is developed conspicuously in Q. variabilis but that of Q. accutissima is composed of thinwalled phellem and thickwalled stone cell. 3. Quercus Bark has sieve tube, companion cell, phloem fiber and sclereid. Sclereids of Quercus bark are the most distinguished characteristics comparing with pinus and populus. The volume percent of sclereids are higher than that of fiber. 4. Rays are 1~3 seriate, and multiseriate ranging with from 15 to 20. 5. Parenchyma cell contains two types, polygonal and druses crystal.

  • PDF

Factors Related to Poor School Performance of Elementary School Children (국민학교아동의 학습부진에 관련된 요인)

  • Park, Jung-Han;Kim, Gui-Yeon;Her, Kyu-Sook;Lee, Ju-Young;Kim, Doo-Hie
    • Journal of Preventive Medicine and Public Health
    • /
    • v.26 no.4 s.44
    • /
    • pp.628-649
    • /
    • 1993
  • This study was conducted to investigate the factors related to the poor school performance of the elementary school children. Two schools in Taegu, one in the affluent area and the other in the poor area, were selected and a total of 175 children whose school performance was within low 10 percentile (poor performers) and 97 children whose school performance were within high 5 percentile (good performers) in each class of 2nd, 4th and 6th grades were tested for the physical health, behavioral problem and family background. Each child had gone through a battery of tests including visual and hearing acuity, anthropometry (body weight, height, head circumference), intelligence (Kodae Stanford-Binet test), test anxiety (TAI-K), neurologic examination by a developmental pediatrician and heavy metal content (Pb, Cd, Zn) in hair by atomic absorption spectrophotometry. A questionnaire was administered to the mothers for prenatal and prenatal courses of the child, family environment, child's developmental history, and child's behavioral and learning problems. Another questionnaire was administered to the teachers of the children for the child's family background, arithmatic & language abilities and behavioral problem. The poor school performance had a significant correlation with male gender, high birth order, broken home, low educational and occupational levels of parents, visual problem, high test anxiety score, attention deficit hyperactivity disorder (ADHD), poor physical growth (weight, height, head circumference) and low I.Q. score. The factors that had a significant correlation with the poor school performance in multiple logistic regression analysis were child's birth order (odds ratio=2.06), male gender(odds ratio=5.91), broken home(odds ratio=9.29), test anxiety score(odds ratio=1.07), ADHD (odds ratio=9.67), I.Q. score (odds ratio=0.85) and height less than Korean standard mean-1S.D.(odds ratio=11.12). The heavy metal contents in hair did not show any significant correlation with poor school performance. However the lead and cadmium contents were high in males than in females. The lead content was negatively correlated with child's grade(P<0.05) and zinc was positively correlated with grade (P<0.05). among the factors that showed a significant correlation with the poor school performance, high birth order, short stature and ADHD may be modified by a good family planning, good feeding practice for infant and child, and early detection and treatment of ADHD. Also, teacher and parents should restrain themselves from inducing excessive test anxiety by forcing the child to study and over-expecting beyond the child's intellectual capability.

  • PDF

A Systematic Review and Meta-Analysis on the Correlation between Learning Satisfaction and Academic Achievement (학습자의 교육훈련 만족도와 학업성취도의 상관관계에 관한 체계적 문헌고찰과 메타분석)

  • Jeong, Sun-jeong;Rim, Kyung-hwa
    • Journal of vocational education research
    • /
    • v.37 no.2
    • /
    • pp.39-75
    • /
    • 2018
  • The purpose of this study is to verify the general characteristics in the previous studies and the magnitude of the correlation between the learner's satisfaction and the academic achievement in the education and training program. To do this, we searched relevant literature from 2000 to 2016, and conducted a systematic review of the literature on the final 31 studies through the selection criteria and quality evaluation. Among them, 27 meta-analysis of the literature was conducted. The finding of the study were as follows. First, a total of 31 studies were conducted from 2000 to 2016, and more than half of them(16) were conducted for the last 4 years(2009~2012). In terms of education and training students, there are 18 college students, 9 workers, and 4 elementary students in order of study. In terms of methods, 15 collective education, 14 distance education, 2 blended education. In terms of learner's participation, 22 the general participation, 9 the active participation. Second, as a result of the meta-analysis, the magnitude of the correlation between satisfaction and achievement was moderate(ZCOR=.297, 95%: CI .210~.383). Third, as a result of verifying the difference in the magnitude of the correlation effect between satisfaction and achievement according to the characteristics of the education and training program, there was no difference between the groups in the student object and education method, but there was a difference in the magnitude of the correlation effect depending on the participant type(Q=15.40, df=1, p<.0001). The active participation showed a correlation effect size larger(ZCOR=.588, 95%: CI .422~.754). The effect size of the general participation was lower than the median(ZCOR=.211, 95%: CI .12 ~.300).