• Title/Summary/Keyword: experience-based learning algorithm

Search Result 65, Processing Time 0.024 seconds

Heuristics for Motion Planning Based on Learning in Similar Environments

  • Ogay, Dmitriy;Kim, Eun-Gyung
    • Journal of information and communication convergence engineering
    • /
    • v.12 no.2
    • /
    • pp.116-121
    • /
    • 2014
  • This paper discusses computer-generated heuristics for motion planning. Planning with many degrees of freedom is a challenging task, because the complexity of most planning algorithms grows exponentially with the number of dimensions of the problem. A well-designed heuristic may greatly improve the performance of a planning algorithm in terms of the computation time. However, in recent years, with increasingly challenging high-dimensional planning problems, the design of good heuristics has itself become a complicated task. In this paper, we present an approach to algorithmically develop a heuristic for motion planning, which increases the efficiency of a planner in similar environments. To implement the idea, we generalize modern motion planning algorithms to an extent, where a heuristic is represented as a set of random variables. Distributions of the variables are then analyzed with computer learning methods. The analysis results are then utilized to generate a heuristic. During the experiments, the proposed approach is applied to several planning tasks with different algorithms and is shown to improve performance.

Self-Organizing Fuzzy Control of a Flexible Joint Manipulator (유연 관절 매니퓰레이터의 자기 구성 퍼지 제어)

  • Park, J.H.;Lee, S.B.
    • Journal of the Korean Society for Precision Engineering
    • /
    • v.12 no.8
    • /
    • pp.92-98
    • /
    • 1995
  • The position control of flexible joint manipulator is investigated by applying the self-organizing fuzzy logic controller (SOC) proposed by Procyk and Mamdani. The SOC is a heuristic rule-based controller and a further extension of an ordinary fuzzy controller, which has a hierachy structrue which consists of an algorithm being identical to a fuzzy controller at the lower ollp and a learning algorithm accomodating the performance evalution and rule modification function at the upper ollp. This form of control can be used in those complex systems which have been too difficult to control or which in the past have had to rely on the experience of a human operator. Even though the significant dynamic coupling of the motors and links on the flexible joint manipulator, the performance of command-following is good by applying the proposed SOC.

  • PDF

The Study of the System Development on the Safe Environment of Children's Smartphone Use and Contents Recommendations (유아들의 안전한 스마트폰 사용 환경 및 콘텐츠 추천 시스템 개발)

  • Lee, Kyung-A;Park, Eun-Young
    • Journal of Digital Contents Society
    • /
    • v.19 no.5
    • /
    • pp.845-852
    • /
    • 2018
  • This study has developed a preventive launcher from smartphone addiction for the digital generation and the contents recommendation based on machine learning which used multiple and collective intelligence. This could provide convenient digital nurturing experience for the parents who fear their children's over use of digital devices and also suggest individually adaptive digital learning methods that enhance the learning efficiency and pleasurable and safe learning environment for the children. Suggested application is a kind of gamification launcher that protects children from harmful contents and from smartphone addiction with time limit settings. For parents who find difficulty choosing from various kinds of contents and applications for education, this suggested system could provide a learning analytic report based on big data after collecting and analyzing the data of their children's learning and activities and recommend contents necessary for their kids using recommended algorithm by collective intelligence.

The Image Summarization Algorithm for Reviewing the Virtual Reality Experience (가상현실 경험을 복습시켜주는 사진 정리 알고리즘)

  • Kwak, Eun-Joo;Cho, Yong-Joo;Cho, Hyun-Sang;Park, Kyoung-Shin
    • The KIPS Transactions:PartB
    • /
    • v.15B no.3
    • /
    • pp.211-218
    • /
    • 2008
  • In this paper, we proposed a new image summarization algorithm designed for automatically summarizing user's snapshot photos taken in a virtual environment based on user's context information and educational contents, and then presenting a summarized photos shortly after user's virtual reality experience. While other image summarization algorithms used date, location, and keyword to effectively summarize a large amount of photos, this algorithm is intended to improve users' memory retention by recalling their interests and important educational contents. This paper first describes some criteria of extracting the meaningful images to improve learning effects and the identification rate calculations, followed by the system architecture that integrates the virtual environment and the viewer interface. It will also discuss a user study to model the algorithm's optimal identification rate and then future research directions.

Design and Analysis of Educational Java Applets for Learning Simplification Procedure Using Karnaugh Map (Karnaugh Map 간략화 과정의 학습을 위한 교육용 자바 애플릿의 설계와 해석)

  • Kim, Dong-Sik;Jeong, Hye-Kyung
    • Journal of Internet Computing and Services
    • /
    • v.16 no.3
    • /
    • pp.33-41
    • /
    • 2015
  • In this paper, the simplification procedure of Karnaugh Map, which is essential to design digital logic circuits, was implemented as web-based educational Java applets. The learners will be able to experience interesting learning process by executing the proposed Java applets. In addition, since the proposed Java applets were designed to contain educational technologies by step-by-step procedure, the maximization of learning efficiency can be obtained. The learners can make virtual experiments on the simplification of digital logic circuits by clicking on some buttons or filling out some text fields. Furthermore, the Boolean expression and its schematic diagram occurred in the simplification process will be displayed on the separate frame so that the learners can learn effectively. The schematic diagram enables them to check out if the logic circuit is correctly connected or not. Finally, since the simplification algorithm used in the proposed Java applet is based on the modified Quine-McCluskey minimization technique, the proposed Java applets will show more encouraging result in view of learning efficiency if it is used as assistants of the on-campus offline class.

Network Intrusion Detection System Using Feature Extraction Based on AutoEncoder in IOT environment (IOT 환경에서의 오토인코더 기반 특징 추출을 이용한 네트워크 침입탐지 시스템)

  • Lee, Joohwa;Park, Keehyun
    • KIPS Transactions on Software and Data Engineering
    • /
    • v.8 no.12
    • /
    • pp.483-490
    • /
    • 2019
  • In the Network Intrusion Detection System (NIDS), the function of classification is very important, and detection performance depends on various features. Recently, a lot of research has been carried out on deep learning, but network intrusion detection system experience slowing down problems due to the large volume of traffic and a high dimensional features. Therefore, we do not use deep learning as a classification, but as a preprocessing process for feature extraction and propose a research method from which classifications can be made based on extracted features. A stacked AutoEncoder, which is a representative unsupervised learning of deep learning, is used to extract features and classifications using the Random Forest classification algorithm. Using the data collected in the IOT environment, the performance was more than 99% when normal and attack traffic are classified into multiclass, and the performance and detection rate were superior even when compared with other models such as AE-RF and Single-RF.

Multi Label Deep Learning classification approach for False Data Injection Attacks in Smart Grid

  • Prasanna Srinivasan, V;Balasubadra, K;Saravanan, K;Arjun, V.S;Malarkodi, S
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.15 no.6
    • /
    • pp.2168-2187
    • /
    • 2021
  • The smart grid replaces the traditional power structure with information inventiveness that contributes to a new physical structure. In such a field, malicious information injection can potentially lead to extreme results. Incorrect, FDI attacks will never be identified by typical residual techniques for false data identification. Most of the work on the detection of FDI attacks is based on the linearized power system model DC and does not detect attacks from the AC model. Also, the overwhelming majority of current FDIA recognition approaches focus on FDIA, whilst significant injection location data cannot be achieved. Building on the continuous developments in deep learning, we propose a Deep Learning based Locational Detection technique to continuously recognize the specific areas of FDIA. In the development area solver gap happiness is a False Data Detector (FDD) that incorporates a Convolutional Neural Network (CNN). The FDD is established enough to catch the fake information. As a multi-label classifier, the following CNN is utilized to evaluate the irregularity and cooccurrence dependency of power flow calculations due to the possible attacks. There are no earlier statistical assumptions in the architecture proposed, as they are "model-free." It is also "cost-accommodating" since it does not alter the current FDD framework and it is only several microseconds on a household computer during the identification procedure. We have shown that ANN-MLP, SVM-RBF, and CNN can conduct locational detection under different noise and attack circumstances through broad experience in IEEE 14, 30, 57, and 118 bus systems. Moreover, the multi-name classification method used successfully improves the precision of the present identification.

A study on the application of robotic programming to promote logical and critical thinking in mathematics education (논리·비판적 사고 신장을 위한 로봇 프로그래밍의 수학교육 적용 방안)

  • Rim, Haemee;Choi, Inseon;Noh, Sunsook
    • The Mathematical Education
    • /
    • v.53 no.3
    • /
    • pp.413-434
    • /
    • 2014
  • Logic lays the foundation of Mathematics and the development of Mathematics is dependent on critical thinking. So it is important that school mathematics helps students develop their logical and critical thinking ability for both mathematics learning and problem solving in general. MINDSTORMS, a LEGO based programming activity kit, is an effective teaching and learning tool that can be used to enhance logical and critical thinking in students. This study focused on measuring the growth of students' ability to think logically and critically when they used MINDSTORMS activities to learn programming. In addition, we investigated how the students' logical and critical thinking changed from the MINDSTORMS learning experience. The study confirmed that the programming activities using MINDSTORMS help to enhance logical and critical thinking in students. The students attitude about logical and critical thinking became more positive and the activities helped to engage students to think logically and critically. This type of programming activities should be valuable in mathematics education and it should be included in a general mathematics curriculum.

Dynamic Pricing Based on Reinforcement Learning Reflecting the Relationship between Driver and Passenger Using Matching Matrix (Matching Matrix를 사용하여 운전자와 승객의 관계를 반영한 강화학습 기반 유동적인 가격 책정 체계)

  • Park, Jun Hyung;Lee, Chan Jae;Yoon, Young
    • The Journal of The Korea Institute of Intelligent Transport Systems
    • /
    • v.19 no.6
    • /
    • pp.118-133
    • /
    • 2020
  • Research interest in the Mobility-as-a-Service (MaaS) concept for enhancing users' mobility experience is increasing. In particular, dynamic pricing techniques based on reinforcement learning have emerged since adjusting prices based on the demand is expected to help mobility services, such as taxi and car-sharing services, to gain more profit. This paper provides a simulation framework that considers more practical factors, such as demand density per location, preferred prices, the distance between users and drivers, and distance to the destination that critically affect the probability of matching between the users and the mobility service providers (e.g., drivers). The aforementioned new practical features are reflected on a data structure referred to as the Matching Matrix. Using an efficient algorithm of computing the probability of matching between the users and drivers and given a set of precisely identified high-demand locations using HDBSCAN, this study developed a better reward function that can gear the reinforcement learning process towards finding more realistic dynamic pricing policies.

Machine Learning Algorithm for Estimating Ink Usage (머신러닝을 통한 잉크 필요량 예측 알고리즘)

  • Se Wook Kwon;Young Joo Hyun;Hyun Chul Tae
    • Journal of Korean Society of Industrial and Systems Engineering
    • /
    • v.46 no.1
    • /
    • pp.23-31
    • /
    • 2023
  • Research and interest in sustainable printing are increasing in the packaging printing industry. Currently, predicting the amount of ink required for each work is based on the experience and intuition of field workers. Suppose the amount of ink produced is more than necessary. In this case, the rest of the ink cannot be reused and is discarded, adversely affecting the company's productivity and environment. Nowadays, machine learning models can be used to figure out this problem. This study compares the ink usage prediction machine learning models. A simple linear regression model, Multiple Regression Analysis, cannot reflect the nonlinear relationship between the variables required for packaging printing, so there is a limit to accurately predicting the amount of ink needed. This study has established various prediction models which are based on CART (Classification and Regression Tree), such as Decision Tree, Random Forest, Gradient Boosting Machine, and XGBoost. The accuracy of the models is determined by the K-fold cross-validation. Error metrics such as root mean squared error, mean absolute error, and R-squared are employed to evaluate estimation models' correctness. Among these models, XGBoost model has the highest prediction accuracy and can reduce 2134 (g) of wasted ink for each work. Thus, this study motivates machine learning's potential to help advance productivity and protect the environment.