• Title/Summary/Keyword: Learning and Memory

Search Result 1,288, Processing Time 0.03 seconds

Function Approximation for Reinforcement Learning using Fuzzy Clustering (퍼지 클러스터링을 이용한 강화학습의 함수근사)

  • Lee, Young-Ah;Jung, Kyoung-Sook;Chung, Tae-Choong
    • The KIPS Transactions:PartB
    • /
    • v.10B no.6
    • /
    • pp.587-592
    • /
    • 2003
  • Many real world control problems have continuous states and actions. When the state space is continuous, the reinforcement learning problems involve very large state space and suffer from memory and time for learning all individual state-action values. These problems need function approximators that reason action about new state from previously experienced states. We introduce Fuzzy Q-Map that is a function approximators for 1 - step Q-learning and is based on fuzzy clustering. Fuzzy Q-Map groups similar states and chooses an action and refers Q value according to membership degree. The centroid and Q value of winner cluster is updated using membership degree and TD(Temporal Difference) error. We applied Fuzzy Q-Map to the mountain car problem and acquired accelerated learning speed.

Design and Implementation of Multimedia Mobile Learning System using MSMIL (MSMIL을 이용한 멀티미디어 모바일 학습시스템의 설계 및 구현)

  • Lim, Young-Jin;Seo, Jung-Hee;Park, Hung-Bog
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.11 no.3
    • /
    • pp.592-599
    • /
    • 2007
  • The advancement of wireless technology improves the electronic learning by combining with the mobile function, and promotes the expanded transition to the mobile learning. Basically, the mobile learning provides the usefulness in terms of tile and space to provide learners with the access to the educational contents. However, the small display device and limited memory space of mobile device is limiting the access to the learning contents simply to the text-based transmission. This paper designed and implemented the multimedia mobile learning system that reduces the size of parser by define into MSMIL composed only of needed tag to multimedia contents production in the mobile devices by using the SMIL that supports the multimedia object synchronization reduces the data of multimedia learning data and enhances the transmission efficiency by applying the macro method in creating the contents of learning. The results of implementation indicates that it simplifies the designing language, makes the language learning easy, and saves the CPU resources for the parsing by reducing the size of parser.

An Empirical Study on the Cryptocurrency Investment Methodology Combining Deep Learning and Short-term Trading Strategies (딥러닝과 단기매매전략을 결합한 암호화폐 투자 방법론 실증 연구)

  • Yumin Lee;Minhyuk Lee
    • Journal of Intelligence and Information Systems
    • /
    • v.29 no.1
    • /
    • pp.377-396
    • /
    • 2023
  • As the cryptocurrency market continues to grow, it has developed into a new financial market. The need for investment strategy research on the cryptocurrency market is also emerging. This study aims to conduct an empirical analysis on an investment methodology of cryptocurrency that combines short-term trading strategy and deep learning. Daily price data of the Ethereum was collected through the API of Upbit, the Korean cryptocurrency exchange. The investment performance of the experimental model was analyzed by finding the optimal parameters based on past data. The experimental model is a volatility breakout strategy(VBS), a Long Short Term Memory(LSTM) model, moving average cross strategy and a combined model. VBS is a short-term trading strategy that buys when volatility rises significantly on a daily basis and sells at the closing price of the day. LSTM is suitable for time series data among deep learning models, and the predicted closing price obtained through the prediction model was applied to the simple trading rule. The moving average cross strategy determines whether to buy or sell when the moving average crosses. The combined model is a trading rule made by using derived variables of the VBS and LSTM model using AND/OR for the buy conditions. The result shows that combined model is better investment performance than the single model. This study has academic significance in that it goes beyond simple deep learning-based cryptocurrency price prediction and improves investment performance by combining deep learning and short-term trading strategies, and has practical significance in that it shows the applicability in actual investment.

A Design of New Digital Adaptive Predistortion Linearizer Algorithm Based on DFP(Davidon-Fletcher-Powell) Method (DFP Method 기반의 새로운 적응형 디지털 전치 왜곡 선형화기 알고리즘 개발)

  • Jang, Jeong-Seok;Choi, Yong-Gyu;Suh, Kyoung-Whoan;Hong, Ui-Seok
    • The Journal of Korean Institute of Electromagnetic Engineering and Science
    • /
    • v.22 no.3
    • /
    • pp.312-319
    • /
    • 2011
  • In this paper, a new linearization algorithm for DPD(Digital PreDistorter) is suggested. This new algorithm uses DFP(Davidon-Fletcher-Powell) method. This algorithm is more accurate than that of the existing algorithms, and this method renew the best-fit value in every routine with out setting the initial value of step-size. In modeling power amplifier, the memory polynomial model which can model the memory effect of the power amplifier is used. And the overall structure of linearizer is based on an indirect learning architecture. In order to verify for performance of proposed algorithm, we compared with LMS(Least Mean-Squares), RLS(Recursive Least squares) algorithm.

An Experimental Study on the Effect of Sinchim on Enhancing of memory in Rat with water maze (신침(神枕)이 치매유발백서의 학습을 통한 기억에 미치는 영향)

  • Kim, Dong-Hyeon;Jeung, Hee-Sang;Kim, Geun-Woo;Koo, Byung-Soo
    • Journal of Oriental Neuropsychiatry
    • /
    • v.19 no.1
    • /
    • pp.29-42
    • /
    • 2008
  • Objectives : This study was performed to examine the effect of Sinchim on enhancing of memory in rat with water maze. Methods : Experimental animals(white rat) were classfied into normal, control, and aroma sample group. Then, they were injected .{\beta}-amyloid into control and aroma sample group rat's brain about $5{\mu}l$ to injure its brain. After rat smelt Sinchim about 12days, I did water maze test and anatomized its hippocampus. Sections were cut coronally at 30 ${\mu}m$.(XI00) Results: 1. In acquisition test of water maze learning, .{\beta}-amyloid injured group took more time than normal group to reach the escape platform noticeably and through the session of trial, Sinchim aroma sample group shortened time than .l3-amyloid injured group after 6 days. 2. In the acetyltransferase(AchE) immunostained method, it was shown that Sinchim aroma sample recovered tbe syntbesis of ChAT(Choloneacetyltransferase). Conclusion: Smelling Sinchim would be useful for enhancing of memory.

  • PDF

Design and Implementation of Memory-Centric Computing System for Big Data Analysis

  • Jung, Byung-Kwon
    • Journal of the Korea Society of Computer and Information
    • /
    • v.27 no.7
    • /
    • pp.1-7
    • /
    • 2022
  • Recently, as the use of applications such as big data programs and machine learning programs that are driven while generating large amounts of data in the program itself becomes common, the existing main memory alone lacks memory, making it difficult to execute the program quickly. In particular, the need to derive results more quickly has emerged in a situation where it is necessary to analyze whether the entire sequence is genetically altered due to the outbreak of the coronavirus. As a result of measuring performance by applying large-capacity data to a computing system equipped with a self-developed memory pool MOCA host adapter instead of processing large-capacity data from an existing SSD, performance improved by 16% compared to the existing SSD system. In addition, in various other benchmark tests, IO performance was 92.8%, 80.6%, and 32.8% faster than SSD in computing systems equipped with memory pool MOCA host adapters such as SortSampleBam, ApplyBQSR, and GatherBamFiles by task of workflow. When analyzing large amounts of data, such as electrical dielectric pipeline analysis, it is judged that the measurement delay occurring at runtime can be reduced in the computing system equipped with the memory pool MOCA host adapter developed in this research.

Spatial Information Processing between Hippocampus and Prefrontal cortex: a Hypothesis Based on Anatomy and Physiology

  • Jung, Min-Whan
    • Animal cells and systems
    • /
    • v.2 no.1
    • /
    • pp.65-69
    • /
    • 1998
  • The hippocampus and prefrontal cortex are regarded as the highest-order association cortices. The hippocampus has been proposed to store "cognitive maps" of external environments, and the prefrontal cortex is known to be involved in the planning of behavior, among other functions. Considering the prominent functional roles played by these structures, it is not surprising to find direct monosynaptic projections from the hippocampus to the prefrontal cortex. Rhythmic stimulation of this projection patterned after the hippocampal EEG theta rhythm induced stable long-term potentiation of field potentials in the prefrontal cortex. Comparison of behavioral correlates of hippocampal and prefrontal cortical neurons during an a-arm radial maze, working memory task shows a striking contrast. Hippocampal neurons exhibit clear place-specific firing patterns, whereas prefrontal cortical neurons do not show spatial selectivity, but are correlated to different stages of the behavioral task. These data lead to the hypothesis that the role of hippocampal projection to the prefrontal cortex is not to impose spatial representations upon prefrontal activity, but to provide a mechanism for learning the spatial context in which particular behaviors are appropriate.propriate.

  • PDF

Development of an algorithm for solving correspondence problem in stereo vision (스테레오 비젼에서 대응문제 해결을 위한 알고리즘의 개발)

  • Im, Hyuck-Jin;Gweon, Dae-Gab
    • Journal of the Korean Society for Precision Engineering
    • /
    • v.10 no.1
    • /
    • pp.77-88
    • /
    • 1993
  • In this paper, we propose a stereo vision system to solve correspondence problem with large disparity and sudden change in environment which result from small distance between camera and working objects. First of all, a specific feature is divided by predfined elementary feature. And then these are combined to obtain coded data for solving correspondence problem. We use Neural Network to extract elementary features from specific feature and to have adaptability to noise and some change of the shape. Fourier transformation and Log-polar mapping are used for obtaining appropriate Neural Network input data which has a shift, scale, and rotation invariability. Finally, we use associative memory to obtain coded data of the specific feature from the combination of elementary features. In spite of specific feature with some variation in shapes, we could obtain satisfactory 3-dimensional data from corresponded codes.

  • PDF

Neuropsychological Approaches to Mathematical Learning Disabilities and Research on the Development of Diagnostic Test (신경심리학적 이론에 근거한 수학학습장애의 유형분류 및 심층진단검사의 개발을 위한 기초연구)

  • Kim, Yon-Mi
    • Education of Primary School Mathematics
    • /
    • v.14 no.3
    • /
    • pp.237-259
    • /
    • 2011
  • Mathematics learning disabilities is a specific learning disorder affecting the normal acquisition of arithmetic and spatial skills. Reported prevalence rates range from 5 to 10 percent and show high rates of comorbid disabilities, such as dyslexia and ADHD. In this study, the characteristics and the causes of this disorder has been examined. The core cause of mathematics learning disabilities is not clear yet: it can come from general cognitive problems, or disorder of innate intuitive number module could be the cause. Recently, researchers try to subdivide mathematics learning disabilities as (1) semantic/memory type, (2) procedural/skill type, (3) visuospatial type, and (4) reasoning type. Each subtype is related to specific brain areas subserving mathematical cognition. Based on these findings, the author has performed a basic research to develop grade specific diagnostic tests: number processing test and math word problems for lower grades and comprehensive math knowledge tests for the upper grades. The results should help teachers to find out prior knowledge, specific weaknesses of students, and plan personalized intervention program. The author suggest diagnostic tests are organized into 6 components. They are number sense, conceptual knowledge, arithmetic facts retrieval, procedural skills, mathematical reasoning/word problem solving, and visuospatial perception tests. This grouping will also help the examiner to figure out the processing time for each component.

Subjective Assessment of Urban Environmental Sounds with Time Lapse (시간경과에 따른 도시 환경음의 주관평가)

  • Min, Byeong-Cheol;Kang, Sang-Woo;Jeon, Ji-Hyeon;Kook, Chan
    • Proceedings of the Korean Society for Noise and Vibration Engineering Conference
    • /
    • 2007.05a
    • /
    • pp.523-526
    • /
    • 2007
  • Currently, there are various sounds in the urban surrounding environment such as natural, human, mechanical or sound, etc., and these urban environmental sounds remain in several memories according to magnitude, repetition, learning and experience of sounds. However, there are limitations in memorizing these environmental sounds, thus they are forgotten or reminded, or replaced with new ones from time to time. This study was attempted to look into the changes of the memory of noisiness annoyance and sharpness of the suggested sound sources with urban environmental sounds as time goes by and the order of memorization of the sound sources.

  • PDF