• Title/Summary/Keyword: Q learning

Search Result 426, Processing Time 0.026 seconds

The Subjectivity Study on the 'Real Beauty' ('진정한 아름다움'에 대한 주관성 연구)

  • Park, Hee-Jung;Kim, Ju-Hee;Lee, Doh-Hee
    • The Journal of the Korea Contents Association
    • /
    • v.20 no.6
    • /
    • pp.590-597
    • /
    • 2020
  • The human desire for 'beauty' is with the long history of mankind. This study started with how people of the 21st century would think about such beauty. Using the Q methodology, which is a qualitative research method, the Q-statements for the people's real thoughts and perceptions are secured and typified. The survey was conducted on July 8 to July 31, 2019, and was classified into three types of survey analysis results. The results of the analysis are as follows. showed high standard scores of statements such as 'self-development effort', 'good human relations', and 'learning to learn', and named as 「Self-Development Type」. has a high distribution of statements such as 'Passion', 'Young energy' and 'Healthy flesh', and named as 「Passion Type」. showed high statements such as 'I', 'good human relationship', 'self-development effort', and named 「I'm Type」. In addition, this study emphasizes the usefulness of qualitative research as an exploratory study for understanding and future empirical studies.

A Localized Adaptive QoS Routing using TD(${\lambda}$) method (TD(${\lambda}$) 기법을 사용한 지역적이며 적응적인 QoS 라우팅 기법)

  • Han Jeong-Soo
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.30 no.5B
    • /
    • pp.304-309
    • /
    • 2005
  • In this paper, we propose a localized Adaptive QoS Routing using TD method and evaluate performance of various exploration methods when path is selected. Expecially, through extensive simulation, the proposed routing algorithm and exploration method using Exploration Bonus are shown to be effective in significantly reducing the overall blocking probability, when compared to the other path selection method(exploration method), because the proposed exploration method is more adaptive to network environments than others when path is selected.

A Study on Improvement of Childhood with the Body Concept (유아기 아동의 신체개념 향상에 관한 연구)

  • Lee Hyo-Jeong;Song Ju-Young
    • The Journal of Korean Physical Therapy
    • /
    • v.14 no.3
    • /
    • pp.334-344
    • /
    • 2002
  • This study was to investigate the effects of the sensory-motor training program childhood body concept and to investigate the difference between the control group and experimental group. Subjects of the study were compared with children whose age varied from three to four years old, where I.Q was over 100. The major things of this study was as follows, First, sensory-motor training program was effective with regards to body concept improvement among the three-, four-year-old children. Second, both the experimental group trained by sensory-motor program and the control group trained by cognitive-perceptual training program were revealed a meaningful performance. But, sensory-motor program offering subcognitive sensory body experiences yielded higher mean gains in scores than a cognitive-perceptual program. Sensory-motor learning is more effective than verbal learning is promoting body concept reflected in the ability to draw human figures.

  • PDF

Design and Implementation of Othello game Based on Reinforcement Learning (강화학습에 기반한 모델로 게임의 설계 및 구현)

  • Lee, Dong-Hun;Woo, Chong-Woo
    • Proceedings of the Korean Information Science Society Conference
    • /
    • 2005.11b
    • /
    • pp.778-780
    • /
    • 2005
  • 최근 인공지능의 기법을 도입한 게임에 관한 연구가 활발히 진행되고 있다. 특히 신경망의 역 전파 알고리즘을 적용한 게임은 구현이 용이하고 학습이 완료되면 비교적 실행이 빨라서 많은 연구가 진행되고 있지만 기본적인 학습시간이 길고 최적화에 관한 문제점이 존재하고 있다. 이러한 문제점을 개선하고자 본 논문에서는 기존의 역 전파 알고리즘과 강화학습의 Q-learning알고리즘을 모델로 게임에 적용하여 비교 분석 하였다. 실험은 단순한 min-max 알고리즘과 각각 대결하여 승수 와 승율을 중심으로 비교하였고 실험의 결과는 강화학습의 알고리즘이 역 전파 알고리즘에 비하여 비교적 우수한 결과를 제시하였다.

  • PDF

Strategies and measures for capacity building in rural development project (농촌개발사업 참여 주체의 역량 강화 방안)

  • Kim, Jeong-Seop;Kwon, In-Hye
    • Journal of Agricultural Extension & Community Development
    • /
    • v.17 no.3
    • /
    • pp.385-418
    • /
    • 2010
  • This study aimed to find the way to help participants build capacity in rural development projects, through some case studies and Q-methodology. Decentralization and diffusion of bottom-up approach in rural development projects are the main contextual factors in this study. With the ethos of bottom-up approach in rural development, the human and financial inputs for capacity building increased drastically in the area of rural development policy. Four types of capacity building methods were identified in this study; training, consulting, learning organization, and forum. Theses methods were used more at planning step than implementation step in rural development projects. The government's effort to strengthen leadership in rural areas should be continued. The existing government's training program for capacity building had better include more diverse clients. Actions for capacity building should be centered on the needs of the participants in fields. Especially, organizing learning units is very important. Governments' rural development policy should establish the proper process which can help local actors plan their projects with enough time span.

The Roles and Characteristics of R&D Investment in the IT Firms: IT Hardware Firms vs. IT Software Firms

  • Lee, Myunggun;Park, Jongpil;Park, Woojin
    • Asia pacific journal of information systems
    • /
    • v.25 no.1
    • /
    • pp.61-81
    • /
    • 2015
  • Investment in research and development (R&D) is critical in the information technology (IT) firms, where newer and better technology is a quintessential goal that directly affects innovation and competitive advantage. This study investigates how R&D investment influences firm performance and value, and how the effect of R&D investment differs between IT hardware and software firms. We also analyze the relationship between firm age and R&D investment in order to identify learning effects on continuous R&D investment. The empirical investigation in this study, based on longitudinal archival data from 2001 to 2010, found a significant effect of R&D investment on firm performance in IT firms. Further, this study demonstrates causal relationship between firm age, and verifies that learning effects are present in R&D investment. Moreover, the results are found to differ between IT hardware and IT software firms.

A Reinforcement learning-based for Multi-user Task Offloading and Resource Allocation in MEC

  • Xiang, Tiange;Joe, Inwhee
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2022.05a
    • /
    • pp.45-47
    • /
    • 2022
  • Mobile edge computing (MEC), which enables mobile terminals to offload computational tasks to a server located at the user's edge, is considered an effective way to reduce the heavy computational burden and achieve efficient computational offloading. In this paper, we study a multi-user MEC system in which multiple user devices (UEs) can offload computation to the MEC server via a wireless channel. To solve the resource allocation and task offloading problem, we take the total cost of latency and energy consumption of all UEs as our optimization objective. To minimize the total cost of the considered MEC system, we propose an DRL-based method to solve the resource allocation problem in wireless MEC. Specifically, we propose a Asynchronous Advantage Actor-Critic (A3C)-based scheme. Asynchronous Advantage Actor-Critic (A3C) is applied to this framework and compared with DQN, and Double Q-Learning simulation results show that this scheme significantly reduces the total cost compared to other resource allocation schemes

Edge Caching Based on Reinforcement Learning Considering Edge Coverage Overlap in Vehicle Environment (차량 환경에서 엣지 커버리지 오버랩을 고려한 강화학습 기반의 엣지 캐싱)

  • Choi, Yoonjeong;Lim, Yujin
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2022.05a
    • /
    • pp.110-113
    • /
    • 2022
  • 인터넷을 통해 주위 사물과 연결된 차량은 사용자에게 편리성을 제공하기 위해 다양한 콘텐츠를 요구하는데 클라우드로부터 가져오는 시간이 비교적 오래 걸리기 때문에 차량과 물리적으로 가까운 위치에 캐싱하는 기법들이 등장하고 있다. 본 논문에서는 기반 시설이 밀집하게 설치된 도시 환경에서 maximum distance separable(MDS) 코딩을 사용해 road side unit(RSU)에 캐싱하는 방법에 대해 연구하였다. RSU의 중복된 서비스 커버리지 지역을 고려하여 차량의 콘텐츠 요구에 대한 RSU hit ratio를 높이기 위해 deep Q-learning(DQN)를 사용하였다. 실험 결과 비교 알고리즘보다 hit raito 측면에서 더 높은 성능을 보이는 것을 증명하였다.

Migration with Load Balancing Based on Reinforcement Learning in Vehicular Edge Computing (차량 엣지 컴퓨팅에서 로드 밸런싱을 고려한 강화학습 기반의 마이그레이션)

  • Moon, Sungwon;Lim, Yujin
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2021.05a
    • /
    • pp.66-69
    • /
    • 2021
  • 최근 실시간 응답 및 처리에 민감한 서비스들이 급증하면서 멀티액세스 엣지 컴퓨팅(MEC)이 차세대 기술로 주목받고 있다. 사용자들의 잦은 이동성 때문에 MEC 서버들 사이에서의 마이그레이션은 중요한 문제로 다뤄진다. 본 논문에서는 이동성이 많은 차량 엣지 컴퓨팅 환경을 고려하였으며, 강화학습 기법인 Q-learning 을 사용하여 마이그레이션 여부 및 대상을 결정하는 기법을 제안하였다. 제안 기법의 목적은 지연 제약조건을 만족시키면서 차량 엣지 컴퓨팅 서버(VECS) 사이의 로드 밸런싱을 최적화하는 것이다. 제안 기법의 성능 비교를 통하여 다른 기법들보다 로드 밸런싱 측면에서 약 22-30%, 지연 제약조건 만족도 측면에서 약 20-31%로 더 좋은 성능을 보임을 확인하였다.

Deep Reinforcement Learning-Based Edge Caching in Heterogeneous Networks

  • Yoonjeong, Choi; Yujin, Lim
    • Journal of Information Processing Systems
    • /
    • v.18 no.6
    • /
    • pp.803-812
    • /
    • 2022
  • With the increasing number of mobile device users worldwide, utilizing mobile edge computing (MEC) devices close to users for content caching can reduce transmission latency than receiving content from a server or cloud. However, because MEC has limited storage capacity, it is necessary to determine the content types and sizes to be cached. In this study, we investigate a caching strategy that increases the hit ratio from small base stations (SBSs) for mobile users in a heterogeneous network consisting of one macro base station (MBS) and multiple SBSs. If there are several SBSs that users can access, the hit ratio can be improved by reducing duplicate content and increasing the diversity of content in SBSs. We propose a Deep Q-Network (DQN)-based caching strategy that considers time-varying content popularity and content redundancy in multiple SBSs. Content is stored in the SBS in a divided form using maximum distance separable (MDS) codes to enhance the diversity of the content. Experiments in various environments show that the proposed caching strategy outperforms the other methods in terms of hit ratio.