• 제목/요약/키워드: reward time

검색결과 168건 처리시간 0.023초

PGA: An Efficient Adaptive Traffic Signal Timing Optimization Scheme Using Actor-Critic Reinforcement Learning Algorithm

  • Shen, Si;Shen, Guojiang;Shen, Yang;Liu, Duanyang;Yang, Xi;Kong, Xiangjie
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • 제14권11호
    • /
    • pp.4268-4289
    • /
    • 2020
  • Advanced traffic signal timing method plays very important role in reducing road congestion and air pollution. Reinforcement learning is considered as superior approach to build traffic light timing scheme by many recent studies. It fulfills real adaptive control by the means of taking real-time traffic information as state, and adjusting traffic light scheme as action. However, existing works behave inefficient in complex intersections and they are lack of feasibility because most of them adopt traffic light scheme whose phase sequence is flexible. To address these issues, a novel adaptive traffic signal timing scheme is proposed. It's based on actor-critic reinforcement learning algorithm, and advanced techniques proximal policy optimization and generalized advantage estimation are integrated. In particular, a new kind of reward function and a simplified form of state representation are carefully defined, and they facilitate to improve the learning efficiency and reduce the computational complexity, respectively. Meanwhile, a fixed phase sequence signal scheme is derived, and constraint on the variations of successive phase durations is introduced, which enhances its feasibility and robustness in field applications. The proposed scheme is verified through field-data-based experiments in both medium and high traffic density scenarios. Simulation results exhibit remarkable improvement in traffic performance as well as the learning efficiency comparing with the existing reinforcement learning-based methods such as 3DQN and DDQN.

암호화폐 가격 예측을 위한 딥러닝 앙상블 모델링 : Deep 4-LSTM Ensemble Model (Development of Deep Learning Ensemble Modeling for Cryptocurrency Price Prediction : Deep 4-LSTM Ensemble Model)

  • 최수빈;신동훈;윤상혁;김희웅
    • 한국IT서비스학회지
    • /
    • 제19권6호
    • /
    • pp.131-144
    • /
    • 2020
  • As the blockchain technology attracts attention, interest in cryptocurrency that is received as a reward is also increasing. Currently, investments and transactions are continuing with the expectation and increasing value of cryptocurrency. Accordingly, prediction for cryptocurrency price has been attempted through artificial intelligence technology and social sentiment analysis. The purpose of this paper is to develop a deep learning ensemble model for predicting the price fluctuations and one-day lag price of cryptocurrency based on the design science research method. This paper intends to perform predictive modeling on Ethereum among cryptocurrencies to make predictions more efficiently and accurately than existing models. Therefore, it collects data for five years related to Ethereum price and performs pre-processing through customized functions. In the model development stage, four LSTM models, which are efficient for time series data processing, are utilized to build an ensemble model with the optimal combination of hyperparameters found in the experimental process. Then, based on the performance evaluation scale, the superiority of the model is evaluated through comparison with other deep learning models. The results of this paper have a practical contribution that can be used as a model that shows high performance and predictive rate for cryptocurrency price prediction and price fluctuations. Besides, it shows academic contribution in that it improves the quality of research by following scientific design research procedures that solve scientific problems and create and evaluate new and innovative products in the field of information systems.

Differentially Expressed Genes in Period 2-Overexpressing Mice Striatum May Underlie Their Lower Sensitivity to Methamphetamine Addiction-Like Behavior

  • Sayson, Leandro Val;Kim, Mikyung;Jeon, Se Jin;Custodio, Raly James Perez;Lee, Hyun Jun;Ortiz, Darlene Mae;Cheong, Jae Hoon;Kim, Hee Jin
    • Biomolecules & Therapeutics
    • /
    • 제30권3호
    • /
    • pp.238-245
    • /
    • 2022
  • Previous reports have demonstrated that genetic mechanisms greatly mediate responses to drugs of abuse, including methamphetamine (METH). The circadian gene Period 2 (Per2) has been previously associated with differential responses towards METH in mice. While the behavioral consequences of eliminating Per2 have been illustrated previously, Per2 overexpression has not yet been comprehensively described; although, Per2-overexpressing (Per2 OE) mice previously showed reduced sensitivity towards METH-induced addiction-like behaviors. To further elucidate this distinct behavior of Per2 OE mice to METH, we identified possible candidate biomarkers by determining striatal differentially expressed genes (DEGs) in both drug-naïve and METH-treated Per2 OE mice relative to wild-type (WT), through RNA sequencing. Of the several DEGs in drug naïve Per2 OE mice, we identified six genes that were altered after repeated METH treatment in WT mice, but not in Per2 OE mice. These results, validated by quantitative real-time polymerase chain reaction, could suggest that the identified DEGs might underlie the previously reported weaker METH-induced responses of Per2 OE mice compared to WT. Gene network analysis also revealed that Asic3, Hba-a1, and Rnf17 are possibly associated with Per2 through physical interactions and predicted correlations, and might potentially participate in addiction. Inhibiting the functional protein of Asic3 prior to METH administration resulted in the partial reduction of METH-induced conditioned place preference in WT mice, supporting a possible involvement of Asic3 in METH-induced reward. Although encouraging further investigations, our findings suggest that these DEGs, including Asic3, may play significant roles in the lower sensitivity of Per2 OE mice to METH.

국민안전을 위한 민간 방재조직에 대한 소방관들의 인식 연구 (A Study on the Recognition of Fire-fighters on Korean Civil Anti-Disaster Organization for Public Safety)

  • 채종식;이시영
    • 한국엔터테인먼트산업학회논문지
    • /
    • 제15권2호
    • /
    • pp.137-148
    • /
    • 2021
  • 본 연구는 사회재난 대응 업무에 종사하고 있는 소방관들을 대상으로 지역자율방재단의 전문성에 관한 인식도를 조사해 우리나라 지역자율방재단의 방재활동 전반에 대한 현실적인 문제점을 도출하고 개선방안을 모색하고자 하였다. 주요 연구 결과는 다음과 같다. 첫째, 지역자율방재단의 새로운 인적 자원 관리제도와 적극적인 홍보 실시 둘째, 재정적인 지원과 보상제도의 개선이 필요 셋째, 지역자율방재단에 도움이 되는 맞춤식 교육과 훈련이 필요하다. 본 연구 결과는 향후 우리나라 지역자율방재단의 발전을 위한 기초 자료로 활용되기를 기대한다.

Hakeem: An Arabic Application Aimed to Teaching Children First Aid using Augmented Reality

  • Al-ajlan, Monirah;Altukhays, Wujud;Alyousef, Deema;Almansour, Aljawharah;Alsukayt, Layan;Alajlan, Halah
    • International Journal of Computer Science & Network Security
    • /
    • 제22권5호
    • /
    • pp.368-374
    • /
    • 2022
  • Children are by nature curious and enthusiastic about learning and love to explore and search for everything they see around them, but as a result of this exploration they may sometimes be exposed to dangerous situations ranging from falls to poisoning and suffocation. That is why when supporting a child's natural desire to explore the world and supporting his awareness of dangerous situations and good handling of them, helps him build a conscious scientific mind and enhance his curiosity in the natural world. It is not easy to imagine a difficult situation in which we or one of our family is in danger, unable to help ourselves or to help them in time, due to our complete ignorance of the rules of first aid. Hence the importance of learning first aid not only for the child but for the community and the world at large. "Hakeem" is an Arabic E-health educational application that aims to teach children from the age of six to eleven years first aid, in our belief that the seed of renaissance lies in the care and education of children, and the lack of Arabic content that aims to teach children first aid skills. The idea is to create a scenario in which the child is responsible for saving the person who will be in a dangerous situation using Augmented Reality (AR) technology, to increase engagement and interaction and provides a rich user experience, and according to the child's performance, he will get reward points. The game will have several levels: Beginner, Intermediate, and Hakeem, and based on the player's points he will get a title and move to the next level, and when he reaches the end, he will get the certificate.

GRU 기반 단축 URL 판별 기법을 적용한 하이브리드 피싱 사이트 탐지 시스템 (Hybrid phishing site detection system with GRU-based shortened URL determination technique)

  • 김해수;김미희
    • 전기전자학회논문지
    • /
    • 제27권3호
    • /
    • pp.213-219
    • /
    • 2023
  • 경찰청 통계자료에 따르면 코로나19 이후 문자 또는 메신저를 이용한 스미싱(Smishing) 범죄가 급증하였다. 또한 정부 기관에 접수된 공공기관 사칭 건수의 대부분이 백신접종 및 보상 관련하여 가짜 URL(Uniform Resource Locator)을 클릭하도록 유도하는 수법이 다수 사용되었다. 주로 URL의 정보를 숨긴 단축 URL을 사용하며 탐지할 때 URL 기반 탐지방법은 URL의 정보를 숨기면 제대로 탐지할 수 없고, 콘텐츠 기반 탐지 방법은 탐지 속도가 느리고 많은 자원을 사용한다. 이에 본 논문에서는 GRU(Gated Recurrent Units)를 이용한 단축 URL을 판별하는 과정을 통해 일반 URL일 때 transformer를 통한 URL 기반 탐지, 단축 URL일때 XGBoost를 이용한 콘텐츠 기반 탐지하는 시스템을 제안한다. 제안한 탐지 시스템의 F1-Score는 94.86이었고, 처리시간은 평균 5.4초가 소요되었다.

표적의 이동을 고려한 강화학습 기반 무인항공기의 소노부이 최적 배치 (Optimal deployment of sonobuoy for unmanned aerial vehicles using reinforcement learning considering the target movement)

  • 배근영;강주환;홍정표
    • 한국음향학회지
    • /
    • 제43권2호
    • /
    • pp.214-224
    • /
    • 2024
  • 소노부이는 수중에서 음파를 활용하여 정보 수집을 수행하는 장치로, 엔진 소음이나 다양한 음향 특성을 감지하여 수중 표적을 정확하게 탐지하는 대잠전에 효과적인 탐지체계이다. 다중상태 시스템에서의 기존 소노부이 배치 방식은 고정된 패턴이나 휴리스틱 기반의 규칙에 의존하므로, 예측하기 힘든 수중 표적의 기동으로 인해 소노부이 투하 개수 및 작전 소요 시간 측면에서 효율적인 배치를 보장하지는 못한다. 본 논문에서는 기존 소노부이 배치 방식의 한계를 극복하기 위해, 수중 표적의 이동을 고려한 시뮬레이션 기반의 실험 환경에서 강화학습을 이용한 무인항공기의 소노부이 최적 배치를 제안한다. 제안한 방법은 Unity ML-Agents를 통해 Proximal Policy Optimization(PPO) 알고리즘을 이용하여 가상 작전환경과 실시간 상호작용하며 무인항공기를 학습한다. 소노부이 투하 개수 및 음원 및 수신기 간의 비용을 고려한 보상 함수를 설계하여 효과적인 학습이 가능하게 한다. 동일한 실험 환경에서 강화학습을 적용한 배치 방식과 기존 소노부이 배치 방식을 비교한 결과, 탐지 성공률, 투하된 소노부이 개수, 작전 소요 시간 측면에서 강화학습을 적용한 배치 방식이 가장 우수한 성능을 보였다.

노인자원봉사자의 봉사활동 헌신과 생활만족에 관한 연구 - 활동이론을 중심으로 - (An Empirical Study of Elderly Volunteering Commitment and Their Life Satisfaction Based on Activity Theory)

  • 김미혜;정진경
    • 한국사회복지학
    • /
    • 제54권
    • /
    • pp.221-243
    • /
    • 2003
  • 활동이론은 노년기 역할상실 혹은 감소에 따른 대체적 역할로서 새로운 사회활동에 참여하게 되어 노년기의 생활만족감을 증진시킬 수 있다는 이론이다. 본 연구는 이와 같은 활동이론을 기초로 노인의 자원봉사활동이 노년기 역할감소에 따른 대체적 역할로서 노인의 생활만족감에 영양을 미치는지를 분석하고자 했다. 연구대상은 서울시내 23개 자원봉사센터를 통해 활동하고 있는 55세 이상 노인자원봉사자 192명이다. 활동이론은 직업유무, 가구형태, 봉사활동 성취내용으로 조작좌하였으며, 분석결과, 직업유무는 활동빈도와 활동시간에, 봉사활동 성취내용 중 사회적 성취는 지속기간에만 영향을 미쳤으며, 가구형태는 어떠한 영향도 미치지 못했다. 또한 지속기간이나 활동빈도, 활동시간 등 자원봉사에 대한 헌신은 노인의 생활만족도에 어떠한 영향도 미치지 못했다. 오히려 노인의 자원봉사활동 참여는 활동이론 변수 이외에 봉사활동에 대한 보상, 건강상태, 교육수준, 성별에 의해 설명될 수 있었으며, 노인자원봉사자의 생활만족도에는 동거가족형태나 경제수준이 중요한 영향을 미치고 있었다. 이와 같은 분석결과는 활동이론만으로 우리나라 노인의 자원봉사활동을 전적으로 설명할 수 없음을 의미한다. 또한 노인들에게 있어 자원봉사활동은 시간의 투입보다는 봉사활동을 통한 성취감과 이들 활동에 대한 지지 혹은 관심 등의 질적인 측면이 더 중요할 수 있음을 시사한다고 하겠다. 본 연구는 우리나라 노인 자원봉사 분야에 있어 활동이론을 기초로 한 최초의 실증연구라는 점에서 중요한 의의를 갖고 있다고 할 수 있다.

  • PDF

고객중심의 CRM 구축비교 사례연구 (Customer-Centric CRM Implementation Case Study)

  • 이호섭
    • 경영과정보연구
    • /
    • 제23권
    • /
    • pp.25-40
    • /
    • 2007
  • In the highly competitive and divers world of financial market, customer is the single most important factor to company's survival. Especially, creating a relationship with valued customers is a key to success. CRM provides the mean to retain high value customers. It takes a prospect of what customers expect. Utilizing those knowledge can help the products and service meet the customers' needs, thereby maximizing customer satisfaction and company's profit. In this report, I am going to suggest a few ways to develop successful CRM in the life insurance industry. First, CRM should innovate the way of communication to keep pace with Web 2.0 era. In other words, the customer's needs should be caught by real-time communication than traditional off-line market research. Thus, the functionality and specification of products can be decided by customer's direct choice so that the customers are able to purchase the understanding and experience of the products. Second, CRM project should consider whether the initial strategy plan can promise the stable growth of customer at the first step. When planning strategy, the project needs to identify what customer wants and how to fulfill the needs with stable growth of the customer. In addition, the CRM should be developed by realizing that customer centric benefits ultimately guarantee the growth of the organization. Third, CRM systems should enhance the organization's ability to take the customer's insight in a 360 degree view and to capture the voice of the customer directly. In order to develop the best matched product package, more precise customer segmentation should be ahead of market segmentation strategy. Forth, the biggest reward from CRM will be a customer royalty program. Many successful banks are already planning and practicing customer royalty strategy. A comprehensive analysis of customers and their behavior allow organization to identify high value potential customers' needs and determine a strategy required to meet those needs. Even life insurance companies such as Prudential Korea are developing products designed for royal customers. Fifth, understanding and managing the experience of customer called Customer Experience Management also can increase customer satisfaction. Measuring only customers' experience and adapting it to marketing strategy make products position in the gap between the customers' expectation and experience not required by market. A key component of CEM is its application across all organizational functions. At last, the direction of change and development of CRM can be defined from the conceptualization of information technology represented by Ubiquitous and Web 2.0. Instead of just managing customer information, companies should take the initiative in personalized system with customer oriented strategy. Furthermore, with the regular communication between CRM stakeholders (Sales-Marketing-IT), customer's demand should be directly reflected to enterprise strategy in real time.

  • PDF

자기통제의 개념 분석 (The Concept Analysis of Self-Control)

  • 은영;이인숙;이경숙;송경자;최은옥;서순림;양영희;박영임;구미옥;김성재;김인자;이은남;박송자;이동숙;이은옥
    • 대한간호학회지
    • /
    • 제29권4호
    • /
    • pp.951-962
    • /
    • 1999
  • Today human needs for health promotion and maintenance are increasing. The nursing profession as a great responsibility to develop the knowledge for helping clients to practice good health behavior under self-control. But there are few studies about the concept of self-control, or the operational definition of self-control. The purpose of this study was to analyze and clarify the meaning of the concept of self-control. This study used Walker and Avant's process of concept analysis. Antecedents of self control consist of 1) perception of the conflict situation to change his or her behavior ; 2) perception of self as the causes of the barrier for a certain behavior ; 3) internal standard or belief such as self-efficacy and learned resourcefulness ; 4) internal motivation for change of behavior. Critical attributes of self-control were 1) goal-orientation ; 2) self-decision ; 3) time sequence ; 4) effort ; 5) possibility of being learned ; 6) individuality ; 7) social desirability. Consequences occurring as a results of self-control consist of 1) achievement of the controlled behavior whose purposes were planned ; 2) enhancement of the internal standard such as self-efficacy and learned resourcefulness ; 3) eventual elevation of physical and emotional wellness. Therefore, this concept is defined as a cognitive behavior which is attempted by his or her decision when one is confronted with the conflict situation, which is characterized by being changed by time, learned by effort and individual characteristics. One is taking such behavior with the perception of self as the causative barrier for a certain behavior, planning a specific objective for a certain behavior which demands self sacrifice, supplies the internal reward, is socially desirable with the internal standard of self-efficacy and learned resourcefulness and environmental factors.

  • PDF