• Title/Summary/Keyword: Markov Games

Search Result 15, Processing Time 0.018 seconds

Paradox in collective history-dependent Parrondo games (집단 과거 의존 파론도 게임의 역설)

  • Lee, Ji-Yeon
    • Journal of the Korean Data and Information Science Society
    • /
    • v.22 no.4
    • /
    • pp.631-641
    • /
    • 2011
  • We consider a history-dependent Parrondo game in which the winning probability of the present trial depends on the results of the last two trials in the past. When a fraction of an infinite number of players are allowed to choose between two fair Parrondo games at each turn, we compare the blind strategy such as a random sequence of choices with the short-range optimization strategy. In this paper, we show that the random sequence of choices yields a steady increase of average profit. However, if we choose the game that gives the higher expected profit at each turn, surprisingly we are not supposed to get a long-run positive profit for some parameter values.

Implementation of Markov Model for Duplication Processor (이중화 프로세서에 대한 마코프 모델의 구현)

  • Goo, Jung-Du
    • Proceedings of the KAIS Fall Conference
    • /
    • 2010.05a
    • /
    • pp.330-332
    • /
    • 2010
  • 이동통신시스템에서 Warm standby sharing에 비하여 Hot standby sharing은 데이터 손실이 없고 오류 데이터가 확산되지 않는 등의 다수의 장점을 갖지만 동기화 문제로 인하여 이를 시스템에 실제로 구현하는 것은 어렵다. 따라서 본 연구에서는 Hot standby sharing에 비하여 기존의 Warm standby sharing이 갖는 동기화의 장점에 데이터 손실 및 거짓 데이터의 확산 문제를 개선할 수 있는 이중화 프로세서에 대한 마코프 모델을 설계하고자 한다.

  • PDF

A Study on Modeling of Fighter Pilots Using a dPCA-HMM (dPCA-HMM을 이용한 전투기 조종사 모델링 연구)

  • Choi, Yerim;Jeon, Sungwook;Park, Jonghun;Shin, Dongmin
    • Journal of the Korean Society for Aeronautical & Space Sciences
    • /
    • v.43 no.1
    • /
    • pp.23-32
    • /
    • 2015
  • Modeling of fighter pilots, which is a fundamental technology for war games using defense M&S (Modeling & Simulation) becomes one of the prominent research issues as the importance of defense M&S increases. Especially, the recent accumulation of combat logs makes it possible to adopt statistical learning methods to pilot modeling, and an HMM (Hidden Markov Model) which is able to utilize the sequential characteristic of combat logs is suitable for the modeling. However, since an HMM works only by using one type of features, discrete or continuous, to apply an HMM to heterogeneous features, type integration is required. Therefore, we propose a dPCA-HMM method, where dPCA (Discrete Principal Component Analysis) is combined with an HMM for the type integration. From experiments conducted on combat logs acquired from a simulator furnished by agency for defense development, the performance of the proposed model is evaluated and was satisfactory.

Stock investment with a redistribution model of the history-dependent Parrondo game (과거의존 파론도 게임의 재분배 모형을 이용한 주식 투자)

  • Jin, Geonjoo;Lee, Jiyeon
    • Journal of the Korean Data and Information Science Society
    • /
    • v.26 no.4
    • /
    • pp.781-790
    • /
    • 2015
  • The Parrondo paradox is the counter-intuitive phenomenon: when we combine two losing games we can win the game or when we combine two winning games we can lose the game. In this paper, we assume that an investor adopts the rule of the history-dependent Parrondo game for investment in the stock market. Using the KRX (Korea Exchange) data from 2012 to 2014, we found the Parrondo paradox in the stock trading: the redistribution of profits among accounts can turn the decrease of the expected cumulative profit into the increase of the expected cumulative profit. We also found that the opposite case, namely the reverse Parrondo effect, can happen in the stock trading.

Depth Images-based Human Detection, Tracking and Activity Recognition Using Spatiotemporal Features and Modified HMM

  • Kamal, Shaharyar;Jalal, Ahmad;Kim, Daijin
    • Journal of Electrical Engineering and Technology
    • /
    • v.11 no.6
    • /
    • pp.1857-1862
    • /
    • 2016
  • Human activity recognition using depth information is an emerging and challenging technology in computer vision due to its considerable attention by many practical applications such as smart home/office system, personal health care and 3D video games. This paper presents a novel framework of 3D human body detection, tracking and recognition from depth video sequences using spatiotemporal features and modified HMM. To detect human silhouette, raw depth data is examined to extract human silhouette by considering spatial continuity and constraints of human motion information. While, frame differentiation is used to track human movements. Features extraction mechanism consists of spatial depth shape features and temporal joints features are used to improve classification performance. Both of these features are fused together to recognize different activities using the modified hidden Markov model (M-HMM). The proposed approach is evaluated on two challenging depth video datasets. Moreover, our system has significant abilities to handle subject's body parts rotation and body parts missing which provide major contributions in human activity recognition.