• Title/Summary/Keyword: Macro-Action

Search Result 41, Processing Time 0.029 seconds

A Method for Learning Macro-Actions for Virtual Characters Using Programming by Demonstration and Reinforcement Learning

  • Sung, Yun-Sick;Cho, Kyun-Geun
    • Journal of Information Processing Systems
    • /
    • v.8 no.3
    • /
    • pp.409-420
    • /
    • 2012
  • The decision-making by agents in games is commonly based on reinforcement learning. To improve the quality of agents, it is necessary to solve the problems of the time and state space that are required for learning. Such problems can be solved by Macro-Actions, which are defined and executed by a sequence of primitive actions. In this line of research, the learning time is reduced by cutting down the number of policy decisions by agents. Macro-Actions were originally defined as combinations of the same primitive actions. Based on studies that showed the generation of Macro-Actions by learning, Macro-Actions are now thought to consist of diverse kinds of primitive actions. However an enormous amount of learning time and state space are required to generate Macro-Actions. To resolve these issues, we can apply insights from studies on the learning of tasks through Programming by Demonstration (PbD) to generate Macro-Actions that reduce the learning time and state space. In this paper, we propose a method to define and execute Macro-Actions. Macro-Actions are learned from a human subject via PbD and a policy is learned by reinforcement learning. In an experiment, the proposed method was applied to a car simulation to verify the scalability of the proposed method. Data was collected from the driving control of a human subject, and then the Macro-Actions that are required for running a car were generated. Furthermore, the policy that is necessary for driving on a track was learned. The acquisition of Macro-Actions by PbD reduced the driving time by about 16% compared to the case in which Macro-Actions were directly defined by a human subject. In addition, the learning time was also reduced by a faster convergence of the optimum policies.

Modeling of Shear Mechanism of RC Deep Beams Incorporating Bond Action between Re-Bar and Concrete (주근의 부착작용에 기초하는 깊은보의 전단저항 기구의 모델화)

  • Kim, Kil-Hee
    • Journal of the Korea Concrete Institute
    • /
    • v.18 no.5 s.95
    • /
    • pp.639-648
    • /
    • 2006
  • A shear experiment of one-way monotonic loading was carried out with the shear span ratio as the main experimental variable for reinforced concrete beam. Using the finite element analysis as the experimental analysis tool and the analysis method to compute the shear resistance of small shear span ratio, a new macro-model composed of crooked main strut and sub strut is proposed in consideration of the effect of bond action between re-bar and concrete based on the experimental result. The experimental finding affirmed the validity of the proposed macro-model when the shear span ratio was at or below 0.75 and confirmed that the experimental result was the most consistent with the computed analysis result when the effective factor of concrete compressive strength was set at 0.75.

Lateral confining action of mortar-filled sleeve reinforcement splice

  • Kim, Hyong-Kee;Lee, Sang-Ho
    • Structural Engineering and Mechanics
    • /
    • v.41 no.3
    • /
    • pp.379-393
    • /
    • 2012
  • Of the various methods of splicing reinforcing bar in reinforced concrete structure, mortar-filled sleeve reinforcement splice offers diverse benefits, not only in terms of structural performance but also for the construction process. Consequently, after the mortar-filled sleeve splices have been developed in recent years, research and development on these splices has been actively carried out, in order to evaluate its macro structural performance, such as its strength and stiffness, with the aim of enabling this system to be applied to construction in the field as early as possible. However, to make a proper evaluation on the overall structural performance of the mortar-filled sleeve reinforcing bar splice, it is of critical importance to understand the lateral confining action of the sleeve, which is known to affect the bond strength between the embedded bar and mortar in the sleeve. Accordingly, in this study, an experiment of monotonic loading and cyclic loading was conducted with a full-sized mortar-filled sleeve splice attaching strain gauges on the sleeve surface with experimental variables such as development length of bar, etc. Based on the test results, the effect of the lateral confining action of the sleeve was analyzed and considered in terms of the bond strength between the bar and mortar in this splice.

Exploring Elementary Teacher's Challenges with the Perspective of Structure and Agency When Implementing Social Action-Oriented SSI Education Classes (사회적 실천지향 SSI 수업을 시행하면서 직면하는 초등 교사의 어려움 탐색 -구조와 행위주체성 관점에서-)

  • Lim, Sung-Eun;Kim, Jong-Uk;Kim, Chan-Jong
    • Journal of The Korean Association For Science Education
    • /
    • v.41 no.2
    • /
    • pp.115-131
    • /
    • 2021
  • As the global climate change emergency is escalating, the need for 'Social Action-Oriented SSI (SAO-SSI) on climate change topics' in science education that can change society through social activity is increasing. By employing sociocultural theory, this study explores the challenges of limiting teacher's agency in implementing SAO-SSI on climate change topics in science education. Data from participant observation for 46 lessons, in-depth interviews with participants, field notes, and teacher reflection notes were analyzed by the structure of into micro- (classrooms), meso- (school), and macro- (Korea society) level. At the micro-level, the teacher's new attempts of SAO-SSI on climate change topics class made it difficult for him to identify students' understanding of climate change, because they have a low sense of perception that climate change is also their problem. In addition, the teacher had difficulties leading students' into an engagement for social action because students were skeptical about the feasibility of planned social behavior by positioning themselves as children or had difficulty in understanding social action and sympathizing with its values. At the meso-level, a school culture that encourages the implementation of a curriculum similar to that of colleagues, it was difficult to implement one's own curriculum. And it was difficult to develop expertise without the support and communications with colleagues who revealed the burden of unfamiliar science topics of climate change. In addition, conflicts arose in the process of implementing out-of-school social actions with the principal's passive support. At the macro-level, the insufficient proper material resources for SAO-SSI on climate change topics class, and negative perceptions on the students' social action in the society were acting as constraints. We offer implications for what kind of structural support and efforts from various subjects in the educational community should be provided to implement SAO-SSI on climate change topics class in science education.

Effect of hybrid fibers on flexural performance of reinforced SCC symmetric inclination beams

  • Zhang, Cong;Li, Zhihua;Ding, Yining
    • Computers and Concrete
    • /
    • v.22 no.2
    • /
    • pp.209-220
    • /
    • 2018
  • In order to evaluate the effect of hybrid fibers on the flexural performance of tunnel segment at room temperature, twelve reinforced self-consolidating concrete (SCC) symmetric inclination beams containing steel fiber, macro polypropylene fiber, micro polypropylene fiber, and their hybridizations were studied under combined loading of flexure and axial compression. The results indicate that the addition of mono steel fiber and hybrid fibers can enhance the ultimate bearing capacity and cracking behavior of tested beams. These improvements can be further enhanced along with increasing the content of steel fiber and macro PP fiber, but reduced with the increase of the reinforcement ratio of beams. The hybrid effect of steel fiber and macro PP fiber was the most obvious. However, the addition of micro PP fibers led to a degradation to the flexural performance of reinforced beams at room temperature. Meanwhile, the hybrid use of steel fiber and micro polypropylene fiber didn't present an obvious improvement to SCC beams. Compared to micro polypropylene fiber, the macro polypropylene fiber plays a more prominent role on affecting the structural behavior of SCC beams. A calculation method for ultimate bearing capacity of flexural SCC symmetric inclination beams at room temperature by taking appropriate effect of hybrid fibers into consideration was proposed. The prediction results using the proposed model are compared with the experimental data in this study and other literature. The results indicate that the proposed model can estimate the ultimate bearing capacity of SCC symmetric inclination beams containing hybrid fibers subjected to combined action of flexure and axial compression at room temperature.

Influence of Salicylic Acid and Dimethylsulfoxide on Flowering in Lemna gibba $G_3$ (Lemna gibba $G_3$Salicylic Acid와 Dimethylsulfoxide의 영향)

  • 맹주선
    • Journal of Plant Biology
    • /
    • v.27 no.4
    • /
    • pp.215-222
    • /
    • 1984
  • The reversal effect of salicylic acid(SA) on inhibition of flowering in Lemna gibba $G_3$ grown on ${NH_4}^+$-free 1/2H medium under continuous light is modified by ${PO_4}^{2-}$- and $Ca^{2+}$ levels. Dimethylsulfoxide(DMSO) either depresses the SA effect in ${NH_4}^{1}$-free 1/2H medium or amplifies it in E medium. The dual action of DMSO determined by relative levels of macro and micronutrient components is discussed.

  • PDF

Using Action Occurrence Orders in Blog Post Ranking (블로그 포스트 랭킹을 위한 액션 발생의 순서 활용 방안)

  • Hwang, Won-Seok;Do, Young-Joo;Kim, Sang-Wook
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2010.04a
    • /
    • pp.866-867
    • /
    • 2010
  • 블로그 이용이 활성화됨에 따라 포스트 랭킹 알고리즘의 필요성이 증가하고 있다. 본 논문에서는 액션의 발생 순서를 이용하여 포스트에 랭킹을 부여하는 방법을 제안한다. 또한, 실제 블로그 데이터를 이용한 실험을 통하여 본 논문에서 제안하는 방법의 성능의 우수성을 보인다.

The Dynamics of Film Genre Box Office Success: Macro-Economic Conditions, Fashion Momentum, and Inter-Genre Competition (영화 장르 흥행의 동학: 거시경제, 유행의 동력, 장르 간 경쟁의 효과)

  • Dong-Il Jung;Yeseul Kim;Chaewon Ahn;Youngmin Park
    • The Journal of the Convergence on Culture Technology
    • /
    • v.9 no.2
    • /
    • pp.389-397
    • /
    • 2023
  • This study examines how macro-economic conditions, fashion momentum, and inter-genre competition affect movie genre's popularity, thus shaping fashion trends in the feature film market in Korea. Using panel data analysis of genre-specific audience sizes with 6 genre cateories and 132 monthly time points, we found that favorable economic conditions generate the fashion trend in the action/crime genre, while the deterioration of the economic conditions leads to the decline of action/crime genre. The finding implies that economic situations influence cultural consumers' psychological states, which in turn shape the fashion trend in certain direction. Furthermore, we found that the action/crime genre has a greater fashion momentum and its competitive power is stronger than other genres, suggesting that this genre has longer fashion cycle even if other genres rise to the top in their popularity. We argue that such enlengthened fahion cycle and competitive stength of the action/crime genre are associated with its breadth of niche width and audience loyalty. Scholarly and practical implications are discussed.

Study on mechanism of macro failure and micro fracture of local nearly horizontal stratum in super-large section and deep buried tunnel

  • Li, Shu-cai;Wang, Jian-hua;Chen, Wei-zhong;Li, Li-ping;Zhang, Qian-qing;He, Peng
    • Geomechanics and Engineering
    • /
    • v.11 no.2
    • /
    • pp.253-267
    • /
    • 2016
  • The stability of surrounding rock will be poor when the tunnel is excavated through nearly horizontal stratum. In this paper, the instability mechanism of local nearly horizontal stratum in super-large section and deep buried tunnel is revealed by the analysis of the macro failure and micro fracture. A structural model is proposed to explain the mechanics of surrounding rock collapse under the action of stress redistribution and shed light on the macroscopic analytical approach of the stability of surrounding rock. Then, some highly effective formulas applied in the tunnel engineering are developed according to the theory of mixed-mode micro fracture. And well-documented field case is made to demonstrate the effectiveness and accuracy of the proposed analytical methods of mixed-mode fracture. Meanwhile, in order to make the more accurate judgment about yield failure of rock mass, a series of comprehensive failure criteria are formed. In addition, the relationship between the nonlinear failure criterion and $K_I$ and $K_{II}$ of micro fracture is established to make the surrounding rock failure criterion more comprehensive and accurate. Further, the influence of the parameters related to the tension-shear mixed-mode fracture and compression-shear mixed-mode fracture on the propagation of rock crack is analyzed. Results show that ${\sigma}_3$ changes linearly with the change of ${\sigma}_1$. And the change rate is related to ${\beta}$, angle between the cracks and ${\sigma}_1$. The proposed simple analytical approach is economical and efficient, and suitable for the analysis of local nearly horizontal stratum in super-large section and deep buried tunnel.

Study on the Rural Village Planning and Design by Considering Regional Characteristics -Case Study on Haedam maul, Seorim-ri, Seo-myeon, Yangyang-gun- (지역 특성을 고려한 농촌마을계획에 관한 연구 -양양군 서면 서림리 해담마을을 사례로-)

  • Kim, Sang-Bum;Lee, Seung-Yeon;Kim, Eun-Ja;Lee, Seung-Joo;Lim, Chang-Su;Rhee, Sang-Young
    • Journal of Agricultural Extension & Community Development
    • /
    • v.17 no.1
    • /
    • pp.1-23
    • /
    • 2010
  • The purpose of this study is to verify and carry out action plan and issues on how local amenity can be revealed through rural village planning and design especially in the local resources such as nature, history, culture. Especially, this lead to macro view of the rural village plan i.e. related to rural identity and space planning via estimating the local resources. According to this study will plan of 4 phrase steps 1. Analyse nature, environment, human sociology environment, space etc., and comprehensive analysis 2. compare the results of estimation and find the planing factors after that set the planning process 3. plan and create to rural community i.e. considering harmony with space function, environmental circumstance, landscape etc, 4. suggest the rural community action plan by considering amenity attributes.