• Journal of IKEEE
• /
• v.25 no.4
• /
• pp.644-649
• /
• 2021

Self-Imitation Learning is a simple off-policy actor-critic algorithm that makes an agent find an optimal policy by using past good experiences. In case that Self-Imitation Learning is combined with reinforcement learning algorithms that have actor-critic architecture, it shows performance improvement in various game environments. However, its applications are limited to reinforcement learning algorithms that have actor-critic architecture. In this paper, we propose a method of applying Self-Imitation Learning to Deep Q-Network which is a value-based deep reinforcement learning algorithm and train it in various game environments. We also show that Self-Imitation Learning can be applied to Deep Q-Network to improve the performance of Deep Q-Network by comparing the proposed algorithm and ordinary Deep Q-Network training results.

• Journal of the Korean Geographical Society
• /
• v.43 no.4
• /
• pp.526-543
• /
• 2008

Based on the social network analysis(SNA), this study examines the structural and spatial characteristics of the actor networks of the manufacturing industries for the elderly. In the field of economic geography, former researches on network have mainly focused on the network governance. However, this study focused on the social network analysis. Centrality indexes are used to analyze the topological structure of actor networks of firms and organizations. In order to investigate the spatial structure of actor networks, not only the regional distribution of actors but also the correlation between centrality index and distance are analyzed. Network matrixes among actors are transformed to network matrixes among regions using block modeling method to reveal the spatial characteristics of the actor networks. In spite of the importance of the Capital Region, networks in the non-Capital Region like Chungnam and Pusan were showed high network density. This suggested that some kinds of policy project operating in the non-Capital Region had the influence on this network in the initial stage of industry.

• Journal of The Korean Association For Science Education
• /
• v.42 no.3
• /
• pp.341-356
• /
• 2022

This study aims to derive the implications of actor-network theory in science education research. To this end, previous studies applying the actor-network theory were analyzed. The study results show that educational research using actor-network theory can be divided into three main approaches. First, ANT was used as an epistemological perspective to construct an educational method or perspective, Second, ANT was used as an ontological perspective to recognize non-human agency, Third, ANT was used as a methodology for educational research. Based on the results, the possibility of contributing to science education research is discussed. As a new theoretical point of view, we hope that actor-network theory will be meaningful in science education practice and empirical research.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.15 no.7
• /
• pp.893-898
• /
• 2005

Due to the merits that only a small amount of computation is needed for solutions and stochastic policies can be handled explicitly, the actor-critic algorithm, which is a class of reinforcement learning methods, has recently attracted a lot of interests in the area of artificial intelligence. The actor-critic network composes of tile actor network for selecting control inputs and the critic network for estimating value functions, and in its training stage, the actor and critic networks take the strategy, of changing their parameters adaptively in order to select excellent control inputs and yield accurate approximation for value functions as fast as possible. In this paper, we consider a new actor-critic algorithm employing an RLS(Recursive Least Square) method for critic learning, and policy gradients for actor learning. The applicability of the considered algorithm is illustrated with experiments on the two linked robot arm.

• Journal of Technology Innovation
• /
• v.23 no.3
• /
• pp.21-42
• /
• 2015

This paper shows the case of the evolution of Korean e-Government services in the theoretical lens of Actor-Network Theory and Structuration Theory. It presents how human actors (i.e. presidents and the central administrations) and non-human actors (i.e. law, standards, and relay systems) have established as the one network together, and how this network affects the evolution of Korean e-Government services. This case demonstrates in public sector can adopt not only Actor-Network Theory, but also Structuration Theory to explain both micro and macro contexts. The practical implications are given especially for the developing countries in pursuing the rapid development process of e-Government services.

• Journal of Information Processing Systems
• /
• v.13 no.5
• /
• pp.1229-1242
• /
• 2017

In this paper, an interference aware distributed multi-channel MAC (IDMMAC) protocol is proposed for wireless sensor and actor networks (WSANs). The WSAN consists of a huge number of sensors and ample amount of actors. Hence, in the IDMMAC protocol a lightweight channel selection mechanism is proposed to enhance the sensor's lifetime. The IDMMAC protocol divides the beacon interval into two phases (i.e., the ad-hoc traffic indication message (ATIM) window phase and data transmission phase). When a sensor wants to transmit event information to the actor, it negotiates the maximum packet reception ratio (PRR) and the capacity channel in the ATIM window with its 1-hop sensors. The channel negotiation takes place via a control channel. To improve the packet delivery ratio of the IDMMAC protocol, each actor selects a backup cluster head (BCH) from its cluster members. The BCH is elected based on its residual energy and node degree. The BCH selection phase takes place whenever an actor wants to perform actions in the event area or it leaves the cluster to help a neighbor actor. Furthermore, an interference and throughput aware multi-channel MAC protocol is also proposed for actor-actor coordination. An actor selects a minimum interference and maximum throughput channel among the available channels to communicate with the destination actor. The performance of the proposed IDMMAC protocol is analyzed using standard network parameters, such as packet delivery ratio, end-to-end delay, and energy dissipation, in the network. The obtained simulation results indicate that the IDMMAC protocol performs well compared to the existing MAC protocols.

• Journal of the Korea Society of Computer and Information
• /
• v.19 no.8
• /
• pp.63-71
• /
• 2014

This paper proposes an algorithm that forms the clusters on the basis of hop distance in order to improve the actor coverage and connectivity in the sink-based wireless sensor and actor networks. The proposed algorithm forms the clusters that are distributed evenly in the target area by electing the CHs(Cluster Heads) at regular hop intervals from a sink. The CHs are elected sequentially from the sink in order to ensure the connectivity between the sink and the actors that are located on the CHs. Additionally, the electing are achieved from the area of the higher rate of the sensors density in order to improve the actor coverage. The number of clusters that are created in the target area and the number of the actors that are placed on the positions of the CHs are reduced by forming the clusters with regular distribution and minimizing the overlap of them through the proposed algorithm. Simulations are performed to verify that the proposed algorithm constructs the actor network that is connected to the sink. Moreover, we shows that the proposed algorithm improves the actor coverage and, therefore, reduces the amount of the actors that will be deployed in the region by 9~20% compared to the IDSC algorithm.

• The Korean Journal of Applied Statistics
• /
• v.36 no.1
• /
• pp.1-19
• /
• 2023

The purpose of this study was to find out what attributes are valid for the edge between students through longitudinal network analysis, and the results of TERGM (temporal exponential random graph model) and SAOM (stochastic actor-oriented model) statistical models were compared. The TERGM model interprets the research results based on the edge formation of the entire network, and the SAOM model interprets the research results on the surrounding networks formed by specific actors. The TERGM model expressed the influence of a previous time through a time term, and the SAOM model considered temporal dependence by implementing a network that evolves by an actor's opportunity as a ratio function.

• Informatization Policy
• /
• v.17 no.4
• /
• pp.23-43
• /
• 2010

Informatization in Korea has undergone significant changes. So far, most studies on informatization policies have been carried out just on the basis of their structural or functional backgrounds. However, actually, informatization policies have changed dynamically as a lot number of people and organizations have participated in their formulation and implementation. So, this study approaches them with an actor-network view that is distinct from but contains a chronological perspective, which other studies have overlooked so far. This approach allows us to have a clear picture of the changes in and to look into the characteristic of informatization policies from the Chun Doo Hwan government to the Lee Myung-bak government. Consequently, on the basis of the actor-network view, it is found that information and communication technologies, knowledge, and professionalism have dominated the characteristics and streams of informatization policies and brought about changes.

• Journal of Korean Society of Rural Planning
• /
• v.13 no.1 s.34
• /
• pp.97-109
• /
• 2007

The purpose of this research was to investigate and analyse how Community Forest Initiatives as urban fringe management initiatives made alliances with a variety of interest groups, enrol them in the urban fringe management processes using the Actor Network Theory. The Thames Chase Community Forest Initiative was selected and its area of operation included a $97 km^2$ area of green-belt area in East London. It was a instrument far improving and protecting the unique characteristics of the countryside landscape from urban developments as well as evaluating the impact of forestry inclusion in land use planning in the urban fringe. It was operated through a tiered structure comprising the Thames Chase Joint Committee and the management team. They employed a variety of devices to speak with one voice to bring about an effective operation process and to secure the enrolment of a variety of interest groups in its operational processes. Of note, the initiative's actor network impacted on improvement to and management of the countryside landscape despite not owning any land itself. As a result, when urban fringe management initiatives will be launched in South Korea to achieve a more effective and efficient urban fringe management, local councillors and representatives from public and non-government bodies should be more responsive to local communities' views and needs and work more vigorously on their behalf through lobbying, seeking media support, and so on. Moreover, better understanding and communication between local authorities' officers and management initiatives' teams are essential to avoid duplication of work practice.