• Title/Summary/Keyword: Explicit context

Search Result 93, Processing Time 0.028 seconds

Cooperative Multi-agent Reinforcement Learning on Sparse Reward Battlefield Environment using QMIX and RND in Ray RLlib

  • Minkyoung Kim
    • Journal of the Korea Society of Computer and Information
    • /
    • v.29 no.1
    • /
    • pp.11-19
    • /
    • 2024
  • Multi-agent systems can be utilized in various real-world cooperative environments such as battlefield engagements and unmanned transport vehicles. In the context of battlefield engagements, where dense reward design faces challenges due to limited domain knowledge, it is crucial to consider situations that are learned through explicit sparse rewards. This paper explores the collaborative potential among allied agents in a battlefield scenario. Utilizing the Multi-Robot Warehouse Environment(RWARE) as a sparse reward environment, we define analogous problems and establish evaluation criteria. Constructing a learning environment with the QMIX algorithm from the reinforcement learning library Ray RLlib, we enhance the Agent Network of QMIX and integrate Random Network Distillation(RND). This enables the extraction of patterns and temporal features from partial observations of agents, confirming the potential for improving the acquisition of sparse reward experiences through intrinsic rewards.

Active Inferential Processing During Comprehension in Poor Readers (미숙 독자들에 있어 이해 도중의 능동적 추리의 처리)

  • Zoh Myeong-Han;Ahn Jeung-Chan
    • Korean Journal of Cognitive Science
    • /
    • v.17 no.2
    • /
    • pp.75-102
    • /
    • 2006
  • Three experiments were conducted using a verification task to examine good and poor readers' generation of causal inferences(with because sentences) and contrastive inferences(with although sentences). The unfamiliar, critical verification statement was either explicitly mentioned or was implied. In Experiment 1, both good and poor readers responded accurately to the critical statement, suggesting that both groups had the linguistic knowledge necessary to the required inferences. Differences were found, however, in the groups' verification latencies. Poor, but not good, readers responded faster to explicit than to implicit verification statements for both because and although sentences. In Experiment 2, poor readers were induced to generate causal inferences for the because experimental sentences by including fillers that were apparently counterfactual unless a causal inference was made. In Experiment 3, poor readers were induced to generate contrastive inferences for the although sentences by including fillers that could only be resolved by making a contrastive inference. Verification latencies for the critical statements showed that poor readers made causal inferences in Experiment 2 and contrastive inferences in Experiment 3 doting comprehension. These results were discussed in terms of context effect: Specific encoding operations performed on anomaly backgrounded in another passage would form part of the context that guides the ongoing activity in processing potentially relevant subsequent text.

  • PDF

Function of the Korean String Indexing System for the Subject Catalog (주제목록을 위한 한국용어열색인 시스템의 기능)

  • Yoon Kooho
    • Journal of the Korean Society for Library and Information Science
    • /
    • v.15
    • /
    • pp.225-266
    • /
    • 1988
  • Various theories and techniques for the subject catalog have been developed since Charles Ammi Cutter first tried to formulate rules for the construction of subject headings in 1876. However, they do not seem to be appropriate to Korean language because the syntax and semantics of Korean language are different from those of English and other European languages. This study therefore attempts to develop a new Korean subject indexing system, namely Korean String Indexing System(KOSIS), in order to increase the use of subject catalogs. For this purpose, advantages and disadvantages between the classed subject catalog nd the alphabetical subject catalog, which are typical subject ca-alogs in libraries, are investigated, and most of remarkable subject indexing systems, in particular the PRECIS developed by the British National Bibliography, are reviewed and analysed. KOSIS is a string indexing based on purely the syntax and semantics of Korean language, even though considerable principles of PRECIS are applied to it. The outlines of KOSIS are as follows: 1) KOSIS is based on the fundamentals of natural language and an ingenious conjunction of human indexing skills and computer capabilities. 2) KOSIS is. 3 string indexing based on the 'principle of context-dependency.' A string of terms organized accoding to his principle shows remarkable affinity with certain patterns of words in ordinary discourse. From that point onward, natural language rather than classificatory terms become the basic model for indexing schemes. 3) KOSIS uses 24 role operators. One or more operators should be allocated to the index string, which is organized manually by the indexer's intellectual work, in order to establish the most explicit syntactic relationship of index terms. 4) Traditionally, a single -line entry format is used in which a subject heading or index entry is presented as a single sequence of words, consisting of the entry terms, plus, in some cases, an extra qualifying term or phrase. But KOSIS employs a two-line entry format which contains three basic positions for the production of index entries. The 'lead' serves as the user's access point, the 'display' contains those terms which are themselves context dependent on the lead, 'qualifier' sets the lead term into its wider context. 5) Each of the KOSIS entries is co-extensive with the initial subject statement prepared by the indexer, since it displays all the subject specificities. Compound terms are always presented in their natural language order. Inverted headings are not produced in KOSIS. Consequently, the precision ratio of information retrieval can be increased. 6) KOSIS uses 5 relational codes for the system of references among semantically related terms. Semantically related terms are handled by a different set of routines, leading to the production of 'See' and 'See also' references. 7) KOSIS was riginally developed for a classified catalog system which requires a subject index, that is an index -which 'trans-lates' subject index, that is, an index which 'translates' subjects expressed in natural language into the appropriate classification numbers. However, KOSIS can also be us d for a dictionary catalog system. Accordingly, KOSIS strings can be manipulated to produce either appropriate subject indexes for a classified catalog system, or acceptable subject headings for a dictionary catalog system. 8) KOSIS is able to maintain a constistency of index entries and cross references by means of a routine identification of the established index strings and reference system. For this purpose, an individual Subject Indicator Number and Reference Indicator Number is allocated to each new index strings and new index terms, respectively. can produce all the index entries, cross references, and authority cards by means of either manual or mechanical methods. Thus, detailed algorithms for the machine-production of various outputs are provided for the institutions which can use computer facilities.

  • PDF

Learning Material Bookmarking Service based on Collective Intelligence (집단지성 기반 학습자료 북마킹 서비스 시스템)

  • Jang, Jincheul;Jung, Sukhwan;Lee, Seulki;Jung, Chihoon;Yoon, Wan Chul;Yi, Mun Yong
    • Journal of Intelligence and Information Systems
    • /
    • v.20 no.2
    • /
    • pp.179-192
    • /
    • 2014
  • Keeping in line with the recent changes in the information technology environment, the online learning environment that supports multiple users' participation such as MOOC (Massive Open Online Courses) has become important. One of the largest professional associations in Information Technology, IEEE Computer Society, announced that "Supporting New Learning Styles" is a crucial trend in 2014. Popular MOOC services, CourseRa and edX, have continued to build active learning environment with a large number of lectures accessible anywhere using smart devices, and have been used by an increasing number of users. In addition, collaborative web services (e.g., blogs and Wikipedia) also support the creation of various user-uploaded learning materials, resulting in a vast amount of new lectures and learning materials being created every day in the online space. However, it is difficult for an online educational system to keep a learner' motivation as learning occurs remotely, with limited capability to share knowledge among the learners. Thus, it is essential to understand which materials are needed for each learner and how to motivate learners to actively participate in online learning system. To overcome these issues, leveraging the constructivism theory and collective intelligence, we have developed a social bookmarking system called WeStudy, which supports learning material sharing among the users and provides personalized learning material recommendations. Constructivism theory argues that knowledge is being constructed while learners interact with the world. Collective intelligence can be separated into two types: (1) collaborative collective intelligence, which can be built on the basis of direct collaboration among the participants (e.g., Wikipedia), and (2) integrative collective intelligence, which produces new forms of knowledge by combining independent and distributed information through highly advanced technologies and algorithms (e.g., Google PageRank, Recommender systems). Recommender system, one of the examples of integrative collective intelligence, is to utilize online activities of the users and recommend what users may be interested in. Our system included both collaborative collective intelligence functions and integrative collective intelligence functions. We analyzed well-known Web services based on collective intelligence such as Wikipedia, Slideshare, and Videolectures to identify main design factors that support collective intelligence. Based on this analysis, in addition to sharing online resources through social bookmarking, we selected three essential functions for our system: 1) multimodal visualization of learning materials through two forms (e.g., list and graph), 2) personalized recommendation of learning materials, and 3) explicit designation of learners of their interest. After developing web-based WeStudy system, we conducted usability testing through the heuristic evaluation method that included seven heuristic indices: features and functionality, cognitive page, navigation, search and filtering, control and feedback, forms, context and text. We recruited 10 experts who majored in Human Computer Interaction and worked in the same field, and requested both quantitative and qualitative evaluation of the system. The evaluation results show that, relative to the other functions evaluated, the list/graph page produced higher scores on all indices except for contexts & text. In case of contexts & text, learning material page produced the best score, compared with the other functions. In general, the explicit designation of learners of their interests, one of the distinctive functions, received lower scores on all usability indices because of its unfamiliar functionality to the users. In summary, the evaluation results show that our system has achieved high usability with good performance with some minor issues, which need to be fully addressed before the public release of the system to large-scale users. The study findings provide practical guidelines for the design and development of various systems that utilize collective intelligence.

Changes of Corticotropin-Releasing Factor(CRF) and Neuropeptide Y(NPY) of Rats in Response to Footshock or Reexposure to Conditions Previously Paired with Footshock (족부전기충격이나 족부전기충격과 연합-학습된 조건자극에 재노출시 흰쥐뇌내 Corticotropin-Releasing Factor(CRF)와 Neuropeptide Y(NPY)의 변동에 관한 연구)

  • Shin, Kyung-Ho;Kim, Sung Jin;Lee, Kuem Ju;Shin, Seung Gun;Shin, You Chan;Lee, Min-Soo
    • Korean Journal of Biological Psychiatry
    • /
    • v.10 no.1
    • /
    • pp.62-69
    • /
    • 2003
  • Corticotropin-releasing factor(CRF) and neuropeptide Y(NPY) are known to play important roles in mediating stress responses and stress-related behavior. To elucidate the role of neuropeptides in response to the condition that had paired with traumatic event, we observed the changes of CRF and NPY by immunohistochemistry using a conditioned footshock paradigm. Male Sprague-Dawley rats were placed in a shuttle box and exposed to 20 pairings of a tone(< 70dB, 5sec) followed by a footshock(FS, 0.8mA, 1sec) over 60min. A second group was exposed to the tone-footshock pairings, returned to the homecage for 2days, and then reexposed to the test chamber and 20tones alone for 60min, prior to sacrifice. Control groups were : a) sacrificed without exposure to FS ; b) exposed to the tone-footshock pairings and then sacrificed two days later ; or c) exposed to the chamber and tones alone, returned to the homecage for 2days and then reexposed to the chamber and 20tones over 60min prior to sacrifice. CRF was increased in animals exposed to FS or the aversive condition(context and tone) that had paired to FS in bed nucleus of the stria terminalis (BNST) compared to the control. NPY was increased by FS in amygdala and PVN, but the condition previously associated with FS results in slight increase only in amygdala area. These results suggest that the BNST appears to be the mostly involved neural circuit in response to explicit cues previously paired with footshock. Moreover, this study raise the possibility that increased CRF peptide in the BNST in response to re-exposure to the aversive condition may underlie, in part, the experience of conditioned fear-related anxiety behavior.

  • PDF

A Comparative Study of Sea WaybilI and Electronic B/L in the International Contract of Carriage (국제운송계약상 해상화물운송장과 전자선하증권의 비교연구)

  • Kim, Eun-Joo
    • THE INTERNATIONAL COMMERCE & LAW REVIEW
    • /
    • v.51
    • /
    • pp.317-358
    • /
    • 2011
  • The purpose of this study aims to analyse the key differences of the sea waybill and electronic B/L in the international transport documents. Sea waybills look remarkably like ordinary bills of lading. Indeed, in two important ways, they are just like bills of lading: the front of the document will near a description of the quantity and apparent condition of the goods; and the back of the document provides evidence of the terms of the contract of carriage. They differ from bills of lading in that, far from indicating that the goods described are deliverable to the order of the shipper or of the consignee, they will make it explicit that the goods are deliverable only to the consignee. Again, different carries will do thai in a variety of ways. For example, the document may call itself non-negotiable, omitting the word order from the consignee box on the front of the document, and stating explicitly that the goods will be deliverable to the consignee or his authorised representative on proper proof of identity and authorisation. The Hague-Visby Rules and Hamburg Rules give no guidance as to any right to instruct the carrier in respect of goods while they are in transit. However, in applying Article 50 of the Rotterdam Rules, in particular when applying it in the context of seawaybills, straight bills of lading or ship's delivery orders, regard would need to be had to preserve the shipper's rights under any of those three documents even after the buyer of goods covered by them has acquired rights of its own. And, the right of control is defined at Article 1.12 of the Rotterdam Rules. The right to give instruction is further limited by the terms of Article 50.1 to three particular types of instruction in respect of the goods, relating broadly to the goods, their delivery en route, and the identity of the consignee. And, the CMI formulated the CMI Uniform Rules for Sea Waybills for voluntary incorporation into any contract of carriage covered by such a document. Recognising that neither the Hague nor the Hague-Visby Rules are applicable to sea waybills, the CMI Rules provide that a contract of carriage covered by a waybill shall be governed by whichever international or national law, if any, would have been compulsorily applicable if the contract had in fact been covered by a bill of lading or similar document of title.

  • PDF

Cities as Place for Climate Mitigation and Adaptation: A Case Study of Portland, Oregon, USA (기후완화와 적용의 장소로서의 도시 - 미국 오레건주 포트랜드시 사례연구 -)

  • Chang, Hee-Jun;House-Peters, Lily
    • Journal of the Korean Geographical Society
    • /
    • v.45 no.1
    • /
    • pp.49-74
    • /
    • 2010
  • Cities are major sources of greenhouse gas emissions but also suitable places for implementing proactive climate mitigation and adaptation strategies. Based on the interdisciplinary review of literature, we categorize the current discussion about urban climate mitigation and adaptation planning, policy and practices into four perspectives - sustainability science, global change science, multilevel governance, and structural engineering. While these four schools of thought have distinct perspectives rooted in different disciplinary lenses, our synthesis of the literature identifies several universal themes that are common to all of the perspectives in the context of combating threats posed by climate change. The Portland case study illustrates that a city can make changes to reduce greenhouse gas emissions and increase adaptive capacity to climate change impacts by implementing smart growth, devising local climate action plans that target emission reductions in various sectors, recognizing the interactions and influences of multiple scales of governance, and supporting the installation of various green infrastructures that contribute to green economy. Furthermore, a university can serve as a hub in this climate mitigation and adaptation arena by connecting various levels of community organizations in both public and private sectors, creating innovative research centers and spatially explicit green infrastructure, designing impact assessments and campus carbon inventories, and engaging students and the larger community through service learning.

Implications of Science Education as Interdisciplinary Education through the Cases of Scientists and Artists in the Modern Era: Focus on the Relationship Between Science and the Arts (근대 과학자와 예술가의 사례를 통해 살펴 본 융복합교육으로서의 과학교육: 과학과 예술을 중심으로)

  • Jho, Hunkoog
    • Journal of The Korean Association For Science Education
    • /
    • v.34 no.8
    • /
    • pp.755-765
    • /
    • 2014
  • The convergence and consilience in education (hereafter, interdisciplinary education) is receiving great attention from societies. This study aims to investigate the works of scientists and artists who have intended to combine science with the arts in the modern era, to take into account the socio-philosophical setbacks during the period, and to suggest pedagogical implications of science education as interdisciplinary education. The concept of interdisciplinary education stems from Plato's thought, idea, as a comprehensive and invariant truth. The renaissance, full of enrichment about scientific achievement, was based on Neo-Platonism pursuing holistic-synthetic approach. During the time, scientists presented in this study tried to find comprehensive principles and borrow useful method from the arts. In such a context, scientists not only made use of the arts for expression of scientific knowledge, but also drew conclusion by analogical reasoning between science and the arts. Artists, as well, relied upon anatomy and optics especially, to elaborate linear perspective and even developed their own scientific knowledge through personal experience. Hence, contemporary science education should encourage students to hold a holistic viewpoint about science and the arts, articulate explicit goals and outcomes as interdisciplinary education, implement meta-disciplinary instruction about science and the arts, and develop assessment framework for collaborative learning. There may be good examples for inter-disciplinary education as listed: illustrating scientific ideas through the arts and vice versa, organizing collaborative works and evaluations criteria for them, and stressing problem solving on a daily basis.

Performance-based wind design of tall buildings: concepts, frameworks, and opportunities

  • Bezabeh, Matiyas A.;Bitsuamlak, Girma T.;Tesfamariam, Solomon
    • Wind and Structures
    • /
    • v.31 no.2
    • /
    • pp.103-142
    • /
    • 2020
  • One of the next frontiers in structural wind engineering is the design of tall buildings using performance-based approaches. Currently, tall buildings are being designed using provisions in the building codes and standards to meet an acceptable level of public safety and serviceability. However, recent studies in wind and earthquake engineering have highlighted the conceptual and practical limitations of the code-oriented design methods. Performance-based wind design (PBWD) is the logical extension of the current wind design approaches to overcome these limitations. Towards the development of PBWD, in this paper, we systematically review the advances made in this field, highlight the research gaps, and provide a basis for future research. Initially, the anatomy of the Wind Loading Chain is presented, in which emphasis was given to the early works of Alan G. Davenport. Next, the current state of practice to design tall buildings for wind load is presented, and its limitations are highlighted. Following this, we critically review the state of development of PBWD. Our review on PBWD covers the existing design frameworks and studies conducted on the nonlinear response of structures under wind loads. Thereafter, to provide a basis for future research, the nonlinear response of simple yielding systems under long-duration turbulent wind loads is studied in two phases. The first phase investigates the issue of damage accumulation in conventional structural systems characterized by elastic-plastic, bilinear, pinching, degrading, and deteriorating hysteretic models. The second phase introduces methods to develop new performance objectives for PBWD based on joint peak and residual deformation demands. In this context, the utility of multi-variate demand modeling using copulas and kernel density estimation techniques is presented. This paper also presents joined fragility curves based on the results of incremental dynamic analysis. Subsequently, the efficiency of tuned mass dampers and self-centering systems in controlling the accumulation of damage in wind-excited structural systems are investigated. The role and the need for explicit modeling of uncertainties in PBWD are also discussed with a case study example. Lastly, two unified PBWD frameworks are proposed by adapting and revisiting the Wind Loading Chain. This paper concludes with a summary and a proposal for future research.

A Study on Community Counter-terrorism (지역사회 대테러활동에 관한 연구)

  • Jung, Woo-Il
    • Korean Security Journal
    • /
    • no.19
    • /
    • pp.187-205
    • /
    • 2009
  • In this study, Horgan(2005)'s argument highlights the centrality to any successful counter-terrorism strategy of understanding the social context in which terrorist ideologies take root. Counter-terrorism refers to the practices, tactics, techniques, and strategies that governments, militaries, police departments and corporations adopt in response to terrorist threats and/or acts, both real and imputed. Pickering et al.(2008) historically explained four counter-terrorism strategies as traditional counter-terrorism model, community intelligence model, belonging model, social cohesion model. It is thus proposed that counter-terrorism strategies are based in established networks within the community and proactively seeks to continually renew these relationships between the community and police. This approach must embrace an explicit recognition of multiculturalism and its political imperative and drive in a policing organization explicitly committed to social cohesion and human rights in both discourse and practice. We, therefore, suggests community tree counter-terrorism approaches, or community intelligence model, belonging model and social cohesion model to apply to counter-terrorism agencies in Korea. These models are on the basis of Pickering et al.'s counter-terrorism models, which by using community policing to boot socially cohesion police are better able to position themselves as mediators to negotiate settlements between the competing demands of different social groups.

  • PDF