• Title/Summary/Keyword: uncertain environment

Search Result 325, Processing Time 0.033 seconds

Analysis of Reinforcement Learning Methods for BS Switching Operation (기지국 상태 조정을 위한 강화 학습 기법 분석)

  • Park, Hyebin;Lim, Yujin
    • Asia-pacific Journal of Multimedia Services Convergent with Art, Humanities, and Sociology
    • /
    • v.8 no.2
    • /
    • pp.351-358
    • /
    • 2018
  • Reinforcement learning is a machine learning method which aims to determine a policy to get optimal actions in dynamic and stochastic environments. But reinforcement learning has high computational complexity and needs a lot of time to get solution, so it is not easily applicable to uncertain and continuous environments. To tackle the complexity problem, AC (actor-critic) method is used and it separates an action-value function into a value function and an action decision policy. Also, in transfer learning method, the knowledge constructed in one environment is adapted to another environment, so it reduces the time to learn in a reinforcement learning method. In this paper, we present AC method and transfer learning method to solve the problem of a reinforcement learning method. Finally, we analyze the case study which a transfer learning method is used to solve BS(base station) switching problem in wireless access networks.

Data-driven Model Prediction of Harmful Cyanobacterial Blooms in the Nakdong River in Response to Increased Temperatures Under Climate Change Scenarios (기후변화 시나리오의 기온상승에 따른 낙동강 남세균 발생 예측을 위한 데이터 기반 모델 시뮬레이션)

  • Gayeon Jang;Minkyoung Jo;Jayun Kim;Sangjun Kim;Himchan Park;Joonhong Park
    • Journal of Korean Society on Water Environment
    • /
    • v.40 no.3
    • /
    • pp.121-129
    • /
    • 2024
  • Harmful cyanobacterial blooms (HCBs) are caused by the rapid proliferation of cyanobacteria and are believed to be exacerbated by climate change. However, the extent to which HCBs will be stimulated in the future due to increased temperature remains uncertain. This study aims to predict the future occurrence of cyanobacteria in the Nakdong River, which has the highest incidence of HCBs in South Korea, based on temperature rise scenarios. Representative Concentration Pathways (RCPs) were used as the basis for these scenarios. Data-driven model simulations were conducted, and out of the four machine learning techniques tested (multiple linear regression, support vector regressor, decision tree, and random forest), the random forest model was selected for its relatively high prediction accuracy. The random forest model was used to predict the occurrence of cyanobacteria. The results of boxplot and time-series analyses showed that under the worst-case scenario (RCP8.5 (2100)), where temperature increases significantly, cyanobacterial abundance across all study areas was greatly stimulated. The study also found that the frequencies of HCB occurrences exceeding certain thresholds (100,000 and 1,000,000 cells/mL) increased under both the best-case scenario (RCP2.6 (2050)) and worst-case scenario (RCP8.5 (2100)). These findings suggest that the frequency of HCB occurrences surpassing a certain threshold level can serve as a useful diagnostic indicator of vulnerability to temperature increases caused by climate change. Additionally, this study highlights that water bodies currently susceptible to HCBs are likely to become even more vulnerable with climate change compared to those that are currently less susceptible.

SOLVING BI-OBJECTIVE TRANSPORTATION PROBLEM UNDER NEUTROSOPHIC ENVIRONMENT

  • S. SANDHIYA;ANURADHA DHANAPAL
    • Journal of applied mathematics & informatics
    • /
    • v.42 no.4
    • /
    • pp.831-854
    • /
    • 2024
  • The transportation problem (TP) is one of the earliest and the most significant implementations of linear programming problem (LPP). It is a specific type of LPP that mostly works with logistics and it is connected to day-to-day activities in our everyday lives. Nowadays decision makers (DM's) aim to reduce the transporting expenses and simultaneously aim to reduce the transporting time of the distribution system so the bi-objective transportation problem (BOTP) is established in the research. In real life, the transportation parameters are naturally uncertain due to insufficient data, poor judgement and circumstances in the environment, etc. In view of this, neutrosophic bi-objective transportation problem (NBOTP) is introduced in this paper. By introducing single-valued trapezoidal neutrosophic numbers (SVTrNNs) to the co-efficient of the objective function, supply and demand constraints, the problem is formulated. The DM's aim is to determine the optimal compromise solution for NBOTP. The extended weighted possibility mean for single-valued trapezoidal neutrosophic numbers based on [40] is proposed to transform the single-valued trapezoidal neutrosophic BOTP (SVTrNBOTP) into its deterministic BOTP. The transformed deterministic BOTP is then solved using the dripping method [10]. Numerical examples are provided to illustrate the applicability, effectiveness and usefulness of the solution approach. A sensitivity analysis (SA) determines the sensitivity ranges for the objective functions of deterministic BOTP. Finally, the obtained optimal compromise solution from the proposed approach provides a better result as compared to the existing approaches and conclusions are discussed for future research.

Q-learning Using Influence Map (영향력 분포도를 이용한 Q-학습)

  • Sung Yun-Sick;Cho Kyung-Eun
    • Journal of Korea Multimedia Society
    • /
    • v.9 no.5
    • /
    • pp.649-657
    • /
    • 2006
  • Reinforcement Learning is a computational approach to learning whereby an agent take an action which maximize the total amount of reward it receives among possible actions within current state when interacting with a uncertain environment. Q-learning, one of the most active algorithm in Reinforcement Learning, is consist of rewards which is obtained when an agent take an action. But it has the problem with mapping real world to discrete states. When state spaces are very large, Q-learning suffers from time for learning. In constant, when the state space is reduced, many state spaces map to single state space. Because an agent only learns single action within many states, an agent takes an action monotonously. In this paper, to reduce time for learning and complement simple action, we propose the Q-learning using influence map(QIM). By using influence map and adjacent state space's learning result, an agent could choose proper action within uncertain state where an agent does not learn. When this paper compares simulation results of QIM and Q-learning, we show that QIM effects as same as Q-learning even thought QIM uses 4.6% of the Q-learning's state spaces. This is because QIM learns faster than Q-learning about 2.77 times and the state spaces which is needed to learn is reduced, so the occurred problem is complemented by the influence map.

  • PDF

Investigation of Stress-Inducing Factors and Occupational Stress Levels in General and Pediatric Dentists (일반 진료 치과의사와 소아 진료 치과의사의 스트레스 유발 요인과 직무 스트레스 정도에 대한 연구)

  • Seunghyun, Kim;Jaesik, Lee
    • Journal of the korean academy of Pediatric Dentistry
    • /
    • v.49 no.4
    • /
    • pp.481-496
    • /
    • 2022
  • The purpose of this study was to compare factors causing stress in pediatric and general dentists when treating pediatric patients and to evaluate their overall occupational stress level. A total of 191 dentists participated in the online survey, consisting of 66 pediatric dentists and 125 general dentists. The questionnaire was conducted using Google Form. Both groups were stressed due to poor cooperation of patient and caregiver, uncertain prognosis of treatment, and low cost of pediatric dental treatment. The pediatric dentists felt relatively high stress due to poor cooperation from caregivers and an uncertain prognosis of treatment (p < 0.05). Overall occupational stress was high in both groups in the order of patient, time, job environment, and income-related stress, and the degrees of pediatric dentists were lower than general dentists. Among the 3 sub-factors of occupational burnout, more than 98% of both groups showed burnout in "depersonalization", and more than 69% of both groups showed burnout in "emotional exhaustion". Both groups showed a low burnout rate in "reduced sense of accomplishment" and pediatric dentists showed a higher sense of accomplishment than general dentists (p < 0.05). This study showed that both groups were under high occupational stress due to various factors, and efforts were required to relieve stress.

Community Structure Analysis of Carpinus laxiflora Communities in Seoul (서울지역 서어나무림의 군집구조 분석)

  • Park, Byung-Chang;Oh, Choong-Hyeon;Cho, Chi-Woung
    • Korean Journal of Environment and Ecology
    • /
    • v.23 no.4
    • /
    • pp.333-345
    • /
    • 2009
  • Carpinus laxiflora communities are known as the climax forest community of the temperate zone of Korea. There are three Carpinus laxiflora communities in Seoul. The purpose of this research is to analyze the characteristics of Carpinus laxiflora communities of Seoul and supply basic data for establishing of a management plan. The research sites are Sahmyook University, Mountain Dobong and Jinkwandong. This study considers investigation and the analysis of communities structure, soil characteristics and the growth increment of trees. As the result of study, we could know that the growth increment of the Carpinus laxiflora trees of Seoul is decreasing recently because of soil acidification and so on. Also the vegetation disturbance is increasing because of naturalized plant. Oak wilt disease has appeared in the oak forest around Sahmyook University that is the largest Carpinus laxiflora communities area in Seoul. For that reason the open gap was appeared in forest, and the spread of naturalized plants has been increasing in the gap. Furthermore, the Carpinus laxiflora trees are affected by the Platypus koryoensis which is a kind of oak wilt disease. And so, Unless there is a specific management plan, the survival of Carpinus laxiflora communities are uncertain in Seoul. Therefore the management plan of Carpinus laxiflora communities is necessary such as precise investigation, annual monitoring, etc. For the conservation of the Carpinus laxiflora communities, it is necessary to establish the management plan of the biodiversity for Seoul area.

Knowledge-driven Dynamic Capability and Organizational Alignment: A Revelatory Historical Case

  • Kim, Gyeung-Min
    • Asia pacific journal of information systems
    • /
    • v.20 no.1
    • /
    • pp.33-56
    • /
    • 2010
  • The current business environment has been characterized as less munificent, highly uncertain and constantly evolving. In this environment, the company with dynamic capability is reported to be more successful than others in building competitive advantage. Dynamic capability focuses on the link between a dynamically changing environment, strategic agility, architectural reconfiguration, and value creation. Being characterized to be flexible and adaptive to market circumstance changes, an organization with dynamic capability is described to have high resource fluidity, which represents business process, resource allocation, human resource management and incentives that make business transformation faster and easier. Successful redeployment of the resources for dynamic adaptation requires organizational forms and reward systems to be well aligned with firm's technological infrastructures and business process. The alignment is considered to be an executive level commitment. Building dynamic capability is knowledge driven; relying on new knowledge to reconfigure firm's resources. Past studies established the link between the effective execution of a knowledge-focused strategy and relevant setting of architectural elements such as human resources, structure, process and information systems. They do not, however, describe in detail the underlying processes by which architectural elements are adjusted in coordinated manners to build knowledge-driven dynamic capability. In fact, understandings of these processes are one of the top issues in IT management. This study analyzed how a Korean corporation with a knowledge-focused strategy aligned its architectural elements to develop the dynamic capability and thus create value in the dynamically changing markets. When the Korean economy was in crisis, the company implemented a knowledge-focused strategy, restructured the organization's architecture by which human and knowledge resources are identified, structured, integrated and coordinated to identify and seize market opportunity. Specifically, the following architectural elements were reconfigured: human resource, decision rights, reward and evaluation systems, process, and IT infrastructure. As indicated by sales growth, the reconfiguration helped the company create value under an extremely turbulent environment. According to Ancona et al. (2001), depending on the types of lenses the organization uses, different types of architecture will emerge. For example, if an organization uses political lenses focusing on power, influence, and conflict. the architecture that leverage power and negotiate across multiple interest groups would emerge. Similarly, if an organization uses economic lenses focusing on the rational behavior of organizational actors making choices based on the costs and benefits of action, organizational architecture should be designed to motivate and provide incentives for the actors (Smith, 2001). Compared to this view, information processing perspectives consider architecture to be designed to maximize the capacity of information processing by the actors. Using knowledge lenses, the company studied in this research established architectural elements in a manner that allows the firm to effectively structure knowledge resources to form dynamic capability. This study is revelatory single case with a historic perspective. As a result of this study, a set of propositions and a framework are derived, which can be used for architectural alignment.

A Study on the Algorithms for One-way Transmission in IPv6 Environment (IPv6 환경에서의 일방향 통신 알고리즘에 대한 연구)

  • Koh, Keun Ho;Ahn, Seong Jin
    • Convergence Security Journal
    • /
    • v.17 no.5
    • /
    • pp.63-69
    • /
    • 2017
  • In the early 1990s, IETF(Internet Engineering TaskForce) had started the discussion on new address protocol that can modify and supplement various drawbacks of existing IPv4 address protocol with the introduction of CIDR(Classless Inter-Domain Routing) which is a temporary solution for IPv4 address depletion, NAT, private IP address. While various standards related to new address protocol has been proposed, the SIPP(Simple Internet Protocol Plus) was adopted among them because it is regarded as the most promising solution. And this protocol has been developed into current IPv6. The new concepts are introduced with modifying a lot of deficiencies in the exisitng IPv4 such as real-time data processing, performance on QoS, security and the efficiency of routing. Since many security threats in IPv6 environment still exist, the necessity of stable data communication environment has been brought up continuously. This paper deveopled one-way communication algorithm in IPv6 based on the high possibility of protecting the system from uncertain and potential risk factors if the data is transmitted in one way. After the analysis of existing IPv6 and ICMPv6, this paper suggests one-way communication algorithm as a solution for existing IPv6 and ICMPv6 environment.

The Analysis of Job Stress of Workers in the Architectural Design Firm After the Introduction of BIM (BIM 도입 후 설계사무소 실무자들의 직무스트레스 분석)

  • Seo, Hee-Chang;Oh, Jung-Keun;Kim, Jea-Jun
    • Korean Journal of Construction Engineering and Management
    • /
    • v.13 no.4
    • /
    • pp.120-131
    • /
    • 2012
  • Today, companies exist amid unlimited competition and uncertain adminstration environment, so hands-on workers are being exposed to various job requirements and stress due to this. Especially, employees in the design firm are physically difficult because of heavy working intensity unlike other industrial field, and because the process is interrelated unlike working of a five-day workday of the other industry, it is difficult to guarantee periodic holidays and vacation. In addition, recently, while BIM is introduced in the construction industry, various changes in the individual role as well as organizational dimension such as business environment and scope & role, etc. are required, so it is the actual situation that the category and factors of job stress due to this are being also changed. Accordingly, this research has grasped important and weak sectors according to characteristics such as career, position, gender, education and existence/nonexistence of BIM template, etc. by confirming a job stress level and inducing factors of hands-on workers at the design firm. This research has a meaning in constructing a business environment of a design firm that is a main participant of BIM-based projects that are expected to have high utilization in the future.

Evaluation Methods of Soil Resilience Related to Agricultural Environment (농업환경 분야에서 토양 리질리언스 분야별 평가 방법)

  • Kim, Min-Suk;Min, Hyun-Gi;Hyun, Seung-Hun;Kim, Jeong-Gyu
    • Ecology and Resilient Infrastructure
    • /
    • v.7 no.2
    • /
    • pp.97-113
    • /
    • 2020
  • Soil is the foundation of human life and the basis for food security. Considering this it is prioritized in the UN's Sustainable Development Goals (SDG). Therefore, research on soil resilience in the agricultural environment is crucial for sound and sustainable soil management, especially in highly uncertain and unpredictable conditions. Soil resilience is defined in different ways by several researchers; however, its definition typically includes the concepts of recovery and resistance to stress. The physical, chemical, and biological characteristics of soils that are used to assess the soil resilience, i.e., the response of soil to various types of stress are summarized in this study. In addition, various statistical processing techniques and quantification methods are summarized considering the wide spatial and temporal scope of soil resilience research. Several soil resilience studies typically conduct the following five steps: (1) soil and site selection (2) stress (independent variable) setting (3) soil characteristics and indicator (dependent variable) setting (4) performing various spatiotemporal scale experiments (5) statistical analysis. The previous and present studies present a general introduction of soil resilience, based on which, further practical research considering domestic agricultural environment should be conducted. The extensive range of soil resilience measurements will require collaboration between researchers in various fields.