• 제목/요약/키워드: Agent economies

검색결과 5건 처리시간 0.014초

강화 학습에서의 탐색과 이용의 균형을 통한 범용적 온라인 Q-학습이 적용된 에이전트의 구현 (Implementation of the Agent using Universal On-line Q-learning by Balancing Exploration and Exploitation in Reinforcement Learning)

  • 박찬건;양성봉
    • 한국정보과학회논문지:소프트웨어및응용
    • /
    • 제30권7_8호
    • /
    • pp.672-680
    • /
    • 2003
  • shopbot이란 온라인상의 판매자로부터 상품에 대한 가격과 품질에 관한 정보를 자동적으로 수집함으로써 소비자의 만족을 최대화하는 소프트웨어 에이전트이다 이러한 shopbot에 대응해서 인터넷상의 판매자들은 그들에게 최대의 이익을 가져다 줄 수 있는 에이전트인 pricebot을 필요로 할 것이다. 본 논문에서는 pricebot의 가격결정 알고리즘으로 비 모델 강화 학습(model-free reinforcement learning) 방법중의 하나인 Q-학습(Q-learning)을 사용한다. Q-학습된 에이전트는 근시안적인 최적(myopically optimal 또는 myoptimal) 가격 결정 전략을 사용하는 에이전트에 비해 이익을 증가시키고 주기적 가격 전쟁(cyclic price war)을 감소시킬 수 있다. Q-학습 과정 중 Q-학습의 수렴을 위해 일련의 상태-행동(state-action)을 선택하는 것이 필요하다. 이러한 선택을 위해 균일 임의 선택방법 (Uniform Random Selection, URS)이 사용될 경우 최적 값의 수렴을 위해서 Q-테이블을 접근하는 회수가 크게 증가한다. 따라서 URS는 실 세계 환경에서의 범용적인 온라인 학습에는 부적절하다. 이와 같은 현상은 URS가 최적의 정책에 대한 이용(exploitation)의 불확실성을 반영하기 때문에 발생하게 된다. 이에 본 논문에서는 보조 마르코프 프로세스(auxiliary Markov process)와 원형 마르코프 프로세스(original Markov process)로 구성되는 혼합 비정적 정책 (Mixed Nonstationary Policy, MNP)을 제안한다. MNP가 적용된 Q-학습 에이전트는 original controlled process의 실행 시에 Q-학습에 의해 결정되는 stationary greedy 정책을 사용하여 학습함으로써 auxiliary Markov process와 original controlled process에 의해 평가 측정된 최적 정책에 대해 1의 확률로 exploitation이 이루어질 수 있도록 하여, URS에서 발생하는 최적 정책을 위한 exploitation의 불확실성의 문제를 해결하게 된다. 다양한 실험 결과 본 논문에서 제한한 방식이 URS 보다 평균적으로 약 2.6배 빠르게 최적 Q-값에 수렴하여 MNP가 적용된 Q-학습 에이전트가 범용적인 온라인 Q-학습이 가능함을 보였다.

Composting High Moisture Materials : Bio-Drying Livestock Manure in a Sequentially Fed Reactor

  • Lee, J.H.;Park, H.L.
    • 한국농업기계학회:학술대회논문집
    • /
    • 한국농업기계학회 1996년도 International Conference on Agricultural Machinery Engineering Proceedings
    • /
    • pp.701-710
    • /
    • 1996
  • Composting has gained rapid acceptance as a method of recyling relatively dry organic materials such as leaves and brush and , when alternative disposal costs are high, even moist materials such as grass clippings and dewatered sewage sludges. However, as moisture contents rise above 60% , the need for a dry bulking amendment increase the costs of composting , both by direct purchases of amendment and though increased reactor capacity and materials handling requirements. High moisture materials also present increased risks of anaerobic odor formation through reduced oxygen transport (Miller , 1991) . These costs and operational challengers often constrain the opportunities to compost high moisture materials such as agricultural manures. During the last several decades economies of scale in livestock production have been increasing livestock densities and creating manure management challenges throughout the world. This issue is particularly pressing in Korea, where livestock arms typically manage little or no cropland, and the nutrients and boichemical oxygen demand in manure pose a serious threat to water quality. Composting has recently become popular as a means of recycling manure into products for sale off the farm, but bulking amendments (usually sawdust) are expensive designed to minimize bulking agent requirements by using the energy liberated by decompostion. In this context the composting reactor is used as a biological dryer, allowing the repeated use of bulking amendment with several batches of manure.

  • PDF

베트남 닥락성의 커피 중개상인: 지역 경제 변화의 매개체로서 역할을 하는 커피가치 사슬의 주요 이해 관계자 (Coffee Middlemen in Dak Lak, Vietnam: A key stakeholder of coffee value chain as an intermediary of changes in local economies)

  • 이승철
    • 한국경제지리학회지
    • /
    • 제16권3호
    • /
    • pp.372-388
    • /
    • 2013
  • 일반적으로 커피 중개상인은 이윤을 극대화하기 위하여 농가의 커피 생산 통제, 불공정 커피 가격 지불, 일련의 부당 행위 등을 통하여 소규모 영세 커피 농가의 이윤을 착취하는 이른바 '코요테'로 인식되어 왔다. 그러나 베트남 커피 가치사슬 상에서 중개상인이 획득하는 실질적인 이윤은 과장되었으며, 심지어 부당하다고 볼 수 있다. 따라서 본 연구의 목적은 커피 농가, 중개상인, 수출가공업체들 간의 관계 및 연계 분석을 통하여 베트남 커피 가치사슬에서 커피중개상인의 역할과 의미를 재고찰하고자 하였다. 분석 결과, 베트남 커피 중개상인이 획득하는 이윤은 타 커피 관련 주체들과 비교하여 상대적으로 미미하였으며, 지역 커피 농가의 이윤을 착취하기 보다는 오히려 지역 경제 변화의 매개체로서 중요한 역할을 하고 있는 것으로 나타났다. 베트남 닥락 커피 중개상인은 농가에 구매자를 공급해줌으로써 지역 커피 농가의 글로벌 시장 접근성을 제고시켜 시장 촉진자로서의 역할을 하였다. 또한 글로벌 수출 가공업체의 수요에 조응하는 지속 가능한 커피 생산을 활성화하여 지속 가능한 커피 생산의 매개체로서 역할을 하였다.

  • PDF

광산용 숏크리트의 역학적 특성 및 내구성 평가 (Evalution for Mechanical Property and Durability of Miner's Shotcrete)

  • 남궁경;마상준;이겨레;윤경구
    • 한국산학기술학회논문지
    • /
    • 제16권2호
    • /
    • pp.1461-1468
    • /
    • 2015
  • 대규모 갱도의 보강을 위해 현재 일반적인 광산 지보재(록볼트 및 강지보재)가 대부분 적용되고 있으며, 일부에서는 현장타설 숏크리트로 연약지반 보강을 실시하고 있다. 그러나 광산 갱도 굴착 후 매번 숏크리트를 타설할 수는 없는 국내 광산 여건상 경제성 및 부지확보의 문제로 고정적인 현장 배치플랜트를 확보하지 못하고, 인근 레미콘 제조 공장에서 배합된 숏크리트 재료를 공급받아 시공하고 있다. 그러나 레미콘 제조 공장에서 운반되는 숏크리트는 이동 거리 및 시간에 따라 품질이 저하되고, 광산 시공 현장에 상주하는 전문 품질관리자의 부재로 시공 품질 관리에 어려움이 많은 실정이다. 따라서 본 논문에서는 혼화재료의 종류와 혼입률을 변수로 선정하여 숏크리트의 역학적 특성과 단기 내구성 평가를 위한 실내실험을 실시하였다.

일본 어류 양식업의 발전과정과 산지교체에 관한 연구 : 참돔양식업을 사례로 (A study on Development Process of Fish Aquaculture in Japan - Case by Seabream Aquaculture -)

  • 송정헌
    • 수산경영론집
    • /
    • 제34권2호
    • /
    • pp.75-90
    • /
    • 2003
  • When we think of fundamental problems of the aquaculture industry, there are several strict conditions, and consequently the aquaculture industry is forced to change. Fish aquaculture has a structural supply surplus in production, aggravation of fishing grounds, stagnant low price due to recent recession, and drastic change of distribution circumstances. It is requested for us to initiate discussion on such issue as “how fish aquaculture establishes its status in the coastal fishery\ulcorner, will fish aquaculture grow in the future\ulcorner, and if so “how it will be restructured\ulcorner” The above issues can be observed in the mariculture of yellow tail, sea scallop and eel. But there have not been studied concerning seabream even though the production is over 30% of the total production of fish aquaculture in resent and it occupied an important status in the fish aquaculture. The objectives of this study is to forecast the future movement of sea bream aquaculture. The first goal of the study is to contribute to managerial and economic studies on the aquaculture industry. The second goal is to identify the factors influencing the competition between production areas and to identify the mechanisms involved. This study will examine the competitive power in individual producing area, its behavior, and its compulsory factors based on case study. Producing areas will be categorized according to following parameters : distance to market and availability of transportation, natural environment, the time of formation of producing areas (leaderㆍfollower), major production items, scale of business and producing areas, degree of organization in production and sales. As a factor in shaping the production area of sea bream aquaculture, natural conditions especially the water temperature is very important. Sea bream shows more active feeding and faster growth in areas located where the water temperature does not go below 13∼14$^{\circ}C$ during the winter. Also fish aquaculture is constrained by the transporting distance. Aquacultured yellowtail is a mass-produced and a mass-distributed item. It is sold a unit of cage and transported by ship. On the other hand, sea bream is sold in small amount in markets and transported by truck; so, the transportation cost is higher than yellow tail. Aquacultured sea bream has different product characteristics due to transport distance. We need to study live fish and fresh fish markets separately. Live fish was the original product form of aquacultured sea bream. Transportation of live fish has more constraints than the transportation of fresh fish. Death rate and distance are highly correlated. In addition, loading capacity of live fish is less than fresh fish. In the case of a 10 ton truck, live fish can only be loaded up to 1.5 tons. But, fresh fish which can be placed in a box can be loaded up to 5 to 6 tons. Because of this characteristics, live fish requires closer location to consumption area than fresh fish. In the consumption markets, the size of fresh fish is mainly 0.8 to 2kg.Live fish usually goes through auction, and quality is graded. Main purchaser comes from many small-sized restaurants, so a relatively small farmer and distributer can sell it. Aquacultured sea bream has been transacted as a fresh fish in GMS ,since 1993 when the price plummeted. Economies of scale works in case of fresh fish. The characteristics of fresh fish is as follows : As a large scale demander, General Merchandise Stores are the main purchasers of sea bream and the size of the fish is around 1.3kg. It mainly goes through negotiation. Aquacultured sea bream has been established as a representative food in General Merchandise Stores. GMS require stable and mass supply, consistent size, and low price. And Distribution of fresh fish is undertook by the large scale distributers, which can satisfy requirements of GMS. The market share in Tokyo Central Wholesale Market shows Mie Pref. is dominating in live fish. And Ehime Pref. is dominating in fresh fish. Ehime Pref. showed remarkable growth in 1990s. At present, the dealings of live fish is decreasing. However, the dealings of fresh fish is increasing in Tokyo Central Wholesale Market. The price of live fish is decreasing more than one of fresh fish. Even though Ehime Pref. has an ideal natural environment for sea bream aquaculture, its entry into sea bream aquaculture was late, because it was located at a further distance to consumers than the competing producing areas. However, Ehime Pref. became the number one producing areas through the sales of fresh fish in the 1990s. The production volume is almost 3 times the production volume of Mie Pref. which is the number two production area. More conversion from yellow tail aquaculture to sea bream aquaculture is taking place in Ehime Pref., because Kagosima Pref. has a better natural environment for yellow tail aquaculture. Transportation is worse than Mie Pref., but this region as a far-flung producing area makes up by increasing the business scale. Ehime Pref. increases the market share for fresh fish by creating demand from GMS. Ehime Pref. has developed market strategies such as a quick return at a small profit, a stable and mass supply and standardization in size. Ehime Pref. increases the market power by the capital of a large scale commission agent. Secondly Mie Pref. is close to markets and composed of small scale farmers. Mie Pref. switched to sea bream aquaculture early, because of the price decrease in aquacultured yellou tail and natural environmental problems. Mie Pref. had not changed until 1993 when the price of the sea bream plummeted. Because it had better natural environment and transportation. Mie Pref. has a suitable water temperature range required for sea bream aquaculture. However, the price of live sea bream continued to decline due to excessive production and economic recession. As a consequence, small scale farmers are faced with a market price below the average production cost in 1993. In such kind of situation, the small-sized and inefficient manager in Mie Pref. was obliged to withdraw from sea bream aquaculture. Kumamoto Pref. is located further from market sites and has an unsuitable nature environmental condition required for sea bream aquaculture. Although Kumamoto Pref. is trying to convert to the puffer fish aquaculture which requires different rearing techniques, aquaculture technique for puffer fish is not established yet.

  • PDF