• Title/Summary/Keyword: Agent economies

Search Result 5, Processing Time 0.021 seconds

Implementation of the Agent using Universal On-line Q-learning by Balancing Exploration and Exploitation in Reinforcement Learning (강화 학습에서의 탐색과 이용의 균형을 통한 범용적 온라인 Q-학습이 적용된 에이전트의 구현)

  • 박찬건;양성봉
    • Journal of KIISE:Software and Applications
    • /
    • v.30 no.7_8
    • /
    • pp.672-680
    • /
    • 2003
  • A shopbot is a software agent whose goal is to maximize buyer´s satisfaction through automatically gathering the price and quality information of goods as well as the services from on-line sellers. In the response to shopbots´ activities, sellers on the Internet need the agents called pricebots that can help them maximize their own profits. In this paper we adopts Q-learning, one of the model-free reinforcement learning methods as a price-setting algorithm of pricebots. A Q-learned agent increases profitability and eliminates the cyclic price wars when compared with the agents using the myoptimal (myopically optimal) pricing strategy Q-teaming needs to select a sequence of state-action fairs for the convergence of Q-teaming. When the uniform random method in selecting state-action pairs is used, the number of accesses to the Q-tables to obtain the optimal Q-values is quite large. Therefore, it is not appropriate for universal on-line learning in a real world environment. This phenomenon occurs because the uniform random selection reflects the uncertainty of exploitation for the optimal policy. In this paper, we propose a Mixed Nonstationary Policy (MNP), which consists of both the auxiliary Markov process and the original Markov process. MNP tries to keep balance of exploration and exploitation in reinforcement learning. Our experiment results show that the Q-learning agent using MNP converges to the optimal Q-values about 2.6 time faster than the uniform random selection on the average.

Composting High Moisture Materials : Bio-Drying Livestock Manure in a Sequentially Fed Reactor

  • Lee, J.H.;Park, H.L.
    • Proceedings of the Korean Society for Agricultural Machinery Conference
    • /
    • 1996.06c
    • /
    • pp.701-710
    • /
    • 1996
  • Composting has gained rapid acceptance as a method of recyling relatively dry organic materials such as leaves and brush and , when alternative disposal costs are high, even moist materials such as grass clippings and dewatered sewage sludges. However, as moisture contents rise above 60% , the need for a dry bulking amendment increase the costs of composting , both by direct purchases of amendment and though increased reactor capacity and materials handling requirements. High moisture materials also present increased risks of anaerobic odor formation through reduced oxygen transport (Miller , 1991) . These costs and operational challengers often constrain the opportunities to compost high moisture materials such as agricultural manures. During the last several decades economies of scale in livestock production have been increasing livestock densities and creating manure management challenges throughout the world. This issue is particularly pressing in Korea, where livestock arms typically manage little or no cropland, and the nutrients and boichemical oxygen demand in manure pose a serious threat to water quality. Composting has recently become popular as a means of recycling manure into products for sale off the farm, but bulking amendments (usually sawdust) are expensive designed to minimize bulking agent requirements by using the energy liberated by decompostion. In this context the composting reactor is used as a biological dryer, allowing the repeated use of bulking amendment with several batches of manure.

  • PDF

Coffee Middlemen in Dak Lak, Vietnam: A key stakeholder of coffee value chain as an intermediary of changes in local economies (베트남 닥락성의 커피 중개상인: 지역 경제 변화의 매개체로서 역할을 하는 커피가치 사슬의 주요 이해 관계자)

  • Lee, Sung-Cheol
    • Journal of the Economic Geographical Society of Korea
    • /
    • v.16 no.3
    • /
    • pp.372-388
    • /
    • 2013
  • A series of coffee middlemen has come to be regarded as an exploitative force in the lives of small and poor coffee farmers, which is called 'coyote', controlling production, paying unfair prices for labor and goods, and participating in fraudulent practices to maximize their own profits. However, the reality of gains captured by coffee middlemen in the value chain might be exaggerated and even unfair. Therefore, the main aim of this paper is to reconsider the implication of coffee middlemen for the development of coffee value chain in Vietnam. It also attempts to identify their characteristics by investigating relations among coffee farmers, middlemen and processing/exporting firms. In terms of middlemen's margin in the coffee sub-sector, their margin is quite small when compared to other actors higher in the value chain. Rather, coffee middlemen in Vietnam have played a critical role as an intermediary of change in local economies. More specifically, coffee middlemen in Dak Lak has played a significant role as a market facilitator by stimulating the access of farmers to markets by providing buyers for farmers thanks to changes in institutional environment. Also, they have played a critical role as an agent of sustainable coffee production by encouraging sustainable coffee production in accordance with the demand of processing and exporting firms.

  • PDF

Evalution for Mechanical Property and Durability of Miner's Shotcrete (광산용 숏크리트의 역학적 특성 및 내구성 평가)

  • Nam-Gung, Kyeong;Ma, Sang-Joon;Lee, Kyeo-Re;Yun, Kyong-Ku
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.16 no.2
    • /
    • pp.1461-1468
    • /
    • 2015
  • Mostly mine support(Rock bolt and Support) which is currently general for reinforcements of a large scale tunnel is applied, Some executing a reinforcement to Poor ground by cast-in-place shotcrete. However On domestic mine conditions that couldn't having every time after mine tunnel excavation, it couldn't ensure the field batch plant which is a fixed in an issue of economies and site security, constructing it by supply gets from shotcrete materials combined in neighborhood ready mixed concrete manufacturing plants. carried shotcrete in ready mixed concrete manufacturing plants as migration length and time are falling off in quality. But, it is difficult for construction quality control By quality control arbitrariness absence at on-scene. In the present study, carry out Laboratory Test by kinds and percentages of accelerating agent for evalution of Mechanical Property and Durability of Shotcrete.

A study on Development Process of Fish Aquaculture in Japan - Case by Seabream Aquaculture - (일본 어류 양식업의 발전과정과 산지교체에 관한 연구 : 참돔양식업을 사례로)

  • 송정헌
    • The Journal of Fisheries Business Administration
    • /
    • v.34 no.2
    • /
    • pp.75-90
    • /
    • 2003
  • When we think of fundamental problems of the aquaculture industry, there are several strict conditions, and consequently the aquaculture industry is forced to change. Fish aquaculture has a structural supply surplus in production, aggravation of fishing grounds, stagnant low price due to recent recession, and drastic change of distribution circumstances. It is requested for us to initiate discussion on such issue as “how fish aquaculture establishes its status in the coastal fishery\ulcorner, will fish aquaculture grow in the future\ulcorner, and if so “how it will be restructured\ulcorner” The above issues can be observed in the mariculture of yellow tail, sea scallop and eel. But there have not been studied concerning seabream even though the production is over 30% of the total production of fish aquaculture in resent and it occupied an important status in the fish aquaculture. The objectives of this study is to forecast the future movement of sea bream aquaculture. The first goal of the study is to contribute to managerial and economic studies on the aquaculture industry. The second goal is to identify the factors influencing the competition between production areas and to identify the mechanisms involved. This study will examine the competitive power in individual producing area, its behavior, and its compulsory factors based on case study. Producing areas will be categorized according to following parameters : distance to market and availability of transportation, natural environment, the time of formation of producing areas (leaderㆍfollower), major production items, scale of business and producing areas, degree of organization in production and sales. As a factor in shaping the production area of sea bream aquaculture, natural conditions especially the water temperature is very important. Sea bream shows more active feeding and faster growth in areas located where the water temperature does not go below 13∼14$^{\circ}C$ during the winter. Also fish aquaculture is constrained by the transporting distance. Aquacultured yellowtail is a mass-produced and a mass-distributed item. It is sold a unit of cage and transported by ship. On the other hand, sea bream is sold in small amount in markets and transported by truck; so, the transportation cost is higher than yellow tail. Aquacultured sea bream has different product characteristics due to transport distance. We need to study live fish and fresh fish markets separately. Live fish was the original product form of aquacultured sea bream. Transportation of live fish has more constraints than the transportation of fresh fish. Death rate and distance are highly correlated. In addition, loading capacity of live fish is less than fresh fish. In the case of a 10 ton truck, live fish can only be loaded up to 1.5 tons. But, fresh fish which can be placed in a box can be loaded up to 5 to 6 tons. Because of this characteristics, live fish requires closer location to consumption area than fresh fish. In the consumption markets, the size of fresh fish is mainly 0.8 to 2kg.Live fish usually goes through auction, and quality is graded. Main purchaser comes from many small-sized restaurants, so a relatively small farmer and distributer can sell it. Aquacultured sea bream has been transacted as a fresh fish in GMS ,since 1993 when the price plummeted. Economies of scale works in case of fresh fish. The characteristics of fresh fish is as follows : As a large scale demander, General Merchandise Stores are the main purchasers of sea bream and the size of the fish is around 1.3kg. It mainly goes through negotiation. Aquacultured sea bream has been established as a representative food in General Merchandise Stores. GMS require stable and mass supply, consistent size, and low price. And Distribution of fresh fish is undertook by the large scale distributers, which can satisfy requirements of GMS. The market share in Tokyo Central Wholesale Market shows Mie Pref. is dominating in live fish. And Ehime Pref. is dominating in fresh fish. Ehime Pref. showed remarkable growth in 1990s. At present, the dealings of live fish is decreasing. However, the dealings of fresh fish is increasing in Tokyo Central Wholesale Market. The price of live fish is decreasing more than one of fresh fish. Even though Ehime Pref. has an ideal natural environment for sea bream aquaculture, its entry into sea bream aquaculture was late, because it was located at a further distance to consumers than the competing producing areas. However, Ehime Pref. became the number one producing areas through the sales of fresh fish in the 1990s. The production volume is almost 3 times the production volume of Mie Pref. which is the number two production area. More conversion from yellow tail aquaculture to sea bream aquaculture is taking place in Ehime Pref., because Kagosima Pref. has a better natural environment for yellow tail aquaculture. Transportation is worse than Mie Pref., but this region as a far-flung producing area makes up by increasing the business scale. Ehime Pref. increases the market share for fresh fish by creating demand from GMS. Ehime Pref. has developed market strategies such as a quick return at a small profit, a stable and mass supply and standardization in size. Ehime Pref. increases the market power by the capital of a large scale commission agent. Secondly Mie Pref. is close to markets and composed of small scale farmers. Mie Pref. switched to sea bream aquaculture early, because of the price decrease in aquacultured yellou tail and natural environmental problems. Mie Pref. had not changed until 1993 when the price of the sea bream plummeted. Because it had better natural environment and transportation. Mie Pref. has a suitable water temperature range required for sea bream aquaculture. However, the price of live sea bream continued to decline due to excessive production and economic recession. As a consequence, small scale farmers are faced with a market price below the average production cost in 1993. In such kind of situation, the small-sized and inefficient manager in Mie Pref. was obliged to withdraw from sea bream aquaculture. Kumamoto Pref. is located further from market sites and has an unsuitable nature environmental condition required for sea bream aquaculture. Although Kumamoto Pref. is trying to convert to the puffer fish aquaculture which requires different rearing techniques, aquaculture technique for puffer fish is not established yet.

  • PDF