• Title/Summary/Keyword: Process-control agent

Search Result 258, Processing Time 0.029 seconds

Cooperative Multi-Agent Reinforcement Learning-Based Behavior Control of Grid Sortation Systems in Smart Factory (스마트 팩토리에서 그리드 분류 시스템의 협력적 다중 에이전트 강화 학습 기반 행동 제어)

  • Choi, HoBin;Kim, JuBong;Hwang, GyuYoung;Kim, KwiHoon;Hong, YongGeun;Han, YounHee
    • KIPS Transactions on Computer and Communication Systems
    • /
    • v.9 no.8
    • /
    • pp.171-180
    • /
    • 2020
  • Smart Factory consists of digital automation solutions throughout the production process, including design, development, manufacturing and distribution, and it is an intelligent factory that installs IoT in its internal facilities and machines to collect process data in real time and analyze them so that it can control itself. The smart factory's equipment works in a physical combination of numerous hardware, rather than a virtual character being driven by a single object, such as a game. In other words, for a specific common goal, multiple devices must perform individual actions simultaneously. By taking advantage of the smart factory, which can collect process data in real time, if reinforcement learning is used instead of general machine learning, behavior control can be performed without the required training data. However, in the real world, it is impossible to learn more than tens of millions of iterations due to physical wear and time. Thus, this paper uses simulators to develop grid sortation systems focusing on transport facilities, one of the complex environments in smart factory field, and design cooperative multi-agent-based reinforcement learning to demonstrate efficient behavior control.

Multi-Agent Based Cooperative Information System using Knowledge Level (지식레벨을 이용한 다중 에이전트 협동 정보시스템)

  • 강성희;박승수
    • Korean Journal of Cognitive Science
    • /
    • v.11 no.1
    • /
    • pp.67-80
    • /
    • 2000
  • Distributed cooperative information system is the one that has various knowledge sources as well as problem solving capabilities to get information in a distributed and heterogeneous data environment. In a distributed cooperative information system. a control mechanism to facilitate the available information is very important. and usually the role of the control mechanism determines the behavior of the total system In this research. we proposed a model of the distributed cooperative information system which is based on the multi-agent paradigm. We also implemented a test system to show l its feasibility. The proposed system makes the knowledge sources into agents and a special agent called 'facilitator' controls the cooperation between the knowledge agents The facilitator uses the knowledge granularity level to determine the sequence of the activation of the agents. In other words. the knowledge source with simple but fast processing mechanism activates first while more sophisticated but slow knowledge sources are activated late. In an environment in which we have several knowledge sources for the same topic. the proposed system will simulate the focusing mechanism of human cognitive process.

  • PDF

Control of Contaminants Elution by Solidification of Contaminated Soil (오염토양의 고형화에 따른 오염물질 용출제어)

  • Chung, Ha-Ik;Cho, Jin-Woo;Yu, Jun;Lee, Yong-Su
    • Proceedings of the Korean Geotechical Society Conference
    • /
    • 2002.03a
    • /
    • pp.739-742
    • /
    • 2002
  • Immobilization of contaminants in contaminated soils by solidification processes is an attractive potential remediation process. In this study, the treatability of lead, copper, toluene, and COD was investigated by leaching test. Industrial sand was adopted as the test material and was contaminated with lead copper, and toluene to 100mg/kg, 500mg/kg, 200mg/kg respectively. P solidifying agent was used as the binder(20% by weight of contaminated soil) in the solidification treatment. The leachability of contaminants leached from the solidified soil was evaluated using column test. The percentage of contaminants leached from the solidified soil was significantly reduced by reaction of waste species with cement components and encapsulation reaction of binder. Based on the tests, it is ascertained solidification process can be a very effective method to control the elution of contaminants from the contaminated soil.

  • PDF

The Effects of Mechanical Alloying Conditions on the Formation of Mn-sulfide (망간황화물형성에 미치는 기계적합금화 공정변수의 영향)

  • 안인섭;박동규;정광철
    • Journal of Powder Materials
    • /
    • v.8 no.4
    • /
    • pp.253-257
    • /
    • 2001
  • The effects of mechanical alloying conditions on the formation of Mn-sulfide powders were analyzed. Impeller rotating speed, lubricant coating and added amounts of process control agent(stearic acid) were selected as a process control factor. MnS compounds are synthesized in 3 hours by mechanical alloying at the alternative milling condition. Discontinuous rotating speed of 1200rpm for 4 minutes and 1000rpm for 1 minute shows more effects on the compound formation of MnS. After coating of lubricant on the wall, elementary Mn and sulfur were partially remained by mechanical alloying. The friction effects of the wall and grinding media on the powders are significantly important to form the compound of MnS.

  • PDF

Effect of Process-Control Agents on Characteristics of Amorphous Al-Y-Ni-Co Alloy Powder Produced by Mechanical Alloying

  • Nguyen, H.V.;Kim, J.C.;Kim, J.S.;Kwon, Y.J.;Kwon, Y.S.
    • Journal of Powder Materials
    • /
    • v.17 no.1
    • /
    • pp.7-12
    • /
    • 2010
  • In this work, effect of various process-control agents (PCAs) on the mechanical alloying of amorphous alloy of $Al_{85}Y_8Ni_5Co_2$ has been investigated. The dependence of the particle shape, size and crystallization behavior of the amorphous alloy powders on the type of PCAs and their concentrations was investigated by using X-ray diffraction, field-emission scanning electron microscopy and differential scanning calorimetry. It was found that the additive of toluene could affect positively the amorphization and thermally induced crystallization processes, as well as the size refinement, morphology and particle-size distribution of as-milled powders in comparison with alloy obtained without PCA.

EFFECT OF PROCESS CONTROL AGENT ON THE MICROSTRUCTURE OF Ni-BASED ODS SUPERALLOY PRODUCED BY MECHANICAL ALLOYING AND SINTERING

  • JU-YEON HAN;HYUNJI KANG;SUNG-TAG OH
    • Archives of Metallurgy and Materials
    • /
    • v.64 no.3
    • /
    • pp.949-952
    • /
    • 2019
  • The effects of different types of process control agents (PCA) on the microstructure evolution of Ni-based oxide dispersion-strengthened superalloy have been investigated. Alloy synthesis was performed on elemental powders having a nominal composition of Ni-15Cr-4.5Al-4W-2.5Ti-2Mo-2Ta-0.15Zr-1.1Y2O3 in wt % using high energy ball milling for 5 h. The prepared powders are consolidated by spark plasma sintering at 1000℃. Results indicated that the powder ball-milled with ethanol as PCA showed large particle size, low carbon content and homogeneous distribution of elemental powders compared with the powder by stearic acid. The sintered alloy prepared by ethanol as PCA exhibited a homogeneous microstructure with fine precipitates at the grain boundaries. The microstructural characteristics have been discussed on the basis of function of the PCA.

Changes of Color in Doenjang by Different Browning Factors (갈변인자에 따른 된장 색깔의 변화)

  • Kwon, Dong-Jin;Kim, Yoo-Jin;Kim, Hyun-Jung;Hong, Seok-San;Kim, Hyun-Ku
    • Korean Journal of Food Science and Technology
    • /
    • v.30 no.5
    • /
    • pp.1000-1005
    • /
    • 1998
  • To establish the process control for inhibiting browning of Doenjang, the factors of browning were investigated. The browning of Doenjang was prompted by oxygen, temperature, light and Fe. Expecially temperature, oxygen and metal were main factors of browning in Doenjang. The Color Doenjang was determined by ratios of raw materials, process of manufacture and the channel of distribution. Among ascorbic acid and anti-browning agent, anti-browning agent was effective to inhibit the browning of Doenjang. The process control to inhibit the browning of Doenjang was as follows: temperature; $20^{\circ}C$ or less than, oxygen; elimination, Fe; inhibition of inflow.

  • PDF

A study on Production of Al Foam by Using of Al Return Scrap for Sound and Vibration Absorption Materials

  • Hur, Bo-Young;Kim, Sang-Youl;Park, Dae-Chol;Jeon, Sung-Hwan;Park, Chan-Ho;Yoon, Ik-Sub
    • Proceedings of the IEEK Conference
    • /
    • 2001.10a
    • /
    • pp.198-201
    • /
    • 2001
  • Porous structures of aluminum foam have been studied by using return aluminum scrap. The apparent foam shape, foam height, density, pore size and their distributions in various section areas of the experimental samples have been investigated. The sample have been cast into metallic mold, using aluminum foam prepared from a precursor based on pure Al ingot and return aluminum scrap mixed with various amounts of 1-2wt% increasing viscosity and foam agent materials. The process provides for flexibility in design of foam structures via relatively easy control over the amount of hydrogen evolution and the drainage processes which occur during foam formation. This is facilitated by manipulating parameters such as the foaming agent, thermal histories during solidification and mix melt viscosities. A metal for producing the foamed are decomposing a foaming agent in a molten metal such that there is an initial and a subsequent expansion due to foaming agent. It has been found that the Al porous foaming with variation amount of 1∼2wt% foam agent and at 2min holding time, which melting temperature has appeared homogeneous pore size at 650∼700$^{\circ}C$. The compression strength were 10-13 kg/min at 125ppi, and increased by higher pore density. The acoustical performance of the panel made with the foamed aluminum is considerably improved; its absorption coefficient shows NRC 0.6-0.8. It has been found that the Al foam is very preferable for the compactness of the thermal system.

  • PDF

Open Policy Agent based Multilateral Microservice Access Control Policy (개방형 정책 에이전트 기반 다자간 마이크로서비스 접근제어 정책)

  • Gu Min Kim;Song Heon Jeong;Kyung Baek Kim
    • Smart Media Journal
    • /
    • v.12 no.9
    • /
    • pp.60-71
    • /
    • 2023
  • A microservice architecture that accommodates the heterogeneity of various development environments and enables flexible maintenance can secure business agility to manage services in line with rapidly changing requirements. Due to the nature of MSA, where communication between microservices within a service is frequent, the boundary security that has been used in the past is not sufficient in terms of security, and a Zerotrust system is required. In addition, as the size of microservices increases, definition of access control policies according to the API format of each service is required, and difficulties in policy management increase, such as unnecessary governance overhead in the process of redistributing services. In this paper, we propose a microservice architecture that centrally manages policies by separating access control decision and enforcement with a general-purpose policy engine called OPA (Open Policy Agent) for collective and flexible policy management in Zerotrust security-applied environments.

Fermentation Process for Mass Production of Clitocybin A, a New Anti-Wrinkle Agent from Clitocybe aurantiaca and Evaluation of Inhibitory Activity on Matrix Metalloproteinase-1 Expression (Clitocybe aurantiaca 균주가 생산하는 주름개선소재 clitocybin A의 대량 발효생산 및 MMP-1 발현저해활성)

  • Kim, Kwan-Chul;Lee, Hyeok-Won;Lee, Hong-Won;Choo, Soo-Jin;Yoo, Ick-Dong;Ha, Byung-Jo
    • Microbiology and Biotechnology Letters
    • /
    • v.42 no.2
    • /
    • pp.194-201
    • /
    • 2014
  • Clitocybin A is a novel anti-wrinkle cosmetic agent produced by the strain from a Korean native mushroom Clitocybe aurantiaca. In this study, fermentation, extraction, and purification conditions for a large scale production of clitocybin A were optimized, and its cytotoxicity and inhibition activity on the expression of matrix metalloproteinase-1 (MMP-1) were characterized. The mass production of anti-wrinkle agent was achieved according to the 300 L fermentation process with a fed-batch cultivation using the modified yeast-maltose (YM) broth, and a total of 12.5 kg of cell mass was obtained in a 120 L culture broth for 14 days. After extraction and purification, clitocybin A was identified by HPLC. The cytotoxicity of clitocybin A was examined by the MTT assay. When assayed at 100 and 200 ${\mu}g/ml$ concentrations, clitocybin A showed no cytotoxicity, demonstrating safety. The inhibition activity of clitocybin A on the expression of MMP-1 was examined against UV irradiation. Oleanolic acid (control group) showed a relatively low MMP-1 inhibiting activity (ca. 16.7%) at 10 ${\mu}g/ml$ and showed increased cytotoxicity at higher concentrations. In contrast, clitocybin A showed no cytotoxicity at 100 ${\mu}g/ml$, and exhibited a relatively high MMP-1-inhibiting activity (33.1%). These findings indicate that clitocybin A may be a safe and effective anti-wrinkle agent for use in functional cosmetics.