• 한국정보통신학회:학술대회논문집
• /
• 한국정보통신학회 2022년도 추계학술대회
• /
• pp.9-11
• /
• 2022

Applying Reinforcement Learning in everyday applications and varied environments has proved the potential of the of the field and revealed pitfalls along the way. In robotics, a learning agent takes over gradually the control of a robot by abstracting the navigation model of the robot with its inputs and outputs, thus reducing the human intervention. The challenge for the agent is how to implement a feedback function that facilitates the learning process of an MDP problem in an environment while reducing the time of convergence for the method. In this paper we will implement a reward shaping system avoiding sparse rewards which gives fewer data for the learning agent in a ROS environment. Reward shaping prioritizes behaviours that brings the robot closer to the goal by giving intermediate rewards and helps the algorithm converge quickly. We will use a pseudocode implementation as an illustration of the method.

• 한국분말재료학회지
• /
• 제25권2호
• /
• pp.126-131
• /
• 2018

In the present study, we investigate the effects of milling time and the addition of a process control agent (PCA) on the austenite stability of a nanocrystalline Fe-7%Mn alloy by XRD analysis and micrograph observation. Nanocrystalline Fe-7%Mn alloys samples are successfully fabricated by spark plasma sintering. The crystallite size of ball-milled powder and the volume fraction of austenite in the sintered sample are calculated using XRD analysis. Changes in the shape and structure of alloyed powder according to milling conditions are observed through FE-SEM. It is found that the crystallite size is reduced with increasing milling time and amount of PCA addition due to the variation in the balance between the cold-welding and fracturing processes. As a result, the austenite stability increased, resulting in an exceptionally high volume fraction of austenite retained at room temperature.

• 제어로봇시스템학회:학술대회논문집
• /
• 제어로봇시스템학회 2002년도 ICCAS
• /
• pp.49.2-49
• /
• 2002

This paper describes the configuration of a multi-agent system that can recognize human intentions. This system constructs ontologies of human intentions and enables knowledge acquisition and sharing between intelligent agents operating in different environments. This is achieved by using a bi-directional associative memory network. The process of intention recognition is based on fuzzy association inferences. This paper shows the process of information sharing by using ontologies. The purpose of this research is to create human-centered systems that can provide a natural interface in their interaction with people.

• KIEAE Journal
• /
• 제10권3호
• /
• pp.89-96
• /
• 2010

In comparison with ordinary or heavy-weight concrete, light-weight air void concrete has the good aspects in optimizing super tall structure systems for the process of design considering wind load and seismic load by lightening total dead load of buildings and reducing natural resources used. Light-weight air void concrete has excellent properties of heat and sound insulating due to its high amount porosity of air voids. So, it has been used as partition walls and the floor of Ondol which is the traditional Korean floor heating system. Under the condition of which the supply of light-weight aggregates are limited, the development of light-weight concrete using air voids is highly required in the aspects of reduced manufacturing prices and mass production. In this study, we investigated the physical properties and thermal behaviors of specimens that applied different mixing ratios of foaming agent to evaluate the possibility of use in the structural elements. We proposed the estimating equation for compressive strength of each mix having different ratio of foaming agent. We also confirmed that the density of cement matrix is decreased as the mixing amount of foaming agent increase up to 0.6% of foaming agent mixing ratio which was observed by SEM. Based on porosity and compressive strength of control mortar without foaming agent, we built the estimating equations of compressive strength for mortars with foaming agent. The upper limit of use in foaming agent is about 0.6% of the binder amount. Each air void is independent, and size of voids range from 50 to $100{\mu}m$.

• 품질경영학회지
• /
• 제29권3호
• /
• pp.166-176
• /
• 2001

This paper considers a six sigma project for reducing the color variation of the monitor materials in a chemical plant. The project follows a disciplined process of five macro phases: define, measure, analyze, improve, and control (DMAIC). A process map is used to identify process input variables. Three key process input variables are selected by using an input variable evaluation table; a melting pressure, a coloring agent, and a DP color variation. DOE is utilized for finding the optimal process conditions of the three key process input variables. The sigma level of defects rate becomes a 4.58 from a 2.0 at the beginning of the project.

• 한국전기전자재료학회:학술대회논문집
• /
• 한국전기전자재료학회 2003년도 춘계학술대회 논문집 센서 박막재료 반도체 세라믹
• /
• pp.158-161
• /
• 2003

The primary aim of this study is to investigate new semi-abrasive free slurry including acid colloidal silica and hydrogen peroxide for copper chemical-mechanical planarization (CMP). In general, slurry for copper CMP consists of colloidal silica as an abrasive, organic acid as a complex-forming agent, hydrogen peroxide as an oxidizing agent, a film forming agent, a pH control agent and several additives. We developed new semi-abrasive free slurry (SAFS) including below 0.5% acid colloidal silica. We evaluated additives as stabilizers for hydrogen peroxide as well as accelerators in tantalum nitride CMP process. We also estimated dispersion stability and Zeta potential of the acid colloidal silica with additives. The extent of enhancement in tantalum nitride CMP was verified through anelectrochemical test. This approach may be useful for the application of single and first step copper CMP slurry with one package system.

• 한국결정성장학회지
• /
• 제12권2호
• /
• pp.73-79
• /
• 2002

코발트, 니켈, 구리 그리고 귀금속분말에 적용할 수 있는 polyol법은 균질한 크기와 형상을 갖는 금속분말합성에 매우 효과적인 공정이다 이 때 polyol은 용매, 환원제 그리고 보호제의 역학을 한다 $AgNO_3$글 촉매제로 첨가하여 비균질계 핵생성 반응을 야기할 경우 서브마이크폰 크기(0.5$\mu$m)의 코발트 분말을 한성학 수 있었다. 또한 촉매제인 Ag 핵의 수출 변화시키므로써 코발트 분말의 입도를 제어할 수 있음을 확인하였다.

• 한국응용과학기술학회지
• /
• 제6권1호
• /
• pp.1-7
• /
• 1989

To developed new process for obtaining maximum molecular weight of anionic acrylamide and acrylic acid copolymer by inverse emulsion polymerization. Concentration of initiator, reducing agent, surfactant and mole ratio of acrylamide-acrylic acid were studied for the process. Semi-batch processes with method of redox, control of reaction temperature, feeding method of monomer and reaction time, was suitable for maximum molecular weight of P(AMAC) from this process obtained $3.09\;{\time}\;10^6({\bar{M}}n.)$ and $4.41\;{\time}\;10^6({\bar{M}}w.)$ in molecular weight measured by the intrinsic viscosity method. inverse emulsion polymerization mechanism of P(AMAC) does not followed the Smith-Ewart and Medvedev theory, but selected for concentration of initiator, reducing agent, surfactant, water solubility of monomer.

• 한국인쇄학회지
• /
• 제25권1호
• /
• pp.43-52
• /
• 2007

Offset printing is one of the well known printing technique of lithographic process and consists of image area and 'non-image area on a flat image carrier. The surface tension of dampening water can be controlled by adding IPA after mixing of raw water and etching solution. The etching solution contains a surfactant for reducing surface energy, a clean agent for non-imaging area, wetting agent for protecting non-imaging area from oil components like ink and also an emulsifying agent for controlling emulsification. In this study, the present situation of dampening water maintenance has examined by collecting dampening water using at domestic companies. The pH related to dampening water, conductivity, contact angle, emulsification curve are measured to define the current situation of dampening water control of each companies and to analyze the relationship among measured properties. In the study most of companies among 16 printing companies tested controlling dampening water through pH value. However, the quality of printing has varied depending upon conductivity, contact angle, IPA content, and emulsification value. The control of dampening water should be carry at the state of the standard when adding proper ratio of etching solution. It would be more effective when pH or conductivity control carries out in parallel with controlling dampening water. Therefore the concept that pH5.5 is correct is based concept. Based on these initial tests it is defined that the standardization of dampening water control is required.

• 정보처리학회논문지:컴퓨터 및 통신 시스템
• /
• 제9권8호
• /
• pp.171-180
• /
• 2020

스마트 팩토리는 설계, 개발, 제조 및 유통 등 생산과정 전반이 디지털 자동화 솔루션으로 이루어져 있으며, 내부 설비와 기계에 사물인터넷(IoT)을 설치해 공정 데이터를 실시간으로 수집하고 이를 분석해 스스로 제어할 수 있게 하는 지능형 공장이다. 스마트 팩토리의 장비들은 게임과 같이 가상의 캐릭터가 하나의 객체 단위로 구동되는 것이 아니라 수많은 하드웨어가 물리적으로 조합되어 연동한다. 즉, 특정한 공동의 목표를 위해 다수의 장치가 개별적인 행동을 동시다발적으로 수행해야 한다. 공정 데이터를 실시간으로 수집할 수 있는 스마트 팩토리의 장점을 활용하여, 일반적인 기계 학습이 아닌 강화 학습을 사용하면 미리 요구되는 훈련 데이터 없이 행동 제어를 할 수 있다. 하지만, 현실 세계에서는 물리적 마모, 시간적 문제 등으로 인해 수천만 번 이상의 반복 학습이 불가능하다. 따라서, 본 논문에서는 시뮬레이터를 활용해 스마트 팩토리 분야에서 복잡한 환경 중 하나인 이송 설비에 초점을 둔 그리드 분류 시스템을 개발하고 협력적 다중 에이전트 기반의 강화 학습을 설계하여 효율적인 행동 제어가 가능함을 입증한다.