• Proceedings of the Korea Water Resources Association Conference
• /
• 2023.05a
• /
• pp.229-229
• /
• 2023

강화학습은 에이전트(agent)가 주어진 환경(environment)과의 상호작용을 통해서 상태(state)를 변화시켜가며 최대의 보상(reward)을 얻을 수 있도록 최적의 행동(action)을 학습하는 기계학습법을 의미한다. 최근 알파고와 같은 게임뿐만 아니라 자율주행 자동차, 로봇 제어 등 다양한 분야에서 널리 사용되고 있다. 상수도관망 분야의 경우에도 펌프 운영, 밸브 운영, 센서 최적 위치 선정 등 여러 문제에 적용되었으나, 설계에 강화학습을 적용한 연구는 없었다. 설계의 경우, 관망의 크기가 커짐에 따라 알고리즘의 탐색 공간의 크기가 증가하여 기존의 최적화 알고리즘을 이용하는 것에는 한계가 존재한다. 따라서 본 연구는 강화학습을 이용하여 상수도관망의 구성요소와 환경요인 간의 복잡한 상호작용을 고려하는 설계 방법론을 제안한다. 모델의 에이전트를 딥 강화학습(Deep Reinforcement Learning)으로 구성하여, 상태 및 행동 공간이 커 발생하는 고차원성 문제를 해결하였다. 또한, 해당 모델의 상태 및 보상으로 절점에서의 압력 및 수요량과 설계비용을 고려하여 적절한 수량과 수압의 용수 공급이 가능한 경제적인 관망을 설계하도록 하였다. 모델의 행동은 실제로 공학자가 설계하듯이 절점마다 하나씩 차례대로 다른 절점과의 연결 여부를 결정하는 것으로, 이를 통해 관망의 레이아웃(layout)과 관경을 결정한다. 본 연구에서 제안한 방법론을 규모가 큰 그리드 네트워크에 적용하여 모델을 검증하였으며, 고려해야 할 변수의 개수가 많음에도 불구하고 목적에 부합하는 관망을 설계할 수 있었다. 모델 학습과정 동안 에피소드의 평균 길이와 보상의 크기 등의 변화를 비교하여, 제안한 모델의 학습 능력을 평가 및 보완하였다. 향후 강화학습 모델을 통해 신뢰성(reliability) 또는 탄력성(resilience)과 같은 시스템의 성능까지 고려한 설계가 가능할 것으로 기대한다.

• Transactions of the Korean Society of Automotive Engineers
• /
• v.20 no.6
• /
• pp.107-116
• /
• 2012

In this study, the trucks(2.9-liter) have been developed to use DME as fuel, and performance test of the vehicle's DME engine, power, emissions, fuel economy and vehicle aspects was conducted. For experiments, the fuel system(common-rail injectors and high-pressure pump included) and the engine control logic was developed, and ECU mapping was performed. As a result, the rail pressure from 40MPa to approximately 65% increase compared to the base injector has been confirmed that. Also, the pump discharge flow is 15.5 kg/h when the fuel rail pressure is 400rpm(40MPa), and the pump discharge flow is 92.1 kg/h when the fuel rail pressure is 2,000rpm(40MPa). The maximum value of full-load torque capability is 25.5 kgfm(based on 2,000 rpm), and more than 90% compared to the level of the diesel engine were obtained. The DME vehicle was developed in this study, 120 km/h can drive to the stable, and calculated in accordance with the carbon-balance method of fuel consumptions is 5.7 km/L.

• Journal of Institute of Convergence Technology
• /
• v.2 no.1
• /
• pp.24-30
• /
• 2012

In this study, the trucks(2.9-liter) have been developed to use DME as fuel, and performance test of the vehicle's DME engine, power, emissions, fuel economy and vehicle aspects was conducted. For experiments, the fuel system(common-rail injectors and high-pressure pump included) and the engine control logic was developed, and ECU mapping was performed. As a result, the rail pressure from 40MPa to approximately 65% increase compared to the base injector has been confirmed that. Also, the pump discharge flow is 15.5 kg/h when the fuel rail pressure is 400rpm(40 MPa), and the pump discharge flow is 92.1 kg/h when the fuel rail pressure is 2,000rpm(40MPa). The maximum value of full-load torque capability is 25.5kgfm(based on 2,000rpm), and more than 90% compared to the level of the diesel engine were obtained. The DME vehicle was developed in this study, 120 km/h can drive to the stable, and calculated in accordance with the carbon-balance method of fuel consumptions is 5.7 km/L.

• Transactions of the Korean Society of Mechanical Engineers B
• /
• v.40 no.1
• /
• pp.39-45
• /
• 2016

Thermal management of a fuel cell is important to satisfy the requirements of durability and efficiency under varying load conditions. In this study, a linear state feedback controller was designed to maintain the temperature within operating conditions. Due to the nonlinearity of automotive fuel cell system, the state feedback controller results in marginal stable under load condition from $0.5A/cm^2$ to $0.7A/cm^2$. A PWM (Pulse Width Modulation) and the modified state feedback controller are applied to control the temperature under the load condition from $0.5A/cm^2$ to $0.7A/cm^2$. The cooling system model is composed of a reservoir, radiator, bypass valve, fan, and a water pump. The performance of the control algorithm was evaluated in terms of the integral time weighted absolute error (ITAE). Additionally, MATLAB/SIMULINK$^{(R)}$ was used for the development of the system models and controllers. The modified state feedback controller was found to be more effective for controlling temperature than other algorithms when tested under low load conditions.

• Journal of IKEEE
• /
• v.27 no.1
• /
• pp.122-126
• /
• 2023

In this paper, a control system for a complex microbial incubator was proposed. The proposed control system consists of a control unit, a communication unit, a power supply unit, and a control system of the complex microbial incubator. The controller of the complex microbial incubator is designed and manufactured to convert analog signals and digital signals, and control signals of sensors such as displays using LCD panels, water level sensors, temperature sensors, and pH concentration sensors. The water level sensor used is designed and manufactured to enable accurate water level measurement by using the IR laser method with excellent linearity in order to solve the problem that existing water level sensors are difficult to measure due to foreign substances such as bubbles. The temperature sensor is designed and used so that it has high accuracy and no cumulative resistance error by measuring using the thermal resistance principle. The communication unit consists of two LAN ports and one RS-232 port, and is designed and manufactured to transmit signals such as LCD panel, PCT panel, and load cell controller used in the complex microbial incubator to the control unit. The power supply unit is designed and manufactured to supply power by configuring it with three voltage supply terminals such as 24V, 12V and 5V so that the control unit and communication unit can operate smoothly. The control system of the complex microbial incubator uses PLC to control sensor values such as pH concentration sensor, temperature sensor, and water level sensor, and the operation of circulation pump, circulation valve, rotary pump, and inverter load cell used for cultivation. In order to evaluate the performance of the control system of the proposed complex microbial incubator, the result of the experiment conducted by the accredited certification body showed that the range of water level measurement sensitivity was -0.41mm~1.59mm, and the range of change in water temperature was ±0.41℃, which is currently commercially available. It was confirmed that the product operates with better performance than the performance of the products. Therefore, the effectiveness of the control system of the complex microbial incubator proposed in this paper was demonstrated.

• Journal of the Korean Vacuum Society
• /
• v.5 no.4
• /
• pp.269-277
• /
• 1996

The vacuum systems of PLS linac provides average pressure of $2.6\times 10^{-6}$Pa under high power microwave of 54 MW peak with 4.1 $\mu \textrm s$ pulse width and 10 Hz repetition rates. The base pressure of system is$2.4\times 10^{-6}$Pa with 45$^{\circ}C$ cooling water. The outgassing rate of the system is decreased from $3.0\times 10^{-11}Torr-l/sec-\textrm{cm}^2$ at the initial stage after installation to $1\times 10^{-12}Torr-l/sec-\textrm{cm}^2$ at present. Total accumulated microwave energy dose is about 140 GJ per module. All ion pumps are working under saturated regime and effective pumping speeds of 60 I/s, 230 I/s ion pumps are 45 I/s, 65 I/s, 140 I/s under the operating range. Main problems occurred in recent year are troubles of ion pump controller and vacuum gauge controller, vacuum leak of energy doubler window and electron gun ceramic, and water leak in the dummy load of acceleraing columns. Total of 41 troubles with 140. 8 hours down time give good system availability of 98%. Down time can be reduced by high power waveguide valves and water dummy loads under development, and then availability is expected to be increased up to 99.5%.

• Journal of the Korean Institute of Gas
• /
• v.18 no.4
• /
• pp.13-20
• /
• 2014

In natural gas distribution system, gas pressure is regulated correspond to requirement using throttle valve which is releasing huge pressure energy as useless form. The waste pressure can be recovered by using turbo machinery devices such as a turbo expander. In this process, excessive temperature drop occurs due to Joule-Thompson effect during the expansion process. Installing natural gas boiler before or after the turbo expander prevents temperature drop. Fuel cell or gas engine hybrid system further improve the efficiency, but 1~2% of total transporting natural gas is used for operating the hybrid system. In this study, a heat pump system is proposed as a preheating device which can be operated without using transporting natural gas. Thermodynamic analysis on evaporating and condensing temperatures and refrigerants is conducted. Results show that R717 is proper refrigerant for the hybrid system with high COP and low turbine work within the defined operating conditions. In domestic usage in Korea, the heat pump system has more economic feasibility owing to natural gas being imported with a high price of LNG form.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.11 no.12
• /
• pp.4721-4726
• /
• 2010

The performance characteristics of water-chilling heat pump using CO2 for the control of inverter frequency was investigated experimentally. An experimental apparatus is consisted of a compressor, a gas cooler, an expansion valve, an evaporator and a liquid receiver. All heat exchangers used in the test rig are counter flow type heat exchangers with concentric dual tubes, which are made of copper. The gas cooler and the evaporator consist of 6 and 4 straight sections respectively arranged in parallel, each has 2.4m length. The experimental results summarize as the following: for constant inlet temperature of evaporator and gas cooler, as mass flow rate, compression ratio and discharge pressure increases with the inverter frequency. And heating capacity and compressor work increases, but coefficient of performance(COP) decreases with the inverter frequency of compressor. As inlet temperature of secondary fluid in the evaporator increases from $15^{\circ}C$ to $25^{\circ}C$, compression ratio and compressor work decreases, but mass flow rate, heating capacity and COP increases with the inverter frequency of compressor. The above tendency is similar with performance variation with respect to the variation of inverter frequency in the conventional vapor compression refrigeration cycle.

• Journal of Aerospace System Engineering
• /
• v.14 no.5
• /
• pp.91-99
• /
• 2020

A liquid rocket engine goes through many tests to prove its performance before liftoff. It means the tests for setting ignition and start-up conditions or a test on design condition, which verifies the design performance. However, the development process requires verification of performance under off-design conditions through tests involving different operating conditions, which affects the duration of engine development. The off-design performance test is performed by altering the conditions of the propellant supplied to the engine in conjunction with the engine performance test that varies the opening of the control valves in the engine. This paper is based on the results of the engine tests performed at the KSLV-II engine test facilities in the Naro Space Center and describes the operations of the test facility for off-design condition test that changes the inlet conditions of the turbo-pump due to changes in the pressure and temperature of the propellant supplied to the test engines.

• Journal of the Korean Society of Propulsion Engineers
• /
• v.14 no.6
• /
• pp.53-59
• /
• 2010

This research aims in finding a more optimal ejector size for evacuating engine exhaust gasses and 20% of the cell cooling air. The remaining 80% of cell cooling air pumped into the test chamber is separately exhausted from the test chamber via a discharge port fitted with flow control valves and vacuum pump. Unlike its predecessor this configuration utilizes a smaller capture area to improve pressure recovery. The modified ejector size has a diameter of 1100mm enough to evacuate 66kg/s jet engine exhaust in addition to about 20%, 24kg/s of the cell cooling air tapped from the sterling chamber. This configurations has an area ratio of the engine exit and ejector inlet of about 1.2. Simulation results of the proposed ejector configuration, indicates improved pressure recovery.