Nuclear Engineering and Technology

Korean Nuclear Society (한국원자력학회)
권호 표지
DOI QR코드

DOI QR Code

Strategy to coordinate actions through a plant parameter prediction model during startup operation of a nuclear power plant

  • Jae Min Kim (Ulsan National Institute of Science and Technology) ;
  • Junyong Bae (Ulsan National Institute of Science and Technology) ;
  • Seung Jun Lee (Ulsan National Institute of Science and Technology)
  • Received : 2022.06.27
  • Accepted : 2022.11.18
  • Published : 2023.03.25
Download PDF
⟨ Previous Next ⟩

Abstract

The development of automation technology to reduce human error by minimizing human intervention is accelerating with artificial intelligence and big data processing technology, even in the nuclear field. Among nuclear power plant operation modes, the startup and shutdown operations are still performed manually and thus have the potential for human error. As part of the development of an autonomous operation system for startup operation, this paper proposes an action coordinating strategy to obtain the optimal actions. The lower level of the system consists of operating blocks that are created by analyzing the operation tasks to achieve local goals through soft actor-critic algorithms. However, when multiple agents try to perform conflicting actions, a method is needed to coordinate them, and for this, an action coordination strategy was developed in this work as the upper level of the system. Three quantification methods were compared and evaluated based on the future plant state predicted by plant parameter prediction models using long short-term memory networks. Results confirmed that the optimal action to satisfy the limiting conditions for operation can be selected by coordinating the action sets. It is expected that this methodology can be generalized through future research.

Keywords

Acknowledgement

This work was supported by a Korea Institute of Energy Technology Evaluation and Planning (KETEP) grant funded by the Korean government (MOTIE) (No. 20211510100020) and the National Research Foundation of Korea (NRF) grant funded by the Korea government (MSIT). (No.RS-2022-00144042).

References

  1. Stuart Bennett, The past of pid controllers, Annu. Rev. Control 25 (2001) 43-53.  https://doi.org/10.1016/S1367-5788(01)00005-0
  2. H. Basher, Autonomous Control of Nuclear Power Plants, 2003 (ORNL/TM-2003/252)," United States. 
  3. R.E. Uhrig, L.H. Tsoukalas, Multi-agent-based anticipatory control for enhancing the safety and performance of gen4 NPPs during long-term semi-autonomous operation, Prog. Nucl. Energy 43 (1-4) (2003) 113-120.  https://doi.org/10.1016/S0149-1970(03)00003-9
  4. R.T. Wood, B.R. Upadhyaya, D.C. Floyd, An autonomous control framework for advanced reactors, Nucl. Eng. Technol. 49 (Issue 5) (2017) 896-904.  https://doi.org/10.1016/j.net.2017.07.001
  5. J.T. Kim, K.C. Kwon, I.K. Hwang, D.Y. Lee, W.M. Park, J.S. Kim, S.J. Lee, Development of advanced I&C in nuclear power plants: ADIOS and ASICS, Nucl. Eng. Des. 207 (1) (2001) 105-119.  https://doi.org/10.1016/S0029-5493(00)00430-1
  6. S.J. Lee, P.H. Seong, Development of automated operating procedure system using fuzzy colored petri nets for nuclear power plants, Ann. Nucl. Energy 31 (8) (2004) 849-869.  https://doi.org/10.1016/j.anucene.2003.12.002
  7. M. Boroushaki, M.B. Ghofrani, C. Lucas, M.J. Yazdanpanah, An intelligent nuclear reactor core controller for load following operations, using recurrent neural networks and fuzzy systems, Ann. Nucl. Energy 30 (1) (2003) 63-80.  https://doi.org/10.1016/S0306-4549(02)00047-6
  8. S.J. Lee, K. Mo, P.H. Seong, Development of an integrated decision support system to aid the cognitive activities of operators in main control rooms of nuclear power plants, in: 2007 IEEE Symposium on Computational Intelligence in Multi-Criteria Decision-Making, 2007, pp. 146-152. 
  9. M.H. Hsieh, S.L. Hwang, K.H. Liu, S.F.M. Liang, C.F. Chuang, A decision support system for identifying abnormal operating procedures in a nuclear power plant, Nucl. Eng. Des. 249 (2012) 413-418.  https://doi.org/10.1016/j.nucengdes.2012.04.009
  10. J.M. Kim, G. Lee, C. Lee, S.J. Lee, Abnormality diagnosis model for nuclear power plants using two-stage gated recurrent units, Nucl. Eng. Technol. 52 (9) (2020) 2009-2016.  https://doi.org/10.1016/j.net.2020.02.002
  11. J. Kim, D. Lee, J. Yang, S. Lee, Conceptual design of autonomous emergency operation system for nuclear power plants and its prototype, Nucl. Eng. Technol. 52 (2) (2020) 308-322.  https://doi.org/10.1016/j.net.2019.09.016
  12. P.H. Seong, H.G. Kang, M.G. Na, J.H. Kim, G. Heo, Y. Jung, Advanced mmis toward substantial reduction in human errors IN NPPS, Nucl. Eng. Technol. 45 (2) (2013) 125-140.  https://doi.org/10.5516/NET.04.2013.700
  13. KINS, Safety and Operational Status of Nuclear Power Plants in Korea", vol. 21, KINS/ER-035, 2020. 
  14. D. Lee, A.M. Arigi, J. Kim, Algorithm for autonomous power-increase operation using deep reinforcement learning and a rule-based system, IEEE Access ume 8 (2020) 196727-196746.  https://doi.org/10.1109/ACCESS.2020.3034218
  15. J.M. Kim, H.J. Yang, S.J. Lee, Autonomous startup operation for nuclear power plants using a reinforcement learning algorithm, in: International Symposium on Future I&C for Nuclear Power Plants, 2021. 
  16. T. Haarnoja, A. Zhou, P. Abbeel, S. Levine, Soft actor-critic: off-policy maximum entropy deep reinforcement learning with a stochastic actor, in: International Conference on Machine Learning (ICML), PMLR, 2018, pp. 1861-1870. 
  17. S. Hochreiter, J. Schmidhuber, Long short-term memory, Neural Comput. 9 (8) (1997) 1735-1780.  https://doi.org/10.1162/neco.1997.9.8.1735
  18. R.S. Sutton, A.G. Barto, Reinforcement Learning: an Introduction, 2nd, The MIT Press, 2018. 
  19. D. Lee, S. Koo, I. Jang, J. Kim, Jonghyun, Comparison of deep reinforcement learning and PID controllers for automatic cold shutdown operation, Energies 15 (Issue 8) (2022) 2834. 
  20. J. Bae, G. Kim, S.J. Lee, Real-time prediction of nuclear power plant parameter trends following operator actions, Expert Syst. Appl. 186 (2021), 115848. 
  21. KAERI, Advanced Compact Nuclear Simulator Textbook, 1990. 
  22. Diederik P. Kingma, Ba Jimmy, Adam: A Method for Stochastic Optimization, 2014 arXiv preprint arXiv:1412.6980. 
  23. D.M. Guisi, R. Ribeiro, M. Teixeira, A.P. Borges, F. Enembreck, Reinforcement learning with multiple shared rewards, Procedia Comput. Sci. 80 (2016) 855-864.  https://doi.org/10.1016/j.procs.2016.05.376
  24. G. Dulac-Arnold, D. Mankowitz, T. Hester, Challenges of Real-World Reinforcement Learning, 2019 arXiv preprint arXiv:1904.12901.