DOI QR코드

DOI QR Code

Machine learning-based corporate default risk prediction model verification and policy recommendation: Focusing on improvement through stacking ensemble model

머신러닝 기반 기업부도위험 예측모델 검증 및 정책적 제언: 스태킹 앙상블 모델을 통한 개선을 중심으로

  • Eom, Haneul (Department of Science and Technology Studies, Korea University) ;
  • Kim, Jaeseong (Department of Science and Technology Studies, Korea University) ;
  • Choi, Sangok (Department of public administration, Korea University)
  • 엄하늘 (고려대학교 과학기술학 협동과정) ;
  • 김재성 (고려대학교 과학기술학 협동과정) ;
  • 최상옥 (고려대학교 행정학과)
  • Received : 2020.04.30
  • Accepted : 2020.06.26
  • Published : 2020.06.30

Abstract

This study uses corporate data from 2012 to 2018 when K-IFRS was applied in earnest to predict default risks. The data used in the analysis totaled 10,545 rows, consisting of 160 columns including 38 in the statement of financial position, 26 in the statement of comprehensive income, 11 in the statement of cash flows, and 76 in the index of financial ratios. Unlike most previous prior studies used the default event as the basis for learning about default risk, this study calculated default risk using the market capitalization and stock price volatility of each company based on the Merton model. Through this, it was able to solve the problem of data imbalance due to the scarcity of default events, which had been pointed out as the limitation of the existing methodology, and the problem of reflecting the difference in default risk that exists within ordinary companies. Because learning was conducted only by using corporate information available to unlisted companies, default risks of unlisted companies without stock price information can be appropriately derived. Through this, it can provide stable default risk assessment services to unlisted companies that are difficult to determine proper default risk with traditional credit rating models such as small and medium-sized companies and startups. Although there has been an active study of predicting corporate default risks using machine learning recently, model bias issues exist because most studies are making predictions based on a single model. Stable and reliable valuation methodology is required for the calculation of default risk, given that the entity's default risk information is very widely utilized in the market and the sensitivity to the difference in default risk is high. Also, Strict standards are also required for methods of calculation. The credit rating method stipulated by the Financial Services Commission in the Financial Investment Regulations calls for the preparation of evaluation methods, including verification of the adequacy of evaluation methods, in consideration of past statistical data and experiences on credit ratings and changes in future market conditions. This study allowed the reduction of individual models' bias by utilizing stacking ensemble techniques that synthesize various machine learning models. This allows us to capture complex nonlinear relationships between default risk and various corporate information and maximize the advantages of machine learning-based default risk prediction models that take less time to calculate. To calculate forecasts by sub model to be used as input data for the Stacking Ensemble model, training data were divided into seven pieces, and sub-models were trained in a divided set to produce forecasts. To compare the predictive power of the Stacking Ensemble model, Random Forest, MLP, and CNN models were trained with full training data, then the predictive power of each model was verified on the test set. The analysis showed that the Stacking Ensemble model exceeded the predictive power of the Random Forest model, which had the best performance on a single model. Next, to check for statistically significant differences between the Stacking Ensemble model and the forecasts for each individual model, the Pair between the Stacking Ensemble model and each individual model was constructed. Because the results of the Shapiro-wilk normality test also showed that all Pair did not follow normality, Using the nonparametric method wilcoxon rank sum test, we checked whether the two model forecasts that make up the Pair showed statistically significant differences. The analysis showed that the forecasts of the Staging Ensemble model showed statistically significant differences from those of the MLP model and CNN model. In addition, this study can provide a methodology that allows existing credit rating agencies to apply machine learning-based bankruptcy risk prediction methodologies, given that traditional credit rating models can also be reflected as sub-models to calculate the final default probability. Also, the Stacking Ensemble techniques proposed in this study can help design to meet the requirements of the Financial Investment Business Regulations through the combination of various sub-models. We hope that this research will be used as a resource to increase practical use by overcoming and improving the limitations of existing machine learning-based models.

본 연구는 부도위험 예측을 위해 K-IFRS가 본격적으로 적용된 2012년부터 2018년까지의 기업데이터를 이용한다. 부도위험의 학습을 위해, 기존의 대부분 선행연구들이 부도발생 여부를 기준으로 사용했던 것과 다르게, 본 연구에서는 머튼 모형을 토대로 각 기업의 시가총액과 주가 변동성을 이용하여 부도위험을 산정했으며, 이를 통해 기존 방법론의 한계로 지적되어오던 부도사건 희소성에 따른 데이터 불균형 문제와 정상기업 내에서 존재하는 부도위험 차이 반영 문제를 해소할 수 있도록 하였다. 또한, 시장의 평가가 반영된 시가총액 및 주가 변동성을 기반으로 부도위험을 도출하되, 부도위험과 매칭될 입력데이터로는 비상장 기업에서 활용될 수 있는 기업 정보만을 활용하여 학습을 수행함으로써, 포스트 팬데믹 시대에서 주가 정보가 존재하지 않는 비상장 기업에게도 시장의 판단을 모사하여 부도위험을 적절하게 도출할 수 있도록 하였다. 기업의 부도위험 정보가 시장에서 매우 광범위하게 활용되고 있고, 부도위험 차이에 대한 민감도가 높다는 점에서 부도위험 산출 시 안정적이고 신뢰성 높은 평가방법론이 요구된다. 최근 머신러닝을 활용하여 기업의 부도위험을 예측하는 연구가 활발하게 이루어지고 있으나, 대부분 단일 모델을 기반으로 예측을 수행한다는 점에서 필연적인 모델 편향 문제가 존재하고, 이는 실무에서 활용하기 어려운 요인으로 작용하고 있다. 이에, 본 연구에서는 다양한 머신러닝 모델을 서브모델로 하는 스태킹 앙상블 기법을 활용하여 개별 모델이 갖는 편향을 경감시킬 수 있도록 하였다. 이를 통해 부도위험과 다양한 기업정보들 간의 복잡한 비선형적 관계들을 포착할 수 있으며, 산출에 소요되는 시간이 적다는 머신러닝 기반 부도위험 예측모델의 장점을 극대화할 수 있다. 본 연구가 기존 머신러닝 기반 모델의 한계를 극복 및 개선함으로써 실무에서의 활용도를 높일 수 있는 자료로 활용되기를 바라며, 머신러닝 기반 부도위험 예측 모형의 도입 기준 정립 및 정책적 활용에도 기여할 수 있기를 희망한다.

Keywords

References

  1. Altman, E., A. Resti, and A. Sironi, "Default Recovery Rates in Credit Risk Modelling: A Review of the Literature and Empirical Evidence," Economic Notes, 33(2), (2004), 183-203. https://doi.org/10.1111/j.0391-5026.2004.00129.x
  2. Horrigan, J. O., "The Determination of Long-Term Credit Standing with Financial Ratios," Journal of Accounting Research, 4, (1966), 44-62. https://doi.org/10.2307/2490168
  3. Ohlson, J. S., "Financial Ratios and Probabilistic Prediction of Bankruptcy," Journal of Accounting Research, 18(1), (1980), 109-131. https://doi.org/10.2307/2490395
  4. Zmijewski, M. E., "Methodological Issues Related to the Estimation of Financial Distress Prediction Models," Journal of Accounting Research, 22, (1984), 59-82. https://doi.org/10.2307/2490859
  5. Jeon, Yong., Ki., "Empirical study of the commercial credit rating and predictability of financial statements information", Korea University PhD Thesis, 1986.
  6. Jo, Ji., Ho., "A Study on Credit Rating System in Korea Bond Market", Asian Review of Financial Research, V11, No.15, 1998, 149-190.
  7. Jeong, Wan., Ho., "A Study on Forecasting Corporate Default: Based on Stock Price Information", Asian Review of Financial Research, Vol 15, No.15(2002), 217-249.
  8. Kang, Dae., IL., "An Analysis of Default Portfolios using the First Passage Time Stochastic Process", Vol. 28, No.2,149-187
  9. Kang, Dae., IL., "Stock Portfolio Composition and Trading Strategy Considering Bankruptcy Risks", National Pension Service Research Report, 2014, 1-158
  10. Yoon, J., M, "Effectiveness Analysis of Credit Card Default Risk with Deep Learning Neural Network", Journal of Money & Finance, Vol. 33, No. 1(2019), 151-181. https://doi.org/10.21023/JMF.33.1.5
  11. Kwon, H., C, "A Study on the Work-time Estimation for Block Erections Using Stacking Ensemble Learning", Journal of the Society of Naval Architects of Korea, Vol. 56, No. 6(2019), 488-496. https://doi.org/10.3744/SNAK.2019.56.6.488
  12. Choi, Y., S, "Expected Probability of Default Combining Financial Data and Stock Prices", Korea Defivatives Association(2007)
  13. Oh, S., K, "Structural Credit Risk Model Incorporating the First Hitting Condition of Random Default Barrier", The Korean Journal of Financial Management, Vol 32, No. 4(2015), 23-51. https://doi.org/10.22510/kjofm.2015.32.4.002
  14. Cha, S., J, "Corporate Default Prediction Model Using Deep Learning Time Series Algorithm, RNN and LSTM", Journal of Intelligence and Information Systems, Vol 24, No. 4(2018), 1-32. https://doi.org/10.13088/JIIS.2018.24.4.001
  15. Byun, J., K, "The Effectiveness of Merton Model and Pricing of Credit Risk of Corporate Bonds.", journal of Korean Association of Applied Economics, Vol 6, No. 3(2004), 49-85
  16. Lee, K. C., "Comparative Study on the Bankruptcy Prediction Power of Statistical Model and Al Models : MDA, Inductive Learning, Neural Network)", Journal of the Korean Operations Research and Management Science Society, Vol.18, No.2, (1993), 57-81.
  17. Lee, J. S. and J. H. Han, "Test of Non-Financial Information in Bankruptcy Prediction using Artificial Neural Network - The Case of Small and Medium - Sized Firms - )", Journal of Intelligence and Information Systems, Vol.1, No.1, (1995), 123-134.
  18. Kim, M. J., "Ensemble Learning for Solving Data Imbalance in Bankruptcy Prediction", Journal of Intelligence and Information Systems, Vol.15, No.3(2009), 1-15.
  19. Kim, M. J., H. B. Kim and D. K. Kang, "Optimizing SVM Ensembles Using Genetic Algorithms in Bankruptcy Prediction", Journal of information and communication convergence engineering, Vol.8, No.4(2010), 370-376. https://doi.org/10.6109/jicce.2010.8.4.370
  20. Kim, M. J., "Ensemble Learning with Support Vector Machines for Bond Rating", Journal of Intelligence and Information Systems, Vol.18, No.2(2012), 29-45. https://doi.org/10.13088/JIIS.2012.18.2.029
  21. Bae, J. K., "An Integrated Approach to Predict Corporate Bankruptcy with Voting Algorithms and Neural Networks", Korean Business Review, Vol.3, No.2(2010), 79-101.
  22. Kim, S. J. and H. C. Ahn, "Corporate Bond Rating Model using Random Forest.", Journal of Intelligence and Information Systems, Spring Conference, (2014), 371-376.
  23. Wang, H., Q. Xu and L. Zhou, "Large Unbalanced Credit Scoring Using Lasso-Logistic Regression Ensemble", PLoS One, San Francisco, Vol.10, No.2, (2015).
  24. Yeh, S.-H., Wang, C.-J. and Tsai, M.-F., "Corporate Default Prediction via Deep Learning," in 24th Wireless and Optical Communication Conference (WOCC, 2014)
  25. Min, S. H., "Bankruptcy prediction using an improved bagging ensemble", Journal of Intelligence and Information Systems, Vol.20, No.4, (2014), 121-139. https://doi.org/10.13088/jiis.2014.20.4.121
  26. Min, S. H., "Simultaneous optimization of KNN ensemble model for bankruptcy prediction", Journal of Intelligence and Information Systems, Vol.22, No.1, (2016), 139-157. https://doi.org/10.13088/jiis.2016.22.1.139
  27. Jo, N. O., H. J. Kim and K. S. Shin. "Bankrupcy Type Prediction Using A Hybrid Artificial Neural Networks Model." Journal of Intelligence and Information Systems, Vol.21, No.3, (2015), 79-99. https://doi.org/10.13088/jiis.2015.21.3.79
  28. Jo, N. O. and K. S. Shin. "Bankrupcy Prediction Modeling Using Qualitative Information Based on Big Data Analytics", Journal of Intelligence and Information Systems, Vol.22, No.2, (2016), 33-56. https://doi.org/10.13088/jiis.2016.22.2.033
  29. Addal, S., "Financial forecasting using machine learning", African Institute for Mathematical Science, (2016), 1-32.
  30. Yali Amit; Donald Geman (1997). "Shape quantization and recognition with randomized trees". Neural Computation 9 (7): 1545-1588. doi:10.1162/neco.1997.9.7.1545.