Volume 6, Issue 6, December 2018, Page: 255-260
Performance Evaluation of Machine Learning Approaches for Credit Scoring
Anqi Cao, Dongfang College, Zhejiang University of Finance and Economics, Hangzhou, China
Hongliang He, School of Information, Zhejiang University of Finance and Economics, Hangzhou, China
Zixuan Chen, School of Information, Zhejiang University of Finance and Economics, Hangzhou, China
Wenyu Zhang, School of Information, Zhejiang University of Finance and Economics, Hangzhou, China
Received: Dec. 9, 2018;       Published: Dec. 11, 2018
DOI: 10.11648/j.ijefm.20180606.12      View  54      Downloads  19
In today’s world, assessing financial credit risk is of immense importance in both accounting and finance areas. Financial institutions need to keep the credit default risk to an acceptable level so that higher profitability can be achieved. Recently, with the fast development of modern data science, many machine learning methods have been applied to make accurate predictions based on the information extracted from diverse data sources. The present study aims to apply data mining techniques in acquiring evidence used to judge which classifier performs better in assessing credit scoring for a proposed model. The two datasets employed in the analysis of this paper are the “Give Me Some Credit” dataset and the “PPDai” dataset. Eight classification methods are adopted in the paper including Linear Discriminant Analysis (LDA), Logistic Regression (LR), Decision Tree (DT), Support Vector Machine (SVM), Random Forest (RF), Gradient Boosting Decision Tree (GBDT), eXtreme Gradient Boosting (XGboost) and Multi-Layer Perceptron (MLP). Three indicators (Accuracy, AUC and Logistic loss) are used to analyze the performance of each classifier. The final experiment results indicate that the XGBoost classifier has a better performance in predictive analytics compared with the other seven models. The study results will also provide practical values for financial institutions in choosing the appropriate classifier so as to make correct judgements when they are faced with credit problems in real situations.
Data Mining, Credit Scoring, Machine Learning, Performance Evaluation
To cite this article
Anqi Cao, Hongliang He, Zixuan Chen, Wenyu Zhang, Performance Evaluation of Machine Learning Approaches for Credit Scoring, International Journal of Economics, Finance and Management Sciences. Vol. 6, No. 6, 2018, pp. 255-260. doi: 10.11648/j.ijefm.20180606.12
Huang, C. L., Chen, M. C., & Wang, C. J. (2007). Credit scoring with a data mining approach based on support vector machines. Expert Systems with Applications, 33(4), 847-856.
Sharda, R., Delen, D., & Turban, E. (2018). Business Intelligence, Analytics, and Data Science: A Managerial Perspective (4th ed.). Boston: Pearson.
Han, J., Kamber, M., & Pei, J. (2006). Data Mining: Concepts and Techniques. Burlington: Morgan Kaufmann.
Chen, S. Y., & Liu, X. (2004). The contribution of data mining to information science. Journal of Information Science, 30(6), 550-558.
Chen, N., Ribeiro, B., & Chen, A. (2015). Financial credit risk assessment: a recent review. Artificial Intelligence Review, 45(1), 1-23.
Xia, Y., Liu, C., Li, Y., & Liu, N. (2017). A boosted decision tree approach using Bayesian hyper-parameter optimization for credit scoring. Expert Systems with Applications, 78, 225-241.
Fisher, R. A., (1986). The use of multiple measurements in taxonomic problems. Annals of Eugenics, 7, 179-188.
Karlis, D., & Rahmouni, M. (2007). Analysis of defaulters’ behaviour using the Poisson mixture approach. IMA Journal Management Mathematics, 18(3), 297-311.
Danenas, P., & Garsva, G. (2015). Selection of Support Vector Machines based classifiers for credit risk domain. Expert Systems with Applications, 42(6), 3194-3204.
Orrù, G., Pettersson-Yeo, W., Marquand, A. F., Sartori, G., & Mechelli, A. (2012). Using Support Vector Machine to identify imaging biomarkers of neurological and psychiatric disease: A critical review. Neuroscience and Biobehavioral Reviews, 36(4), 1140-1152.
Maldonado, S., Pérez, J., & Bravo, C. (2017). Cost-based feature selection for support vector machines: an application in credit scoring. European Journal of Operational Research, 261(2), 656-665.
Kamiński, B., Jakubczyk, M., Szufel, P., & Leopold-Wildburger, U. (2018). A framework for sensitivity analysis of decision trees: Central European Journal of Operations Research, 26(1), 135-159.
Trevor, H., Tibshirani, R., & Friedman, J. (2008). The Elements of Statistical Learning (2nd ed.), Springer.
Zięba, M., Tomczak, S. and Tomczak, J. (2016). Ensemble boosted trees with synthetic features generation in application to bankruptcy prediction. Expert Systems with Applications, 58, pp. 93-101.
Chen T, Guestrin C. (2016). Xgboost: a scalable tree boosting system. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, USA, August 13-17, 2016, pp. 785-794.
Browse journals by subject