Paper: arXiv 2609.09945

Authors: Gijs A. F. Niewzwaag, Marijn G. S. Veth, Manuele Massei, Marcos R. Machado

Abstract

Machine learning-based credit scoring is increasingly central to Peer-to-Peer (P2P) lending, yet its resilience to adversarial manipulation, where applicants strategically alter self-reported inputs to secure favourable decisions, remains poorly understood. Most adversarial-robustness evidence comes from image and text domains and evaluates a single attack against a matching defence, offering little guidance on how defences generalise across attack types in tabular credit data. We address this with a systematic train-test robustness benchmark on a large Lending Club subset, spanning three model families (logistic regression, a feed-forward neural network, and a transformer for tabular data) and four attacks confined to applicant-mutable features: Fast Gradient Sign Method (FGSM), Projected Gradient Descent (PGD), Salt-and-Pepper (S&P) noise, and DeepFool, plus a mixed-attack regime. Across a full grid evaluated with stratified cross-validation, adversarial training sharply improves robustness against the attack it is trained on and transfers well within the gradient-based family, but transfers weakly to non-gradient corruption, so single-attack defences overstate real-world resilience. Mixed training delivers the most balanced robustness across heterogeneous attacks while preserving clean-test performance, supporting multi-attack stress testing in credit-model governance.

Complexity vs Empirical Score

  • Math Complexity: 6.0/10
  • Empirical Rigor: 8.0/10
  • Quadrant: Holy Grail — high math complexity, high empirical rigor

Why this score: This paper presents a robust empirical evaluation of adversarial training in a critical financial application. Its strength lies in systematically testing multiple attack types and model families, offering valuable insights into real-world model resilience. The methodology is sound and the findings are clearly presented.

Research Flowchart

  flowchart TD
    A[Research Goal: Evaluate ML Model Robustness to Adversarial Attacks in Tabular Credit Scoring] --> B(Methodology: Systematic Train-Test Robustness Benchmark);
    B --> C{Data/Inputs: Large Lending Club Dataset};
    C --> D[Computational Processes: Evaluate 3 Model Families, 4 Attack Types (+ Mixed Attack), Adversarial Training, Stratified Cross-Validation];
    D --> E{Outcomes: Single-attack defenses overstate robustness; Mixed-attack training delivers balanced robustness & preserves clean performance.};

Cited References (88)

  1. Regulation (EU) 2024/1361 of the European Parliament and of the Council of 13 March 2024 Laying Down Harmonised Rules on Artificial Intelligence (Artificial Intelligence Act) (2024) — link
  2. The Global Findex Database 2021: Financial Inclusion, Digital Payments, and Resilience in the Age of COVID-19 (2022) — link
  3. Enhancing credit scoring with alternative data (2021)
  4. Economic Well-Being of U.S. Households in 2023 (2024) — link
  5. Evaluating credit risk and loan performance in online Peer-to-Peer (P2P) lending (2015)
  6. An econometric analysis of the bank credit scoring problem (1989)
  7. Intelligent Credit Scoring: Building and Implementing Better Credit Risk Scorecards (2017)
  8. An analytical approach to credit risk assessment using machine learning models (2025) — link
and 80 more
  1. Neural network credit scoring models (2000)
  2. A systematic review of machine learning and explainable artificial intelligence (XAI) in credit risk modelling (2022) — link
  3. XAI‑Credit Risk Analysis (2024)
  4. Credit Risk Assessment and Financial Decision Support Using Explainable Artificial Intelligence (2024)
  5. Analyzing credit risk among Chinese P2P-lending businesses by integrating text-related soft information (2020)
  6. Towards CRISP-ML (Q): a machine learning process model with quality assurance methodology (2021)
  7. How can consumers without credit history benefit from the use of information processing and machine learning tools by financial institutions? (2025)
  8. Robust Classification of Financial Risk (2018)
  9. Adversarial Threats to Cloud IDS: Robust Defense with Adversarial Training and Feature Selection (2025) — link
  10. TabAttackBench: A Benchmark for Adversarial Attacks on Tabular Data (2025) — link
  11. Consumer Credit Risk Assessment: A Review from the State‑of‑the‑Art Classification Algorithms, Data Traits, and Learning Methods (2024) — link
  12. Credit risk evaluation model with textual features from loan descriptions for P2P lending (2020)
  13. Advancing credit risk assessment in the retail banking industry: A hybrid approach using time series and supervised learning models (2025) — link
  14. Assessing credit risk of commercial customers using hybrid machine learning algorithms (2022) — link
  15. A Rasch model for partial credit scoring (1982)
  16. Commercial bank lending: process, credit scoring, and costs of errors in lending (1980)
  17. The role of peer-to-peer (P2P) lending in developing countries: a systematic literature review (2025)
  18. Too much technology and too little regulation? The spectacular demise of P2P lending in China (2025)
  19. Exploring peer-to-peer lending: key influences of firm uncertainty, loan features and venture quality (2025)
  20. How signaling and search costs affect information asymmetry in P2P lending: the economics of big data (2015)
  21. Strategic information transmission in peer-to-peer lending markets (2018)
  22. Salt and pepper noise: Effects and removal (2018)
  23. Deepfool: a simple and accurate method to fool deep neural networks (2016)
  24. Mitigating adversarial attacks on transformer models in credit scoring (2025)
  25. Machine learning in banking risk management: Mapping a decade of evolution (2025)
  26. Credit risk analysis applying logistic regression, neural networks and genetic algorithms models (2007)
  27. Predicting China’s SME credit risk in supply chain financing by logistic regression, artificial neural network and hybrid models (2016)
  28. Enhancing Credit Risk Assessment Through Transformer-Based Machine Learning Models
  29. P2P lending: how does it affect Indonesian bank’s profitability? (2025)
  30. CRISP-DM: Towards a standard process model for data mining (2000)
  31. The crystal ball of user-generated content: indication of P2P lending platform failure (2025)
  32. Toward an evolving framework for responsible AI for credit scoring in the banking industry (2025)
  33. Improving Credit Risk Assessment in Uncertain Times: Insights from IFRS 9 (2025)
  34. GIIDS-AR: End-to-end generalized intelligent intrusion detection system with adversarial robustness for heterogeneous UAVs in UAM (2025)
  35. Enhancing Adversarial Transferability by Balancing Exploration and Exploitation with Gradient-Guided Sampling (2025)
  36. Misreporting and Risk of Loan Default: Evidence from an Online Lending Platform Affiliated with a Rural Commercial Bank in China (2025)
  37. The Effectiveness of the UK’s Viability Statement in Providing Early Warning Signs of Corporate Distress (2025)
  38. CNN-based projected gradient descent for consistent CT image reconstruction (2018)
  39. Adversarial Attacks on Visual Objects Using the Fast Gradient Sign Method (2023)
  40. Trans-IFFT-FGSM: a novel fast gradient sign method for adversarial attacks (2024)
  41. Explaining to Defend: SHAP-Based Defense Mechanism Against Adversarial Attacks in P2P Credit Risk (2025)
  42. Supervisory and Bank Resolution Planning (2017)
  43. AI Under Attack: Six Key Adversarial Attacks and Their Consequences (2025)
  44. Basel III: International Regulatory Framework for Banks (2019)
  45. Train-Test Split for Evaluating Machine Learning Algorithms (2020)
  46. The CRISP-DM Process: A Comprehensive Guide (n.d.)
  47. CRISP-DM Is Still the Most Popular Framework for Executing Data Science Projects (2025)
  48. Legal Transparency in AI Finance: Facing the Accountability Dilemma in Digital Decision-Making (2024)
  49. EU AI Act: First Regulation on Artificial Intelligence (2025)
  50. Equal Credit Opportunity (Regulation B) (2024)
  51. Train Test Split: What It Means and How to Use It (2025)
  52. How To Use ML for Credit Scoring & Decisioning (2023)
  53. Fairness Hacking: The Malicious Practice of Shrouding (2024)
  54. Data Splitting (Train-Test-Validation) in Machine Learning (2025)
  55. Machine Learning Approach for Credit Score Predictions (2023)
  56. Adversarial Robustness of Credit Scoring Models: Leveraging GANs for Model Improvement (2019)
  57. Adversarial Machine Learning: A Review of Methods, Tools, and Critical Industry Sectors (2025) — link
  58. Machine Learning for Credit Scoring: Benefits, Models, and Implementation Challenges (2024)
  59. Artificial Intelligence and Machine Learning (2024)
  60. What Is CRISP-DM? (n.d.)
  61. When DeepFool Meets Deep Prior: Adversarial Attack on Super-Resolution Network (n.d.)
  62. Credit Risk Identification in Supply Chains Using Generative Adversarial Networks (2025)
  63. Adversarial Training: A Survey (n.d.)
  64. Adversarial Machine Learning in Industry: A Systematic Literature Review (2024)
  65. TabAttackBench: A Benchmark for Adversarial Attacks on Tabular Data (2025)
  66. Towards Deep Learning Models Resistant to Adversarial Attacks (2017) — link
  67. Credit Worthiness Prediction: Approaches and Methods (2024) — link
  68. Fairness in Credit Scoring: Assessment, Implementation and Profit Implications (2021) — link
  69. The Importance of Addressing Adversarial Attacks on AI Systems (2024)
  70. Adversarial Attacks and Defenses (2021) — link
  71. Fairness-Aware Practices from Developers’ Perspective: A Survey (2025) — link
  72. Problems with SHAP and LIME in Interpretable AI for Education: A Comparative Study of Post-Hoc Explanations and Neural-Symbolic Rule Extraction (2024) — link
  73. Throwing Good Money After Bad: Risk Mitigation Strategies in the P2P Lending Platforms (2023) — link
  74. Understanding Machine Learning Robustness: Why It Matters and How It Affects Your Models (2023)
  75. Model Robustness: Building Reliable AI Models (2025)
  76. Metrics (n.d.)
  77. Confusion Matrix: How To Use It & Interpret Results [Examples] (n.d.)
  78. Performance and Prediction — H2O 3.46.0.7 Documentation (n.d.)
  79. Under the ROC: AUC-ROC vs. AUC-PR — Choosing the Right Curve (2024)
  80. Investigating imperceptibility of adversarial attacks on tabular data: An empirical analysis (2025) — link

0 of 88 cited works are in the corpus; resolved via arXiv source bundles, Semantic Scholar and OpenAlex. Corpus-wide: 2518 linked papers.