Paper: arXiv 2501.12285

Authors: Xia Li, Hanghang Zheng, Kunpeng Tao, Mao Mao

Abstract

Credit scoring is a systematic approach to evaluate a borrower’s probability of default (PD) on a bank loan. The data associated with such scenarios are characteristically imbalanced, complicating binary classification owing to the often-underestimated cost of misclassification during the classifier’s learning process. Considering the high imbalance ratio (IR) of these datasets, we introduce an innovative yet straightforward optimized activation function by incorporating an IR-dependent asymmetric adjusted factor embedded Sigmoid activation function (ASIG). The embedding of ASIG makes the sensitive margin of the Sigmoid function auto-adjustable, depending on the imbalance nature of the datasets distributed, thereby giving the activation function an asymmetric characteristic that prevents the underrepresentation of the minority class (positive samples) during the classifier’s learning process. The experimental results show that the ASIG-embedded-classifier outperforms traditional classifiers on datasets across wide-ranging IRs in the downstream credit-scoring task. The algorithm also shows robustness and stability, even when the IR is ultra-high. Therefore, the algorithm provides a competitive alternative in the financial industry, especially in credit scoring, possessing the ability to effectively process highly imbalanced distribution data.

Complexity vs Empirical Score

  • Math Complexity: 4.5/10
  • Empirical Rigor: 7.5/10
  • Quadrant: Street Traders — practical and empirical, lighter on theory

Why this score: The paper addresses a crucial real-world machine learning challenge in credit scoring—class imbalance—by modifying the Sigmoid activation function based on dataset Imbalance Ratios (IR). The methodology is clearly explained and empirically well-tested across various synthetic and real-world IR scenarios, though advanced mathematical derivations are relatively light.

Research Flowchart

  flowchart TD
    A[Research Goal: Improve Credit Scoring on Highly Imbalanced Data] --> B[Inputs: Credit Datasets with Varying Imbalance Ratios]
    B --> C[Methodology: Develop Asymmetric Adjusted Sigmoid Function]
    C --> D[Mechanism: Auto-adjust Sensitive Margins Based on Imbalance Ratio]
    D --> E[Computation: Train Classifier with ASIG to Prevent Minority Underrepresentation]
    E --> F[Outcomes: Superior Performance & High Stability on Ultra-High Imbalance Data]