Paper: arXiv 2602.00049

Authors: Oskar Våle, Shiliang Zhang, Sabita Maharjan, Gro Klæboe

Abstract

The balancing market in the energy sector plays a critical role in physically and financially balancing the supply and demand. Modeling dynamics in the balancing market can provide valuable insights and prognosis for power grid stability and secure energy supply. While complex machine learning models can achieve high accuracy, their black-box nature severely limits the model interpretability. In this paper, we explore the trade-off between model accuracy and interpretability for the energy balancing market. Particularly, we take the example of forecasting manual frequency restoration reserve (mFRR) activation price in the balancing market using real market data from different energy price zones. We explore the interpretability of mFRR forecasting using two models: extreme gradient boosting (XGBoost) machine and explainable boosting machine (EBM). We also integrate the two models, and we benchmark all the models against a baseline naive model. Our results show that EBM provides forecasting accuracy comparable to XGBoost while yielding a considerable level of interpretability. Our analysis also underscores the challenge of accurately predicting the mFRR price for the instances when the activation price deviates significantly from the spot price. Importantly, EBM’s interpretability features reveal insights into non-linear mFRR price drivers and regional market dynamics. Our study demonstrates that EBM is a viable and valuable interpretable alternative to complex black-box AI models in the forecast for the balancing market.

Complexity vs Empirical Score

  • Math Complexity: 3.5/10
  • Empirical Rigor: 6.5/10
  • Quadrant: Street Traders — practical and empirical, lighter on theory

Why this score: The paper applies standard gradient boosting algorithms (XGBoost and EBM) to forecast mFRR activation prices in Norwegian energy markets. While the mathematical formulations are standard implementations of GAMs and boosted trees, the empirical focus on interpretability versus accuracy in balancing market dynamics offers practical insights.

Research Flowchart

  flowchart TD
    A["Research Goal:<br>Evaluate Accuracy vs. Interpretability Trade-off in mFRR Price Forecasting"] --> B["Data Inputs:<br>Real energy balancing market data across price zones"]
    
    B --> C["Model Training & Benchmarking"]
    
    subgraph C ["Model Training & Benchmarking"]
        C1["Naive Baseline Model"]
        C2["XGBoost (Black-Box)"]
        C3["EBM (Glass-Box)"]
        C4["Ensemble (XGBoost + EBM)"]
    end
    
    C --> D["Evaluation:<br>Forecasting Accuracy & Global/Local Feature Interpretability"]
    
    D --> E["Key Outcomes:<br>1. EBM matches XGBoost accuracy with high interpretability<br>2. Identifies non-linear price drivers & regional market dynamics<br>3. Highlights challenge in predicting extreme mFRR price spikes"]

Cited References (90)

  1. Impacts of large-scale deployment of vertical bifacial photovoltaics on European electricity market dynamics (2024)
  2. The impact of electricity market reform on renewable energy production (2024) — link
  3. Electricity balancing challenges for markets with high variable renewable generation (2024) — link
  4. The impact of variable renewable energy technologies on electricity markets: An analysis of the Turkish balancing market (2021) — link
  5. Short-term imbalance forecasting with machine learning for proactive mFRR controlling (2024) — link
  6. Comprehensive review of transmission system operators–Distribution system operators collaboration for flexible grid operations (2024) — link
  7. Transforming the electrical grid: the role of AI in advancing smart, sustainable, and secure energy systems (2025) — link
  8. Understanding the Black Box: A Deep Empirical Dive into Shapley Value Approximations for Tabular Data (2025) — link
and 82 more
  1. LARSI-TPE-XGB: Short-Term Load Forecasting by Load-Adaptive Relative Strength Index and Fusion of Tree-Structured Parzen Estimator and XGBoost (2025) — link
  2. Optimal FNN -Based Energy Management System With High Real-Time Performance and Good Interpretability for Battery in Grid-Connected Microgrid (2025) — link
  3. The impact of integration of renewable energy on imbalance settlement: Resilience analysis (2024) — link
  4. Exploring explanation deficits in subclinical mastitis detection with explainable boosting machines (2025)
  5. Integration of energy storage systems and grid modernization for reliable urban power management toward future energy sustainability (2025) — link
  6. Driving towards net-zero: The impact of electric vehicle flexibility participation on a future Norwegian electricity system (2025)
  7. Effects of flexibility contracts on manual frequency restoration reserve market considering transmission system flexibility issues (2025) — link
  8. Prediction of Imbalance Prices Through Gradient Boosting Algorithms: An Application to the Greek Balancing Market (2025) — link
  9. Data from the power system — link
  10. Theory — link
  11. Algorithm (2022) — link
  12. Harmonising the Imbalance Markets in the Nordics : Interview with Volue ’s Bård Mageli — link
  13. The power market - Norwegian Energy - Energifakta Norge — link
  14. Electricity production — link
  15. 15 min Imbalance Settlement Period — link
  16. Explainable Boosting Machine — link
  17. Basics of the Power Market — link
  18. Hydro reservoir levels and power price dynamics. Empirical insight on the nonlinear influence of fuel and emission cost on Nord Pool day-ahead prices (2009) — link
  19. 15 Minutes Imbalance Settlement Period Market Impacts of Late Implementation : Final Report (2018) — link
  20. Analysing Norwegian Electricity Prices During the Energy Crisis : A Data - Driven Forecasting Approach with Explainable AI — link
  21. Transmission capacities for cross-zonal trade of electricity and congestion management in the EU - 2024 MMR (2024) — link
  22. Shorter Market Time Units : Implications for Volatility and Trading (2020)
  23. Framework Guidelines on Electricity Balancing (2015) — link
  24. Impact Assessment of 15 minute ISP in Denmark (2019) — link
  25. Market- Based Control of Electric Power Systems (2018)
  26. What can electricity market models tell us about market design? A review of quantitative studies (2018)
  27. Impact Assessment of the Early Implementation of Flow - Based Intraday Capacity Calculation (2021)
  28. Memo Algorithm description Nordic mFRR EAM bid selection v2 (2024) — link
  29. The Nordic power market introduces 15-minute balancing (2022)
  30. Impact analysis of the reduction of the imbalance settlement period from one hour to 15 minutes (2017) — link
  31. A Unified Approach to Interpreting Model Predictions (2017) — link
  32. Data Sharing, Privacy and Security Considerations in the Energy Sector: A Review from Technical Landscape to Regulatory Specifications (2025) — link
  33. " Why Should I Trust You ?": Explaining the Predictions of Any Classifier (2016) — link
  34. Forecasting: Principles and Practice (2021) — link
  35. Predictions of prices and volumes in the Nordic balancing markets for electricity (2023) — link
  36. Exploratory data analysis (1977)
  37. Flow- Based - Market - Coupling expands into the Nordics — link
  38. Flow- Based Methodology successfully implemented in the Nordic Region (2024) — link
  39. Nordic Flow - Based Day - Ahead Market Coupling — link
  40. Nordic Flow - Based Market Coupling Project confirms Go - Live for 29th October 2024 (2024) — link
  41. Bringing New Energy to the Nordic Electricity Market (2022) — link
  42. Electricity prices: How are they set, and why do they vary so much? — link
  43. The Nordic power market introduces 15-minute balancing — link
  44. Long-term Market Analysis 2020-2050 - Update 2021 (2021) — link
  45. Why is predicting the price of electricity difficult? (2024) — link
  46. Price formation — link
  47. Day-ahead market — link
  48. BSP - Implementation Guide mFRR energy activation market (2024) — link
  49. Memo - Process for activating mFRR products – update August 2024 (2024) — link
  50. Confirmation of mFRR EAM go live March 4th 2025 (2025) — link
  51. Nordic Balancing Model Consultation report May 29 2019 (2019) — link
  52. Data from the power system (2025) — link
  53. Single price and Single position – implementation in the Nordics Common Market Design description (2020) — link
  54. Nordic Imbalance Settlement Handbook (2024) — link
  55. Questions and answers from the Nordic webinar on: Future imbalance pricing in the Nordics when connected to MARI and PICASSO (2023) — link
  56. Vedlegg I Metode for prisfastsettelse av balanseenergi og kapasitet mellom budområder som brukes til utveksling av balanseenergi (2024) — link
  57. Quarterly resolution and the energy markets (2022) — link
  58. Handbook \textbar Nordic Imbalance Settlement Model — link
  59. The physics behind a balanced electricity market - and what happens if we fall out of balance? (2025) — link
  60. Balancing Predictive Performance and Interpretability in Machine Learning : A Scoring System and an Empirical Study in Traffic Prediction (2024) — link
  61. Model interpretability in Azure Machine Learning — link
  62. EDPS TechDispatch 3/2023 on Explainable Artificial Intelligence ( XAI ) (2023) — link
  63. Interpretable Machine Learning (2022) — link
  64. Stacked generalization (1992)
  65. Ensemble based systems in decision making (2006)
  66. Stacked generalization: when does it work? (1997)
  67. What is an API ? - Application Programming Interface Explained — link
  68. Machine Learning APIs : Simplify AI Integration — link
  69. Accurate intelligible models with pairwise interactions (2013)
  70. InterpretML : A unified framework for machine learning interpretability (2019)
  71. XGBoost : A Scalable Tree Boosting System (2016) — link
  72. Extended Vehicle Energy Dataset (eVED): An Enhanced Large-Scale Dataset for Vehicle Energy Consumption Analysis (2025)
  73. The Elements of Statistical Learning : Data Mining , Inference , and Prediction (2017)
  74. Rekordhøy strømproduksjon i 2024 (2025) — link
  75. Norwegian electricity in geographic dataset (noregeo) (2025) — link
  76. Ultra-short-term solar power forecasting by deep learning and data reconstruction (2025) — link
  77. Privacy-preserving transactive energy systems: Key topics and open research challenges (2023) — link
  78. Extended vehicle energy dataset (eVED): an enhanced large-scale dataset for deep learning on vehicle trip energy consumption (2022) — link
  79. Privacy-Preservation and the Automotives (2020)
  80. An energy consumption model for electrical vehicle networks via extended federated-learning (2021)
  81. Cenergy3: An API for City Energy 3 D Modeling (2025) — link
  82. Norwegian Electricity in Geographic Dataset (NoreGeo)[Dataset] (2025) — link

0 of 90 cited works are in the corpus; resolved via arXiv source bundles, Semantic Scholar and OpenAlex. Corpus-wide: 2518 linked papers.