Paper: arXiv 2602.00049
Authors: Oskar Våle, Shiliang Zhang, Sabita Maharjan, Gro Klæboe
Abstract
The balancing market in the energy sector plays a critical role in physically and financially balancing the supply and demand. Modeling dynamics in the balancing market can provide valuable insights and prognosis for power grid stability and secure energy supply. While complex machine learning models can achieve high accuracy, their black-box nature severely limits the model interpretability. In this paper, we explore the trade-off between model accuracy and interpretability for the energy balancing market. Particularly, we take the example of forecasting manual frequency restoration reserve (mFRR) activation price in the balancing market using real market data from different energy price zones. We explore the interpretability of mFRR forecasting using two models: extreme gradient boosting (XGBoost) machine and explainable boosting machine (EBM). We also integrate the two models, and we benchmark all the models against a baseline naive model. Our results show that EBM provides forecasting accuracy comparable to XGBoost while yielding a considerable level of interpretability. Our analysis also underscores the challenge of accurately predicting the mFRR price for the instances when the activation price deviates significantly from the spot price. Importantly, EBM’s interpretability features reveal insights into non-linear mFRR price drivers and regional market dynamics. Our study demonstrates that EBM is a viable and valuable interpretable alternative to complex black-box AI models in the forecast for the balancing market.
Complexity vs Empirical Score
- Math Complexity: 3.5/10
- Empirical Rigor: 6.5/10
- Quadrant: Street Traders — practical and empirical, lighter on theory
Why this score: The paper applies standard gradient boosting algorithms (XGBoost and EBM) to forecast mFRR activation prices in Norwegian energy markets. While the mathematical formulations are standard implementations of GAMs and boosted trees, the empirical focus on interpretability versus accuracy in balancing market dynamics offers practical insights.
Research Flowchart
flowchart TD
A["Research Goal:<br>Evaluate Accuracy vs. Interpretability Trade-off in mFRR Price Forecasting"] --> B["Data Inputs:<br>Real energy balancing market data across price zones"]
B --> C["Model Training & Benchmarking"]
subgraph C ["Model Training & Benchmarking"]
C1["Naive Baseline Model"]
C2["XGBoost (Black-Box)"]
C3["EBM (Glass-Box)"]
C4["Ensemble (XGBoost + EBM)"]
end
C --> D["Evaluation:<br>Forecasting Accuracy & Global/Local Feature Interpretability"]
D --> E["Key Outcomes:<br>1. EBM matches XGBoost accuracy with high interpretability<br>2. Identifies non-linear price drivers & regional market dynamics<br>3. Highlights challenge in predicting extreme mFRR price spikes"]
Cited References (90)
- Impacts of large-scale deployment of vertical bifacial photovoltaics on European electricity market dynamics (2024)
- The impact of electricity market reform on renewable energy production (2024) — link
- Electricity balancing challenges for markets with high variable renewable generation (2024) — link
- The impact of variable renewable energy technologies on electricity markets: An analysis of the Turkish balancing market (2021) — link
- Short-term imbalance forecasting with machine learning for proactive mFRR controlling (2024) — link
- Comprehensive review of transmission system operators–Distribution system operators collaboration for flexible grid operations (2024) — link
- Transforming the electrical grid: the role of AI in advancing smart, sustainable, and secure energy systems (2025) — link
- Understanding the Black Box: A Deep Empirical Dive into Shapley Value Approximations for Tabular Data (2025) — link
and 82 more
- LARSI-TPE-XGB: Short-Term Load Forecasting by Load-Adaptive Relative Strength Index and Fusion of Tree-Structured Parzen Estimator and XGBoost (2025) — link
- Optimal FNN -Based Energy Management System With High Real-Time Performance and Good Interpretability for Battery in Grid-Connected Microgrid (2025) — link
- The impact of integration of renewable energy on imbalance settlement: Resilience analysis (2024) — link
- Exploring explanation deficits in subclinical mastitis detection with explainable boosting machines (2025)
- Integration of energy storage systems and grid modernization for reliable urban power management toward future energy sustainability (2025) — link
- Driving towards net-zero: The impact of electric vehicle flexibility participation on a future Norwegian electricity system (2025)
- Effects of flexibility contracts on manual frequency restoration reserve market considering transmission system flexibility issues (2025) — link
- Prediction of Imbalance Prices Through Gradient Boosting Algorithms: An Application to the Greek Balancing Market (2025) — link
- Data from the power system — link
- Theory — link
- Algorithm (2022) — link
- Harmonising the Imbalance Markets in the Nordics : Interview with Volue ’s Bård Mageli — link
- The power market - Norwegian Energy - Energifakta Norge — link
- Electricity production — link
- 15 min Imbalance Settlement Period — link
- Explainable Boosting Machine — link
- Basics of the Power Market — link
- Hydro reservoir levels and power price dynamics. Empirical insight on the nonlinear influence of fuel and emission cost on Nord Pool day-ahead prices (2009) — link
- 15 Minutes Imbalance Settlement Period Market Impacts of Late Implementation : Final Report (2018) — link
- Analysing Norwegian Electricity Prices During the Energy Crisis : A Data - Driven Forecasting Approach with Explainable AI — link
- Transmission capacities for cross-zonal trade of electricity and congestion management in the EU - 2024 MMR (2024) — link
- Shorter Market Time Units : Implications for Volatility and Trading (2020)
- Framework Guidelines on Electricity Balancing (2015) — link
- Impact Assessment of 15 minute ISP in Denmark (2019) — link
- Market- Based Control of Electric Power Systems (2018)
- What can electricity market models tell us about market design? A review of quantitative studies (2018)
- Impact Assessment of the Early Implementation of Flow - Based Intraday Capacity Calculation (2021)
- Memo Algorithm description Nordic mFRR EAM bid selection v2 (2024) — link
- The Nordic power market introduces 15-minute balancing (2022)
- Impact analysis of the reduction of the imbalance settlement period from one hour to 15 minutes (2017) — link
- A Unified Approach to Interpreting Model Predictions (2017) — link
- Data Sharing, Privacy and Security Considerations in the Energy Sector: A Review from Technical Landscape to Regulatory Specifications (2025) — link
- " Why Should I Trust You ?": Explaining the Predictions of Any Classifier (2016) — link
- Forecasting: Principles and Practice (2021) — link
- Predictions of prices and volumes in the Nordic balancing markets for electricity (2023) — link
- Exploratory data analysis (1977)
- Flow- Based - Market - Coupling expands into the Nordics — link
- Flow- Based Methodology successfully implemented in the Nordic Region (2024) — link
- Nordic Flow - Based Day - Ahead Market Coupling — link
- Nordic Flow - Based Market Coupling Project confirms Go - Live for 29th October 2024 (2024) — link
- Bringing New Energy to the Nordic Electricity Market (2022) — link
- Electricity prices: How are they set, and why do they vary so much? — link
- The Nordic power market introduces 15-minute balancing — link
- Long-term Market Analysis 2020-2050 - Update 2021 (2021) — link
- Why is predicting the price of electricity difficult? (2024) — link
- Price formation — link
- Day-ahead market — link
- BSP - Implementation Guide mFRR energy activation market (2024) — link
- Memo - Process for activating mFRR products – update August 2024 (2024) — link
- Confirmation of mFRR EAM go live March 4th 2025 (2025) — link
- Nordic Balancing Model Consultation report May 29 2019 (2019) — link
- Data from the power system (2025) — link
- Single price and Single position – implementation in the Nordics Common Market Design description (2020) — link
- Nordic Imbalance Settlement Handbook (2024) — link
- Questions and answers from the Nordic webinar on: Future imbalance pricing in the Nordics when connected to MARI and PICASSO (2023) — link
- Vedlegg I Metode for prisfastsettelse av balanseenergi og kapasitet mellom budområder som brukes til utveksling av balanseenergi (2024) — link
- Quarterly resolution and the energy markets (2022) — link
- Handbook \textbar Nordic Imbalance Settlement Model — link
- The physics behind a balanced electricity market - and what happens if we fall out of balance? (2025) — link
- Balancing Predictive Performance and Interpretability in Machine Learning : A Scoring System and an Empirical Study in Traffic Prediction (2024) — link
- Model interpretability in Azure Machine Learning — link
- EDPS TechDispatch 3/2023 on Explainable Artificial Intelligence ( XAI ) (2023) — link
- Interpretable Machine Learning (2022) — link
- Stacked generalization (1992)
- Ensemble based systems in decision making (2006)
- Stacked generalization: when does it work? (1997)
- What is an API ? - Application Programming Interface Explained — link
- Machine Learning APIs : Simplify AI Integration — link
- Accurate intelligible models with pairwise interactions (2013)
- InterpretML : A unified framework for machine learning interpretability (2019)
- XGBoost : A Scalable Tree Boosting System (2016) — link
- Extended Vehicle Energy Dataset (eVED): An Enhanced Large-Scale Dataset for Vehicle Energy Consumption Analysis (2025)
- The Elements of Statistical Learning : Data Mining , Inference , and Prediction (2017)
- Rekordhøy strømproduksjon i 2024 (2025) — link
- Norwegian electricity in geographic dataset (noregeo) (2025) — link
- Ultra-short-term solar power forecasting by deep learning and data reconstruction (2025) — link
- Privacy-preserving transactive energy systems: Key topics and open research challenges (2023) — link
- Extended vehicle energy dataset (eVED): an enhanced large-scale dataset for deep learning on vehicle trip energy consumption (2022) — link
- Privacy-Preservation and the Automotives (2020)
- An energy consumption model for electrical vehicle networks via extended federated-learning (2021)
- Cenergy3: An API for City Energy 3 D Modeling (2025) — link
- Norwegian Electricity in Geographic Dataset (NoreGeo)[Dataset] (2025) — link
0 of 90 cited works are in the corpus; resolved via arXiv source bundles, Semantic Scholar and OpenAlex. Corpus-wide: 2518 linked papers.