Paper: arXiv 2410.22346
Authors: Alexa Orton, Tim Gebbie
Abstract
We consider financial market regime detection from the perspective of deep representation learning of the causal information geometry underpinning traded asset systems using a hierarchical correlation structure to characterise market evolution. We assess the robustness of three toy models: SPDNet, SPD-NetBN and U-SPDNet whose architectures respect the underlying Riemannian manifold of input block hierarchical SPD correlation matrices. Market phase detection for each model is carried out using three data configurations: randomised JSE Top 60 data, synthetically-generated block hierarchical SPD matrices and block-resampled chronology-preserving JSE Top 60 data. We show that using a singular performance metric is misleading in our financial market investment use cases where deep learning models overfit in learning spatio-temporal correlation dynamics.
Complexity vs Empirical Score
- Math Complexity: 9.2/10
- Empirical Rigor: 4.5/10
- Quadrant: Lab Rats — high math complexity, limited empirical testing
Why this score: The paper employs advanced deep learning on Riemannian manifolds (SPD matrices) and uses synthetic data for controlled experiments, showing high mathematical complexity but limited backtest-ready implementation details, aligning with the Lab Rats quadrant.
Research Flowchart
flowchart TD A["Research Goal:<br>Deep Representation Learning<br>for Financial Regime Detection"] --> B["Data Configurations"] B --> C["JSE Top 60<br>Randomized"] B --> D["Synthetic Block<br>Hierarchical SPD"] B --> E["JSE Top 60<br>Chronology-Preserving"] C & D & E --> F["Computational Process:<br>Three SPD-Net Variants<br>SPDNet / SPD-NetBN / U-SPDNet"] F --> G["Key Findings"] G --> H["Deep models overfit<br>spatio-temporal dynamics"] G --> I["Singular performance<br>metrics are misleading<br>in investment use cases"]
Evidence Card
What the authors claim, on what data, and who has checked it. Read from the paper's own text by a language model: every quote is verbatim, nothing was re-run. How to read this card
Proposes
The paper proposes using deep representation learning models (SPDNet, SPDNetBN, U‑SPDNet) on hierarchical SPD correlation matrices for financial market regime detection.
Source sentence
We consider financial market regime detection from the perspective of deep representation learning of the causal information geometry underpinning traded asset systems using a hierarchical correlation structure to characterise market evolution.
Assumes 2
- The analysis assumes underlying data may violate Gaussianity and stationarity, requiring robustness. statistical
Source sentence
Novel approaches have been developed to address the key problems related to the assumptions of Guassianity, stationarity, and the need to address robustness and reflexivity
- Backtesting assumes no trading costs are incurred. execution
Source sentence
Fig. 11: MVPO backtesting. We perform daily-rebalanced portfolio optimisation backtesting on the OOS JSE Top 60 data set from 01-2008 - 07-2012 with no trading costs.
Data
- JSE Top 60 daily equity returns market-prices commercial
Source sentence
To conduct a real‑world application of the selected manifold learning techniques for regime classification, the set of daily equity returns of the top 60 high‑capitalised stocks traded on the JSE over the period January 2000 - December 2023 is considered.
- Synthetic block‑hierarchical SPD correlation matrices synthetic unknown
Source sentence
The synthetic construction uses techniques for nested factor timeseries generation as proposed by Yelibi and Gebbie (2021) to create 5 clusters with 3 hierarchies each, sampled from Student’s t‑distribution with v = 3 d.o.f.
Costs
Not modeled
Finds 3
- Riemannian batch‑normalisation layers improve market state classification accuracy across models. predictive-accuracy
Source sentence
the introduction of Riemannian batchnorm layers improves the market state classification accuracy, irrespective of the dataset used for training
- Increasing model depth beyond the baseline does not improve classification accuracy; performance converges around 71% (real‑world) and 66% (synthetic). predictive-accuracy
Source sentence
increased depth holds no relationship with improved classification accuracy since the performance measure convergence occurs within a narrow band around 71% and 66% for the real‑world and synthetic data scenarios
- Mean‑Variance portfolio optimisation outperforms both regime‑dependent strategies after 2010, though U‑SPDNet regime‑dependent strategy outperforms before 2010 during stressed periods. performance
Source sentence
Before 2010 the U‑SPDNet regime‑dependent strategy outperforms both the benchmark mean‑variance and SPDNet regime‑dependent strategies during the stressed market periods
Checked by others
No other paper in the archive has been found to support or contradict these findings (compared with 14 related papers). Coverage is partial, so this is neither replication nor refutation.
Extracted 2026-11-14 · same card as JSON · A language model chose these items: check the source sentence before relying on one.
Cited References (82)
- Epistemic Limits of Empirical Finance: Causal Reductionism and Self-Reference — → 2311.16570
- Dissecting financial markets: sectors and states (2002) — link
- Agglomerative likelihood clustering (2021) — link
- Hierarchically nested factor model from multivariate data (2007) — link
- Correlation, hierarchies, and networks in financial markets (2010)
- A tool for filtering information in complex systems (2005) — link
- DYNAMIC HIERARCHICAL FACTOR MODELS (2013)
- Hierarchical structure in financial markets (1999)
and 74 more
- Information and hierarchical structure in financial markets (1999)
- On clustering financial time series: a need for distances between dependent random variables (2016) — link
- Statistically validated hierarchical clustering: Nested partitions in hierarchical trees (2022)
- Noise Thresholds for Spectral Clustering (2011) — link
- Efficient Active Algorithms for Hierarchical Clustering (2012)
- The development of hierarchical factor solutions (1957)
- Matrix Evolutions: Synthetic Correlations and Explainable Machine Learning for Constructing Robust Investment Portfolios (2021)
- Data clustering and noise undressing of correlation matrices (2001)
- Returns-Driven Macro Regimes and Characteristic Lead-Lag Behaviour between Asset Classes (2022) — link
- How Regimes Affect Asset Allocation (2004)
- Emergence of time-horizon invariant correlation structure in financial returns by subtraction of the market mode (2007) — link
- A hybrid learning approach to detecting regime switches in financial markets (2020) — link
- CorrGAN: Sampling Realistic Financial Correlation Matrices Using Generative Adversarial Networks (2020) — link
- Hierarchical Causality in Financial Economics (2014) — link
- Taxonomy of stock market indices (2000)
- Financial Applications of Random Matrix Theory: a short review (2011)
- A first course in random matrix theory : for physicists, engineers and data scientists (2021)
- Noise Dressing of Financial Correlation Matrices (1999) — link
- The Science of Can and Can’t: A Physicist’s Journey through the Land of Counterfactuals (2021)
- The Poverty of Historicism, I (1944)
- Riemannian batch normalization for SPD neural networks (2019) — link
- A Riemannian Network for SPD Matrix Learning (2016) — link
- Geometric means in a novel vector space structure on symmetric positive-definite matrices (2007)
- Positive definite matrices and the S-divergence (2013) — link
- Training Deep Networks with Structured Layers by Matrix Backpropagation (2016) — link
- SEMANTIC SEGMENTATION METHOD WITH SECOND-ORDER POOLING (2015)
- The Geometry of Algorithms with Orthogonality Constraints (2006) — link
- Jean-Louis Koszul and the Elementary Structures of Information Geometry (2019)
- On the Fisher-Rao Information Metric in the Space of Normal Distributions (2019) — link
- A Riemannian Framework for Tensor Computing (2006)
- Natural Langevin Dynamics for Neural Networks (2017)
- Rao’s Distance Measure (1981)
- Information Geometry and Its Applications: On the Occasion of Shun-Ichi Amari’s 80th Birthday, IGAIA IV Liblice, Czech Republic, June 2016 (2018)
- Averaging Symmetric Positive-Definite Matrices (2020)
- Riemannian Gaussian Distributions on the Space of Symmetric Positive Definite Matrices (2017)
- Geometric means (2004)
- Riemannian geometry and matrix geometric means (2006)
- Riemannian median, geometry of covariance matrices and radar target detection (2010)
- Riemannian median and its estimation (2010) — link
- The geometric median on Riemannian manifolds with application to robust atlas estimation (2009)
- Parallel Transport on the Cone Manifold of SPD Matrices for Domain Adaptation (2019) — link
- Riemannian metric and geometric mean for positive semidefinite matrices of fixed rank (2009)
- The Riemannian Barycentre as a Proxy for Global Optimisation (2019)
- Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift (2015) — link
- Gradient-based learning applied to document recognition (1998)
- DeepKSPD: Learning Kernel-Matrix-Based SPD Representation For Fine-Grained Image Recognition (2018) — link
- Transfer Learning: A Riemannian Geometry Framework With Applications to Brain-Computer Interfaces (2018)
- Optimization Algorithms on Matrix Manifolds (2010)
- DeepKSPD: Learning Kernel-matrix-based SPD Representation for Fine-grained Image Recognition (2017) — link
- Classification of Correlation Matrices using SPDNet with Riemannian Batch Normalization (2021) — link
- Can we predict a market regime from correlation matrix features? (2020) — link
- Approximation by superpositions of a sigmoidal function (1989) — link
- DreamNet: A Deep Riemannian Network based on SPD Manifold Learning for Visual Classification (2022) — link
- U-SPDNet: An SPD manifold learning-based neural network for visual classification (2022) — link
- U-Net: Convolutional Networks for Biomedical Image Segmentation (2015) — link
- Geometry Regularized Autoencoders (2023) — link
- Tactical investment algorithms through Monte Carlo backtesting (2022)
- Statistical Consequences of Fat Tails: Real World Preasymptotics, Epistemology, and Applications (2022) — link
- timeseries_generator (2021) — link
- BH-SPD-CorrMat-Nets (2024) — link
- Representation Learning for Regime Detection in Block Hierarchical Financial Markets (2024)
- A Review of Two Decades of Correlations, Hierarchies, Networks and Clustering in Financial Markets (2021) — link
- Advances in financial machine learning (2018)
- Market state discovery (2022)
- The Impact of Bootstrap Methods on Time Series Analysis (2003)
- Portfolio optimization based on neural networks sensitivities from assets dynamics respect common drivers (2023)
- GNU Parallel 20230822 (‘Chandrayaan’) (2023) — link
- Dynamic portfolio optimization across hidden market regimes (2018) — link
- Detecting intraday financial market states using temporal clustering (2016) — link
- Modeling and pricing long memory in stock market volatility (1996)
- Fallibility, reflexivity, and the human uncertainty principle (2013)
- Empirical properties of asset returns: stylized facts and statistical issues (2000)
- Portfolio optimization for student t and skewed t returns (2010)
- Second-Order Networks in PyTorch (2019)
1 of 82 cited works are in the corpus; resolved via arXiv source bundles, Semantic Scholar and OpenAlex. Corpus-wide: 2596 linked papers.