Paper: arXiv 2511.05463

Authors: Manan Vyas, M. Mijaíl Martínez-Ramos, Parisa Majari, Thomas H. Seligman

Abstract

Starting from the Pearson Correlation Matrix of stock returns and from the desire to obtain a reduced number of parameters relevant for the dynamics of a financial market, we propose to take the idea of a sectorial matrix, which would have a large number of parameters, to the reduced picture of a real symmetric \(2 \times 2\) matrix, extreme case, that still conserves the desirable feature that the average correlation can be one of the parameters. This is achieved by averaging the correlation matrix over blocks created by choosing two subsets of stocks for rows and columns and averaging over each of the resulting blocks. Averaging over these blocks, we retain the average of the correlation matrix. We shall use a random selection for two equal block sizes as well as two specific, hopefully relevant, ones that do not produce equal block sizes. The results show that one of the non-random choices has somewhat different properties, whose meaning will have to be analyzed from an economy point of view.

Complexity vs Empirical Score

  • Math Complexity: 4.0/10
  • Empirical Rigor: 6.5/10
  • Quadrant: Street Traders — empirical and applied, lower math complexity

Why this score: The mathematics is moderate, relying on standard correlation matrices and averaging, without advanced derivations. The paper is empirically rigorous, using real S&P 500 data over 4,430 days with detailed methodology, clustering (k-means), and specific numerical comparisons for different stock subset choices.

Research Flowchart

  flowchart TD
  A["Research Goal<br>Reduce Correlation Matrix<br>Dimensionality"] --> B["Input: Pearson Correlation<br>Matrix of S&P 500 Returns"]
  B --> C["Method: Block Averaging<br>Partition rows/columns into subsets"]
  C --> D{"Random Selection<br>vs. Specific Selection"}
  D -- Random --> E["Random Blocks<br>(Equal/Unequal Sizes)"]
  D -- Specific --> F["Specific Blocks<br>(Economy-Relevant Sectors)"]
  E --> G["Compute Averaged<br>2x2 Symmetric Matrix"]
  F --> G
  G --> H["Key Findings<br>Specific selection yields<br>unique dynamic properties<br>Avg. correlation retained as parameter"]

Evidence Card

What the authors claim, on what data, and who has checked it. Read from the paper's own text by a language model: every quote is verbatim, nothing was re-run. How to read this card

Proposes

The paper proposes to coarse‑grain the Pearson correlation matrix of S&P 500 stock returns into a real symmetric 2 × 2 matrix that retains the average correlation as a parameter.

Source sentence
Starting from the Pearson Correlation Matrix of stock returns and from the desire to obtain a reduced number of parameters relevant for the dynamics of a financial market, we propose to take the idea of a sectorial matrix, which would have a large number of parameters, to the reduced picture of a real symmetric $2 \times 2$ matrix, extreme case, that still conserves the desirable feature that the average correlation

Assumes 5

  • Returns are set to zero on days without a closing quote. data
    Source sentence
    (1) For the corresponding returns, we assume zero for the days without closing quote while the return for the active trading day is computed using last active trading day.
  • The correlation matrix is computed from logarithmic returns of adjusted closing prices. model
    Source sentence
    Pearson correlation matrix elements are computed using logarithmic return time series of adjusted closing prices. We divide the total time horizon T into epochs of 20 trading days, shifted by one trading day, and use logarithmic returns r between these days as the dataset, given the adjusted closing price pi(t) of trading day t for stock i, ri(t) = log  pi(t) pi(t −1)  .
  • The time horizon is divided into epochs of 20 trading days with a one‑day shift. data
    Source sentence
    We divide the total time horizon T into epochs of 20 trading days, shifted by one trading day, and use logarithmic returns r between these days as the dataset, given the adjusted closing price pi(t) of trading day t for stock i, ri(t) = log  pi(t) pi(t −1)  . The time horizon divided into epochs of 20 trading days with one trading day shift will define our set of data matrices from which we calculate the
  • Two blocks are formed either randomly with equal size or by selecting stocks with strong intra‑ or inter‑sectorial correlations. model
    Source sentence
    We will use just two blocks, which we shall choose at random but of equal size, or intuitively depending upon the intra- and inter-sectorial correlations. Note that in Choice 1, we choose sectors with strong intra-sectorial correlations (EG, FN, TC, UT) as the first block and rest of the sectors as second block; in Choice 2, we choose sectors with strong inter-sectorial correlations (CD, FN, ID) as first block and
Show 1 more
  • The Pearson correlation matrix elements are averaged within each block (excluding self‑correlations) to form the 2 × 2 extreme coarse‑grained matrix. model
    Source sentence
    Then, we sum all the correlation matrix elements inside each block (excluding the self-correlations) and divide by the total number of correlation matrix elements in the block resulting in a 2 × 2 dimensional extreme coarse grained (ECG) correlation matrix for each epoch.

Data

  • Adjusted end‑of‑day price returns of S&P 500 stocks · Yahoo Finance market-prices public
    2006‑01‑03 to 2023‑08‑10 · 322 S&P 500 constituents (after filtering)
    Source sentence
    2 Data and Methodology For the present analysis, we use as data the returns for adjusted end of day prices of the stocks of the S&P 500 index. The reason for this is the obvious representativity of the stocks selected as the most relevant components on the New York Stock exchange and NASDAQ.

Costs

Not applicable The paper reports no trading or execution result.

Finds 4

  • Using a 2 × 2 extreme coarse‑grained correlation matrix reduces the number of parameters to three while preserving the average correlation. theoretical
    Source sentence
    In this paper, we plan to extend the analysis to 2 × 2 dimensional correlation matrices, which generates only three parameters.
  • The approach yields similar clustering results to sectorial coarse‑graining at lower computational cost. statistical
    Source sentence
    We shall see that under typical circumstances similar results are obtained at a lower computational cost, reducing the number of parameters to three.
  • Transition matrices between market states are near‑tridiagonal, satisfying the Markovianity criterion. statistical
    Source sentence
    The transition matrices are near-tridiagonal. Also, the necessary criterion for Markovianity given in Eq. (2) of [2] is fulfilled for both.
  • The COVID‑related market state appears only after 2019 and is not captured by the extreme coarse‑grained representation. other
    Source sentence
    Also, comparison with the time horizon until 2019 showed that the COVID state did not exist previously.

Checked by others

No other paper in the archive has been found to support or contradict these findings (compared with 13 related papers). Coverage is partial, so this is neither replication nor refutation.

Code

No repository by the authors found in the paper.

Extracted 2026-11-14 · same card as JSON · A language model chose these items: check the source sentence before relying on one.

Cited References (34)

  1. Global Development Patterns: A Clustering Analysis of Economic, Social and Environmental Indicators (2025) — link
  2. Refining coarse-grained molecular topologies: a Bayesian optimization approach (2025) — link
  3. Coarse graining correlation matrices according to macrostructures: financial markets as a paradigm — → 2402.05364
  4. COVID anomaly in the correlation analysis of S&P 500 market states (2023) — link
  5. Non-linear correlation analysis in financial markets using hierarchical clustering — → 2301.05080
  6. Bottom-up Coarse-Graining: Principles and Perspectives (2022) — link
  7. New collectivity measures for financial covariances and correlations (2022) — link
  8. Simultaneous Decorrelation of Matrix Time Series (2021) — link
and 26 more
  1. Bottom-Up Coarse-Grained Modeling of DNA (2021) — link
  2. Dynamics of market states and risk assessment (2020) — link
  3. Emerging spectra characterization of catastrophic instabilities in complex systems (2020) — link
  4. Phase separation and scaling in correlation structures of financial markets (2019) — link
  5. Coarse-graining auto-encoders for molecular dynamics (2018) — link
  6. Complex Market Dynamics in the Light of Random Matrix Theory (2018) — link
  7. Identifying long-term precursors of financial market crashes using correlation patterns (2018) — link
  8. Dynamic of consumer groups and response of commodity markets by principal component analysis (2017) — link
  9. Complex network analysis of time series (2016) — link
  10. Universal resilience patterns in complex networks (2016) — link
  11. Dynamics of quasi-stationary systems: Finance as an example (2015) — link
  12. Community detection for correlation matrices (2013) — link
  13. Emerging spectra of singular correlation matrices under small power-map deformations. (2013) — link
  14. Identifying States of a Financial Market (2012) — link
  15. On the Complex Definition of Risk: A Systems‐Based Approach (2009) — link
  16. Data clustering: 50 years beyond K-means (2008) — link
  17. Detecting synchronization clusters in multivariate time series via coarse-graining of Markov chains. (2007) — link
  18. A New Method to Estimate the Noise in Financial Correlation Matrices (2002) — link
  19. An Introduction to Econophysics: Correlations and Complexity in Finance (1999)
  20. Modern Multidimensional Scaling: Theory and Applications (1999) — link
  21. Coarse-grained embeddings of time series: random walks, Gaussian random processes, and deterministic chaos (1993) — link
  22. The Advanced Theory of Statistics: Volume 2: Inference and Relationship (1963) — link
  23. K-means clustering tutorial (2006)
  24. Journal vv
  25. Cognizant Technology Solutions Corporation
  26. Market state dynamics in correlation matrix space

2 of 34 cited works are in the corpus; resolved via arXiv source bundles, Semantic Scholar and OpenAlex. Corpus-wide: 2596 linked papers.