Paper: arXiv 2511.05463
Authors: Manan Vyas, M. Mijaíl Martínez-Ramos, Parisa Majari, Thomas H. Seligman
Abstract
Starting from the Pearson Correlation Matrix of stock returns and from the desire to obtain a reduced number of parameters relevant for the dynamics of a financial market, we propose to take the idea of a sectorial matrix, which would have a large number of parameters, to the reduced picture of a real symmetric \(2 \times 2\) matrix, extreme case, that still conserves the desirable feature that the average correlation can be one of the parameters. This is achieved by averaging the correlation matrix over blocks created by choosing two subsets of stocks for rows and columns and averaging over each of the resulting blocks. Averaging over these blocks, we retain the average of the correlation matrix. We shall use a random selection for two equal block sizes as well as two specific, hopefully relevant, ones that do not produce equal block sizes. The results show that one of the non-random choices has somewhat different properties, whose meaning will have to be analyzed from an economy point of view.
Complexity vs Empirical Score
- Math Complexity: 4.0/10
- Empirical Rigor: 6.5/10
- Quadrant: Street Traders — empirical and applied, lower math complexity
Why this score: The mathematics is moderate, relying on standard correlation matrices and averaging, without advanced derivations. The paper is empirically rigorous, using real S&P 500 data over 4,430 days with detailed methodology, clustering (k-means), and specific numerical comparisons for different stock subset choices.
Research Flowchart
flowchart TD
A["Research Goal<br>Reduce Correlation Matrix<br>Dimensionality"] --> B["Input: Pearson Correlation<br>Matrix of S&P 500 Returns"]
B --> C["Method: Block Averaging<br>Partition rows/columns into subsets"]
C --> D{"Random Selection<br>vs. Specific Selection"}
D -- Random --> E["Random Blocks<br>(Equal/Unequal Sizes)"]
D -- Specific --> F["Specific Blocks<br>(Economy-Relevant Sectors)"]
E --> G["Compute Averaged<br>2x2 Symmetric Matrix"]
F --> G
G --> H["Key Findings<br>Specific selection yields<br>unique dynamic properties<br>Avg. correlation retained as parameter"]
Evidence Card
What the authors claim, on what data, and who has checked it. Read from the paper's own text by a language model: every quote is verbatim, nothing was re-run. How to read this card
Proposes
The paper proposes to coarse‑grain the Pearson correlation matrix of S&P 500 stock returns into a real symmetric 2 × 2 matrix that retains the average correlation as a parameter.
Source sentence
Starting from the Pearson Correlation Matrix of stock returns and from the desire to obtain a reduced number of parameters relevant for the dynamics of a financial market, we propose to take the idea of a sectorial matrix, which would have a large number of parameters, to the reduced picture of a real symmetric $2 \times 2$ matrix, extreme case, that still conserves the desirable feature that the average correlation
Assumes 5
- Returns are set to zero on days without a closing quote. data
Source sentence
(1) For the corresponding returns, we assume zero for the days without closing quote while the return for the active trading day is computed using last active trading day.
- The correlation matrix is computed from logarithmic returns of adjusted closing prices. model
Source sentence
Pearson correlation matrix elements are computed using logarithmic return time series of adjusted closing prices. We divide the total time horizon T into epochs of 20 trading days, shifted by one trading day, and use logarithmic returns r between these days as the dataset, given the adjusted closing price pi(t) of trading day t for stock i, ri(t) = log pi(t) pi(t −1) .
- The time horizon is divided into epochs of 20 trading days with a one‑day shift. data
Source sentence
We divide the total time horizon T into epochs of 20 trading days, shifted by one trading day, and use logarithmic returns r between these days as the dataset, given the adjusted closing price pi(t) of trading day t for stock i, ri(t) = log pi(t) pi(t −1) . The time horizon divided into epochs of 20 trading days with one trading day shift will define our set of data matrices from which we calculate the
- Two blocks are formed either randomly with equal size or by selecting stocks with strong intra‑ or inter‑sectorial correlations. model
Source sentence
We will use just two blocks, which we shall choose at random but of equal size, or intuitively depending upon the intra- and inter-sectorial correlations. Note that in Choice 1, we choose sectors with strong intra-sectorial correlations (EG, FN, TC, UT) as the first block and rest of the sectors as second block; in Choice 2, we choose sectors with strong inter-sectorial correlations (CD, FN, ID) as first block and
Show 1 more
- The Pearson correlation matrix elements are averaged within each block (excluding self‑correlations) to form the 2 × 2 extreme coarse‑grained matrix. model
Source sentence
Then, we sum all the correlation matrix elements inside each block (excluding the self-correlations) and divide by the total number of correlation matrix elements in the block resulting in a 2 × 2 dimensional extreme coarse grained (ECG) correlation matrix for each epoch.
Data
- Adjusted end‑of‑day price returns of S&P 500 stocks market-prices public
Source sentence
2 Data and Methodology For the present analysis, we use as data the returns for adjusted end of day prices of the stocks of the S&P 500 index. The reason for this is the obvious representativity of the stocks selected as the most relevant components on the New York Stock exchange and NASDAQ.
Costs
Not applicable
Finds 4
- Using a 2 × 2 extreme coarse‑grained correlation matrix reduces the number of parameters to three while preserving the average correlation. theoretical
Source sentence
In this paper, we plan to extend the analysis to 2 × 2 dimensional correlation matrices, which generates only three parameters.
- The approach yields similar clustering results to sectorial coarse‑graining at lower computational cost. statistical
Source sentence
We shall see that under typical circumstances similar results are obtained at a lower computational cost, reducing the number of parameters to three.
- Transition matrices between market states are near‑tridiagonal, satisfying the Markovianity criterion. statistical
Source sentence
The transition matrices are near-tridiagonal. Also, the necessary criterion for Markovianity given in Eq. (2) of [2] is fulfilled for both.
- The COVID‑related market state appears only after 2019 and is not captured by the extreme coarse‑grained representation. other
Source sentence
Also, comparison with the time horizon until 2019 showed that the COVID state did not exist previously.
Checked by others
No other paper in the archive has been found to support or contradict these findings (compared with 13 related papers). Coverage is partial, so this is neither replication nor refutation.
Code
No repository by the authors found in the paper.
Extracted 2026-11-14 · same card as JSON · A language model chose these items: check the source sentence before relying on one.
Cited References (34)
- Global Development Patterns: A Clustering Analysis of Economic, Social and Environmental Indicators (2025) — link
- Refining coarse-grained molecular topologies: a Bayesian optimization approach (2025) — link
- Coarse graining correlation matrices according to macrostructures: financial markets as a paradigm — → 2402.05364
- COVID anomaly in the correlation analysis of S&P 500 market states (2023) — link
- Non-linear correlation analysis in financial markets using hierarchical clustering — → 2301.05080
- Bottom-up Coarse-Graining: Principles and Perspectives (2022) — link
- New collectivity measures for financial covariances and correlations (2022) — link
- Simultaneous Decorrelation of Matrix Time Series (2021) — link
and 26 more
- Bottom-Up Coarse-Grained Modeling of DNA (2021) — link
- Dynamics of market states and risk assessment (2020) — link
- Emerging spectra characterization of catastrophic instabilities in complex systems (2020) — link
- Phase separation and scaling in correlation structures of financial markets (2019) — link
- Coarse-graining auto-encoders for molecular dynamics (2018) — link
- Complex Market Dynamics in the Light of Random Matrix Theory (2018) — link
- Identifying long-term precursors of financial market crashes using correlation patterns (2018) — link
- Dynamic of consumer groups and response of commodity markets by principal component analysis (2017) — link
- Complex network analysis of time series (2016) — link
- Universal resilience patterns in complex networks (2016) — link
- Dynamics of quasi-stationary systems: Finance as an example (2015) — link
- Community detection for correlation matrices (2013) — link
- Emerging spectra of singular correlation matrices under small power-map deformations. (2013) — link
- Identifying States of a Financial Market (2012) — link
- On the Complex Definition of Risk: A Systems‐Based Approach (2009) — link
- Data clustering: 50 years beyond K-means (2008) — link
- Detecting synchronization clusters in multivariate time series via coarse-graining of Markov chains. (2007) — link
- A New Method to Estimate the Noise in Financial Correlation Matrices (2002) — link
- An Introduction to Econophysics: Correlations and Complexity in Finance (1999)
- Modern Multidimensional Scaling: Theory and Applications (1999) — link
- Coarse-grained embeddings of time series: random walks, Gaussian random processes, and deterministic chaos (1993) — link
- The Advanced Theory of Statistics: Volume 2: Inference and Relationship (1963) — link
- K-means clustering tutorial (2006)
- Journal vv
- Cognizant Technology Solutions Corporation
- Market state dynamics in correlation matrix space
2 of 34 cited works are in the corpus; resolved via arXiv source bundles, Semantic Scholar and OpenAlex. Corpus-wide: 2596 linked papers.