Random Matrix Theory

Decomposition Pipeline for Large-Scale Portfolio Optimization with Applications to Near-Term Quantum Computing ArXiv ID: 2409.10301 “View on arXiv” Authors: Unknown Abstract Industrially relevant constrained optimization problems, such as portfolio optimization and portfolio rebalancing, are often intractable or difficult to solve exactly. In this work, we propose and benchmark a decomposition pipeline targeting portfolio optimization and rebalancing problems with constraints. The pipeline decomposes the optimization problem into constrained subproblems, which are then solved separately and aggregated to give a final result. Our pipeline includes three main components: preprocessing of correlation matrices based on random matrix theory, modified spectral clustering based on Newman’s algorithm, and risk rebalancing. Our empirical results show that our pipeline consistently decomposes real-world portfolio optimization problems into subproblems with a size reduction of approximately 80%. Since subproblems are then solved independently, our pipeline drastically reduces the total computation time for state-of-the-art solvers. Moreover, by decomposing large problems into several smaller subproblems, the pipeline enables the use of near-term quantum devices as solvers, providing a path toward practical utility of quantum computers in portfolio optimization. ...

Inferring financial stock returns correlation from complex network analysis ArXiv ID: 2407.20380 “View on arXiv” Authors: Unknown Abstract Financial stock returns correlations have been studied in the prism of random matrix theory, to distinguish the signal from the “noise”. Eigenvalues of the matrix that are above the rescaled Marchenko Pastur distribution can be interpreted as collective modes behavior while the modes under are usually considered as noise. In this analysis we use complex network analysis to simulate the “noise” and the “market” component of the return correlations, by introducing some meaningful correlations in simulated geometric Brownian motion for the stocks. We find that the returns correlation matrix is dominated by stocks with high eigenvector centrality and clustering found in the network. We then use simulated “market” random walks to build an optimal portfolio and find that the overall return performs better than using the historical mean-variance data, up to 50% on short time scale. ...

Longitudinal market structure detection using a dynamic modularity-spectral algorithm ArXiv ID: 2407.04500 “View on arXiv” Authors: Unknown Abstract In this paper, we introduce the Dynamic Modularity-Spectral Algorithm (DynMSA), a novel approach to identify clusters of stocks with high intra-cluster correlations and low inter-cluster correlations by combining Random Matrix Theory with modularity optimisation and spectral clustering. The primary objective is to uncover hidden market structures and find diversifiers based on return correlations, thereby achieving a more effective risk-reducing portfolio allocation. We applied DynMSA to constituents of the S&P 500 and compared the results to sector- and market-based benchmarks. Besides the conception of this algorithm, our contributions further include implementing a sector-based calibration for modularity optimisation and a correlation-based distance function for spectral clustering. Testing revealed that DynMSA outperforms baseline models in intra- and inter-cluster correlation differences, particularly over medium-term correlation look-backs. It also identifies stable clusters and detects regime changes due to exogenous shocks, such as the COVID-19 pandemic. Portfolios constructed using our clusters showed higher Sortino and Sharpe ratios, lower downside volatility, reduced maximum drawdown and higher annualised returns compared to an equally weighted market benchmark. ...

Dynamic relationship between XRP price and correlation tensor spectra of the transaction network ArXiv ID: 2309.05935 “View on arXiv” Authors: Unknown Abstract The emergence of cryptoassets has sparked a paradigm shift in the world of finance and investment, ushering in a new era of digital assets with profound implications for the future of currency and asset management. A recent study showed that during the bubble period around the year, 2018, the price of cryptoasset, XRP has a strong anti correlation with the largest singular values of the correlation tensors obtained from the weekly XRP transaction networks. In this study, we provide a detailed analysis of the method of correlation tensor spectra for XRP transaction networks. We calculate and compare the distribution of the largest singular values of the correlation tensor using the random matrix theory with the largest singular values of the empirical correlation tensor. We investigate the correlation between the XRP price and the largest singular values for a period spanning two years. We also uncover the distinct dependence between XRP price and the singular values for bubble and non-bubble periods. The significance of time evolution of singular values is shown by comparison with the evolution of singular values of the reshuffled correlation tensor. Furthermore, we identify a set of driver nodes in the transaction networks that drives the market during the bubble period using the singular vectors. ...

Decomposing cryptocurrency high-frequency price dynamics into recurring and noisy components ArXiv ID: 2306.17095 “View on arXiv” Authors: Unknown Abstract This paper investigates the temporal patterns of activity in the cryptocurrency market with a focus on Bitcoin, Ethereum, Dogecoin, and WINkLink from January 2020 to December 2022. Market activity measures - logarithmic returns, volume, and transaction number, sampled every 10 seconds, were divided into intraday and intraweek periods and then further decomposed into recurring and noise components via correlation matrix formalism. The key findings include the distinctive market behavior from traditional stock markets due to the nonexistence of trade opening and closing. This was manifest in three enhanced-activity phases aligning with Asian, European, and U.S. trading sessions. An intriguing pattern of activity surge in 15-minute intervals, particularly at full hours, was also noticed, implying the potential role of algorithmic trading. Most notably, recurring bursts of activity in bitcoin and ether were identified to coincide with the release times of significant U.S. macroeconomic reports such as Nonfarm payrolls, Consumer Price Index data, and Federal Reserve statements. The most correlated daily patterns of activity occurred in 2022, possibly reflecting the documented correlations with U.S. stock indices in the same period. Factors that are external to the inner market dynamics are found to be responsible for the repeatable components of the market dynamics, while the internal factors appear to be substantially random, which manifests itself in a good agreement between the empirical eigenvalue distributions in their bulk and the random matrix theory predictions expressed by the Marchenko-Pastur distribution. The findings reported support the growing integration of cryptocurrencies into the global financial markets. ...