Noise Reduction

Eigenvalue Distribution of Empirical Correlation Matrices for Multiscale Complex Systems and Application to Financial Data ArXiv ID: 2507.14325 “View on arXiv” Authors: Luan M. T. de Moraes, Antônio M. S. Macêdo, Giovani L. Vasconcelos, Raydonal Ospina Abstract We introduce a method for describing eigenvalue distributions of correlation matrices from multidimensional time series. Using our newly developed matrix H theory, we improve the description of eigenvalue spectra for empirical correlation matrices in multivariate financial data by considering an informational cascade modeled as a hierarchical structure akin to the Kolmogorov statistical theory of turbulence. Our approach extends the Marchenko-Pastur distribution to account for distinct characteristic scales, capturing a larger fraction of data variance, and challenging the traditional view of noise-dressed financial markets. We conjecture that the effectiveness of our method stems from the increased complexity in financial markets, reflected by new characteristic scales and the growth of computational trading. These findings not only support the turbulent market hypothesis as a source of noise but also provide a practical framework for noise reduction in empirical correlation matrices, enhancing the inference of true market correlations between assets. ...

Noise reduction for functional time series ArXiv ID: 2307.02154 “View on arXiv” Authors: Unknown Abstract A novel method for noise reduction in the setting of curve time series with error contamination is proposed, based on extending the framework of functional principal component analysis (FPCA). We employ the underlying, finite-dimensional dynamics of the functional time series to separate the serially dependent dynamical part of the observed curves from the noise. Upon identifying the subspaces of the signal and idiosyncratic components, we construct a projection of the observed curve time series along the noise subspace, resulting in an estimate of the underlying denoised curves. This projection is optimal in the sense that it minimizes the mean integrated squared error. By applying our method to similated and real data, we show the denoising estimator is consistent and outperforms existing denoising techniques. Furthermore, we show it can be used as a pre-processing step to improve forecasting. ...