{"paper_id":"2509.13923","title":"Holdout cross-validation for large non-Gaussian covariance matrix estimation using Weingarten calculus","authors":["Lamia Lamrani","Benoît Collins","Jean-Philippe Bouchaud"],"paper_date":"2025-09-17","paper_type":"theoretical","paper_url":"https://arxiv.org/pdf/2509.13923v1","page_url":"https://thequant.space/flowcharts/holdout-cross-validation-for-large-non-gaussian-covariance-m/","scores":{"empirical_rigor":3,"math_complexity":8.5,"quadrant":"Lab Rats"},"proposes":{"status":"available","statement":"The paper derives the expected Frobenius holdout error for rotationally invariant multiplicative noise models using Weingarten calculus and extends the analysis to non‑Gaussian noise distributions.","quote":"In this paper, we derive the expected Frobenius error of the holdout method, a particular cross-validation procedure that involves a single train and test split, for a generic rotationally invariant multiplicative noise model, therefore extending previous results to non-Gaussian data distributions. Our approach involves using the Weingarten calculus and the Ledoit-Péché formula to derive the oracle eigenvalues in","summary":"Cross-validation is one of the most widely used methods for model selection and evaluation; its efficiency for large covariance matrix estimation appears robust in practice, but little is known about the theoretical behavior of its error. In this paper, we derive the expected Frobenius error of the…","strategy":null},"assumptions":{"status":"available","items":[{"assumption":"The population covariance matrix Σ follows an inverse Wishart distribution.","type":"model","stated":"explicit","quote":"However, when the population covariance matrix Σ is inverse Wishart and the data are Gaussian, the computations reduce to the linear shrinkage described in Proposition (1). In the following section, we will approximate the oracle eigenvalues using first a linear, then a quadratic shrinkage and will consider an inverse Wishart population covariance matrix.","support":"full"},{"assumption":"The noise vectors are rotationally invariant (multiplicative noise model).","type":"data","stated":"explicit","quote":"Although the data are not assumed Gaussian but rotationally invariant, we will approximate the oracle eigenvalues by the eigenvalues of the optimal linear shrinkage given in proposition (1), let us define Diag(V t inΣVin)L as the diagonal matrix containing the optimal linear shrinkage eigenvalues, i.e. for i an integer between 1 and n (Diag(V t inΣVin)L)ii = rλEin i + (1 −r),","support":"full"},{"assumption":"Finite sixth and eighth moments of the noise norm are assumed (E‖ξ‖⁶<∞ and E‖ξ‖⁸<∞).","type":"statistical","stated":"explicit","quote":"When Σ is an inverse Wishart of parameters n and p such that p is negligible in front of n, under the assumptions of proposition (3) and by assuming that E \u0002 ∥ξ∥6\u0003 < ∞ (83) and E \u0002 ∥ξ∥8\u0003 < ∞, (84) the expected holdout Frobenius error written in Eq. (82) in the high dimension limit equals E \u0000∥ΞH −Σ∥2 Q \u0001 = \" k t 3E \u0002 Tr((ξξT )2) \u0003 n(n + 2) −1 ! −1 # E + 1 + p,","support":"full"}]},"datasets":{"status":"available","items":[{"name":"Monte Carlo simulations of rotationally invariant noise","provider":null,"kind":"synthetic","access":"unknown","period":null,"universe":null,"quote":"(87) 4 Applications to rotationally invariant noise distributions In this section, we compute the expected holdout error for different rotationally invariant noise distributions. For stability, the Monte Carlo is averaged over 20000 simulations for different distributions of the norm of the noise, namely Gaussian, Student and Laplace as defined in 4.","support":"full"}],"known":[],"sample":{"start":null,"end":null,"market":null,"asset_class":null,"frequency":null},"data_resolution":"synthetic"},"transaction_costs":{"status":"not_applicable","modeled":"n/a","headline_net_of_costs":null,"detail":null,"quote":null,"source":"front_matter","rule":"R3","candidates":{"front_matter":"n/a","evidence_card":"n/a","evidence_card_quoted":false},"meaning":"the paper reports no trading or execution result"},"results":{"status":"available","evaluation_type":"none","findings":[{"finding":"Under the linear shrinkage approximation, the optimal train‑test split ratio is proportional to the square root of the matrix dimension.","kind":"theoretical","quote":"Under the linear approximation, we find that the optimal train-test split ratio is proportional to the square root of the matrix dimension.","support":"full"},{"finding":"The quadratic shrinkage approximation yields a substantial improvement in holdout error, especially around the optimal train‑test split ratio.","kind":"theoretical","quote":"Then we compute Monte Carlo simulations of the holdout error for different distributions of the norm of the noise, such as the Gaussian, Student, and Laplace distributions and observe that the quadratic approximation yields a substantial improvement, especially around the optimal train-test split ratio.","support":"full"},{"finding":"A higher fourth‑order moment of the noise norm sharpens the holdout error curve near the optimal split and lowers the ideal train‑test ratio.","kind":"theoretical","quote":"We also observe that a higher fourth-order moment of the Euclidean norm of the noise vector sharpens the holdout error curve near the optimal split and lowers the ideal train-test ratio, making the choice of the train-test ratio more important when performing the holdout method.","support":"full"},{"finding":"Monte Carlo simulations confirm that the quadratic approximation reduces the error compared to the linear approximation for Gaussian, Student, and Laplace noise norms.","kind":"performance","quote":"For stability, the Monte Carlo is averaged over 20000 simulations for different distributions of the norm of the noise, namely Gaussian, Student and Laplace as defined in 4. We observe a small negative bias in the simulations which becomes more visible for higher values of γ.","support":"full"},{"finding":"A small negative bias is observed in simulations, becoming more pronounced for higher values of the noise‑norm factor γ.","kind":"statistical","quote":"We observe a small negative bias in the simulations which becomes more visible for higher values of γ. Furthermore, the higher the value of γ, the higher the dispersion of the error around its mean making the choice of the optimal k more important.","support":"full"}],"reported_performance":null,"out_of_sample":{"method":"none","headline_out_of_sample":null}},"independent_evidence":{"status":"none_found","supports":[],"contradicts":[],"qualifies":[],"compared_with":14,"citations":{"cited_by_in_corpus":0,"by_independent_authors":0,"how_cited":{"used_as_baseline":0,"uses_method_or_data":0,"extends":0,"discusses_findings":0,"mentions":0,"unclassified":0},"independent_papers":[],"scope":"Citations between papers in this corpus only; citations from outside it are not counted."}},"implementation":{"status":"available","public":false,"code_url":null,"note":"No repository presented by the authors as their own was found in the paper. Absence here is not proof that no code exists."},"replication":{"status":"none_found","card":null,"note":"No replication of this paper has been run by thequant.space yet."},"extraction":{"text_source":"fulltext","model":"openai/gpt-oss-120b","version":2,"extracted_at":"2026-11-14T19:47:42Z"},"provenance":{"claims":"Everything here is what the authors state in the paper. Nothing was re-run or reproduced by the platform.","quotes":"Assumptions, datasets, cost detail and findings were extracted by a language model. Every quote is verbatim paper text. Where an item has `support`, \"full\" means every figure in it appears in the quoted sentences and \"partial\" means a figure is stated elsewhere in the paper; items with a figure found nowhere in the paper were discarded.","datasets_known":"datasets.known lists well-known vendors and public datasets by a stable id, found by a dictionary over the full text where the sentence says the data is used; it is independent of the model and covers only names in the dictionary.","flags":"transaction_costs.modeled, results.evaluation_type and results.out_of_sample.method are platform classifications (structured-decision models); see https://thequant.space/score-guide/#penalty-flags","comparisons":"supports / contradicts / qualifies are a language model's reading of two papers' quoted findings, restricted to closely related papers that share no author. They are pointers to read, not verified replications, and coverage is partial.","implementation":"code_url is a repository the paper itself presents as its own (rule-scored, ambiguous cases judged by a model), checked for liveness when it was recorded."},"docs":"https://thequant.space/agents/"}