{"paper_id":"2410.17366","title":"Kendall Correlation Coefficients for Portfolio Optimization","authors":["Tomas Espana","Victor Le Coz","Matteo Smerlak"],"paper_date":"2024-10-22","paper_type":"empirical","paper_url":"https://arxiv.org/pdf/2410.17366v1","page_url":"https://thequant.space/flowcharts/kendall-correlation-coefficients-for-portfolio-optimization/","scores":{"empirical_rigor":6,"math_complexity":8,"quadrant":"Holy Grail"},"proposes":{"status":"available","statement":"The paper proposes a class of correlation estimators generalizing Kendall's rank correlation coefficient and a Kendall-specific isotonic cross‑validation covariance method (Kendall ICVC).","quote":"Here we discuss a class of correlation estimators generalizing Kendall's rank correlation coefficient which improve the estimation of both eigenvalues and eigenvectors in data-poor regimes.","summary":"Markowitz’s optimal portfolio relies on the accurate estimation of correlations between asset returns, a difficult problem when the number of observations is not much larger than the number of assets. Using powerful results from random matrix theory, several schemes have been developed to “clean”…","strategy":null},"assumptions":{"status":"available","items":[{"assumption":"After de‑meaning and volatility normalisation, the returns are approximately stationary.","type":"data","stated":"implied","quote":"To a first approximation, these returns are now stationary."},{"assumption":"The ratio q = N/T is used to characterize data‑poverty regimes (e.g., q→0 implies abundant data).","type":"statistical","stated":"explicit","quote":"When q = N/T →0, i.e., when there is infinitely more data than stocks, one expects that E →C."},{"assumption":"Only a minimal expected gain constraint is imposed in the portfolio optimisation.","type":"execution","stated":"explicit","quote":"To fully leverage the quality of the estimation methods, we therefore apply only the constraint of a minimal expected gain."},{"assumption":"When q > 1 the sample correlation matrix has (N‑T) zero eigenvalues that need special handling.","type":"statistical","stated":"explicit","quote":"In this case, E has (N −T) zero eigenvalues. These singularities are not corrected by the previous RIE schemes and remain at zero."},{"assumption":"The training period is T = 1000 (≈4 years) and the out‑of‑sample test period is Tout = 60 (3 months).","type":"data","stated":"explicit","quote":"We choose T = 1000 (4 years) for the training (in-sample) period, i.e., q = 0.5 and Tout = 60 (3 months) for the out-of-sample test period."}]},"datasets":{"status":"available","items":[{"name":"Synthetic multivariate Student data","provider":null,"kind":"synthetic","access":"unknown","period":null,"universe":null,"quote":"Our study on synthetic multivariate Student data showed that, when the number of observations is low, the eigenvalues of GCMs, although biased in theory, are closer to the true Pearson eigenvalues than those obtained from standard Pearson coefficients."},{"name":"500 American stocks","provider":null,"kind":"market-prices","access":"unknown","period":null,"universe":"500 American stocks","quote":"We follow the same processing scheme as outlined in Section III and use the same 500 American stocks mentioned in Section IV."}],"known":[],"sample":{"start":null,"end":null,"market":null,"asset_class":null,"frequency":null},"data_resolution":"daily"},"transaction_costs":{"status":"available","modeled":"no","headline_net_of_costs":null,"detail":null,"quote":null,"source":"front_matter","rule":"R1","candidates":{"front_matter":"no","evidence_card":"unclear","evidence_card_quoted":false},"meaning":"a trading or execution result is reported without costs"},"results":{"status":"available","evaluation_type":"trading-pnl","findings":[{"finding":"Kendall‑related methods consistently achieve lower out‑of‑sample risk across all four trading strategies.","kind":"performance","quote":"we observe that the two Kendall-related methods consistently demonstrate lower out-of-sample risk across all four trading strategies."},{"finding":"Kendall ICVC provides the best out‑of‑sample risk performance among all tested estimators.","kind":"performance","quote":"Kendall ICVC stands out as the best candidate among all the methods."},{"finding":"Generalized correlation matrices avoid zero eigenvalues until N = O(T^2), making them more robust to singularities than Pearson’s matrix.","kind":"theoretical","quote":"we have demonstrated that generalized correlation matrices are more robust to the appearance of singularities than Pearson’s correlation matrix: null eigenvalues appear when N = O(T 2) instead of N = O(T)."},{"finding":"On synthetic data, eigenvalues of GCMs are closer to true Pearson eigenvalues than those from standard Pearson coefficients.","kind":"statistical","quote":"Our study on synthetic multivariate Student data showed that, when the number of observations is low, the eigenvalues of GCMs, although biased in theory, are closer to the true Pearson eigenvalues than those obtained from standard Pearson coefficients."},{"finding":"GCMs also estimate the eigenvectors of the true correlation matrix more accurately than Pearson’s coefficients.","kind":"statistical","quote":"We have shown that these GCMs are also more accurate in estimating the eigenvectors of the true correlation matrix than the usual Pearson coefficients."}],"reported_performance":null,"out_of_sample":{"method":"unclear","headline_out_of_sample":null}},"independent_evidence":{"status":"available","supports":[],"contradicts":[],"qualifies":[],"compared_with":42,"citations":{"cited_by_in_corpus":2,"by_independent_authors":2,"how_cited":{"used_as_baseline":0,"uses_method_or_data":1,"extends":0,"discusses_findings":0,"mentions":1,"unclassified":0},"independent_papers":[{"paper":{"paper_id":"2507.01918","title":"End-to-End Large Portfolio Optimization for Variance Minimization with Neural Networks through Covariance Cleaning","paper_date":"2025-07-02","authors":["Christian Bongiorno","Efstratios Manolakis","Rosario Nunzio Mantegna"],"empirical_rigor":8,"page_url":"https://thequant.space/flowcharts/end-to-end-large-portfolio-optimization-for-variance-minimiz/"},"how":"uses_method_or_data","quote":null}],"scope":"Citations between papers in this corpus only; citations from outside it are not counted."}},"implementation":{"status":"available","public":false,"code_url":null,"note":"No repository presented by the authors as their own was found in the paper. Absence here is not proof that no code exists."},"replication":{"status":"none_found","card":null,"note":"No replication of this paper has been run by thequant.space yet."},"extraction":{"text_source":"fulltext","model":"openai/gpt-oss-120b","version":1,"extracted_at":"2026-11-14T17:58:00Z"},"provenance":{"claims":"Everything here is what the authors state in the paper. Nothing was re-run or reproduced by the platform.","quotes":"Assumptions, datasets, cost detail and findings were extracted by a language model. Every quote is verbatim paper text. Where an item has `support`, \"full\" means every figure in it appears in the quoted sentences and \"partial\" means a figure is stated elsewhere in the paper; items with a figure found nowhere in the paper were discarded.","datasets_known":"datasets.known lists well-known vendors and public datasets by a stable id, found by a dictionary over the full text where the sentence says the data is used; it is independent of the model and covers only names in the dictionary.","flags":"transaction_costs.modeled, results.evaluation_type and results.out_of_sample.method are platform classifications (structured-decision models); see https://thequant.space/score-guide/#penalty-flags","comparisons":"supports / contradicts / qualifies are a language model's reading of two papers' quoted findings, restricted to closely related papers that share no author. They are pointers to read, not verified replications, and coverage is partial.","implementation":"code_url is a repository the paper itself presents as its own (rule-scored, ambiguous cases judged by a model), checked for liveness when it was recorded."},"docs":"https://thequant.space/agents/"}