{"paper_id":"2406.19105","title":"Benchmarking M6 Competitors: An Analysis of Financial Metrics and Discussion of Incentives","authors":["Matthew J. Schneider","Rufus Rankin","Prabir Burman","Alexander Aue"],"paper_date":"2024-06-27","paper_type":"dataset-benchmark","paper_url":"https://arxiv.org/pdf/2406.19105v2","page_url":"https://thequant.space/flowcharts/benchmarking-m6-competitors-an-analysis-of-financial-metric/","scores":{"empirical_rigor":6,"math_complexity":6,"quadrant":"Holy Grail"},"proposes":{"status":"available","statement":"The paper documents M6 competitors' performance with industry metrics, applies factor models to assess value‑add, and introduces Superstar/Superloser strategies.","quote":"... Second, we apply factor models to competitors’ returns and find that competitors who performed in the extremes tended to be less dependent on the benchmark indices.","summary":"The M6 Competition assessed the performance of competitors using a ranked probability score and an information ratio (IR). While these metrics do well at picking the winners in the competition, crucial questions remain for investors with longer-term incentives. To address these questions, we…","strategy":null},"assumptions":{"status":"available","items":[{"assumption":"All benchmark indices and competitors traded on the same 238 trading days for a fair comparison.","type":"data","stated":"explicit","quote":"we removed the Crypto returns that occurred on the weekends (non-trading days) and assumed that all benchmark indices and competitors traded on the same 238 trading days for a fair comparison."},{"assumption":"Returns across the competition days are independent and identically distributed (i.i.d.) for MDD analysis.","type":"statistical","stated":"explicit","quote":"trading days in the competition are independent and identically distributed (i.i.d.)"},{"assumption":"A low fee structure of 1% management and 10% performance fees is applied daily.","type":"execution","stated":"explicit","quote":"we assume a low fee structure (1%/10%) and deduct performance fees and prorated management fees daily."},{"assumption":"Crypto returns on weekends are excluded from the analysis.","type":"data","stated":"explicit","quote":"For the analysis in this paper, we removed the Crypto returns that occurred on the weekends (non-trading days)"},{"assumption":"Raw returns are used instead of log returns, approximating log returns via exp transformation.","type":"model","stated":"explicit","quote":"which differ from log returns used by Makridakis et al. (2023)"}]},"datasets":{"status":"available","items":[{"name":"M6 competition competitor NAVs","provider":null,"kind":"benchmark","access":"unknown","period":"238 trading days","universe":"individual large‑cap equities or ETFs","quote":"The majority of assets in the universe for the competition are individual large-cap equities or ETFs that track some set of large-cap equities."},{"name":"Major benchmark indices (including equal‑weighted benchmark)","provider":null,"kind":"benchmark","access":"unknown","period":"238 trading days","universe":"large‑cap equity market","quote":"Table 1 presents the financial metrics for the major benchmark indices, including the equal-weighted benchmark in the M6 Competition."}],"known":[],"sample":{"start":null,"end":null,"market":null,"asset_class":null,"frequency":null},"data_resolution":"daily"},"transaction_costs":{"status":"available","modeled":"yes","headline_net_of_costs":null,"detail":"A low fee structure of 1% annual management fee and 10% performance fee is deducted daily from NAVs.","quote":"we assume a low fee structure (1%/10%) and deduct performance fees and prorated management fees daily.","source":"evidence_card","rule":"R2","candidates":{"front_matter":"unclear","evidence_card":"yes","evidence_card_quoted":true},"card_detail":"A low fee structure of 1% annual management fee and 10% performance fee is deducted daily from NAVs.","card_quote":"we assume a low fee structure (1%/10%) and deduct performance fees and prorated management fees daily.","meaning":"costs are part of the reported headline results"},"results":{"status":"available","evaluation_type":"trading-pnl","findings":[{"finding":"Competitors with extreme performance are less dependent on benchmark indices, showing low R‑square values.","kind":"performance","quote":"We find that those competitors with extreme alphas (and high values of SR) all had R-square values below 50% (and frequently below 20%)."},{"finding":"Only 12 of 163 alphas in the seven‑factor model are statistically significant at 5%, and 11 of those are negative.","kind":"statistical","quote":"Of the 163 alphas in the seven factor model, 12 alphas were statistically significant at the 0.05 level, including the largest (annualized) alpha of 30.8%. However, 11 of the 12 statistically significant alphas were negative."},{"finding":"GRS tests reject the null that all alphas equal zero for both one‑factor and seven‑factor models (p < 0.0001).","kind":"statistical","quote":"For the one factor model, the test statistic is 15.3 with a p-value < 0.0001, rejecting the null hypothesis that all alphas are equal to 0. For the seven factor model, the test statistic is 15.1 with a p-value < 0.0001, rejecting the null hypothesis that all alphas are equal to 0."},{"finding":"Management and performance fees of 1%/10% slightly worsen median competitor performance (SR from -0.09 to -0.17, IR from -1.3 to -2.6).","kind":"performance","quote":"For the median competitor, the 1%/10% fees decreased the SR from -0.09 to -0.17, the IR decreased from -1.3 to -2.6, and the MDD increased from 15.5% to 16.0%."},{"finding":"Most competitors did not add value over an equal‑weighted portfolio, but a majority expressed smaller losses than long‑only benchmarks.","kind":"performance","quote":"while most competitors did not add value over the equal-weighted portfolio of universe constituents, a majority did manage to express smaller losses than widely used long-only benchmarks."}],"reported_performance":null,"out_of_sample":{"method":"none","headline_out_of_sample":null}},"independent_evidence":{"status":"available","supports":[{"paper":{"paper_id":"2604.28124","title":"Measuring the risk or reducing it, that is the question: is risk measurement necessary for risk reduction?","paper_date":"2026-04-30","authors":["Pierpaolo Uberti"],"empirical_rigor":6,"page_url":"https://thequant.space/flowcharts/measuring-the-risk-or-reducing-it-that-is-the-question-is-risk-measurement/"},"question":"Do active portfolio strategies add value relative to an equal‑weighted (1/N) benchmark?","this_paper_finding":"Most competitors did not add value over an equal‑weighted portfolio, but a majority expressed smaller losses than long‑only benchmarks.","other_paper_finding":"Active portfolio strategies generally achieve lower Sharpe ratios than the 1/N benchmark due to transaction‑cost‑induced return erosion.","other_paper_quote":"most active portfolio strategies exhibit a Sharpe ratio lower than that of the 1/N benchmark, as documented by DeMiguel et al. [2009b].","note":"Both find that active strategies generally do not outperform the 1/N benchmark: most competitors add no value and show smaller losses, and active portfolios have lower Sharpe ratios due to transaction‑cost erosion.","confidence":0.558}],"contradicts":[],"qualifies":[],"compared_with":29,"citations":{"cited_by_in_corpus":0,"by_independent_authors":0,"how_cited":{"used_as_baseline":0,"uses_method_or_data":0,"extends":0,"discusses_findings":0,"mentions":0,"unclassified":0},"independent_papers":[],"scope":"Citations between papers in this corpus only; citations from outside it are not counted."}},"implementation":{"status":"available","public":false,"code_url":null,"note":"No repository presented by the authors as their own was found in the paper. Absence here is not proof that no code exists."},"replication":{"status":"none_found","card":null,"note":"No replication of this paper has been run by thequant.space yet."},"extraction":{"text_source":"fulltext","model":"openai/gpt-oss-120b","version":1,"extracted_at":"2026-11-14T18:07:11Z"},"provenance":{"claims":"Everything here is what the authors state in the paper. Nothing was re-run or reproduced by the platform.","quotes":"Assumptions, datasets, cost detail and findings were extracted by a language model. Every quote is verbatim paper text. Where an item has `support`, \"full\" means every figure in it appears in the quoted sentences and \"partial\" means a figure is stated elsewhere in the paper; items with a figure found nowhere in the paper were discarded.","datasets_known":"datasets.known lists well-known vendors and public datasets by a stable id, found by a dictionary over the full text where the sentence says the data is used; it is independent of the model and covers only names in the dictionary.","flags":"transaction_costs.modeled, results.evaluation_type and results.out_of_sample.method are platform classifications (structured-decision models); see https://thequant.space/score-guide/#penalty-flags","comparisons":"supports / contradicts / qualifies are a language model's reading of two papers' quoted findings, restricted to closely related papers that share no author. They are pointers to read, not verified replications, and coverage is partial.","implementation":"code_url is a repository the paper itself presents as its own (rule-scored, ambiguous cases judged by a model), checked for liveness when it was recorded."},"docs":"https://thequant.space/agents/"}