{"paper_id":"2508.02685","title":"Benchmarking Classical and Quantum Models for DeFi Yield Prediction on Curve Finance","authors":["Chi-Sheng Chen","Aidan Hung-Wen Tsai"],"paper_date":"2025-07-22","paper_type":"dataset-benchmark","paper_url":"https://arxiv.org/pdf/2508.02685v1","page_url":"https://thequant.space/flowcharts/benchmarking-classical-and-quantum-models-for-defi-yield-pre/","scores":{"empirical_rigor":8,"math_complexity":6.5,"quadrant":"Holy Grail"},"proposes":{"status":"available","statement":"The paper presents a comprehensive benchmark of six machine learning models on a newly curated dataset from 28 Curve Finance pools over a full year.","quote":"In this work, we present a comprehensive benchmark study of six machine learning models on a newly curated dataset derived from 28 Curve Finance","summary":"The rise of decentralized finance (DeFi) has created a growing demand for accurate yield and performance forecasting to guide liquidity allocation strategies. In this study, we benchmark six models, XGBoost, Random Forest, LSTM, Transformer, quantum neural networks (QNN), and quantum support vector…","strategy":null},"assumptions":{"status":"available","items":[{"assumption":"Models are trained and evaluated using identical feature sets and an 80/20 chronological data split.","type":"data","stated":"implied","quote":"Under identical feature sets and an 80/20 chronological split, Random Forest achieved the lowest test MAE (1.77), while XGBoost delivered the highest directional accuracy (71.57%)."},{"assumption":"The time series data is temporally complete with no missing timestamps on the six‑hour grid.","type":"data","stated":"explicit","quote":"The series is temporally complete with no missing timestamps on the six-hour grid, ensuring a clean foundation for downstream forecasting tasks."},{"assumption":"A six‑hour sampling frequency is sufficient to capture intra‑day fluctuations typical of DeFi markets.","type":"market","stated":"explicit","quote":"This sampling frequency is sufficient to capture intra-day fluctuations typical of DeFi markets while maintaining an almost year-long horizon."}]},"datasets":{"status":"available","items":[{"name":"Curve Finance pools dataset","provider":"Curve Finance","kind":"crypto-onchain","access":"unknown","period":"2024-07-20 to 2025-07-20","universe":"28 Curve Finance liquidity pools","quote":"We compiled historical time series from 28 Curve Finance liquidity pools, covering the period from 2024-07-20 15:31:05 to 2025-07-20 09:31:05, for a total span of 364 days..."}],"known":[],"sample":{"start":null,"end":null,"market":null,"asset_class":null,"frequency":null},"data_resolution":"intraday-bars"},"transaction_costs":{"status":"not_applicable","modeled":"n/a","headline_net_of_costs":null,"detail":null,"quote":null,"source":"front_matter","rule":"R3","candidates":{"front_matter":"n/a","evidence_card":"n/a","evidence_card_quoted":false},"meaning":"the paper reports no trading or execution result"},"results":{"status":"available","evaluation_type":"forecast-accuracy","findings":[{"finding":"XGBoost achieved the highest directional accuracy (71.57%) with a test MAE of 1.80.","kind":"performance","quote":"the highest directional accuracy (71.57%) with a test MAE of 1.80"},{"finding":"Random Forest attained the lowest test MAE (1.77) and a directional accuracy of 71.36%.","kind":"performance","quote":"Random Forest attains the lowest test MAE of 1.77 and 71.36% accuracy"},{"finding":"Quantum models (QNN and QSVM‑QNN) had directional accuracy below 50% and higher test MAE (2.25–2.33).","kind":"negative","quote":"Quantum models—QNN and QSVM‑QNN—performed worse than classical baselines, with higher test MAE (2.25–2.33) and lower accuracy (<50%)."},{"finding":"Deep learning models (LSTM and Transformer) lagged behind classical models with directional accuracy around 49–51% and higher errors.","kind":"performance","quote":"Among deep learning models, both LSTM and Transformer lagged behind with directional accuracy around 49–51%."},{"finding":"XGBoost showed near‑perfect training accuracy (99.85%) suggesting possible overfitting, though test performance remained strong.","kind":"statistical","quote":"While XGBoost achieved nearly perfect training accuracy (99.85%), its test MAE and accuracy are close to Random Forest, suggesting possible overfitting."}],"reported_performance":null,"out_of_sample":{"method":"holdout","headline_out_of_sample":null}},"independent_evidence":{"status":"none_found","supports":[],"contradicts":[],"qualifies":[],"compared_with":33,"citations":{"cited_by_in_corpus":3,"by_independent_authors":0,"how_cited":{"used_as_baseline":0,"uses_method_or_data":0,"extends":0,"discusses_findings":0,"mentions":0,"unclassified":3},"independent_papers":[],"scope":"Citations between papers in this corpus only; citations from outside it are not counted."}},"implementation":{"status":"available","public":false,"code_url":null,"note":"No repository presented by the authors as their own was found in the paper. Absence here is not proof that no code exists."},"replication":{"status":"none_found","card":null,"note":"No replication of this paper has been run by thequant.space yet."},"extraction":{"text_source":"fulltext","model":"openai/gpt-oss-120b","version":1,"extracted_at":"2026-11-14T17:31:26Z"},"provenance":{"claims":"Everything here is what the authors state in the paper. Nothing was re-run or reproduced by the platform.","quotes":"Assumptions, datasets, cost detail and findings were extracted by a language model. Every quote is verbatim paper text. Where an item has `support`, \"full\" means every figure in it appears in the quoted sentences and \"partial\" means a figure is stated elsewhere in the paper; items with a figure found nowhere in the paper were discarded.","datasets_known":"datasets.known lists well-known vendors and public datasets by a stable id, found by a dictionary over the full text where the sentence says the data is used; it is independent of the model and covers only names in the dictionary.","flags":"transaction_costs.modeled, results.evaluation_type and results.out_of_sample.method are platform classifications (structured-decision models); see https://thequant.space/score-guide/#penalty-flags","comparisons":"supports / contradicts / qualifies are a language model's reading of two papers' quoted findings, restricted to closely related papers that share no author. They are pointers to read, not verified replications, and coverage is partial.","implementation":"code_url is a repository the paper itself presents as its own (rule-scored, ambiguous cases judged by a model), checked for liveness when it was recorded."},"docs":"https://thequant.space/agents/"}