{"paper_id":"2503.06928","title":"FinTSBridge: A New Evaluation Suite for Real-world Financial Prediction with Advanced Time Series Models","authors":["Yanlong Wang","Jian Xu","Tiantian Gao","Hongkang Zhang","Shao-Lun Huang","Danny Dongning Sun","Xiao-Ping Zhang"],"paper_date":"2025-03-10","paper_type":"dataset-benchmark","paper_url":"https://arxiv.org/pdf/2503.06928v2","page_url":"https://thequant.space/flowcharts/fintsbridge-a-new-evaluation-suite-for-real-world-financial/","scores":{"empirical_rigor":6,"math_complexity":4,"quadrant":"Street Traders"},"proposes":{"status":"available","statement":"The paper introduces FinTSBridge, a suite that provides three financial time series datasets, selects over ten forecasting models, and adds new multi‑step correlation metrics msIC and msIR for evaluating financial forecasting.","quote":"We developed new metrics, msIC and msIR, in addition to MSE and MAE, to showcase the time series correlation captured by the models","summary":"Despite the growing attention to time series forecasting in recent years, many studies have proposed various solutions to address the challenges encountered in time series prediction, aiming to improve forecasting performance. However, effectively applying these time series forecasting models to…","strategy":"PSformer"},"assumptions":{"status":"available","items":[{"assumption":"The investment strategy rebalances every five trading days.","type":"execution","stated":"explicit","quote":"The investment strategy involves rebalancing every five trading days by selecting from the 20 available indices"},{"assumption":"Risk‑free rate is proxied by the 1‑Year Shibor.","type":"data","stated":"explicit","quote":"Risk-free rate (proxied by 1-Year Shibor)"}]},"datasets":{"status":"available","items":[{"name":"GSMI","provider":null,"kind":"market-prices","access":"public","period":"2005-2024","universe":"20 major global stock indices","quote":"The GSMI dataset includes 20 major indices from global stock markets, recording daily price and trading volume data for these indices over nearly 20 years, from 2005 to 2024"},{"name":"OPTION","provider":null,"kind":"options","access":"public","period":null,"universe":"CSI 300ETF options","quote":"The OPTION dataset includes the CSI 300ETF options from the Chinese financial market, with variables related to risk for both call and put options"},{"name":"BTCF","provider":"Binance","kind":"crypto-onchain","access":"public","period":"2020-01-01 to 2024-11-30","universe":"Bitcoin spot and futures contracts","quote":"The BTCF dataset is sourced from the Binance platform and contains hourly frequency data for Bitcoin spot and futures contracts, spanning from January 1, 2020, to November 30, 2024","known_id":"binance"}],"known":[{"id":"binance","name":"Binance","provider":"Binance","kind":"market-prices","access":"public","quote":"A.3 BTCF DATASET A.3.1 DISCRIPTION The BTCF dataset is sourced from the Binance platform and contains hourly frequency data for Bitcoin spot and futures contracts, spanning from January 1, 2020, to November 30, 2024.","mentions":1,"used_in":1}],"sample":{"start":null,"end":null,"market":"SPX index","asset_class":"equities","frequency":"daily"},"data_resolution":"intraday-bars"},"transaction_costs":{"status":"available","modeled":"no","headline_net_of_costs":false,"detail":null,"quote":null,"source":"front_matter","rule":"R1","candidates":{"front_matter":"no","evidence_card":"unclear","evidence_card_quoted":false},"meaning":"a trading or execution result is reported without costs"},"results":{"status":"available","evaluation_type":"trading-pnl","findings":[{"finding":"The Naive model performs poorly on strongly periodic series like Traffic but yields smaller errors on less periodic series such as Exchange, indicating prediction error alone is insufficient for evaluation.","kind":"predictive-accuracy","quote":"The results suggest that the Naive model performs poorly on time series with strong periodicity, such as Traffic, but achieves smaller prediction errors on datasets like Exchange"},{"finding":"Extensive strategy evaluations and visualizations validate the effectiveness and potential of advanced models in real‑world financial deployment.","kind":"performance","quote":"extensive strategy evaluations and visualizations validate the effectiveness and potential of advanced models in real-world financial deployment"}],"reported_performance":{"strategy":"PSformer","sharpe":1.2,"sharpe_benchmark":0.02,"annual_return_pct":17.87,"total_return_pct":133.68,"max_drawdown_pct":21.63},"out_of_sample":{"method":"holdout","headline_out_of_sample":true}},"independent_evidence":{"status":"none_found","supports":[],"contradicts":[],"qualifies":[],"compared_with":11,"citations":{"cited_by_in_corpus":0,"by_independent_authors":0,"how_cited":{"used_as_baseline":0,"uses_method_or_data":0,"extends":0,"discusses_findings":0,"mentions":0,"unclassified":0},"independent_papers":[],"scope":"Citations between papers in this corpus only; citations from outside it are not counted."}},"implementation":{"status":"available","public":false,"code_url":null,"note":"No repository presented by the authors as their own was found in the paper. Absence here is not proof that no code exists."},"replication":{"status":"none_found","card":null,"note":"No replication of this paper has been run by thequant.space yet."},"extraction":{"text_source":"fulltext","model":"openai/gpt-oss-120b","version":1,"extracted_at":"2026-11-14T17:42:58Z"},"provenance":{"claims":"Everything here is what the authors state in the paper. Nothing was re-run or reproduced by the platform.","quotes":"Assumptions, datasets, cost detail and findings were extracted by a language model. Every quote is verbatim paper text. Where an item has `support`, \"full\" means every figure in it appears in the quoted sentences and \"partial\" means a figure is stated elsewhere in the paper; items with a figure found nowhere in the paper were discarded.","datasets_known":"datasets.known lists well-known vendors and public datasets by a stable id, found by a dictionary over the full text where the sentence says the data is used; it is independent of the model and covers only names in the dictionary.","flags":"transaction_costs.modeled, results.evaluation_type and results.out_of_sample.method are platform classifications (structured-decision models); see https://thequant.space/score-guide/#penalty-flags","comparisons":"supports / contradicts / qualifies are a language model's reading of two papers' quoted findings, restricted to closely related papers that share no author. They are pointers to read, not verified replications, and coverage is partial.","implementation":"code_url is a repository the paper itself presents as its own (rule-scored, ambiguous cases judged by a model), checked for liveness when it was recorded."},"docs":"https://thequant.space/agents/"}