{"paper_id":"2411.13562","title":"The Role of AI in Financial Forecasting: ChatGPT's Potential and Challenges","authors":["Shuochen Bi","Tingting Deng","Jue Xiao"],"paper_date":"2024-11-07","paper_type":"perspective-policy","paper_url":"https://arxiv.org/pdf/2411.13562v1","page_url":"https://thequant.space/flowcharts/the-role-of-ai-in-financial-forecasting-chatgpts-potential/","scores":{"empirical_rigor":1.5,"math_complexity":2,"quadrant":"Philosophers"},"proposes":{"status":"available","statement":"The paper proposes the RiskLabs framework, a large‑language‑model based system for financial risk prediction that integrates multiple data sources.","quote":"RiskLabs framework is proposed to make up for the insufficient application of LLM in financial risk prediction","summary":"The outlook for the future of artificial intelligence (AI) in the financial sector, especially in financial forecasting, the challenges and implications. The dynamics of AI technology, including deep learning, reinforcement learning, and integration with blockchAIn and the Internet of Things, also…","strategy":null},"assumptions":{"status":"none_found","items":[]},"datasets":{"status":"available","items":[{"name":"S&P 500 company earnings conference call data set","provider":null,"kind":"text-news","access":"public","period":null,"universe":"S&P 500 constituents","quote":"The experimental data set for the model is derived from the publicly available S&P 500 company earnings conference call data set."},{"name":"Daily relevant news texts","provider":null,"kind":"text-news","access":"unknown","period":null,"universe":null,"quote":"we have also introduced daily relevant news texts to provide a more comprehensive view of the company's financial condition."},{"name":"Historical price data (30 days prior to earnings announcement)","provider":null,"kind":"market-prices","access":"unknown","period":null,"universe":null,"quote":"we collected historical price data for the 30 days prior to the earnings announcement, including daily price updates and quarterly earnings notifications"}],"known":[],"sample":{"start":null,"end":null,"market":null,"asset_class":null,"frequency":null},"data_resolution":"daily"},"transaction_costs":{"status":"not_applicable","modeled":"n/a","headline_net_of_costs":null,"detail":null,"quote":null,"source":"front_matter","rule":"R1","candidates":{"front_matter":"n/a","evidence_card":"unclear","evidence_card_quoted":false},"meaning":"the paper reports no trading or execution result"},"results":{"status":"available","evaluation_type":"forecast-accuracy","findings":[{"finding":"RiskLabs framework performed best in short‑ and medium‑term forecasting, outperforming current state‑of‑the‑art HTML solutions.","kind":"performance","quote":"The RiskLabs framework performed best in short- and medium-term forecasting, outperforming current state-of-the-art HTML solutions."},{"finding":"The historical method overestimated the 95% VaR benchmark, yielding a prediction of 0.016, significantly below the predefined percentile.","kind":"negative","quote":"The result above shows that the prediction of VaR via applying the historical method is 0.016, which is significantly below the pre-defined percentile (5%). It indicates that the historical method overestimated the 95% VaR benchmark."}],"reported_performance":null,"out_of_sample":{"method":"holdout","headline_out_of_sample":null}},"independent_evidence":{"status":"none_found","supports":[],"contradicts":[],"qualifies":[],"compared_with":6,"citations":{"cited_by_in_corpus":0,"by_independent_authors":0,"how_cited":{"used_as_baseline":0,"uses_method_or_data":0,"extends":0,"discusses_findings":0,"mentions":0,"unclassified":0},"independent_papers":[],"scope":"Citations between papers in this corpus only; citations from outside it are not counted."}},"implementation":{"status":"available","public":false,"code_url":null,"note":"No repository presented by the authors as their own was found in the paper. Absence here is not proof that no code exists."},"replication":{"status":"none_found","card":null,"note":"No replication of this paper has been run by thequant.space yet."},"extraction":{"text_source":"fulltext","model":"openai/gpt-oss-120b","version":1,"extracted_at":"2026-11-14T17:54:48Z"},"provenance":{"claims":"Everything here is what the authors state in the paper. Nothing was re-run or reproduced by the platform.","quotes":"Assumptions, datasets, cost detail and findings were extracted by a language model. Every quote is verbatim paper text. Where an item has `support`, \"full\" means every figure in it appears in the quoted sentences and \"partial\" means a figure is stated elsewhere in the paper; items with a figure found nowhere in the paper were discarded.","datasets_known":"datasets.known lists well-known vendors and public datasets by a stable id, found by a dictionary over the full text where the sentence says the data is used; it is independent of the model and covers only names in the dictionary.","flags":"transaction_costs.modeled, results.evaluation_type and results.out_of_sample.method are platform classifications (structured-decision models); see https://thequant.space/score-guide/#penalty-flags","comparisons":"supports / contradicts / qualifies are a language model's reading of two papers' quoted findings, restricted to closely related papers that share no author. They are pointers to read, not verified replications, and coverage is partial.","implementation":"code_url is a repository the paper itself presents as its own (rule-scored, ambiguous cases judged by a model), checked for liveness when it was recorded."},"docs":"https://thequant.space/agents/"}