{"paper_id":"2411.01368","title":"Combining Financial Data and News Articles for Stock Price Movement Prediction Using Large Language Models","authors":["Ali Elahi","Fatemeh Taghvaei"],"paper_date":"2024-11-02","paper_type":"methodological","paper_url":"https://arxiv.org/pdf/2411.01368v1","page_url":"https://thequant.space/flowcharts/combining-financial-data-and-news-articles-for-stock-price-m/","scores":{"empirical_rigor":6,"math_complexity":3,"quadrant":"Street Traders"},"proposes":{"status":"available","statement":"The paper proposes an LLM-based classifier that combines tabular financial data and textual news articles to predict stock price movements.","quote":"We introduce an LLM-based classifier capable of performing classification tasks using combination of tabular (structured) and textual (unstructured) data.","summary":"Predicting financial markets and stock price movements requires analyzing a company’s performance, historic price movements, industry-specific events alongside the influence of human factors such as social media and press coverage. We assume that financial reports (such as income statements…","strategy":null},"assumptions":{"status":"available","items":[{"assumption":"Financial reports, historical price data, and recent news articles together can represent the factors influencing stock price movements.","type":"data","stated":"explicit","quote":"We assume that financial reports (such as income statements, balance sheets, and cash flow statements), historical price data, and recent news articles can collectively represent aforementioned factors."},{"assumption":"The analysis can be performed in zero‑to‑four‑shot settings without fine‑tuning the LLMs.","type":"model","stated":"explicit","quote":"we will conduct this analysis in a zero to four-shot setting."}]},"datasets":{"status":"available","items":[{"name":"Combined financial and news dataset","provider":null,"kind":"text-news","access":"unknown","period":"2021‑present","universe":"20 companies with highest trading volume across different industries","quote":"Our dataset contains news articles collected from different sources, historic stock price, and financial report data for 20 companies with the highest trading volume across different industries in the stock market."}],"known":[],"sample":{"start":null,"end":null,"market":null,"asset_class":null,"frequency":null},"data_resolution":"unclear"},"transaction_costs":{"status":"not_applicable","modeled":"n/a","headline_net_of_costs":null,"detail":null,"quote":null,"source":"front_matter","rule":"R1","candidates":{"front_matter":"n/a","evidence_card":"unclear","evidence_card_quoted":false},"meaning":"the paper reports no trading or execution result"},"results":{"status":"available","evaluation_type":"forecast-accuracy","findings":[{"finding":"The LLM‑based classifier achieved weighted F1‑scores of 58.5% (3‑month) and 59.1% (6‑month) with a Matthews Correlation Coefficient of 0.175 for both horizons.","kind":"predictive-accuracy","quote":"By using this model, we predicted the movement of a given stock’s price in our dataset with a weighted F1-score of 58.5% and 59.1% and Matthews Correlation Coefficient of 0.175 for both 3-month and 6-month periods."},{"finding":"The best‑performing models for both 3‑month and 6‑month predictions were the GPT and LLaMA3‑8B models.","kind":"performance","quote":"The best-performing models for both 3-month and 6-month predictions were the GPT and LLaMA3-8B models."},{"finding":"More advanced models (LLaMA3 and GPT) outperform LLaMA2, and GPT‑4 generally outperforms GPT‑3.5 except in zero‑shot 3‑month prediction where GPT‑3.5 has a better WF1 and MCC.","kind":"performance","quote":"The results in Figure 3 demonstrate that more advanced models, such as LLaMA3 and GPT models, outperform LLaMA2 models. Additionally, LLaMA2 models show improved performance with an increase in the number of parameters. GPT-4 models generally exhibit better performance than GPT-3.5 models based in both WF1 and MCC, exc"}],"reported_performance":null,"out_of_sample":{"method":"holdout","headline_out_of_sample":null}},"independent_evidence":{"status":"available","supports":[],"contradicts":[],"qualifies":[{"paper":{"paper_id":"2503.16974","title":"Assessing Consistency and Reproducibility in the Outputs of Large Language Models: Evidence Across Diverse Finance and Accounting Tasks","paper_date":"2025-03-21","authors":["Julian Junyan Wang","Victor Xiaoqi Wang"],"empirical_rigor":6,"page_url":"https://thequant.space/flowcharts/assessing-consistency-and-reproducibility-in-the-outputs-of-large-language/"},"question":"Do more advanced large language models improve performance on financial prediction tasks?","this_paper_finding":"More advanced models (LLaMA3 and GPT) outperform LLaMA2, and GPT‑4 generally outperforms GPT‑3.5 except in zero‑shot 3‑month prediction where GPT‑3.5 has a better WF1 and MCC.","other_paper_finding":"More advanced models do not consistently outperform earlier models in consistency; GPT‑4o is better for numerical predictions but GPT‑3.5‑turbo outperforms GPT‑4o‑mini in multi‑class classification of FOMC statements.","other_paper_quote":"While GPT‑4o demonstrates superior consistency in numerical predictions relative to earlier models, GPT‑3.5‑turbo unexpectedly outperforms GPT‑4o‑mini in multi‑class classification of FOMC statements.","note":"A shows LLaMA3/GPT and GPT‑4 generally beat earlier models, except GPT‑3.5 beats GPT‑4 in zero‑shot 3‑month WF1/MCC. B finds advanced models not consistently superior; GPT‑4o excels in numeric forecasts, while GPT‑3.5‑tu","confidence":0.487}],"compared_with":13,"citations":{"cited_by_in_corpus":2,"by_independent_authors":2,"how_cited":{"used_as_baseline":0,"uses_method_or_data":0,"extends":0,"discusses_findings":0,"mentions":1,"unclassified":1},"independent_papers":[],"scope":"Citations between papers in this corpus only; citations from outside it are not counted."}},"implementation":{"status":"available","public":false,"code_url":null,"note":"No repository presented by the authors as their own was found in the paper. Absence here is not proof that no code exists."},"replication":{"status":"none_found","card":null,"note":"No replication of this paper has been run by thequant.space yet."},"extraction":{"text_source":"fulltext","model":"openai/gpt-oss-120b","version":1,"extracted_at":"2026-11-14T17:56:09Z"},"provenance":{"claims":"Everything here is what the authors state in the paper. Nothing was re-run or reproduced by the platform.","quotes":"Assumptions, datasets, cost detail and findings were extracted by a language model. Every quote is verbatim paper text. Where an item has `support`, \"full\" means every figure in it appears in the quoted sentences and \"partial\" means a figure is stated elsewhere in the paper; items with a figure found nowhere in the paper were discarded.","datasets_known":"datasets.known lists well-known vendors and public datasets by a stable id, found by a dictionary over the full text where the sentence says the data is used; it is independent of the model and covers only names in the dictionary.","flags":"transaction_costs.modeled, results.evaluation_type and results.out_of_sample.method are platform classifications (structured-decision models); see https://thequant.space/score-guide/#penalty-flags","comparisons":"supports / contradicts / qualifies are a language model's reading of two papers' quoted findings, restricted to closely related papers that share no author. They are pointers to read, not verified replications, and coverage is partial.","implementation":"code_url is a repository the paper itself presents as its own (rule-scored, ambiguous cases judged by a model), checked for liveness when it was recorded."},"docs":"https://thequant.space/agents/"}