{"paper_id":"2503.03612","title":"Large language models in finance : what is financial sentiment?","authors":["Kemal Kirtac","Guido Germano"],"paper_date":"2025-03-05","paper_type":"empirical","paper_url":"https://arxiv.org/pdf/2503.03612v4","page_url":"https://thequant.space/flowcharts/large-language-models-in-finance--what-is-financial-sentime/","scores":{"empirical_rigor":4,"math_complexity":3.5,"quadrant":"Philosophers"},"proposes":{"status":"available","statement":"The paper proposes to define what financial sentiment is and to evaluate how large language models can be used to estimate it.","quote":"We explore the nature of financial sentiment and investigate how large language models (LLMs) contribute to its estimation. By exploring what financial sentiment is and how it is estimated within LLMs, we provide insights into the growing role of AI-driven sentiment analysis in finance.","summary":"Financial sentiment has become a crucial yet complex concept in finance, increasingly used in market forecasting and investment strategies. Despite its growing importance, there remains a need to define and understand what financial sentiment truly represents and how it can be effectively measured.…","strategy":null},"assumptions":{"status":"none_found","items":[]},"datasets":{"status":"none_found","items":[],"known":[],"sample":{"start":null,"end":null,"market":null,"asset_class":null,"frequency":null},"data_resolution":"none"},"transaction_costs":{"status":"not_applicable","modeled":"n/a","headline_net_of_costs":null,"detail":null,"quote":null,"source":"front_matter","rule":"R3","candidates":{"front_matter":"n/a","evidence_card":"n/a","evidence_card_quoted":false},"meaning":"the paper reports no trading or execution result"},"results":{"status":"available","evaluation_type":"none","findings":[{"finding":"LLM-based sentiment approaches significantly outperformed traditional sentiment methods in predicting stock returns.","kind":"predictive-accuracy","quote":"More recently, Kirtac and Germano (2024a) examined the role of large language models (LLMs) in financial sentiment analysis and stock return prediction, finding that LLM-based approaches significantly outperformed traditional sentiment methods.","support":"full"},{"finding":"LLM-driven sentiment measures significantly outperformed traditional sentiment indices in forecasting stock price movements.","kind":"performance","quote":"Their study found that LLM-driven sentiment measures significantly outperformed traditional sentiment indices in forecasting stock price movements, reinforcing the growing role of deep learning in financial sentiment research (Kirtac and Germano, 2024a).","support":"full"},{"finding":"Deep learning models enable more accurate and dynamic sentiment scores that capture nuances of financial language and market dynamics.","kind":"predictive-accuracy","quote":"These models enable more accurate and dynamic sentiment scores, capturing the nuances of financial language, economic narratives, and market dynamics.","support":"full"}],"reported_performance":null,"out_of_sample":{"method":"none","headline_out_of_sample":null}},"independent_evidence":{"status":"available","supports":[{"paper":{"paper_id":"2311.14759","title":"Deep Learning and NLP in Cryptocurrency Forecasting: Integrating Financial, Blockchain, and Social Media Data","paper_date":"2023-11-23","authors":["Vincent Gurgul","Stefan Lessmann","Wolfgang Karl Härdle"],"empirical_rigor":6,"page_url":"https://thequant.space/flowcharts/deep-learning-and-nlp-in-cryptocurrency-forecasting-integra/"},"question":"Do deep learning NLP models provide superior financial sentiment signals compared to dictionary‑based approaches?","this_paper_finding":"Deep learning models enable more accurate and dynamic sentiment scores that capture nuances of financial language and market dynamics.","other_paper_finding":"Deep learning NLP models outperform dictionary‑based sentiment analysis.","other_paper_quote":"deep learning NLP models demonstrate superior performance compared with dictionary-based sentiment analysis","note":"Both findings state that deep learning models outperform dictionary‑based sentiment analysis, offering more accurate and dynamic sentiment scores.","confidence":0.811}],"contradicts":[],"qualifies":[],"compared_with":25,"citations":{"cited_by_in_corpus":0,"by_independent_authors":0,"how_cited":{"used_as_baseline":0,"uses_method_or_data":0,"extends":0,"discusses_findings":0,"mentions":0,"unclassified":0},"independent_papers":[],"scope":"Citations between papers in this corpus only; citations from outside it are not counted."}},"implementation":{"status":"available","public":false,"code_url":null,"note":"No repository presented by the authors as their own was found in the paper. Absence here is not proof that no code exists."},"replication":{"status":"none_found","card":null,"note":"No replication of this paper has been run by thequant.space yet."},"extraction":{"text_source":"fulltext","model":"openai/gpt-oss-120b","version":2,"extracted_at":"2026-11-14T19:51:30Z"},"provenance":{"claims":"Everything here is what the authors state in the paper. Nothing was re-run or reproduced by the platform.","quotes":"Assumptions, datasets, cost detail and findings were extracted by a language model. Every quote is verbatim paper text. Where an item has `support`, \"full\" means every figure in it appears in the quoted sentences and \"partial\" means a figure is stated elsewhere in the paper; items with a figure found nowhere in the paper were discarded.","datasets_known":"datasets.known lists well-known vendors and public datasets by a stable id, found by a dictionary over the full text where the sentence says the data is used; it is independent of the model and covers only names in the dictionary.","flags":"transaction_costs.modeled, results.evaluation_type and results.out_of_sample.method are platform classifications (structured-decision models); see https://thequant.space/score-guide/#penalty-flags","comparisons":"supports / contradicts / qualifies are a language model's reading of two papers' quoted findings, restricted to closely related papers that share no author. They are pointers to read, not verified replications, and coverage is partial.","implementation":"code_url is a repository the paper itself presents as its own (rule-scored, ambiguous cases judged by a model), checked for liveness when it was recorded."},"docs":"https://thequant.space/agents/"}