{"paper_id":"2306.12659","title":"Instruct-FinGPT: Financial Sentiment Analysis by Instruction Tuning of General-Purpose Large Language Models","authors":["Boyu Zhang","Hongyang Yang","Xiao-Yang Liu"],"paper_date":"2023-06-22","paper_type":"empirical","paper_url":"https://arxiv.org/pdf/2306.12659v1","page_url":"https://thequant.space/flowcharts/instruct-fingpt-financial-sentiment-analysis-by-instruction/","scores":{"empirical_rigor":8.5,"math_complexity":1,"quadrant":"Street Traders"},"proposes":{"status":"available","statement":"The paper proposes Instruct-FinGPT, an instruction‑tuned LLaMA model for financial sentiment analysis that transforms classification data into a generation task.","quote":"We propose Instruct-FinGPT by instruction tuning [Wei et al., 2022] a pre-trained LLM (namely LLaMA [Touvron et al., 2023]).","summary":"Sentiment analysis is a vital tool for uncovering insights from financial articles, news, and social media, shaping our understanding of market movements. Despite the impressive capabilities of large language models (LLMs) in financial natural language processing (NLP), they still struggle with…","strategy":null},"assumptions":{"status":"available","items":[{"assumption":"A small amount of fine‑tuning data is sufficient to achieve superior performance.","type":"data","stated":"implied","quote":"With only a small amount of fine-tuning data, our model consistently achieves superior performance in sentiment analysis compared to FinBERT and ChatGPT."},{"assumption":"Numerical values and financial context are essential for accurate sentiment prediction.","type":"model","stated":"explicit","quote":"These challenges underline the need for improved models that can adeptly understand the intricate nuances of financial sentiment analysis."}]},"datasets":{"status":"available","items":[{"name":"Twitter Financial News dataset","provider":null,"kind":"text-news","access":"public","period":null,"universe":null,"quote":"Twitter financial news sentiment training: This dataset is a corpus of news tweets that pertain to the financial sector and is exclusively in English.","known_id":"twitter"},{"name":"FiQA dataset","provider":"HuggingFace","kind":"text-news","access":"public","period":null,"universe":null,"quote":"FiQA dataset: This dataset, which is readily accessible via HuggingFace, includes 961 samples.","known_id":"fiqa"},{"name":"Twitter Val (validation) dataset","provider":null,"kind":"benchmark","access":"public","period":null,"universe":null,"quote":"Face, contains 2,390 samples annotated with three labels: Bearish, Bullish, or Neutral.","known_id":"twitter"},{"name":"Numerical sensitivity dataset","provider":null,"kind":"benchmark","access":"public","period":null,"universe":null,"quote":"Numerical sensitivity dataset (numerical): This dataset, which we automatically filtered from Twitter Val, includes 117 samples."},{"name":"Contextual understanding dataset","provider":null,"kind":"benchmark","access":"public","period":null,"universe":null,"quote":"Contextual understanding dataset (contextual): This dataset, which we randomly selected from Twitter Val, includes 20 samples."},{"name":"Financial PhraseBank (FPB) dataset","provider":"LexisNexis","kind":"benchmark","access":"public","period":null,"universe":null,"quote":"comprises 4,840 samples randomly extracted from financial news articles available on the LexisNexis database.","known_id":"financial-phrasebank"}],"known":[{"id":"twitter","name":"Twitter / X","provider":"X Corp.","kind":"text-news","access":"public","quote":"4.1 Datasets Our training data is an amalgamation of the Twitter Finan-cial News dataset [Magic, 2022] and FiQA dataset [Maia et al., 2018], resulting in a comprehensive collection of 10, 501 samples.","mentions":8,"used_in":1},{"id":"fiqa","name":"FiQA","provider":"FiQA challenge","kind":"benchmark","access":"public","quote":"4.1 Datasets Our training data is an amalgamation of the Twitter Finan-cial News dataset [Magic, 2022] and FiQA dataset [Maia et al., 2018], resulting in a comprehensive collection of 10, 501 samples.","mentions":2,"used_in":1},{"id":"financial-phrasebank","name":"Financial PhraseBank","provider":"Malo et al.","kind":"benchmark","access":"public","quote":"These samples lack the essential contexts to make a sentiment prediciton. • Financial PhraseBank (FPB) dataset: This dataset [Malo et al., 2014] comprises 4,840 samples randomly extracted from financial news articles available on the LexisNexis database.","mentions":1,"used_in":1}],"sample":{"start":null,"end":null,"market":null,"asset_class":null,"frequency":null},"data_resolution":"none"},"transaction_costs":{"status":"not_applicable","modeled":"n/a","headline_net_of_costs":null,"detail":null,"quote":null,"source":"front_matter","rule":"R3","candidates":{"front_matter":"n/a","evidence_card":"n/a","evidence_card_quoted":false},"meaning":"the paper reports no trading or execution result"},"results":{"status":"available","evaluation_type":"forecast-accuracy","findings":[{"finding":"Overall, instruction‑tuned LLaMA‑7B consistently outperforms both FinBERT and the original LLaMA‑7B across all evaluated datasets.","kind":"performance","quote":"our instruction tuned LLaMA-7B (Instruct-FinGPT-7B) consistently outperforms both FinBERT and LLaMA-7B across all three datasets in terms of accuracy and F1 score."}],"reported_performance":null,"out_of_sample":{"method":"holdout","headline_out_of_sample":null}},"independent_evidence":{"status":"available","supports":[],"contradicts":[],"qualifies":[],"compared_with":4,"citations":{"cited_by_in_corpus":31,"by_independent_authors":24,"how_cited":{"used_as_baseline":0,"uses_method_or_data":3,"extends":0,"discusses_findings":0,"mentions":19,"unclassified":9},"independent_papers":[{"paper":{"paper_id":"2512.23515","title":"Alpha-R1: Alpha Screening with LLM Reasoning via Reinforcement Learning","paper_date":"2025-12-29","authors":["Zuoyou Jiang","Li Zhao","Rui Sun","Ruohan Sun","Zhongjian Li","Jing Li"],"empirical_rigor":8.5,"page_url":"https://thequant.space/flowcharts/alpha-r1-alpha-screening-with-llm-reasoning-via-reinforceme/"},"how":"uses_method_or_data","quote":null},{"paper":{"paper_id":"2409.07486","title":"MarS: a Financial Market Simulation Engine Powered by Generative Foundation Model","paper_date":"2024-09-04","authors":["Junjie Li","Yang Liu","Weiqing Liu","Shikai Fang","Lewen Wang","Chang Xu"],"empirical_rigor":8,"page_url":"https://thequant.space/flowcharts/mars-a-financial-market-simulation-engine-powered-by-genera/"},"how":"uses_method_or_data","quote":null},{"paper":{"paper_id":"2406.11903","title":"A Survey of Large Language Models for Financial Applications: Progress, Prospects and Challenges","paper_date":"2024-06-15","authors":["Yuqi Nie","Yaxuan Kong","Xiaowen Dong","John M. Mulvey","H. Vincent Poor","Qingsong Wen"],"empirical_rigor":6,"page_url":"https://thequant.space/flowcharts/a-survey-of-large-language-models-for-financial-applications/"},"how":"uses_method_or_data","quote":null}],"scope":"Citations between papers in this corpus only; citations from outside it are not counted."}},"implementation":{"status":"available","public":false,"code_url":null,"note":"No repository presented by the authors as their own was found in the paper. Absence here is not proof that no code exists."},"replication":{"status":"none_found","card":null,"note":"No replication of this paper has been run by thequant.space yet."},"extraction":{"text_source":"fulltext","model":"openai/gpt-oss-120b","version":1,"extracted_at":"2026-11-14T18:25:32Z"},"provenance":{"claims":"Everything here is what the authors state in the paper. Nothing was re-run or reproduced by the platform.","quotes":"Assumptions, datasets, cost detail and findings were extracted by a language model. Every quote is verbatim paper text. Where an item has `support`, \"full\" means every figure in it appears in the quoted sentences and \"partial\" means a figure is stated elsewhere in the paper; items with a figure found nowhere in the paper were discarded.","datasets_known":"datasets.known lists well-known vendors and public datasets by a stable id, found by a dictionary over the full text where the sentence says the data is used; it is independent of the model and covers only names in the dictionary.","flags":"transaction_costs.modeled, results.evaluation_type and results.out_of_sample.method are platform classifications (structured-decision models); see https://thequant.space/score-guide/#penalty-flags","comparisons":"supports / contradicts / qualifies are a language model's reading of two papers' quoted findings, restricted to closely related papers that share no author. They are pointers to read, not verified replications, and coverage is partial.","implementation":"code_url is a repository the paper itself presents as its own (rule-scored, ambiguous cases judged by a model), checked for liveness when it was recorded."},"docs":"https://thequant.space/agents/"}