{"paper_id":"2405.09747","title":"NIFTY Financial News Headlines Dataset","authors":["Raeid Saqur","Ken Kato","Nicholas Vinden","Frank Rudzicz"],"paper_date":"2024-05-16","paper_type":"dataset-benchmark","paper_url":"https://arxiv.org/pdf/2405.09747v1","page_url":"https://thequant.space/flowcharts/nifty-financial-news-headlines-dataset/","scores":{"empirical_rigor":6.5,"math_complexity":2,"quadrant":"Street Traders"},"proposes":{"status":"available","statement":"The paper introduces and releases the NIFTY Financial News Headlines dataset for financial market forecasting with LLMs.","quote":"We introduce and make publicly available the NIFTY Financial News Headlines dataset, designed to facilitate and advance research in financial market forecasting using large language models (LLMs).","summary":"We introduce and make publicly available the NIFTY Financial News Headlines dataset, designed to facilitate and advance research in financial market forecasting using large language models (LLMs). This dataset comprises two distinct versions tailored for different modeling approaches: (i) NIFTY-LM…","strategy":null},"assumptions":{"status":"available","items":[{"assumption":"Labels are derived from daily percentage change in closing price with thresholds at ±0.5%.","type":"data","stated":"explicit","quote":"xr = { Fall if PCTchange < −0.5% Neutral if −0.5% ≤PCTchange ≤0.5%"},{"assumption":"Only headlines with similarity score ≥ 0.2 are retained.","type":"data","stated":"explicit","quote":"Headlines with a similarity score below 0.2, were excluded from the dataset."},{"assumption":"Prompts longer than 3000 words are truncated after removing low tf‑idf words.","type":"execution","stated":"explicit","quote":"In instances where the prompt exceeded a length of 3000 words, a further refinement process was employed"}]},"datasets":{"status":"available","items":[{"name":"NIFTY-LM","provider":null,"kind":"text-news","access":"public","period":"2010-2023","universe":"US equities market","quote":"NIFTY is comprised of two related datasets, NIFTY-LM and NIFTY-RL."},{"name":"NIFTY-RL","provider":null,"kind":"text-news","access":"public","period":"2010-2023","universe":"US equities market","quote":"NIFTY is comprised of two related datasets, NIFTY-LM and NIFTY-RL."}],"known":[{"id":"twitter","name":"Twitter / X","provider":"X Corp.","kind":"text-news","access":"public","quote":"Other stock price movement prediction from social dataset include StockNet [64] which is mainly stock tweets of 88 stock tickers from 9 financial market industries from Twitter over two years (from 2014-2015) aligned with their corresponding historical price data.","mentions":1,"used_in":1},{"id":"yahoo-finance","name":"Yahoo Finance","provider":"Yahoo","kind":"market-prices","access":"public","quote":"The dataset was assembled by aggregating information from various internet news sources from January 6, 2010, to September 21, 2020 – including headlines from The Wall Street Journal and Reuters News, as well as market data of the $SPY index from Yahoo Finance.","mentions":1,"used_in":1}],"sample":{"start":null,"end":null,"market":null,"asset_class":null,"frequency":null},"data_resolution":"daily"},"transaction_costs":{"status":"not_applicable","modeled":"n/a","headline_net_of_costs":null,"detail":null,"quote":null,"source":"front_matter","rule":"R3","candidates":{"front_matter":"n/a","evidence_card":"n/a","evidence_card_quoted":false},"meaning":"the paper reports no trading or execution result"},"results":{"status":"available","evaluation_type":"forecast-accuracy","findings":[{"finding":"Larger models (e.g., Meta‑Llama‑3‑8B‑Instruct) show higher information gain and better performance on market movement tasks compared to smaller variants.","kind":"predictive-accuracy","quote":"Information gain resulted from clustering our list of model’s embeddings are summarized in Table 7"}],"reported_performance":null,"out_of_sample":{"method":"unclear","headline_out_of_sample":null}},"independent_evidence":{"status":"available","supports":[],"contradicts":[],"qualifies":[],"compared_with":7,"citations":{"cited_by_in_corpus":5,"by_independent_authors":2,"how_cited":{"used_as_baseline":0,"uses_method_or_data":1,"extends":0,"discusses_findings":0,"mentions":1,"unclassified":3},"independent_papers":[{"paper":{"paper_id":"2412.18174","title":"INVESTORBENCH: A Benchmark for Financial Decision-Making Tasks with LLM-based Agent","paper_date":"2024-12-24","authors":["Haohang Li","Yupeng Cao","Yangyang Yu","Shashidhar Reddy Javaji","Zhiyang Deng","Yueru He"],"empirical_rigor":6,"page_url":"https://thequant.space/flowcharts/investorbench-a-benchmark-for-financial-decision-making-tas/"},"how":"uses_method_or_data","quote":null}],"scope":"Citations between papers in this corpus only; citations from outside it are not counted."}},"implementation":{"status":"available","public":true,"code_url":"https://huggingface.co/datasets/raeidsaqur/NIFTY","note":null},"replication":{"status":"none_found","card":null,"note":"No replication of this paper has been run by thequant.space yet."},"extraction":{"text_source":"fulltext","model":"openai/gpt-oss-120b","version":1,"extracted_at":"2026-11-14T18:09:24Z"},"provenance":{"claims":"Everything here is what the authors state in the paper. Nothing was re-run or reproduced by the platform.","quotes":"Assumptions, datasets, cost detail and findings were extracted by a language model. Every quote is verbatim paper text. Where an item has `support`, \"full\" means every figure in it appears in the quoted sentences and \"partial\" means a figure is stated elsewhere in the paper; items with a figure found nowhere in the paper were discarded.","datasets_known":"datasets.known lists well-known vendors and public datasets by a stable id, found by a dictionary over the full text where the sentence says the data is used; it is independent of the model and covers only names in the dictionary.","flags":"transaction_costs.modeled, results.evaluation_type and results.out_of_sample.method are platform classifications (structured-decision models); see https://thequant.space/score-guide/#penalty-flags","comparisons":"supports / contradicts / qualifies are a language model's reading of two papers' quoted findings, restricted to closely related papers that share no author. They are pointers to read, not verified replications, and coverage is partial.","implementation":"code_url is a repository the paper itself presents as its own (rule-scored, ambiguous cases judged by a model), checked for liveness when it was recorded."},"docs":"https://thequant.space/agents/"}