{"paper_id":"2412.06794","title":"Understanding the Impact of News Articles on the Movement of Market Index: A Case on Nifty 50","authors":["Subhasis Dasgupta","Pratik Satpati","Ishika Choudhary","Jaydip Sen"],"paper_date":"2024-11-22","paper_type":"empirical","paper_url":"https://arxiv.org/pdf/2412.06794v1","page_url":"https://thequant.space/flowcharts/understanding-the-impact-of-news-articles-on-the-movement-of/","scores":{"empirical_rigor":8,"math_complexity":2,"quadrant":"Street Traders"},"proposes":{"status":"available","statement":"The paper proposes analyzing Nifty 50 index movements using sentiment scores from news items across multiple topics and evaluating predictive performance with regression models.","quote":"The current study focused on bridging this gap by analysing the movement of Nifty 50 index with respect to the sentiments associated with news items related to various different topic such as sports, politics, markets etc.","summary":"In the recent past, there were several works on the prediction of stock price using different methods. Sentiment analysis of news and tweets and relating them to the movement of stock prices have already been explored. But, when we talk about the news, there can be several topics such as politics…","strategy":null},"assumptions":{"status":"available","items":[{"assumption":"News published on weekends can influence the index movement on Monday.","type":"data","stated":"explicit","quote":"But it was quite natural to assume that news of Saturdays and Sundays can easily influence the movement of the Index on Monday."},{"assumption":"Sentiment of a headline reflects the sentiment of the corresponding news article.","type":"model","stated":"explicit","quote":"It is quite natural to assume that if the sentiment of the news headline is positive, the sentiment of the corresponding news would also be positive."},{"assumption":"Movement of NIFTY 50 index depends on immediate past news.","type":"market","stated":"explicit","quote":"It was assumed that movement of NIFTY 50 index was dependent of immediate past news and hence, these two separate lag values were considered in the analysis."},{"assumption":"Linear regression assumptions (error distribution, multicollinearity) hold for the model.","type":"statistical","stated":"explicit","quote":"Linear regression has several important assumptions related to the distribution of errors and multicollinearity."},{"assumption":"Missing price data can be filled by forward fill (last value carry forward).","type":"data","stated":"implied","quote":"The missing values introduced due to left joining in the variables “Open”, “High”, “Low” and “Close” were filled with forward fill process (i.e., last value carry forward)."},{"assumption":"Sentiment scores of topics with frequency below 200 are negligible and can be omitted.","type":"data","stated":"implied","quote":"The threshold frequency was taken as 200 and all the topics which were below this threshold were neglected."}]},"datasets":{"status":"available","items":[{"name":"NIFTY 50 price dataset","provider":null,"kind":"market-prices","access":"unknown","period":"1st Jan 2021 to 22nd Feb 2024","universe":"NIFTY 50 index","quote":"The dataset of NIFTY 50 data from 1st Jan 2021 till 22nd Feb 2024 were also downloaded. This dataset contained “Open”, “High”, “Low” and “Close” values of the NIFTY 50 index date wise."},{"name":"News sentiment dataset (VADER)","provider":null,"kind":"text-news","access":"unknown","period":null,"universe":null,"quote":"Next, for news, VADER sentiment analysis was used to extract the overall sentiment of each news item and DistilBERT was used to extract the sentiment score of each headline."},{"name":"News headline sentiment dataset (DistilBERT)","provider":null,"kind":"text-news","access":"unknown","period":null,"universe":null,"quote":"DistilBERT gives binary outcome, i.e., POSITIVE and NEGATIVE along with the probability score of the predicted class. For the current study, the requirement was a numeric score."}],"known":[],"sample":{"start":null,"end":null,"market":null,"asset_class":null,"frequency":null},"data_resolution":"daily"},"transaction_costs":{"status":"not_applicable","modeled":"n/a","headline_net_of_costs":null,"detail":null,"quote":null,"source":"front_matter","rule":"R3","candidates":{"front_matter":"n/a","evidence_card":"n/a","evidence_card_quoted":false},"meaning":"the paper reports no trading or execution result"},"results":{"status":"available","evaluation_type":"forecast-accuracy","findings":[{"finding":"Using VADER sentiment scores with up to 3 lags marginally improves RMSE from 134.85 to 134.15 compared to a model without sentiment.","kind":"predictive-accuracy","quote":"The RMSE observed was 134.85. That way, with VADER sentiment scores on the news data, a marginal improvement in RMSE was observed with up to lag 3 data."},{"finding":"DistilBERT sentiment scores lead to larger RMSE reductions; Linear Regression RMSE drops to 128.78 (lag 3) from 137.76 (no sentiment).","kind":"predictive-accuracy","quote":"Linear Regression 137.76 128.78 137.45"},{"finding":"Ridge regression RMSE improves from 206.01 (no sentiment, lag 5) to 128.74 (lag 3) when using DistilBERT sentiment scores.","kind":"predictive-accuracy","quote":"Ridge Regression 206.01 128.74 136.98"},{"finding":"Top contributing features in Ridge regression (VADER) include market_lag1 (0.017038) and industry_lag2 (0.006105) for up to 3 lags.","kind":"statistical","quote":"market_lag1 0.017038 market_lag2 0.008143 industry_lag2 0.006105 industry_lag1 0.005057 industry_lag3 0.004473"},{"finding":"Linear regression assumptions are violated (high condition number, non‑normal error distribution), prompting use of regularized models.","kind":"statistical","quote":"Even though the results were impressive, the condition number was very high and the error terms were significantly deviated from the normal distribution."}],"reported_performance":null,"out_of_sample":{"method":"unclear","headline_out_of_sample":null}},"independent_evidence":{"status":"available","supports":[{"paper":{"paper_id":"2402.06698","title":"FNSPID: A Comprehensive Financial News Dataset in Time Series","paper_date":"2024-02-09","authors":["Zihan Dong","Xinyu Fan","Zhiyuan Peng"],"empirical_rigor":8.5,"page_url":"https://thequant.space/flowcharts/fnspid-a-comprehensive-financial-news-dataset-in-time-serie/"},"question":"Does adding sentiment scores improve model performance on financial time‑series predictions?","this_paper_finding":"Using VADER sentiment scores with up to 3 lags marginally improves RMSE from 134.85 to 134.15 compared to a model without sentiment.","other_paper_finding":"Adding sentiment scores modestly enhances performance on the transformer-based model.","other_paper_quote":"adding sentiment scores modestly enhances performance on the transformer-based model","note":"Both report modest gains: A notes a modest enhancement, B lowers RMSE from 134.85 to 134.15 (Δ0.70).","confidence":0.725}],"contradicts":[],"qualifies":[{"paper":{"paper_id":"2405.00522","title":"DAM: A Universal Dual Attention Mechanism for Multimodal Timeseries Cryptocurrency Trend Forecasting","paper_date":"2024-05-01","authors":["Yihang Fu","Mingyu Zhou","Luyao Zhang"],"empirical_rigor":5,"page_url":"https://thequant.space/flowcharts/dam-a-universal-dual-attention-mechanism-for-multimodal-tim/"},"question":"Does adding sentiment data improve prediction accuracy for financial time series?","this_paper_finding":"Using VADER sentiment scores with up to 3 lags marginally improves RMSE from 134.85 to 134.15 compared to a model without sentiment.","other_paper_finding":"Integrating sentiment data raises TFT model prediction performance by about 20 % and LSTM model by about 5 %.","other_paper_quote":"The application of multimodal data confers an elevation of prediction by approximately 20 percent for the TFT model and 5 percent for the LSTM model.","note":"A reports ~20% gain for TFT and ~5% for LSTM; B shows RMSE drop from 134.85 to 134.15 (~0.5%). Both find sentiment beneficial, though magnitude and metric differ.","confidence":0.738}],"compared_with":21,"citations":{"cited_by_in_corpus":0,"by_independent_authors":0,"how_cited":{"used_as_baseline":0,"uses_method_or_data":0,"extends":0,"discusses_findings":0,"mentions":0,"unclassified":0},"independent_papers":[],"scope":"Citations between papers in this corpus only; citations from outside it are not counted."}},"implementation":{"status":"available","public":false,"code_url":null,"note":"No repository presented by the authors as their own was found in the paper. Absence here is not proof that no code exists."},"replication":{"status":"none_found","card":null,"note":"No replication of this paper has been run by thequant.space yet."},"extraction":{"text_source":"fulltext","model":"openai/gpt-oss-120b","version":1,"extracted_at":"2026-11-14T17:53:03Z"},"provenance":{"claims":"Everything here is what the authors state in the paper. Nothing was re-run or reproduced by the platform.","quotes":"Assumptions, datasets, cost detail and findings were extracted by a language model. Every quote is verbatim paper text. Where an item has `support`, \"full\" means every figure in it appears in the quoted sentences and \"partial\" means a figure is stated elsewhere in the paper; items with a figure found nowhere in the paper were discarded.","datasets_known":"datasets.known lists well-known vendors and public datasets by a stable id, found by a dictionary over the full text where the sentence says the data is used; it is independent of the model and covers only names in the dictionary.","flags":"transaction_costs.modeled, results.evaluation_type and results.out_of_sample.method are platform classifications (structured-decision models); see https://thequant.space/score-guide/#penalty-flags","comparisons":"supports / contradicts / qualifies are a language model's reading of two papers' quoted findings, restricted to closely related papers that share no author. They are pointers to read, not verified replications, and coverage is partial.","implementation":"code_url is a repository the paper itself presents as its own (rule-scored, ambiguous cases judged by a model), checked for liveness when it was recorded."},"docs":"https://thequant.space/agents/"}