{"paper_id":"2404.02053","title":"BERTopic-Driven Stock Market Predictions: Unraveling Sentiment Insights","authors":["Enmin Zhu","Jerome Yen"],"paper_date":"2024-04-02","paper_type":"empirical","paper_url":"https://arxiv.org/pdf/2404.02053v2","page_url":"https://thequant.space/flowcharts/bertopic-driven-stock-market-predictions-unraveling-sentime/","scores":{"empirical_rigor":6,"math_complexity":3.5,"quadrant":"Street Traders"},"proposes":{"status":"available","statement":"The paper proposes applying BERTopic for topic-level sentiment analysis to improve stock price prediction models.","quote":"This paper is the first to employ the BERTopic model for sentiment analysis in the context of the stock market.","summary":"This paper explores the intersection of Natural Language Processing (NLP) and financial analysis, focusing on the impact of sentiment analysis in stock price prediction. We employ BERTopic, an advanced NLP technique, to analyze the sentiment of topics derived from stock market comments. Our…","strategy":null},"assumptions":{"status":"available","items":[{"assumption":"The stock‑related comments collected from Reddit and Seeking Alpha are representative of market sentiment.","type":"data","stated":"implied","quote":"Given that the data set is constructed of stock-related comments from platforms such as Reddit or Seeking Alpha without utilizing predefined topic tags, it becomes imperative to employ clustering algorithms to categorize these comments into different topics."},{"assumption":"Daily closing prices from Yahoo Finance accurately reflect the true market price for evaluation.","type":"market","stated":"implied","quote":"Finally, we compare these topic-sentiment-based predictions with the actual daily stock prices sourced from Yahoo Finance."},{"assumption":"Sentiment scores derived from BERTopic can be meaningfully combined with topic information to enhance model inputs.","type":"model","stated":"implied","quote":"Because our sentiment scores don’t cover the topic,we will try to use topic sentiment for improving our model."}]},"datasets":{"status":"available","items":[{"name":"Stock comments web‑crawled from Reddit and Seeking Alpha","provider":null,"kind":"text-news","access":"unknown","period":null,"universe":null,"quote":"Our text dataset comprises stock comments obtained by web crawling various internet websites related to the stock market.","known_id":"reddit"},{"name":"Daily stock prices from Yahoo Finance","provider":"Yahoo Finance","kind":"market-prices","access":"public","period":null,"universe":null,"quote":"Finally, we compare these topic-sentiment-based predictions with the actual daily stock prices sourced from Yahoo Finance.","known_id":"yahoo-finance"}],"known":[{"id":"yahoo-finance","name":"Yahoo Finance","provider":"Yahoo","kind":"market-prices","access":"public","quote":"The study utilized a comment dataset from Yahoo Finance covering the period from 2012 to 2013 and data from the Sahamyab website in Iran spanning from 2016 to 2018.","mentions":3,"used_in":2}],"sample":{"start":null,"end":null,"market":null,"asset_class":null,"frequency":null},"data_resolution":"daily"},"transaction_costs":{"status":"not_applicable","modeled":"n/a","headline_net_of_costs":null,"detail":null,"quote":null,"source":"front_matter","rule":"R3","candidates":{"front_matter":"n/a","evidence_card":"n/a","evidence_card_quoted":false},"meaning":"the paper reports no trading or execution result"},"results":{"status":"available","evaluation_type":"forecast-accuracy","findings":[{"finding":"Incorporating BERTopic‑derived topic sentiment improves key error metrics by roughly 10% across models.","kind":"performance","quote":"Quantitatively, the key evaluation metrics of RMSE, MAE, R-squared, and MAPE improved by about 10%."}],"reported_performance":null,"out_of_sample":{"method":"holdout","headline_out_of_sample":null}},"independent_evidence":{"status":"available","supports":[],"contradicts":[{"paper":{"paper_id":"2602.00086","title":"Impact of LLMs news Sentiment Analysis on Stock Price Movement Prediction","paper_date":"2026-01-22","authors":["Walid Siala","Ahmed Khanfir","Mike Papadakis"],"empirical_rigor":6.5,"page_url":"https://thequant.space/flowcharts/impact-of-llms-news-sentiment-analysis-on-stock-price-movement-prediction/"},"question":"Does incorporating sentiment features improve stock prediction error?","this_paper_finding":"Incorporating BERTopic‑derived topic sentiment improves key error metrics by roughly 10% across models.","other_paper_finding":"LSTM and tPatchGNN exhibit minimal sensitivity to sentiment integration, achieving their lowest errors without sentiment features.","other_paper_quote":"LSTM and tPatchGNN exhibit minimal sensitivity to sentiment integration, with differences between the NS baseline and sentiment-augmented models remaining within 0.002-0.009 for MAE and 0.051-0.110 for RSE, and both architectures achieving their lowest errors without sentiment features.","note":"A shows ~10% error reduction with BERTopic sentiment; B shows LSTM and tPatchGNN have lowest errors without sentiment, indicating minimal sensitivity.","confidence":0.583}],"qualifies":[],"compared_with":8,"citations":{"cited_by_in_corpus":2,"by_independent_authors":2,"how_cited":{"used_as_baseline":0,"uses_method_or_data":0,"extends":0,"discusses_findings":0,"mentions":0,"unclassified":2},"independent_papers":[],"scope":"Citations between papers in this corpus only; citations from outside it are not counted."}},"implementation":{"status":"available","public":false,"code_url":null,"note":"No repository presented by the authors as their own was found in the paper. Absence here is not proof that no code exists."},"replication":{"status":"none_found","card":null,"note":"No replication of this paper has been run by thequant.space yet."},"extraction":{"text_source":"fulltext","model":"openai/gpt-oss-120b","version":1,"extracted_at":"2026-11-14T18:11:48Z"},"provenance":{"claims":"Everything here is what the authors state in the paper. Nothing was re-run or reproduced by the platform.","quotes":"Assumptions, datasets, cost detail and findings were extracted by a language model. Every quote is verbatim paper text. Where an item has `support`, \"full\" means every figure in it appears in the quoted sentences and \"partial\" means a figure is stated elsewhere in the paper; items with a figure found nowhere in the paper were discarded.","datasets_known":"datasets.known lists well-known vendors and public datasets by a stable id, found by a dictionary over the full text where the sentence says the data is used; it is independent of the model and covers only names in the dictionary.","flags":"transaction_costs.modeled, results.evaluation_type and results.out_of_sample.method are platform classifications (structured-decision models); see https://thequant.space/score-guide/#penalty-flags","comparisons":"supports / contradicts / qualifies are a language model's reading of two papers' quoted findings, restricted to closely related papers that share no author. They are pointers to read, not verified replications, and coverage is partial.","implementation":"code_url is a repository the paper itself presents as its own (rule-scored, ambiguous cases judged by a model), checked for liveness when it was recorded."},"docs":"https://thequant.space/agents/"}