{"paper_id":"2510.01203","title":"Mamba Outpaces Reformer in Stock Prediction with Sentiments from Top Ten LLMs","authors":["Lokesh Antony Kadiyala","Amir Mirzaeinia"],"paper_date":"2025-09-14","paper_type":"methodological","paper_url":"https://arxiv.org/pdf/2510.01203v1","page_url":"https://thequant.space/flowcharts/mamba-outpaces-reformer-in-stock-prediction-with-sentiments/","scores":{"empirical_rigor":8,"math_complexity":7.5,"quadrant":"Holy Grail"},"proposes":{"status":"available","statement":"The paper proposes a novel framework that integrates sentiment scores from ten large language models with minute‑level intraday stock price data to improve short‑term stock prediction, and evaluates Mamba and Reformer models on this data.","quote":"This research proposes a novel framework for improving minute-level prediction accuracy using semantic sentiment scores from top ten different large language models (LLMs) combined with minute interval intraday stock price data.","summary":"The stock market is extremely difficult to predict in the short term due to high market volatility, changes caused by news, and the non-linear nature of the financial time series. This research proposes a novel framework for improving minute-level prediction accuracy using semantic sentiment scores…","strategy":"Mamba with LLaMA 3.3–70B sentiment scores"},"assumptions":{"status":"available","items":[{"assumption":"Only Apple Inc. (AAPL) stock is considered for prediction.","type":"market","stated":"implied","quote":"We systematically constructed a time-aligned dataset of AAPL news articles and 1-minute Apple Inc. (AAPL) stock prices for the dates of April 4 to May 2, 2025."},{"assumption":"News articles published outside regular market hours are shifted to the next trading day at 9:30 AM EST.","type":"data","stated":"explicit","quote":"Articles that were published outside regular business hours (before 9:30 AM or after 4:00 PM ET), as well as those from non-business days"},{"assumption":"Sentiment scores from each LLM are scaled to a [0, 1] range before being used as model inputs.","type":"data","stated":"explicit","quote":"Each article obtained sentiment scores from all ten LLMs, which were scaled to a [0, 1] range and combined with prices and technical indicators..."},{"assumption":"Technical indicators (RSI, ROC, Bollinger Band Width) are computed from the 1‑minute price series and are treated as stationary inputs.","type":"model","stated":"implied","quote":"combined with prices and technical indicators like RSI, ROC, and Bollinger Band Width."},{"assumption":"Model hyper‑parameters are tuned using Optuna over 20 iterations and evaluated on a 3‑day hold‑out period.","type":"model","stated":"explicit","quote":"Hyper parameters were optimized by means of Optuna and were evaluated through a 3-day evaluation period."}]},"datasets":{"status":"available","items":[{"name":"AAPL news articles","provider":"News API","kind":"text-news","access":"public","period":"2025-04-04 to 2025-05-02","universe":"Apple Inc.","quote":"The News API was used to fetch news headlines about Apple Inc. (AAPL) that were published between April 4, 2025, at 4:01 PM Eastern Time (ET), and May 2, 2025, at 4:00 PM ET."},{"name":"AAPL 1‑minute price data","provider":"Polygon.io API","kind":"market-prices","access":"commercial","period":"2025-04-04 to 2025-05-02","universe":"Apple Inc.","quote":"High-frequency stock price data at 1‑minute intervals during U.S. market hours was collected using the Polygon.io API.","known_id":"polygon"}],"known":[{"id":"polygon","name":"Polygon.io","provider":"Polygon.io","kind":"market-prices","access":"commercial","quote":"High-frequency stock price data at 1-minute intervals during U.S. market hours was collected using the Polygon.io API.","mentions":1,"used_in":1}],"sample":{"start":"2025-04","end":"2025-05","market":"Apple Inc. (AAPL) intraday stock prices","asset_class":"equities","frequency":"intraday"},"data_resolution":"intraday-bars"},"transaction_costs":{"status":"not_applicable","modeled":"n/a","headline_net_of_costs":null,"detail":null,"quote":null,"source":"front_matter","rule":"R3","candidates":{"front_matter":"n/a","evidence_card":"n/a","evidence_card_quoted":false},"meaning":"the paper reports no trading or execution result"},"results":{"status":"available","evaluation_type":"forecast-accuracy","findings":[{"finding":"Mamba achieved the lowest error of 0.137 when using LLaMA 3.3‑70B sentiment scores, outperforming Reformer across all ten LLMs.","kind":"performance","quote":"Mamba performed best with LLaMA 3.3–70B, with the lowest error of 0.137."},{"finding":"Mamba repeatedly outperformed Reformer on 9 out of 10 LLM‑based inputs, showing lower MSE and better short‑term adaptability.","kind":"performance","quote":"Mamba repeatedly outperformed Reformer across 9 out of 10 LLM-based inputs."},{"finding":"Reformer’s best per‑performance was with Qwen Turbo, yielding an MSE of 2.647, but it was less accurate than the top Mamba models.","kind":"performance","quote":"The Qwen Turbo setup had the best per‑formance in the Reformer model, with an MSE value of 2.647."},{"finding":"Mamba demonstrated greater responsiveness to rapid price shifts, maintaining tight alignment with ground truth, whereas Reformer produced smoother curves.","kind":"predictive-accuracy","quote":"The Mamba model displayed greater responsiveness to minor market trends and price surges, maintaining tight alignment with ground truth data during rapid price shifts."},{"finding":"Despite higher error margins, Reformer captured broader trend directions reasonably well when paired with certain LLMs (e.g., Qwen Turbo, DeepSeek V3).","kind":"predictive-accuracy","quote":"showed reasonable outcomes when paired with Qwen Turbo and DeepSeek V3, capturing the broader structure of stock market trends."}],"reported_performance":{"strategy":"Mamba with LLaMA 3.3–70B sentiment scores","sharpe":null,"sharpe_benchmark":null,"annual_return_pct":null,"total_return_pct":null,"max_drawdown_pct":null},"out_of_sample":{"method":"holdout","headline_out_of_sample":true}},"independent_evidence":{"status":"none_found","supports":[],"contradicts":[],"qualifies":[],"compared_with":46,"citations":{"cited_by_in_corpus":0,"by_independent_authors":0,"how_cited":{"used_as_baseline":0,"uses_method_or_data":0,"extends":0,"discusses_findings":0,"mentions":0,"unclassified":0},"independent_papers":[],"scope":"Citations between papers in this corpus only; citations from outside it are not counted."}},"implementation":{"status":"available","public":false,"code_url":null,"note":"No repository presented by the authors as their own was found in the paper. Absence here is not proof that no code exists."},"replication":{"status":"none_found","card":null,"note":"No replication of this paper has been run by thequant.space yet."},"extraction":{"text_source":"fulltext","model":"openai/gpt-oss-120b","version":1,"extracted_at":"2026-11-14T17:27:07Z"},"provenance":{"claims":"Everything here is what the authors state in the paper. Nothing was re-run or reproduced by the platform.","quotes":"Assumptions, datasets, cost detail and findings were extracted by a language model. Every quote is verbatim paper text. Where an item has `support`, \"full\" means every figure in it appears in the quoted sentences and \"partial\" means a figure is stated elsewhere in the paper; items with a figure found nowhere in the paper were discarded.","datasets_known":"datasets.known lists well-known vendors and public datasets by a stable id, found by a dictionary over the full text where the sentence says the data is used; it is independent of the model and covers only names in the dictionary.","flags":"transaction_costs.modeled, results.evaluation_type and results.out_of_sample.method are platform classifications (structured-decision models); see https://thequant.space/score-guide/#penalty-flags","comparisons":"supports / contradicts / qualifies are a language model's reading of two papers' quoted findings, restricted to closely related papers that share no author. They are pointers to read, not verified replications, and coverage is partial.","implementation":"code_url is a repository the paper itself presents as its own (rule-scored, ambiguous cases judged by a model), checked for liveness when it was recorded."},"docs":"https://thequant.space/agents/"}