{"paper_id":"2410.18988","title":"Generating long-horizon stock buy signals with a neural language model","authors":["Joel R. Bock"],"paper_date":"2024-10-09","paper_type":"empirical","paper_url":"https://arxiv.org/pdf/2410.18988v1","page_url":"https://thequant.space/flowcharts/generating-long-horizon-stock-buy-signals-with-a-neural-la/","scores":{"empirical_rigor":7,"math_complexity":3.5,"quadrant":"Street Traders"},"proposes":{"status":"available","statement":"The paper fine‑tunes a small language model on 10‑K report text to generate forward‑looking buy or sell decisions for S&P 500 stocks.","quote":"In the present study, a pre-trained language model is fine‑tuned [18] to generate forecasts of future stock price movements. Inputs to the model are raw text from 10‑K reports of large market capitalization companies in the S&P 500 index; the output is a forward‑looking buy or sell decision.","summary":"This paper describes experiments on fine-tuning a small language model to generate forecasts of long-horizon stock price movements. Inputs to the model are narrative text from 10-K reports of large market capitalization companies in the S&P 500 index; the output is a forward-looking buy or sell…","strategy":null},"assumptions":{"status":"available","items":[{"assumption":"Only narrative text from 10‑K filings is used as input; no structured financial data are included.","type":"data","stated":"explicit","quote":"No structured ﬁnancial input data are used; numeric data enters only as it appears in the narrative sections of the report."},{"assumption":"Companies are split by SEC ID so that the same firm does not appear in both training and test sets.","type":"execution","stated":"explicit","quote":"The data were partitioned by ID number such that companies were not simultaneously represented in both training and out‑of‑sample test sets during the experiments."},{"assumption":"Out‑of‑sample performance is evaluated without accounting for trading costs or market impact.","type":"execution","stated":"implied","quote":"The results reported here demonstrate good out‑of‑sample statistical performance (F1‑macro= 0.62) at medium to long investment horizons."},{"assumption":"The random‑selection benchmark assumes a null hypothesis of no predictive value in the 10‑K text.","type":"statistical","stated":"explicit","quote":"The null hypothesis of “no predictive value” in the 10‑K text was tested by running 2500 trials using a pseudo‑random number as a decision function."}]},"datasets":{"status":"available","items":[{"name":"10‑K report text","provider":"U.S. Securities and Exchange Commission (SEC)","kind":"text-news","access":"public","period":null,"universe":"S&P 500 large‑cap companies","quote":"Inputs to the model are narrative text from 10‑K reports of large market capitalization companies in the S&P 500 index."}],"known":[],"sample":{"start":null,"end":null,"market":null,"asset_class":null,"frequency":null},"data_resolution":"unclear"},"transaction_costs":{"status":"not_applicable","modeled":"n/a","headline_net_of_costs":null,"detail":null,"quote":null,"source":"front_matter","rule":"R1","candidates":{"front_matter":"n/a","evidence_card":"no","evidence_card_quoted":false},"meaning":"the paper reports no trading or execution result"},"results":{"status":"available","evaluation_type":"forecast-accuracy","findings":[{"finding":"The model achieves an out‑of‑sample macro‑averaged F1 score of 0.62 for buy/sell classification across horizons up to 12 months.","kind":"predictive-accuracy","quote":"The results reported here demonstrate good out‑of‑sample statistical performance (F1‑macro= 0.62) at medium to long investment horizons."},{"finding":"Buy signals are most precise at 6‑ and 9‑month horizons, with the peak sensitivity at 9 months.","kind":"performance","quote":"In particular, the “buy” signals generated from 10‑K text are found most precise at 6 and 9 months in the future"},{"finding":"The buy signal improves over random selection by 4.8 % to 9 % in aggregate, with the largest gain at the 9‑month horizon.","kind":"performance","quote":"As measured by the F1 score, the buy signal provides between 4.8 and 9 percent improvement against a random stock selection model."},{"finding":"Sell signals perform poorly, likely due to highly imbalanced out‑of‑sample data and positive‑language bias in reports.","kind":"negative","quote":"In contrast, sell signals generated by the models do not perform well. This may be attributed to the highly imbalanced out‑of‑sample data, or perhaps due to management drafting annual reports with a bias toward positive language."},{"finding":"Cross‑sectional analysis shows that reporting style effects on predictability vary by economic sector.","kind":"statistical","quote":"Cross‑sectional analysis of performance by economic sector suggests that characteristic reporting styles within industries are correlated with varying degrees and time scales of price movement predictability."}],"reported_performance":null,"out_of_sample":{"method":"cross-validation","headline_out_of_sample":null}},"independent_evidence":{"status":"none_found","supports":[],"contradicts":[],"qualifies":[],"compared_with":23,"citations":{"cited_by_in_corpus":0,"by_independent_authors":0,"how_cited":{"used_as_baseline":0,"uses_method_or_data":0,"extends":0,"discusses_findings":0,"mentions":0,"unclassified":0},"independent_papers":[],"scope":"Citations between papers in this corpus only; citations from outside it are not counted."}},"implementation":{"status":"available","public":false,"code_url":null,"note":"No repository presented by the authors as their own was found in the paper. Absence here is not proof that no code exists."},"replication":{"status":"none_found","card":null,"note":"No replication of this paper has been run by thequant.space yet."},"extraction":{"text_source":"fulltext","model":"openai/gpt-oss-120b","version":1,"extracted_at":"2026-11-14T17:59:41Z"},"provenance":{"claims":"Everything here is what the authors state in the paper. Nothing was re-run or reproduced by the platform.","quotes":"Assumptions, datasets, cost detail and findings were extracted by a language model. Every quote is verbatim paper text. Where an item has `support`, \"full\" means every figure in it appears in the quoted sentences and \"partial\" means a figure is stated elsewhere in the paper; items with a figure found nowhere in the paper were discarded.","datasets_known":"datasets.known lists well-known vendors and public datasets by a stable id, found by a dictionary over the full text where the sentence says the data is used; it is independent of the model and covers only names in the dictionary.","flags":"transaction_costs.modeled, results.evaluation_type and results.out_of_sample.method are platform classifications (structured-decision models); see https://thequant.space/score-guide/#penalty-flags","comparisons":"supports / contradicts / qualifies are a language model's reading of two papers' quoted findings, restricted to closely related papers that share no author. They are pointers to read, not verified replications, and coverage is partial.","implementation":"code_url is a repository the paper itself presents as its own (rule-scored, ambiguous cases judged by a model), checked for liveness when it was recorded."},"docs":"https://thequant.space/agents/"}