{"paper_id":"2609.39420","title":"QuantCode Model: Specializing Language Models for Executable Algorithmic Trading Code","authors":["Alexey Chernysh","Orkhan Ekhtibarov","Dmitry Zmitrovich"],"paper_date":"2026-09-30","paper_type":"empirical","paper_url":"https://arxiv.org/pdf/2609.39420","page_url":"https://thequant.space/flowcharts/quantcode-model-specializing-language-models-for-executable-algorithmic-trading/","scores":{"empirical_rigor":6,"math_complexity":4,"quadrant":"Street Traders"},"proposes":{"status":"available","statement":"The paper proposes specializing large language models for executable algorithmic‑trading code via continued pretraining on trading‑framework code and supervised fine‑tuning on validated request‑to‑code pairs, and introduces the QuantCode‑Bench benchmark.","quote":"We study two complementary mechanisms for specializing language models for this setting: continued pretraining on algorithmic‑trading framework code and supervised fine‑tuning (SFT) on agent‑validated request‑to‑code pairs.","summary":"Large language models are strong general-purpose code generators, but executable algorithmic trading remains a demanding specialization target: a model must translate a natural-language strategy specification into correct program logic for a specialized trading framework, execute on historical…","strategy":null},"assumptions":{"status":"none_found","items":[]},"datasets":{"status":"available","items":[{"name":"QuantCode‑Bench","provider":null,"kind":"benchmark","access":"public","period":null,"universe":null,"quote":"Evaluation is centered on QuantCode‑Bench, our 400‑task benchmark for Backtrader strategy generation, together with a repository‑level SWE‑bench‑like track."},{"name":"SFT request‑to‑code dataset","provider":null,"kind":"benchmark","access":"public","period":null,"universe":null,"quote":"The resulting SFT dataset contains approximately 800 validated request‑to‑code pairs."}],"known":[{"id":"reddit","name":"Reddit","provider":"Reddit","kind":"text-news","access":"public","quote":"Strategy requests are derived from strategy-related material collected from Reddit, StackEx-change, and GitHub, so that the request distribution approximates realistic user intent rather than templated synthetic prompts.","mentions":1,"used_in":1}],"sample":{"start":null,"end":null,"market":null,"asset_class":null,"frequency":null},"data_resolution":"unclear"},"transaction_costs":{"status":"available","modeled":"unclear","headline_net_of_costs":null,"detail":null,"quote":null,"source":"conflict","rule":"R4b","candidates":{"front_matter":"n/a","evidence_card":"no","evidence_card_quoted":true},"conflict_kind":"applicability","card_detail":null,"card_quote":"Neither QuantCode‑Bench nor the SFT validation pipeline measures profitability, robustness across market regimes, realistic transaction costs, market impact, or production risk.","meaning":"the platform classifier and the paper-text extraction disagree, so no value is asserted"},"results":{"status":"available","evaluation_type":"forecast-accuracy","findings":[{"finding":"Continued pretraining improves single‑turn Judge Pass from 41.5% to 47.5% for Qwen3.5‑397B‑A17B and from 27.8% to 33.0% for Qwen3.6‑35B‑A3B.","kind":"performance","quote":"Continued pretraining improves single‑turn Judge Pass from 41.5% to 47.5% for Qwen3.5‑397B‑A17B and from 27.8% to 33.0% for Qwen3.6‑35B‑A3B."},{"finding":"Supervised fine‑tuning after continued pretraining raises Judge Pass to 58.2% and achieves 83.5% successful backtests for Qwen3.6‑35B‑A3B.","kind":"performance","quote":"SFT applied after continued pretraining yields a larger gain for Qwen3.6‑35B‑A3B, reaching 58.2% Judge Pass and 83.5% successful backtests;"},{"finding":"In agentic evaluation, first‑turn success increases from 22.3% to 58.3% and final success after up to 10 turns rises from 47.5% to 79.5% for the SFT checkpoint.","kind":"performance","quote":"in agentic evaluation it raises first‑turn success from 22.3% to 58.3% and final success after up to 10 turns from 47.5% to 79.5%."},{"finding":"Continued pretraining alone lowers final success after repair from 47.5% to 32.5%, indicating degraded instruction following.","kind":"negative","quote":"Continued pretraining alone improves first‑turn agentic success but lowers final success after repair from 47.5% to 32.5%, consistent with degraded instruction following,"},{"finding":"Domain specialization degrades parser‑conformant structured tool calling, and recovery SFT restores tool‑call formatting but not overall repository‑level performance.","kind":"negative","quote":"Domain specialization degraded parser‑conformant structured tool calling in the target agent harness. Dedicated recovery SFT restored operational tool‑call formatting in qualitative deployment checks, but repository‑level task resolution remained below the Qwen3.6‑35B‑A3B base checkpoint."}],"reported_performance":null,"out_of_sample":{"method":"none","headline_out_of_sample":null}},"independent_evidence":{"status":"none_found","supports":[],"contradicts":[],"qualifies":[],"compared_with":21,"citations":{"cited_by_in_corpus":0,"by_independent_authors":0,"how_cited":{"used_as_baseline":0,"uses_method_or_data":0,"extends":0,"discusses_findings":0,"mentions":0,"unclassified":0},"independent_papers":[],"scope":"Citations between papers in this corpus only; citations from outside it are not counted."}},"implementation":{"status":"available","public":false,"code_url":null,"note":"No repository presented by the authors as their own was found in the paper. Absence here is not proof that no code exists."},"replication":{"status":"none_found","card":null,"note":"No replication of this paper has been run by thequant.space yet."},"extraction":{"text_source":"fulltext","model":"openai/gpt-oss-120b","version":1,"extracted_at":"2026-11-14T17:04:01Z"},"provenance":{"claims":"Everything here is what the authors state in the paper. Nothing was re-run or reproduced by the platform.","quotes":"Assumptions, datasets, cost detail and findings were extracted by a language model. Every quote is verbatim paper text. Where an item has `support`, \"full\" means every figure in it appears in the quoted sentences and \"partial\" means a figure is stated elsewhere in the paper; items with a figure found nowhere in the paper were discarded.","datasets_known":"datasets.known lists well-known vendors and public datasets by a stable id, found by a dictionary over the full text where the sentence says the data is used; it is independent of the model and covers only names in the dictionary.","flags":"transaction_costs.modeled, results.evaluation_type and results.out_of_sample.method are platform classifications (structured-decision models); see https://thequant.space/score-guide/#penalty-flags","comparisons":"supports / contradicts / qualifies are a language model's reading of two papers' quoted findings, restricted to closely related papers that share no author. They are pointers to read, not verified replications, and coverage is partial.","implementation":"code_url is a repository the paper itself presents as its own (rule-scored, ambiguous cases judged by a model), checked for liveness when it was recorded."},"docs":"https://thequant.space/agents/"}