{"paper_id":"2312.15730","title":"Deep Reinforcement Learning for Quantitative Trading","authors":["Maochun Xu","Zixun Lan","Zheng Tao","Jiawei Du","Zongao Ye"],"paper_date":"2023-12-25","paper_type":"empirical","paper_url":"https://arxiv.org/pdf/2312.15730v1","page_url":"https://thequant.space/flowcharts/deep-reinforcement-learning-for-quantitative-trading/","scores":{"empirical_rigor":6,"math_complexity":7,"quadrant":"Holy Grail"},"proposes":{"status":"available","statement":"The paper proposes QTNet, an adaptive deep‑reinforcement‑learning trading model that autonomously formulates quantitative‑trading strategies via an intelligent agent.","quote":"our proposed solution, QT‑Net, introduces an adaptive trading model that autonomously formulates QT strategies through an intelligent trading agent.","summary":"Artificial Intelligence (AI) and Machine Learning (ML) are transforming the domain of Quantitative Trading (QT) through the deployment of advanced algorithms capable of sifting through extensive financial datasets to pinpoint lucrative investment openings. AI-driven models, particularly those…","strategy":null},"assumptions":{"status":"available","items":[{"assumption":"Each order is executed at the opening of each minute bar and rewards are calculated at the minute’s closing.","type":"execution","stated":"explicit","quote":"We presume that each order is executed right at the opening of each minute bar, with the rewards calculated at the minute’s closing."},{"assumption":"Transaction costs are modeled as a fee δ = 2 × 10⁻⁵ per trade and a fixed slippage ζ = 0.15.","type":"market","stated":"explicit","quote":"we integrate practical elements like a transaction fee (notated as δ = 2 × 10−5 ) and a fixed slippage amount (ζ = 0.15)."},{"assumption":"Initial account balance for testing is $1,000,000.","type":"execution","stated":"explicit","quote":"We set the initial account balance at $1, 000, 000 for the commencement of the testing phase."},{"assumption":"Training stops when either a 50 % loss of positions occurs or margin is depleted.","type":"model","stated":"explicit","quote":"The training process is designed to conclude under two conditions: either a 50% loss of positions or the depletion of the required margin."},{"assumption":"Quantitative trading is modeled as a Partially Observable Markov Decision Process (POMDP).","type":"model","stated":"explicit","quote":"we conceptualize the QT mechanism within the framework of a Partially Observable Markov Decision Process (POMDP)."}]},"datasets":{"status":"available","items":[{"name":"Minute‑bar OHLC futures data (IF and IC)","provider":"open data of the Oriental Wealth network, Flush, Sina Financ","kind":"market-prices","access":"public","period":"training Sep 28 2015–Nov 10 2022; testin","universe":"Chinese stock‑index futures IF and IC","quote":"Data spans a training period from September 28, 2015, to November 10, 2022, and a subsequent testing period from November 11, 2022, to November 10, 2023."}],"known":[],"sample":{"start":null,"end":null,"market":null,"asset_class":null,"frequency":null},"data_resolution":"intraday-bars"},"transaction_costs":{"status":"available","modeled":"yes","headline_net_of_costs":null,"detail":"Fee δ = 2 × 10⁻⁵ per trade and fixed slippage ζ = 0.15 are incorporated into the simulation.","quote":"we integrate practical elements like a transaction fee (notated as δ = 2 × 10−5 ) and a fixed slippage amount (ζ = 0.15).","source":"front_matter","rule":"R3","candidates":{"front_matter":"yes","evidence_card":"yes","evidence_card_quoted":true},"card_detail":"Fee δ = 2 × 10⁻⁵ per trade and fixed slippage ζ = 0.15 are incorporated into the simulation.","card_quote":"we integrate practical elements like a transaction fee (notated as δ = 2 × 10−5 ) and a fixed slippage amount (ζ = 0.15).","meaning":"costs are part of the reported headline results"},"results":{"status":"available","evaluation_type":"trading-pnl","findings":[{"finding":"QTNet learns profitable trading policies and shows superior generalization across various futures markets.","kind":"performance","quote":"demonstrating its ability to learn profitable trading policies and exhibit superior generalization across various futures markets."},{"finding":"Merging imitative learning with reinforcement learning yields enhanced adaptability and performance gains for quantitative‑trading agents.","kind":"performance","quote":"Our results underscore the enhanced adaptability and performance gains achieved by merging imitative learning with a reinforcement learning paradigm in the realm of QT solutions."},{"finding":"Experimental findings highlight the model’s proficiency in extracting robust market features and adapting to diverse market conditions.","kind":"performance","quote":"Experimental findings underscore the model's proficiency in extracting robust market features and its adaptability to diverse market conditions."}],"reported_performance":null,"out_of_sample":{"method":"holdout","headline_out_of_sample":null}},"independent_evidence":{"status":"none_found","supports":[],"contradicts":[],"qualifies":[],"compared_with":21,"citations":{"cited_by_in_corpus":2,"by_independent_authors":2,"how_cited":{"used_as_baseline":0,"uses_method_or_data":0,"extends":0,"discusses_findings":0,"mentions":2,"unclassified":0},"independent_papers":[],"scope":"Citations between papers in this corpus only; citations from outside it are not counted."}},"implementation":{"status":"available","public":false,"code_url":null,"note":"No repository presented by the authors as their own was found in the paper. Absence here is not proof that no code exists."},"replication":{"status":"none_found","card":null,"note":"No replication of this paper has been run by thequant.space yet."},"extraction":{"text_source":"fulltext","model":"openai/gpt-oss-120b","version":1,"extracted_at":"2026-11-14T16:28:34Z"},"provenance":{"claims":"Everything here is what the authors state in the paper. Nothing was re-run or reproduced by the platform.","quotes":"Assumptions, datasets, cost detail and findings were extracted by a language model. Every quote is verbatim paper text. Where an item has `support`, \"full\" means every figure in it appears in the quoted sentences and \"partial\" means a figure is stated elsewhere in the paper; items with a figure found nowhere in the paper were discarded.","datasets_known":"datasets.known lists well-known vendors and public datasets by a stable id, found by a dictionary over the full text where the sentence says the data is used; it is independent of the model and covers only names in the dictionary.","flags":"transaction_costs.modeled, results.evaluation_type and results.out_of_sample.method are platform classifications (structured-decision models); see https://thequant.space/score-guide/#penalty-flags","comparisons":"supports / contradicts / qualifies are a language model's reading of two papers' quoted findings, restricted to closely related papers that share no author. They are pointers to read, not verified replications, and coverage is partial.","implementation":"code_url is a repository the paper itself presents as its own (rule-scored, ambiguous cases judged by a model), checked for liveness when it was recorded."},"docs":"https://thequant.space/agents/"}