{"paper_id":"2512.12420","title":"Deep Hedging with Reinforcement Learning: A Practical Framework for Option Risk Management","authors":["Travon Lucius","Christian Koch","Jacob Starling","Julia Zhu","Miguel Urena","Carrie Hu"],"paper_date":"2025-12-13","paper_type":"perspective-policy","paper_url":"https://arxiv.org/pdf/2512.12420v1","page_url":"https://thequant.space/flowcharts/deep-hedging-with-reinforcement-learning-a-practical-framew/","scores":{"empirical_rigor":8.5,"math_complexity":7,"quadrant":"Holy Grail"},"proposes":{"status":"available","statement":"The paper proposes a reinforcement‑learning framework for dynamic hedging of equity index option exposures with realistic transaction costs and position limits.","quote":"We present a reinforcement-learning (RL) framework for dynamic hedging of equity index option exposures under realistic transaction costs and position limits.","summary":"We present a reinforcement-learning (RL) framework for dynamic hedging of equity index option exposures under realistic transaction costs and position limits. We hedge a normalized option-implied equity exposure (one unit of underlying delta, offset via SPY) by trading the underlying index ETF…","strategy":"GAE deep hedging policy"},"assumptions":{"status":"available","items":[{"assumption":"Trading occurs on daily end‑of‑day bars, ignoring intraday inventory and execution costs.","type":"execution","stated":"implied","quote":"The present study operates on daily bars, which ignore intraday inventory management and execution costs"},{"assumption":"Option Greeks are not used as state features; only surface‑level implied volatility, term structure and skew are used.","type":"model","stated":"implied","quote":"For simplicity, we do not feed option Greeks directly into the state because of their sensitivity to intra‑day moves and model assumptions; instead we use more stable surface‑level features such as implied volatility levels, term structure, and skew."},{"assumption":"Transaction costs consist of a fixed 10 bps per unit of |Δposition| plus proportional slippage of 8 bps.","type":"execution","stated":"explicit","quote":"with transaction costs of 10 bps per unit of |∆position|, proportional slippage of 8 bps"},{"assumption":"The market data span the 2005–2023 window for SPX/SPY implied volatility, realized volatility and rates.","type":"market","stated":"implied","quote":"The figure below illustrates the macro/volatility regimes that motivate this work, highlighting how VIX, realized volatility, and rates evolve across the 2005–2023 window."}]},"datasets":{"status":"available","items":[{"name":"SPX/SPY panel data","provider":null,"kind":"options","access":"unknown","period":"2005–2023","universe":"SPX and SPY","quote":"daily end-of-day panel data constructed from SPX/SPY implied volatility term structure, skew, realized volatility, and macro rate context"}],"known":[],"sample":{"start":null,"end":null,"market":"S&P 500 index / SPY","asset_class":"options","frequency":"daily"},"data_resolution":"daily"},"transaction_costs":{"status":"available","modeled":"yes","headline_net_of_costs":true,"detail":"10 bps per unit of |Δposition| plus 8 bps proportional slippage, with a position limit of 2.0 and rebalance cadence of every 25 steps","quote":"with transaction costs of 10 bps per unit of |∆position|, proportional slippage of 8 bps, a position limit of pos_limit = 2.0, and rebalance cadence rebalance_every = 25","source":"front_matter","rule":"R3","candidates":{"front_matter":"yes","evidence_card":"yes","evidence_card_quoted":true},"card_detail":"10 bps per unit of |Δposition| plus 8 bps proportional slippage, with a position limit of 2.0 and rebalance cadence of every 25 steps","card_quote":"with transaction costs of 10 bps per unit of |∆position|, proportional slippage of 8 bps, a position limit of pos_limit = 2.0, and rebalance cadence rebalance_every = 25","meaning":"costs are part of the reported headline results"},"results":{"status":"available","evaluation_type":"trading-pnl","findings":[{"finding":"The GAE policy achieves deterministic Sharpe ratios of 0.48 (train), 0.77 (validation) and 0.50 (test) under the specified cost and cadence settings.","kind":"performance","quote":"deterministic evaluation yields Train Sharpe 0.48, Validation 0.77, and Test 0.50"},{"finding":"Turnover stays below one full notional rotation per day on average, indicating low churn.","kind":"performance","quote":"Turnover stays below one full notional rotation per day on average"},{"finding":"Maximum drawdown on the test split for the standalone overlay‑equity series remains inside -3%, lower than unhedged or simple volatility‑targeting approaches.","kind":"performance","quote":"Maximum drawdown on the test split for the standalone overlay-equity series remains inside -3%, materially lower than an unhedged or simple volatility targeting approach"},{"finding":"Only the GAE overlay’s test‑sample Sharpe is statistically distinguishable from zero, though confidence intervals overlap with a long‑SPY benchmark.","kind":"statistical","quote":"only the GAE overlay’s test Sharpe is statistically distinguishable from zero, but confidence bands versus the long‑SPY benchmark remain wide enough"},{"finding":"Robustness checks show modest seed‑to‑seed variance (base test Sharpe average 0.45 ± 0.13, shifted test Sharpe 0.52 ± 0.05) and similar drawdowns when shifting the training window forward.","kind":"performance","quote":"remains modest: base test Sharpe averages 0.45 (std 0.13) and shifted test Sharpe 0.52 (std 0.05). Mean portfolio-level max drawdowns for the 50/50 blend cluster around −20% (base/test) and −16% (shifted/test)"}],"reported_performance":{"strategy":"GAE deep hedging policy","sharpe":0.502,"sharpe_benchmark":null,"annual_return_pct":null,"total_return_pct":null,"max_drawdown_pct":3},"out_of_sample":{"method":"holdout","headline_out_of_sample":true}},"independent_evidence":{"status":"none_found","supports":[],"contradicts":[],"qualifies":[],"compared_with":23,"citations":{"cited_by_in_corpus":0,"by_independent_authors":0,"how_cited":{"used_as_baseline":0,"uses_method_or_data":0,"extends":0,"discusses_findings":0,"mentions":0,"unclassified":0},"independent_papers":[],"scope":"Citations between papers in this corpus only; citations from outside it are not counted."}},"implementation":{"status":"available","public":true,"code_url":"https://github.com/tlucius16/deep-hedging-rl","note":null},"replication":{"status":"none_found","card":null,"note":"No replication of this paper has been run by thequant.space yet."},"extraction":{"text_source":"fulltext","model":"openai/gpt-oss-120b","version":1,"extracted_at":"2026-11-14T17:19:10Z"},"provenance":{"claims":"Everything here is what the authors state in the paper. Nothing was re-run or reproduced by the platform.","quotes":"Assumptions, datasets, cost detail and findings were extracted by a language model. Every quote is verbatim paper text. Where an item has `support`, \"full\" means every figure in it appears in the quoted sentences and \"partial\" means a figure is stated elsewhere in the paper; items with a figure found nowhere in the paper were discarded.","datasets_known":"datasets.known lists well-known vendors and public datasets by a stable id, found by a dictionary over the full text where the sentence says the data is used; it is independent of the model and covers only names in the dictionary.","flags":"transaction_costs.modeled, results.evaluation_type and results.out_of_sample.method are platform classifications (structured-decision models); see https://thequant.space/score-guide/#penalty-flags","comparisons":"supports / contradicts / qualifies are a language model's reading of two papers' quoted findings, restricted to closely related papers that share no author. They are pointers to read, not verified replications, and coverage is partial.","implementation":"code_url is a repository the paper itself presents as its own (rule-scored, ambiguous cases judged by a model), checked for liveness when it was recorded."},"docs":"https://thequant.space/agents/"}