{"paper_id":"2309.00630","title":"Commodities Trading through Deep Policy Gradient Methods","authors":["Jonas Hanetho"],"paper_date":"2023-08-10","paper_type":"perspective-policy","paper_url":"https://arxiv.org/pdf/2309.00630v1","page_url":"https://thequant.space/flowcharts/commodities-trading-through-deep-policy-gradient-methods/","scores":{"empirical_rigor":6,"math_complexity":7.5,"quadrant":"Holy Grail"},"proposes":{"status":"available","statement":"The paper proposes a deep reinforcement learning framework for commodities trading that includes a novel time‑discretization scheme adaptive to market volatility and two policy‑gradient algorithms (actor‑based and actor‑critic‑based) using CNN and LSTM networks.","quote":"It formulates the commodities trading problem as a continuous, discrete-time stochastic dynamical system. The proposed system employs a novel time-discretization scheme that adapts to market volatility, enhancing the statistical properties of subsampled financial time series.","summary":"Algorithmic trading has gained attention due to its potential for generating superior returns. This paper investigates the effectiveness of deep reinforcement learning (DRL) methods in algorithmic commodities trading. It formulates the commodities trading problem as a continuous, discrete-time…","strategy":null},"assumptions":{"status":"available","items":[{"assumption":"No slippage; all trades can be executed at the exact quoted price.","type":"execution","stated":"explicit","quote":"1. No slippage; all trades can be executed at the exact quoted price."},{"assumption":"No market impact; the capital invested by the agent is not significant enough to move the market.","type":"market","stated":"explicit","quote":"2. No market impact; the capital invested by the agent is not significant enough to move the market."}]},"datasets":{"status":"available","items":[{"name":"Front‑month TTF Natural Gas Futures","provider":null,"kind":"market-prices","access":"unknown","period":"2011‑2022","universe":"front‑month contracts of the TTF Natural Gas Futures","quote":"The dataset comprises trades of the front‑month contracts of the TTF Natural Gas Futures, which represent the most liquid market, spanning from 2011 to 2022."}],"known":[],"sample":{"start":null,"end":null,"market":null,"asset_class":null,"frequency":null},"data_resolution":"tick"},"transaction_costs":{"status":"available","modeled":"yes","headline_net_of_costs":null,"detail":"A transaction‑cost fraction λc (identical for buying and selling) is subtracted from gross returns; λc is treated as a constant cost parameter.","quote":"where λη ∈[0, 1] is the transaction cost fraction that is assumed to be identical for buying and selling.","source":"evidence_card","rule":"R2","candidates":{"front_matter":"unclear","evidence_card":"yes","evidence_card_quoted":true},"card_detail":"A transaction‑cost fraction λc (identical for buying and selling) is subtracted from gross returns; λc is treated as a constant cost parameter.","card_quote":"where λη ∈[0, 1] is the transaction cost fraction that is assumed to be identical for buying and selling.","meaning":"costs are part of the reported headline results"},"results":{"status":"available","evaluation_type":"trading-pnl","findings":[{"finding":"The deep RL models achieve an average out‑of‑sample Sharpe ratio that is 83% higher than the buy‑and‑hold baseline.","kind":"performance","quote":"Averaged across all deep RL models and risk‑sensitivity terms, they yield a Sharpe ratio that is 83% higher than the baseline."},{"finding":"Actor‑based policy‑gradient algorithms outperform actor‑critic algorithms in 7 out of 8 model‑risk‑sensitivity combinations.","kind":"performance","quote":"Comparing two algorithms employing the same network architecture and risk sensitivity term reveals that the actor‑based algorithm outperforms the actor‑critic‑based algorithm in 7 out of 8 combinations."},{"finding":"CNN‑based models show a slight performance advantage over LSTM‑based models.","kind":"performance","quote":"The actor‑based models outperform the actor‑critic‑based models, while the CNN‑based models show a slight performance advantage over the LSTM‑based models."}],"reported_performance":null,"out_of_sample":{"method":"unclear","headline_out_of_sample":null}},"independent_evidence":{"status":"none_found","supports":[],"contradicts":[],"qualifies":[],"compared_with":27,"citations":{"cited_by_in_corpus":0,"by_independent_authors":0,"how_cited":{"used_as_baseline":0,"uses_method_or_data":0,"extends":0,"discusses_findings":0,"mentions":0,"unclassified":0},"independent_papers":[],"scope":"Citations between papers in this corpus only; citations from outside it are not counted."}},"implementation":{"status":"available","public":false,"code_url":null,"note":"No repository presented by the authors as their own was found in the paper. Absence here is not proof that no code exists."},"replication":{"status":"none_found","card":null,"note":"No replication of this paper has been run by thequant.space yet."},"extraction":{"text_source":"fulltext","model":"openai/gpt-oss-120b","version":1,"extracted_at":"2026-11-14T18:23:31Z"},"provenance":{"claims":"Everything here is what the authors state in the paper. Nothing was re-run or reproduced by the platform.","quotes":"Assumptions, datasets, cost detail and findings were extracted by a language model. Every quote is verbatim paper text. Where an item has `support`, \"full\" means every figure in it appears in the quoted sentences and \"partial\" means a figure is stated elsewhere in the paper; items with a figure found nowhere in the paper were discarded.","datasets_known":"datasets.known lists well-known vendors and public datasets by a stable id, found by a dictionary over the full text where the sentence says the data is used; it is independent of the model and covers only names in the dictionary.","flags":"transaction_costs.modeled, results.evaluation_type and results.out_of_sample.method are platform classifications (structured-decision models); see https://thequant.space/score-guide/#penalty-flags","comparisons":"supports / contradicts / qualifies are a language model's reading of two papers' quoted findings, restricted to closely related papers that share no author. They are pointers to read, not verified replications, and coverage is partial.","implementation":"code_url is a repository the paper itself presents as its own (rule-scored, ambiguous cases judged by a model), checked for liveness when it was recorded."},"docs":"https://thequant.space/agents/"}