{"paper_id":"2508.20103","title":"Deep Reinforcement Learning for Optimal Asset Allocation Using DDPG with TiDE","authors":["Rongwei Liu","Jin Zheng","John Cartlidge"],"paper_date":"2025-08-12","paper_type":"empirical","paper_url":"https://arxiv.org/pdf/2508.20103v1","page_url":"https://thequant.space/flowcharts/deep-reinforcement-learning-for-optimal-asset-allocation-usi/","scores":{"empirical_rigor":3,"math_complexity":7.5,"quadrant":"Lab Rats"},"proposes":{"status":"available","statement":"The paper proposes integrating the Time-series Dense Encoder (TiDE) into a Deep Deterministic Policy Gradient (DDPG) reinforcement learning framework for optimal two‑asset allocation.","quote":"into the Deep Deterministic Policy Gradient (DDPG) [14] mechanism to enhance the handling of temporal relationships in multivariate time series within the state space.","summary":"The optimal asset allocation between risky and risk-free assets is a persistent challenge due to the inherent volatility in financial markets. Conventional methods rely on strict distributional assumptions or non-additive reward ratios, which limit their robustness and applicability to investment…","strategy":"DDPG with TiDE (continuous-action) asset allocation"},"assumptions":{"status":"available","items":[{"assumption":"The market portfolio (CRSP index) is observable and broadly representative of the investable universe.","type":"market","stated":"explicit","quote":"This study seeks to fill the above research gaps by examining portfolio allocation between a market index—the CRSP index, serving as a representative proxy for the aggregate U.S. equity market—and a risk-free asset."},{"assumption":"Investor utility follows a constant relative risk aversion (CRRA) utility function consistent with the Kelly criterion.","type":"model","stated":"explicit","quote":"To ensure theoretical rigor, the study adopts the Kelly criterion through the use of the constant relative risk aversion (CRRA) utility function and the accumulated reward, providing mathematical consistency between log-utility maximization and long-term capital growth."},{"assumption":"The reinforcement learning problem is formulated as a Markov Decision Process (MDP).","type":"model","stated":"explicit","quote":"the optimal two-asset allocation problem as a sequential decision-making task within a Markov Decision Process (MDP)."},{"assumption":"Trading occurs without explicit transaction costs or market impact in the reported results.","type":"execution","stated":"explicit","quote":"We have deliberately used a simplistic simulation framework."},{"assumption":"Leverage can be applied up to 50% (w > 1) to allow borrowing for investment.","type":"execution","stated":"explicit","quote":"We also introduce the opportunity for Q-learning and DDPG-TiDE strategies to use leverage (i.e., to select values w > 1) to see if they can learn strategies that profit from borrowing to invest."}]},"datasets":{"status":"available","items":[{"name":"Monthly market return and risk‑free rate series with macro predictors","provider":"Fama/French website","kind":"macro","access":"public","period":"1927-2019","universe":"CRSP market index and risk‑free asset","quote":"We used a dataset consisting of monthly time series on the market return rate rt (Mkt) and risk‑free asset return rate r f (RF) from 1927 to 2019."}],"known":[],"sample":{"start":"1989","end":"2019","market":"market index","asset_class":"equities","frequency":"monthly"},"data_resolution":"weekly-monthly"},"transaction_costs":{"status":"available","modeled":"no","headline_net_of_costs":false,"detail":null,"quote":"We have deliberately used a simplistic simulation framework.","source":"front_matter","rule":"R3","candidates":{"front_matter":"no","evidence_card":"no","evidence_card_quoted":true},"card_detail":null,"card_quote":"We have deliberately used a simplistic simulation framework.","meaning":"a trading or execution result is reported without costs"},"results":{"status":"available","evaluation_type":"trading-pnl","findings":[{"finding":"DDPG‑TiDE without leverage achieves a final portfolio value of 14.85, slightly below buy‑and‑hold (17.77), while with 50% leverage it reaches 21.06, slightly above buy‑and‑hold.","kind":"performance","quote":"The final portfolio value for DDPG‑TiDE without leverage (14.85) is slightly below buy‑and‑hold, and the final portfolio value for DDPG‑TiDE with 50% leverage available (21.06) is slightly above buy‑and‑hold."},{"finding":"DDPG‑TiDE attains an average Sharpe ratio of 1.13 (no leverage) and 0.99 (with leverage), both modestly higher than the buy‑and‑hold average Sharpe ratio of 0.95.","kind":"performance","quote":"... average Sharpe ratio of 1.13 when no leverage is available, and average Sharpe ratio of 0.99 when leverage is available. Both of these values are slightly higher than the average Sharpe ratio for buy‑and‑hold (0.95)."},{"finding":"DDPG‑TiDE outperforms the discrete‑action Q‑learning strategy on all evaluated metrics, including portfolio value and risk‑adjusted returns.","kind":"performance","quote":"We showed that a continuous‑action DDPG‑TiDE strategy outperforms a simple discrete‑action Q‑learning strategy in all metrics; it is also able to generate more profits than buy‑and‑hold by applying leverage during bull periods; and it generates the highest average Sharpe ratio."}],"reported_performance":{"strategy":"DDPG with TiDE (continuous-action) asset allocation","sharpe":1.13,"sharpe_benchmark":0.95,"annual_return_pct":null,"total_return_pct":null,"max_drawdown_pct":null},"out_of_sample":{"method":"holdout","headline_out_of_sample":true}},"independent_evidence":{"status":"none_found","supports":[],"contradicts":[],"qualifies":[],"compared_with":15,"citations":{"cited_by_in_corpus":1,"by_independent_authors":1,"how_cited":{"used_as_baseline":0,"uses_method_or_data":0,"extends":0,"discusses_findings":0,"mentions":1,"unclassified":0},"independent_papers":[],"scope":"Citations between papers in this corpus only; citations from outside it are not counted."}},"implementation":{"status":"available","public":false,"code_url":null,"note":"No repository presented by the authors as their own was found in the paper. Absence here is not proof that no code exists."},"replication":{"status":"none_found","card":null,"note":"No replication of this paper has been run by thequant.space yet."},"extraction":{"text_source":"fulltext","model":"openai/gpt-oss-120b","version":1,"extracted_at":"2026-11-14T17:30:10Z"},"provenance":{"claims":"Everything here is what the authors state in the paper. Nothing was re-run or reproduced by the platform.","quotes":"Assumptions, datasets, cost detail and findings were extracted by a language model. Every quote is verbatim paper text. Where an item has `support`, \"full\" means every figure in it appears in the quoted sentences and \"partial\" means a figure is stated elsewhere in the paper; items with a figure found nowhere in the paper were discarded.","datasets_known":"datasets.known lists well-known vendors and public datasets by a stable id, found by a dictionary over the full text where the sentence says the data is used; it is independent of the model and covers only names in the dictionary.","flags":"transaction_costs.modeled, results.evaluation_type and results.out_of_sample.method are platform classifications (structured-decision models); see https://thequant.space/score-guide/#penalty-flags","comparisons":"supports / contradicts / qualifies are a language model's reading of two papers' quoted findings, restricted to closely related papers that share no author. They are pointers to read, not verified replications, and coverage is partial.","implementation":"code_url is a repository the paper itself presents as its own (rule-scored, ambiguous cases judged by a model), checked for liveness when it was recorded."},"docs":"https://thequant.space/agents/"}