{"paper_id":"2407.09557","title":"Deep Reinforcement Learning Strategies in Finance: Insights into Asset Holding, Trading Behavior, and Purchase Diversity","authors":["Alireza Mohammadshafie","Akram Mirzaeinia","Haseebullah Jumakhan","Amir Mirzaeinia"],"paper_date":"2024-06-29","paper_type":"methodological","paper_url":"https://arxiv.org/pdf/2407.09557v1","page_url":"https://thequant.space/flowcharts/deep-reinforcement-learning-strategies-in-finance-insights/","scores":{"empirical_rigor":7,"math_complexity":5,"quadrant":"Holy Grail"},"proposes":{"status":"available","statement":"The paper investigates the tendencies of deep reinforcement learning algorithms to hold or trade assets and their purchase diversity in finance.","quote":"This paper aims to investigate their tendencies towards holding or trading financial assets as well as purchase diversity.","summary":"Recent deep reinforcement learning (DRL) methods in finance show promising outcomes. However, there is limited research examining the behavior of these DRL algorithms. This paper aims to investigate their tendencies towards holding or trading financial assets as well as purchase diversity. By…","strategy":null},"assumptions":{"status":"available","items":[{"assumption":"The analysis uses hourly price data from Yahoo Finance without accounting for market impact or slippage.","type":"data","stated":"implied","quote":"The financial data used in this analysis was obtained from Yahoo Finance. The data covers hourly intervals"}]},"datasets":{"status":"available","items":[{"name":"Yahoo Finance","provider":"Yahoo","kind":"market-prices","access":"public","period":null,"universe":null,"quote":"The financial data used in this analysis was obtained from Yahoo Finance. The data covers hourly intervals","known_id":"yahoo-finance"}],"known":[{"id":"yahoo-finance","name":"Yahoo Finance","provider":"Yahoo","kind":"market-prices","access":"public","quote":"Data Source Yahoo finance is one of the top available financial data sources and a comprehensive financial platform that offers a wide range of tools, resources, and information for investors, traders, and financial professionals.","mentions":11,"used_in":4}],"sample":{"start":null,"end":null,"market":null,"asset_class":null,"frequency":null},"data_resolution":"daily"},"transaction_costs":{"status":"none_found","modeled":"unclear","headline_net_of_costs":null,"detail":null,"quote":null,"source":"none","rule":"R0b","candidates":{"front_matter":"unclear","evidence_card":"no","evidence_card_quoted":false},"meaning":"no cost treatment was found in the passages the extractor read; that is not evidence that costs are not modeled"},"results":{"status":"available","evaluation_type":"trading-pnl","findings":[{"finding":"A2C emerges as the top performer in terms of cumulative rewards among the DRL algorithms studied.","kind":"performance","quote":"Our findings reveal that each DRL algorithm exhibits unique trading patterns and strategies, with A2C emerging as the top performer in terms of cumulative rewards."},{"finding":"PPO and SAC engage in significant trades with a limited number of stocks.","kind":"performance","quote":"While PPO and SAC engage in significant trades with a limited number of stocks"},{"finding":"DDPG and TD3 adopt a more balanced approach, trading smaller amounts across a wider range of securities.","kind":"performance","quote":"DDPG and TD3 adopt a more balanced approach, trading smaller amounts across a wider range of securities."},{"finding":"SAC and PPO tend to hold positions for shorter durations, frequently buying and selling stocks.","kind":"performance","quote":"SAC and PPO tend to hold positions for shorter durations, frequently buying and selling stocks"},{"finding":"DDPG, A2C, and TD3 display a propensity to remain stationary for extended periods.","kind":"performance","quote":"D DPG, A2C, and TD3 display a propensity to remain stationary for extended periods"}],"reported_performance":null,"out_of_sample":{"method":"unclear","headline_out_of_sample":null}},"independent_evidence":{"status":"available","supports":[{"paper":{"paper_id":"2307.07694","title":"Evaluation of Deep Reinforcement Learning Algorithms for Portfolio Optimisation","paper_date":"2023-07-15","authors":["Chung I Lu"],"empirical_rigor":6,"page_url":"https://thequant.space/flowcharts/evaluation-of-deep-reinforcement-learning-algorithms-for-por/"},"question":"Which deep reinforcement learning algorithm achieves the highest cumulative reward for portfolio optimisation?","this_paper_finding":"A2C emerges as the top performer in terms of cumulative rewards among the DRL algorithms studied.","other_paper_finding":"On‑policy algorithms (PPO, A2C) with generalized advantage estimation can handle reward noise and learn a near‑optimal policy.","other_paper_quote":"The on-policy algorithms PPO and A2C, with the use of generalised advantage estimation, are able to deal with the noise and derive a close to optimal policy.","note":"Both findings highlight A2C as the top performer; A notes on‑policy methods (PPO, A2C) handle reward noise, B confirms A2C leads in cumulative rewards.","confidence":0.7}],"contradicts":[],"qualifies":[],"compared_with":37,"citations":{"cited_by_in_corpus":1,"by_independent_authors":1,"how_cited":{"used_as_baseline":0,"uses_method_or_data":0,"extends":0,"discusses_findings":0,"mentions":1,"unclassified":0},"independent_papers":[],"scope":"Citations between papers in this corpus only; citations from outside it are not counted."}},"implementation":{"status":"available","public":false,"code_url":null,"note":"No repository presented by the authors as their own was found in the paper. Absence here is not proof that no code exists."},"replication":{"status":"none_found","card":null,"note":"No replication of this paper has been run by thequant.space yet."},"extraction":{"text_source":"fulltext","model":"openai/gpt-oss-120b","version":1,"extracted_at":"2026-11-14T18:06:53Z"},"provenance":{"claims":"Everything here is what the authors state in the paper. Nothing was re-run or reproduced by the platform.","quotes":"Assumptions, datasets, cost detail and findings were extracted by a language model. Every quote is verbatim paper text. Where an item has `support`, \"full\" means every figure in it appears in the quoted sentences and \"partial\" means a figure is stated elsewhere in the paper; items with a figure found nowhere in the paper were discarded.","datasets_known":"datasets.known lists well-known vendors and public datasets by a stable id, found by a dictionary over the full text where the sentence says the data is used; it is independent of the model and covers only names in the dictionary.","flags":"transaction_costs.modeled, results.evaluation_type and results.out_of_sample.method are platform classifications (structured-decision models); see https://thequant.space/score-guide/#penalty-flags","comparisons":"supports / contradicts / qualifies are a language model's reading of two papers' quoted findings, restricted to closely related papers that share no author. They are pointers to read, not verified replications, and coverage is partial.","implementation":"code_url is a repository the paper itself presents as its own (rule-scored, ambiguous cases judged by a model), checked for liveness when it was recorded."},"docs":"https://thequant.space/agents/"}