{"paper_id":"2409.08426","title":"A Deep Reinforcement Learning Framework For Financial Portfolio Management","authors":["Jinyang Li"],"paper_date":"2024-09-03","paper_type":"empirical","paper_url":"https://arxiv.org/pdf/2409.08426v1","page_url":"https://thequant.space/flowcharts/a-deep-reinforcement-learning-framework-for-financial-portfo/","scores":{"empirical_rigor":8,"math_complexity":7.5,"quadrant":"Holy Grail"},"proposes":{"status":"available","statement":"The paper proposes a financial‑model‑free reinforcement learning framework comprising an Ensemble of Identical Independent Evaluators (EIIE) topology, a Portfolio‑Vector Memory (PVM), an Online Stochastic Batch Learning (OSBL) scheme, and an explicit reward function.","quote":"The original paper proposes a financial-model-free reinforcement learning framework, which consists of the Ensemble of Identical Independent Evaluators (EIIE) topology, a Portfolio-Vector Memory (PVM), an Online Stochastic Batch Learning (OSBL) scheme, and a fully exploiting and explicit reward function.","summary":"In this research paper, we investigate into a paper named “A Deep Reinforcement Learning Framework for the Financial Portfolio Management Problem” [“arXiv:1706.10059”]. It is a portfolio management problem which is solved by deep learning techniques. The original paper proposes a…","strategy":"EIIE deep reinforcement learning framework"},"assumptions":{"status":"available","items":[{"assumption":"Zero slippage: market volume is high enough that each order can be filled at the market price.","type":"execution","stated":"explicit","quote":"Zero slippage: we assume that the volume of the market is high enough that each order can be filled with the market price at placement."},{"assumption":"Zero money impact: the portfolio capital is small enough to have no influence on the market.","type":"execution","stated":"explicit","quote":"Zero money impact: the capital of the portfolio is small enough that it has no influence on the market."}]},"datasets":{"status":"available","items":[{"name":"cryptocurrency market dataset","provider":null,"kind":"crypto-onchain","access":"unknown","period":null,"universe":null,"quote":"The original paper tests its validity and profitability in the cryptocurrency exchange market."},{"name":"stock market dataset","provider":null,"kind":"market-prices","access":"unknown","period":null,"universe":null,"quote":"we further evaluate this framework in the stock market."}],"known":[],"sample":{"start":"2015-07","end":"2017-07","market":"cryptocurrency market","asset_class":"crypto","frequency":"daily"},"data_resolution":"unclear"},"transaction_costs":{"status":"available","modeled":"yes","headline_net_of_costs":null,"detail":"Costs are assumed to come from a constant commission rate; transaction remainder factor µt is derived from commission rates for buying and selling.","quote":"In our framework, we assume that the costs mainly come from commission fee and we assume a constant commission rate using the recursive formula by Ormos and Urbán (2013).","source":"evidence_card","rule":"R2","candidates":{"front_matter":"unclear","evidence_card":"yes","evidence_card_quoted":true},"card_detail":"Costs are assumed to come from a constant commission rate; transaction remainder factor µt is derived from commission rates for buying and selling.","card_quote":"In our framework, we assume that the costs mainly come from commission fee and we assume a constant commission rate using the recursive formula by Ormos and Urbán (2013).","meaning":"costs are part of the reported headline results"},"results":{"status":"available","evaluation_type":"trading-pnl","findings":[{"finding":"The three EIIE models (CNN, RNN, LSTM) significantly beat all other portfolio‑selection strategies in the cryptocurrency market.","kind":"performance","quote":"The EIIEs significantly beat all the other strategies when it is in the cryptocurrency market, but the performance is average in stock market."},{"finding":"In the stock market the framework’s performance is only average, comparable to a Uniform Constant Rebalanced Portfolio.","kind":"performance","quote":"Surprisingly, when it comes to the stock market, the magic of this framework disappeared and fell back to be equivalent to the Uniformly Constant Rebalanced Portfolios algorithm or the equally weighted strategy."},{"finding":"Among the three EIIE networks, LSTM obtains lower scores than CNN and RNN.","kind":"performance","quote":"Among the three EIIE networks, LSTM has lower scores than that of CNN and RNN."},{"finding":"A vanilla RNN outperforms LSTM in exploiting repetitive price patterns, likely due to its inability to forget history.","kind":"performance","quote":"Not being designed to forget its input history, a vanilla RNN is more able than a LSTM to exploit"}],"reported_performance":{"strategy":"EIIE deep reinforcement learning framework","sharpe":null,"sharpe_benchmark":null,"annual_return_pct":null,"total_return_pct":793.8229,"max_drawdown_pct":null},"out_of_sample":{"method":"holdout","headline_out_of_sample":true}},"independent_evidence":{"status":"available","supports":[],"contradicts":[],"qualifies":[],"compared_with":15,"citations":{"cited_by_in_corpus":1,"by_independent_authors":1,"how_cited":{"used_as_baseline":0,"uses_method_or_data":0,"extends":0,"discusses_findings":1,"mentions":0,"unclassified":0},"independent_papers":[{"paper":{"paper_id":"2508.03910","title":"Comparing Normalization Methods for Portfolio Optimization with Reinforcement Learning","paper_date":"2025-08-05","authors":["Caio de Souza Barbosa Costa","Anna Helena Reali Costa"],"empirical_rigor":6,"page_url":"https://thequant.space/flowcharts/comparing-normalization-methods-for-portfolio-optimization-w/"},"how":"discusses_findings","quote":"However, recent studies point that the framework is not as reliable as it appears in stock markets: its performance is considerably worse in comparison to the cryptocurrency market [CITED]."}],"scope":"Citations between papers in this corpus only; citations from outside it are not counted."}},"implementation":{"status":"available","public":false,"code_url":null,"note":"No repository presented by the authors as their own was found in the paper. Absence here is not proof that no code exists."},"replication":{"status":"none_found","card":null,"note":"No replication of this paper has been run by thequant.space yet."},"extraction":{"text_source":"fulltext","model":"openai/gpt-oss-120b","version":1,"extracted_at":"2026-11-14T18:02:59Z"},"provenance":{"claims":"Everything here is what the authors state in the paper. Nothing was re-run or reproduced by the platform.","quotes":"Assumptions, datasets, cost detail and findings were extracted by a language model. Every quote is verbatim paper text. Where an item has `support`, \"full\" means every figure in it appears in the quoted sentences and \"partial\" means a figure is stated elsewhere in the paper; items with a figure found nowhere in the paper were discarded.","datasets_known":"datasets.known lists well-known vendors and public datasets by a stable id, found by a dictionary over the full text where the sentence says the data is used; it is independent of the model and covers only names in the dictionary.","flags":"transaction_costs.modeled, results.evaluation_type and results.out_of_sample.method are platform classifications (structured-decision models); see https://thequant.space/score-guide/#penalty-flags","comparisons":"supports / contradicts / qualifies are a language model's reading of two papers' quoted findings, restricted to closely related papers that share no author. They are pointers to read, not verified replications, and coverage is partial.","implementation":"code_url is a repository the paper itself presents as its own (rule-scored, ambiguous cases judged by a model), checked for liveness when it was recorded."},"docs":"https://thequant.space/agents/"}