{"paper_id":"2309.00626","title":"An Ensemble Method of Deep Reinforcement Learning for Automated Cryptocurrency Trading","authors":["Shuyang Wang","Diego Klabjan"],"paper_date":"2023-07-27","paper_type":"empirical","paper_url":"https://arxiv.org/pdf/2309.00626v1","page_url":"https://thequant.space/flowcharts/an-ensemble-method-of-deep-reinforcement-learning-for-automa/","scores":{"empirical_rigor":6,"math_complexity":8.5,"quadrant":"Holy Grail"},"proposes":{"status":"available","statement":"The paper proposes an ensemble method with a novel mixture distribution policy to combine multiple deep reinforcement learning models for cryptocurrency portfolio trading.","quote":"We propose a novel mixture distribution policy for DRL trading strategies to effectively ensemble the best performance models on multiple validation periods, and achieve high returns on out-of-sample data.","summary":"We propose an ensemble method to improve the generalization performance of trading strategies trained by deep reinforcement learning algorithms in a highly stochastic environment of intraday cryptocurrency portfolio trading. We adopt a model selection method that evaluates on multiple validation…","strategy":null},"assumptions":{"status":"available","items":[{"assumption":"The market is liquid enough with negligible bid‑ask spread.","type":"market","stated":"explicit","quote":"We assume that the market is liquid enough with negligible bid ask spread."}]},"datasets":{"status":"available","items":[{"name":"4‑year cryptocurrency price data","provider":null,"kind":"market-prices","access":"unknown","period":"07/01/2018 to 06/30/2022","universe":"five cryptocurrencies","quote":"We use the 4-year data from 07/01/2018 t0 06/30/2022 for back‑testing. ... The"}],"known":[{"id":"kraken","name":"Kraken","provider":"Kraken","kind":"market-prices","access":"public","quote":"5 COMPUTATIONAL EXPERIMENTS 5.1 Data Processing We use historical hourly OHLCV data from the online cryptocur-rency exchange Kraken for the period from 01/01/2018 to 06/30/2022.","mentions":1,"used_in":1}],"sample":{"start":null,"end":null,"market":null,"asset_class":null,"frequency":null},"data_resolution":"intraday-bars"},"transaction_costs":{"status":"available","modeled":"no","headline_net_of_costs":null,"detail":null,"quote":null,"source":"front_matter","rule":"R1","candidates":{"front_matter":"no","evidence_card":"no","evidence_card_quoted":false},"meaning":"a trading or execution result is reported without costs"},"results":{"status":"available","evaluation_type":"trading-pnl","findings":[{"finding":"The ensemble policy achieves an annualized return of 0.9319, 47% higher than the FinRL benchmark (0.6320) and 23% higher than buy‑and‑hold (0.7571).","kind":"performance","quote":"The ensemble policy method outperforms the FinRL model in the annualized return by 47% and the buy and hold strategy by 23%."},{"finding":"The ensemble method improves the Sortino ratio by 18% over FinRL (1.6218 vs 1.3762) and by 29% over buy‑and‑hold (1.6218 vs 1.2560).","kind":"performance","quote":"our ensemble method still outperforms FinRL in the Sortino ratio by 18% and the buy and hold strategy by 29%."},{"finding":"The ensemble method attains a cumulative return of 7.9361 over the 4‑year test period, compared with 4.8851 for FinRL and 2.6088 for buy‑and‑hold.","kind":"performance","quote":"Cumulative return 7.9361 4.8851 2.6088"}],"reported_performance":null,"out_of_sample":{"method":"walk-forward","headline_out_of_sample":null}},"independent_evidence":{"status":"none_found","supports":[],"contradicts":[],"qualifies":[],"compared_with":12,"citations":{"cited_by_in_corpus":0,"by_independent_authors":0,"how_cited":{"used_as_baseline":0,"uses_method_or_data":0,"extends":0,"discusses_findings":0,"mentions":0,"unclassified":0},"independent_papers":[],"scope":"Citations between papers in this corpus only; citations from outside it are not counted."}},"implementation":{"status":"available","public":false,"code_url":null,"note":"No repository presented by the authors as their own was found in the paper. Absence here is not proof that no code exists."},"replication":{"status":"none_found","card":null,"note":"No replication of this paper has been run by thequant.space yet."},"extraction":{"text_source":"fulltext","model":"openai/gpt-oss-120b","version":1,"extracted_at":"2026-11-14T18:24:00Z"},"provenance":{"claims":"Everything here is what the authors state in the paper. Nothing was re-run or reproduced by the platform.","quotes":"Assumptions, datasets, cost detail and findings were extracted by a language model. Every quote is verbatim paper text. Where an item has `support`, \"full\" means every figure in it appears in the quoted sentences and \"partial\" means a figure is stated elsewhere in the paper; items with a figure found nowhere in the paper were discarded.","datasets_known":"datasets.known lists well-known vendors and public datasets by a stable id, found by a dictionary over the full text where the sentence says the data is used; it is independent of the model and covers only names in the dictionary.","flags":"transaction_costs.modeled, results.evaluation_type and results.out_of_sample.method are platform classifications (structured-decision models); see https://thequant.space/score-guide/#penalty-flags","comparisons":"supports / contradicts / qualifies are a language model's reading of two papers' quoted findings, restricted to closely related papers that share no author. They are pointers to read, not verified replications, and coverage is partial.","implementation":"code_url is a repository the paper itself presents as its own (rule-scored, ambiguous cases judged by a model), checked for liveness when it was recorded."},"docs":"https://thequant.space/agents/"}