{"paper_id":"2402.03338","title":"CNN-DRL with Shuffled Features in Finance","authors":["Sina Montazeri","Akram Mirzaeinia","Amir Mirzaeinia"],"paper_date":"2024-01-16","paper_type":"empirical","paper_url":"https://arxiv.org/pdf/2402.03338v1","page_url":"https://thequant.space/flowcharts/cnn-drl-with-shuffled-features-in-finance/","scores":{"empirical_rigor":6.5,"math_complexity":4,"quadrant":"Street Traders"},"proposes":{"status":"available","statement":"The paper proposes a CNN-based deep reinforcement learning agent that uses a shuffled feature vector to improve reward performance.","quote":"a specific permutation was applied to the feature vector, thereby generating a CNN matrix that strategically positions more pertinent features in close proximity.","summary":"In prior methods, it was observed that the application of Convolutional Neural Networks agent in Deep Reinforcement Learning to financial data resulted in an enhanced reward. In this study, a specific permutation was applied to the feature vector, thereby generating a CNN matrix that strategically…","strategy":null},"assumptions":{"status":"available","items":[{"assumption":"The turbulence exclusion period is not activated, and the agent trades during turbulent market periods.","type":"market","stated":"explicit","quote":"Machine learning models typically exclude the period of uncertainty in the stock market, often characterized by a turbulence factor, in order to stabilize their learning process. In contrast, we chose not to activate the turbulence exclusion and instead closely monitored and took action during this period as well as ot"},{"assumption":"Trading costs are represented by fixed percentage fees as defined in the FinRL framework.","type":"execution","stated":"explicit","quote":"We employ identical fixed cost percentages as those developed in the FinRL framework."},{"assumption":"The initial reward is set to one million dollars and later scaled down to one for learning stability.","type":"model","stated":"explicit","quote":"The environment employs an initial reward of one million dollars, in line with established research practices. This reward is later scaled down to one when it is returned from the environment to the agent, aiding in the learning process."}]},"datasets":{"status":"available","items":[{"name":"Dow Jones 30 price data","provider":"Yahoo Finance and Wharton dataset","kind":"market-prices","access":"public","period":"Jan 2015 - Sep 2023","universe":"30 Dow Jones companies","quote":"We obtained the stock prices of thirty companies listed in the Dow Jones index, spanning from January 2015 to September 2023. This timeframe encompasses the pandemic, a particularly challenging period in the field of finance. This data is sourced from both Yahoo Finance and the Wharton dataset [10].","known_id":"yahoo-finance"}],"known":[{"id":"yahoo-finance","name":"Yahoo Finance","provider":"Yahoo","kind":"market-prices","access":"public","quote":"This data is sourced from both Yahoo Finance and the Wharton dataset [10].","mentions":1,"used_in":1}],"sample":{"start":null,"end":null,"market":null,"asset_class":null,"frequency":null},"data_resolution":"daily"},"transaction_costs":{"status":"available","modeled":"partial","headline_net_of_costs":null,"detail":null,"quote":"We employ identical fixed cost percentages as those developed in the FinRL framework.","source":"evidence_card","rule":"R2","candidates":{"front_matter":"unclear","evidence_card":"partial","evidence_card_quoted":true},"card_detail":null,"card_quote":"We employ identical fixed cost percentages as those developed in the FinRL framework.","meaning":"costs appear only as a robustness check, a flat fee without spread or impact, or outside the headline numbers"},"results":{"status":"available","evaluation_type":"trading-pnl","findings":[{"finding":"The shuffled-feature CNN agent shows a clear improvement over the original CNN and decisively outperforms the MLP agent, especially from January 2020 to January 2023, outpacing the MLP by almost 100% during its peak around October 2023.","kind":"performance","quote":"By even a mere glance, the shuffled-featured CNN demonstrates a clear improvement over the original CNN and decisively outperforms the MLP agent. What is most interesting is that both CNN policies, particularly the shuffled-featured one performed vastly better from January 2020 to Jan 2023, outpacing the MLP by almost "},{"finding":"The proposed CNN architecture with shuffled features yields substantially higher cumulative rewards compared to conventional MLP models.","kind":"performance","quote":"This study showcases the capability of convolutional neural networks as a proficient deep reinforcement learning framework for stock trading in settings characterized by shuffled feature vectors. Through empirical assessments using historical market data and the FinRL platform, our specialized CNN agent in addition to "}],"reported_performance":null,"out_of_sample":{"method":"unclear","headline_out_of_sample":null}},"independent_evidence":{"status":"none_found","supports":[],"contradicts":[],"qualifies":[],"compared_with":8,"citations":{"cited_by_in_corpus":3,"by_independent_authors":0,"how_cited":{"used_as_baseline":0,"uses_method_or_data":0,"extends":0,"discusses_findings":0,"mentions":0,"unclassified":3},"independent_papers":[],"scope":"Citations between papers in this corpus only; citations from outside it are not counted."}},"implementation":{"status":"available","public":false,"code_url":null,"note":"No repository presented by the authors as their own was found in the paper. Absence here is not proof that no code exists."},"replication":{"status":"none_found","card":null,"note":"No replication of this paper has been run by thequant.space yet."},"extraction":{"text_source":"fulltext","model":"openai/gpt-oss-120b","version":1,"extracted_at":"2026-11-14T18:16:10Z"},"provenance":{"claims":"Everything here is what the authors state in the paper. Nothing was re-run or reproduced by the platform.","quotes":"Assumptions, datasets, cost detail and findings were extracted by a language model. Every quote is verbatim paper text. Where an item has `support`, \"full\" means every figure in it appears in the quoted sentences and \"partial\" means a figure is stated elsewhere in the paper; items with a figure found nowhere in the paper were discarded.","datasets_known":"datasets.known lists well-known vendors and public datasets by a stable id, found by a dictionary over the full text where the sentence says the data is used; it is independent of the model and covers only names in the dictionary.","flags":"transaction_costs.modeled, results.evaluation_type and results.out_of_sample.method are platform classifications (structured-decision models); see https://thequant.space/score-guide/#penalty-flags","comparisons":"supports / contradicts / qualifies are a language model's reading of two papers' quoted findings, restricted to closely related papers that share no author. They are pointers to read, not verified replications, and coverage is partial.","implementation":"code_url is a repository the paper itself presents as its own (rule-scored, ambiguous cases judged by a model), checked for liveness when it was recorded."},"docs":"https://thequant.space/agents/"}