{"paper_id":"2511.22101","title":"Adaptive Dueling Double Deep Q-networks in Uniswap V3 Replication and Extension with Mamba","authors":["Zhaofeng Zhang"],"paper_date":"2025-11-27","paper_type":"empirical","paper_url":"https://arxiv.org/pdf/2511.22101v1","page_url":"https://thequant.space/flowcharts/adaptive-dueling-double-deep-q-networks-in-uniswap-v3-replic/","scores":{"empirical_rigor":8,"math_complexity":7.5,"quadrant":"Holy Grail"},"proposes":{"status":"available","statement":"The paper proposes a new extended structure named Mamba‑DDQN that combines the Mamba state‑space model with a dueling DDQN and a new reward function.","quote":"we propose a new structure based on the original model, which combines Mamba with DDQN and a new reward function.","summary":"The report goes through the main steps of replicating and improving the article “Adaptive Liquidity Provision in Uniswap V3 with Deep Reinforcement Learning.” The replication part includes how to obtain data from the Uniswap Subgraph, details of the implementation, and comments on the results.…","strategy":"Mamba-DDQN"},"assumptions":{"status":"available","items":[{"assumption":"A flat gas fee is assumed in the experiments.","type":"execution","stated":"explicit","quote":"there is an assumption about the ”flat” gas fee in the paper"},{"assumption":"The price process for the dynamic programming baseline is assumed to follow a geometric Brownian motion in continuous time.","type":"model","stated":"explicit","quote":"Based on the assumption of [3], the price should be a GBM in continuous time"},{"assumption":"Each time tick appears only once after data cleaning; rows with NaN values are removed.","type":"data","stated":"explicit","quote":"In the data cleaning, each time tick only contains once, and more raw data will be removed. The rows containing a NaN value were also removed."}]},"datasets":{"status":"available","items":[{"name":"ETH/USDC-0.3% pool","provider":"The Graph","kind":"crypto-onchain","access":"public","period":"2021/08/02 to 2023/01/25","universe":"ETH/USDC-0.3% pool","quote":"... will be collected and used. The dataset used for replication was collected from The Graph","known_id":"the-graph"},{"name":"ETH/USDT-0.3% pool","provider":"The Graph","kind":"crypto-onchain","access":"public","period":"2021/08/02 to 2023/01/25","universe":"ETH/USDT-0.3% pool","quote":"... will be collected and used. The dataset used for replication was collected from The Graph","known_id":"the-graph"}],"known":[],"sample":{"start":"2021-08","end":"2023-01","market":"ETH/USDC-0.3% and ETH/USDT-0.3% pools","asset_class":"crypto","frequency":"daily"},"data_resolution":"intraday-bars"},"transaction_costs":{"status":"available","modeled":"yes","headline_net_of_costs":null,"detail":"Trading fee is modeled as fee = { δ 1−δL(√p′ −√p) ... } and gas fee is a flat fee per reallocation (gas_t = self.gas_flat if action != 0 else 0).","quote":"Based on the rules of Uniswap V3, the trading fee can be represented in this way: fee = { δ 1−δL(√p′ −√p) ... }","source":"evidence_card","rule":"R2","candidates":{"front_matter":"unclear","evidence_card":"yes","evidence_card_quoted":true},"card_detail":"Trading fee is modeled as fee = { δ 1−δL(√p′ −√p) ... } and gas fee is a flat fee per reallocation (gas_t = self.gas_flat if action != 0 else 0).","card_quote":"Based on the rules of Uniswap V3, the trading fee can be represented in this way: fee = { δ 1−δL(√p′ −√p) ... }","meaning":"costs are part of the reported headline results"},"results":{"status":"available","evaluation_type":"trading-pnl","findings":[{"finding":"In replication, the M1 baseline achieved the highest PnL and LVR across all periods for both pools.","kind":"performance","quote":"Both the PnL of M1 perform best of all in all the periods and the LVR of M1 is always the highest in all the periods."},{"finding":"The extended M‑DDQN model outperforms the original Dueling‑DDQN without hedging in all sets and periods, and often beats the hedging version.","kind":"performance","quote":"M‑DDQN performs better than the Dueling‑DDQN without hedging in all the sets and periods, but only better than Dueling‑DDQN with hedging in a few of the sets and periods."},{"finding":"The new model shows stronger theoretical support than the original and performs better in some tests.","kind":"theoretical","quote":"it shows stronger theoretical support than the original model and performs better in some tests."}],"reported_performance":{"strategy":"Mamba-DDQN","sharpe":null,"sharpe_benchmark":null,"annual_return_pct":null,"total_return_pct":null,"max_drawdown_pct":null},"out_of_sample":{"method":"holdout","headline_out_of_sample":true}},"independent_evidence":{"status":"none_found","supports":[],"contradicts":[],"qualifies":[],"compared_with":16,"citations":{"cited_by_in_corpus":0,"by_independent_authors":0,"how_cited":{"used_as_baseline":0,"uses_method_or_data":0,"extends":0,"discusses_findings":0,"mentions":0,"unclassified":0},"independent_papers":[],"scope":"Citations between papers in this corpus only; citations from outside it are not counted."}},"implementation":{"status":"available","public":false,"code_url":null,"note":"No repository presented by the authors as their own was found in the paper. Absence here is not proof that no code exists."},"replication":{"status":"none_found","card":null,"note":"No replication of this paper has been run by thequant.space yet."},"extraction":{"text_source":"fulltext","model":"openai/gpt-oss-120b","version":1,"extracted_at":"2026-11-14T17:20:49Z"},"provenance":{"claims":"Everything here is what the authors state in the paper. Nothing was re-run or reproduced by the platform.","quotes":"Assumptions, datasets, cost detail and findings were extracted by a language model. Every quote is verbatim paper text. Where an item has `support`, \"full\" means every figure in it appears in the quoted sentences and \"partial\" means a figure is stated elsewhere in the paper; items with a figure found nowhere in the paper were discarded.","datasets_known":"datasets.known lists well-known vendors and public datasets by a stable id, found by a dictionary over the full text where the sentence says the data is used; it is independent of the model and covers only names in the dictionary.","flags":"transaction_costs.modeled, results.evaluation_type and results.out_of_sample.method are platform classifications (structured-decision models); see https://thequant.space/score-guide/#penalty-flags","comparisons":"supports / contradicts / qualifies are a language model's reading of two papers' quoted findings, restricted to closely related papers that share no author. They are pointers to read, not verified replications, and coverage is partial.","implementation":"code_url is a repository the paper itself presents as its own (rule-scored, ambiguous cases judged by a model), checked for liveness when it was recorded."},"docs":"https://thequant.space/agents/"}