{"paper_id":"2508.16589","title":"ARL-Based Multi-Action Market Making with Hawkes Processes and Variable Volatility","authors":["Ziyi Wang","Carmine Ventre","Maria Polukarov"],"paper_date":"2025-08-07","paper_type":"empirical","paper_url":"https://arxiv.org/pdf/2508.16589v1","page_url":"https://thequant.space/flowcharts/arl-based-multi-action-market-making-with-hawkes-processes-a/","scores":{"empirical_rigor":6,"math_complexity":7.5,"quadrant":"Holy Grail"},"proposes":{"status":"available","statement":"The paper proposes a market‑making strategy that combines Adversarial Reinforcement Learning, Hawkes process modeling, variable volatility levels, and an expanded multi‑action space.","quote":"We advance market-making strategies by integrating Adversarial Reinforcement Learning (ARL), Hawkes Processes, and variable volatility levels while also expanding the action space available to market makers (MMs).","summary":"We advance market-making strategies by integrating Adversarial Reinforcement Learning (ARL), Hawkes Processes, and variable volatility levels while also expanding the action space available to market makers (MMs). To enhance the adaptability and robustness of these strategies – which can quote…","strategy":null},"assumptions":{"status":"available","items":[{"assumption":"Execution dynamics are modeled with a Hawkes process instead of a Poisson process.","type":"model","stated":"explicit","quote":"we transition from using a Poisson process to a Hawkes process for modeling execution dynamics."},{"assumption":"Two volatility regimes are considered: low (vol=2) and high (vol=200).","type":"market","stated":"explicit","quote":"we investigate the effects of volatility on market maker strategies by employing two distinct volatility levels: low and high."},{"assumption":"The adversary can be fixed, random, or strategic, with parameters drawn from predefined ranges.","type":"model","stated":"explicit","quote":"Strategic Adversary. In this setup, the adversary adjusts the market parameters 𝑏𝑛, 𝐴±𝑛, and 𝑘±𝑛 to maximize its own reward."},{"assumption":"Market makers may choose among four actions: two‑sided quote, bid‑only, ask‑only, or no quote.","type":"model","stated":"explicit","quote":"flexibility allows market makers to dynamically choose among providing two-sided quotes, offering only a bid price, providing only an ask price, or declining to quote."}]},"datasets":{"status":"available","items":[{"name":"Synthetic market simulation with Hawkes process","provider":null,"kind":"synthetic","access":"unknown","period":null,"universe":null,"quote":"we shift from the commonly used Poisson process to the Hawkes process, which better captures real market dynamics and self‑exciting behaviors."}],"known":[],"sample":{"start":null,"end":null,"market":null,"asset_class":null,"frequency":null},"data_resolution":"synthetic"},"transaction_costs":{"status":"not_extracted","modeled":"unclear","headline_net_of_costs":null,"detail":null,"quote":null,"source":"none","rule":"R0","candidates":{"front_matter":"unclear","evidence_card":"unclear","evidence_card_quoted":false},"meaning":"the classifier was not confident"},"results":{"status":"available","evaluation_type":"trading-pnl","findings":[{"finding":"A 4‑action market maker trained at low volatility adapts to high volatility, maintaining stable performance and quoting both sides at least 92% of the time.","kind":"performance","quote":"Our findings show that the 4-action MM trained in a low-volatility environment effectively adapts to high-volatility conditions, maintaining stable performance and providing two-sided quotes at least 92% of the time."},{"finding":"The 4‑action MM trained at high volatility performs poorly in high‑volatility test because it was trained with an always‑quoting strategy generated under low volatility.","kind":"negative","quote":"the 4-Action MM (Train & Test @ vol=200) performs poorly in high-volatility environments, primarily because the always-quoting strategy used during training was generated under a volatility of 2, leading to a mismatch with the testing environment."}],"reported_performance":null,"out_of_sample":{"method":"none","headline_out_of_sample":null}},"independent_evidence":{"status":"none_found","supports":[],"contradicts":[],"qualifies":[],"compared_with":12,"citations":{"cited_by_in_corpus":0,"by_independent_authors":0,"how_cited":{"used_as_baseline":0,"uses_method_or_data":0,"extends":0,"discusses_findings":0,"mentions":0,"unclassified":0},"independent_papers":[],"scope":"Citations between papers in this corpus only; citations from outside it are not counted."}},"implementation":{"status":"available","public":false,"code_url":null,"note":"No repository presented by the authors as their own was found in the paper. Absence here is not proof that no code exists."},"replication":{"status":"none_found","card":null,"note":"No replication of this paper has been run by thequant.space yet."},"extraction":{"text_source":"fulltext","model":"openai/gpt-oss-120b","version":1,"extracted_at":"2026-11-14T17:30:17Z"},"provenance":{"claims":"Everything here is what the authors state in the paper. Nothing was re-run or reproduced by the platform.","quotes":"Assumptions, datasets, cost detail and findings were extracted by a language model. Every quote is verbatim paper text. Where an item has `support`, \"full\" means every figure in it appears in the quoted sentences and \"partial\" means a figure is stated elsewhere in the paper; items with a figure found nowhere in the paper were discarded.","datasets_known":"datasets.known lists well-known vendors and public datasets by a stable id, found by a dictionary over the full text where the sentence says the data is used; it is independent of the model and covers only names in the dictionary.","flags":"transaction_costs.modeled, results.evaluation_type and results.out_of_sample.method are platform classifications (structured-decision models); see https://thequant.space/score-guide/#penalty-flags","comparisons":"supports / contradicts / qualifies are a language model's reading of two papers' quoted findings, restricted to closely related papers that share no author. They are pointers to read, not verified replications, and coverage is partial.","implementation":"code_url is a repository the paper itself presents as its own (rule-scored, ambiguous cases judged by a model), checked for liveness when it was recorded."},"docs":"https://thequant.space/agents/"}