{"paper_id":"2410.23294","title":"Exploiting Risk-Aversion and Size-dependent fees in FX Trading with Fitted Natural Actor-Critic","authors":["Vito Alessandro Monaco","Antonio Riva","Luca Sabbioni","Lorenzo Bisi","Edoardo Vittori","Marco Pinciroli","Michele Trapletti","Marcello Restelli"],"paper_date":"2024-10-15","paper_type":"empirical","paper_url":"https://arxiv.org/pdf/2410.23294v1","page_url":"https://thequant.space/flowcharts/exploiting-risk-aversion-and-size-dependent-fees-in-fx-tradi/","scores":{"empirical_rigor":6,"math_complexity":7.5,"quadrant":"Holy Grail"},"proposes":{"status":"available","statement":"The paper proposes using the Fitted Natural Actor-Critic (FNAC) algorithm with continuous actions to model size‑dependent transaction fees and integrate risk‑averse approaches for Forex trading.","quote":"Our approach involves the implementation of a Reinforcement Learning algorithm called Fitted Natural Actor-Critic. This algorithm allows the training of an agent capable of effectively trading by means of continuous actions, which enable the possibility of executing orders with variable trading sizes","summary":"In recent years, the popularity of artificial intelligence has surged due to its widespread application in various fields. The financial sector has harnessed its advantages for multiple purposes, including the development of automated trading systems designed to interact autonomously with markets…","strategy":"Fitted Natural Actor-Critic (FNAC)"},"assumptions":{"status":"available","items":[{"assumption":"Transaction costs increase with order size because larger trades face lower immediate liquidity.","type":"execution","stated":"explicit","quote":"Indeed, the larger the trade size (in the order of million dollars), the more difficult it becomes to find enough immediate liquidity for the requested volume, resulting in higher transaction costs."},{"assumption":"The fee function depends on order size rather than on time.","type":"model","stated":"explicit","quote":"It is important to recall that the fixed/variable nature of the transaction fee we refer to regards the dependence on the order size, not the dependence on time."},{"assumption":"Historical EUR/USD price data from 2018‑2022 is representative for training and testing.","type":"data","stated":"explicit","quote":"We first split the available data, which includes market observations from 2018 to 2022, into four parts."},{"assumption":"Risk‑averse behavior can be induced via mean‑volatility and RCVaR risk measures.","type":"model","stated":"explicit","quote":"through the use of risk measures (mean‑volatility and RCVaR), the trained agents successfully developed risk‑averse behaviors"},{"assumption":"Continuous action spaces better reflect real trading environments than discrete actions.","type":"other","stated":"implied","quote":"trading is one of those tasks where considering continuous action spaces enables a more realistic representation of the environment and expands the range of viable solutions"},{"assumption":"Lower trading frequency improves signal‑to‑noise ratio and generalization.","type":"model","stated":"implied","quote":"As expected, a lower trading frequency ensured a better signal‑to‑noise ratio, which increased the generalization capabilities of the model."}]},"datasets":{"status":"available","items":[{"name":"EUR/USD historical price data","provider":null,"kind":"market-prices","access":"unknown","period":"2018-2022","universe":"EUR/USD pair","quote":"The proposed approaches have been empirically validated on EUR-USD historical data."}],"known":[],"sample":{"start":null,"end":null,"market":"EUR-USD","asset_class":"fx","frequency":"intraday"},"data_resolution":"intraday-bars"},"transaction_costs":{"status":"available","modeled":"yes","headline_net_of_costs":true,"detail":"Fees are modeled as either fixed or variable, with the variable fee depending on order size.","quote":"the fixed/variable nature of the transaction fee we refer to regards the dependence on the order size, not the dependence on time.","source":"front_matter","rule":"R3","candidates":{"front_matter":"yes","evidence_card":"yes","evidence_card_quoted":true},"card_detail":"Fees are modeled as either fixed or variable, with the variable fee depending on order size.","card_quote":"the fixed/variable nature of the transaction fee we refer to regards the dependence on the order size, not the dependence on time.","meaning":"costs are part of the reported headline results"},"results":{"status":"available","evaluation_type":"trading-pnl","findings":[{"finding":"FNAC achieves significantly better performance than all baselines (FQI, PPO, Buy&Hold, Sell&Hold) on out‑of‑sample EUR/USD data.","kind":"performance","quote":"FNAC has proven to achieve significantly better performance compared to all the baselines, included FQI and PPO, for the considered test dataset."},{"finding":"In continuous‑action mode FNAC performs slightly worse than in discrete‑action mode, showing higher drawdowns and larger return volatility.","kind":"performance","quote":"the proposed approach obtained slightly worse performances in its continuous form w.r.t. the discrete one. For instance, in the last 4 months of 2022, we noticed higher drawdowns and a significant rise in the standard deviation of the cumulative return."},{"finding":"Risk‑averse FNAC agents reduce reward variability compared to risk‑neutral agents.","kind":"performance","quote":"the trained agents successfully developed risk‑averse behaviors, decreasing the variability of the obtained rewards."},{"finding":"Variable transaction fees (size‑dependent) can be learned, allowing the agent to limit order volume to balance revenue and costs.","kind":"performance","quote":"Through the integration of a size‑dependent fee function, we were able to train an agent capable of limiting the order volume in order to better exploit the trade‑off between revenues and transaction costs."},{"finding":"Discrete‑action FNAC with persistence 10 (trading every 10 minutes) outperforms other persistence settings in 2022.","kind":"performance","quote":"the model trained with persistence equal to 10 significantly outperforms the others in 2022."}],"reported_performance":{"strategy":"Fitted Natural Actor-Critic (FNAC)","sharpe":null,"sharpe_benchmark":null,"annual_return_pct":null,"total_return_pct":null,"max_drawdown_pct":null},"out_of_sample":{"method":"holdout","headline_out_of_sample":true}},"independent_evidence":{"status":"none_found","supports":[],"contradicts":[],"qualifies":[],"compared_with":49,"citations":{"cited_by_in_corpus":0,"by_independent_authors":0,"how_cited":{"used_as_baseline":0,"uses_method_or_data":0,"extends":0,"discusses_findings":0,"mentions":0,"unclassified":0},"independent_papers":[],"scope":"Citations between papers in this corpus only; citations from outside it are not counted."}},"implementation":{"status":"available","public":false,"code_url":null,"note":"No repository presented by the authors as their own was found in the paper. Absence here is not proof that no code exists."},"replication":{"status":"none_found","card":null,"note":"No replication of this paper has been run by thequant.space yet."},"extraction":{"text_source":"fulltext","model":"openai/gpt-oss-120b","version":1,"extracted_at":"2026-11-14T17:58:52Z"},"provenance":{"claims":"Everything here is what the authors state in the paper. Nothing was re-run or reproduced by the platform.","quotes":"Assumptions, datasets, cost detail and findings were extracted by a language model. Every quote is verbatim paper text. Where an item has `support`, \"full\" means every figure in it appears in the quoted sentences and \"partial\" means a figure is stated elsewhere in the paper; items with a figure found nowhere in the paper were discarded.","datasets_known":"datasets.known lists well-known vendors and public datasets by a stable id, found by a dictionary over the full text where the sentence says the data is used; it is independent of the model and covers only names in the dictionary.","flags":"transaction_costs.modeled, results.evaluation_type and results.out_of_sample.method are platform classifications (structured-decision models); see https://thequant.space/score-guide/#penalty-flags","comparisons":"supports / contradicts / qualifies are a language model's reading of two papers' quoted findings, restricted to closely related papers that share no author. They are pointers to read, not verified replications, and coverage is partial.","implementation":"code_url is a repository the paper itself presents as its own (rule-scored, ambiguous cases judged by a model), checked for liveness when it was recorded."},"docs":"https://thequant.space/agents/"}