MacroHFT: Memory Augmented Context-aware Reinforcement Learning On High Frequency Trading ArXiv ID: 2406.14537 “View on arXiv” Authors: Unknown Abstract High-frequency trading (HFT) that executes algorithmic trading in short time scales, has recently occupied the majority of cryptocurrency market. Besides traditional quantitative trading methods, reinforcement learning (RL) has become another appealing approach for HFT due to its terrific ability of handling high-dimensional financial data and solving sophisticated sequential decision-making problems, \emph{“e.g.,”} hierarchical reinforcement learning (HRL) has shown its promising performance on second-level HFT by training a router to select only one sub-agent from the agent pool to execute the current transaction. However, existing RL methods for HFT still have some defects: 1) standard RL-based trading agents suffer from the overfitting issue, preventing them from making effective policy adjustments based on financial context; 2) due to the rapid changes in market conditions, investment decisions made by an individual agent are usually one-sided and highly biased, which might lead to significant loss in extreme markets. To tackle these problems, we propose a novel Memory Augmented Context-aware Reinforcement learning method On HFT, \emph{“a.k.a.”} MacroHFT, which consists of two training phases: 1) we first train multiple types of sub-agents with the market data decomposed according to various financial indicators, specifically market trend and volatility, where each agent owns a conditional adapter to adjust its trading policy according to market conditions; 2) then we train a hyper-agent to mix the decisions from these sub-agents and output a consistently profitable meta-policy to handle rapid market fluctuations, equipped with a memory mechanism to enhance the capability of decision-making. Extensive experiments on various cryptocurrency markets demonstrate that MacroHFT can achieve state-of-the-art performance on minute-level trading tasks. ...

What Teaches Robots to Walk, Teaches Them to Trade too – Regime Adaptive Execution using Informed Data and LLMs ArXiv ID: 2406.15508 “View on arXiv” Authors: Unknown Abstract Machine learning techniques applied to the problem of financial market forecasting struggle with dynamic regime switching, or underlying correlation and covariance shifts in true (hidden) market variables. Drawing inspiration from the success of reinforcement learning in robotics, particularly in agile locomotion adaptation of quadruped robots to unseen terrains, we introduce an innovative approach that leverages world knowledge of pretrained LLMs (aka. ‘privileged information’ in robotics) and dynamically adapts them using intrinsic, natural market rewards using LLM alignment technique we dub as “Reinforcement Learning from Market Feedback” (RLMF). Strong empirical results demonstrate the efficacy of our method in adapting to regime shifts in financial markets, a challenge that has long plagued predictive models in this domain. The proposed algorithmic framework outperforms best-performing SOTA LLM models on the existing (FLARE) benchmark stock-movement (SM) tasks by more than 15% improved accuracy. On the recently proposed NIFTY SM task, our adaptive policy outperforms the SOTA best performing trillion parameter models like GPT-4. The paper details the dual-phase, teacher-student architecture and implementation of our model, the empirical results obtained, and an analysis of the role of language embeddings in terms of Information Gain. ...

Adaptive Curves for Optimally Efficient Market Making ArXiv ID: 2406.13794 “View on arXiv” Authors: Unknown Abstract Automated Market Makers (AMMs) are essential in Decentralized Finance (DeFi) as they match liquidity supply with demand. They function through liquidity providers (LPs) who deposit assets into liquidity pools. However, the asset trading prices in these pools often trail behind those in more dynamic, centralized exchanges, leading to potential arbitrage losses for LPs. This issue is tackled by adapting market maker bonding curves to trader behavior, based on the classical market microstructure model of Glosten and Milgrom. Our approach ensures a zero-profit condition for the market maker’s prices. We derive the differential equation that an optimal adaptive curve should follow to minimize arbitrage losses while remaining competitive. Solutions to this optimality equation are obtained for standard Gaussian and Lognormal price models using Kalman filtering. A key feature of our method is its ability to estimate the external market price without relying on price or loss oracles. We also provide an equivalent differential equation for the implied dynamics of canonical static bonding curves and establish conditions for their optimality. Our algorithms demonstrate robustness to changing market conditions and adversarial perturbations, and we offer an on-chain implementation using Uniswap v4 alongside off-chain AI co-processors. ...

Death, Taxes, and Inequality. Can a Minimal Model Explain Real Economic Inequality? ArXiv ID: 2406.13789 “View on arXiv” Authors: Unknown Abstract Income inequality and redistribution policies are modeled with a minimal, endogenous model of a simple foraging economy. Significant income inequalities emerge from the model for populations of equally capable individuals presented with equal opportunities. Stochastic income distributions from the model are compared to empirical data from actual economies. The impacts of redistribution policies on total wealth, income distributions, and inequality are shown to be similar for the empirical data and the model. These comparisons enable detailed determinations of population welfare beyond what is possible with total wealth and inequality metrics. I ...

Integral Betti signature confirms the hyperbolic geometry of brain, climate, and financial networks ArXiv ID: 2406.15505 “View on arXiv” Authors: Unknown Abstract This paper extends the possibility to examine the underlying curvature of data through the lens of topology by using the Betti curves, tools of Persistent Homology, as key topological descriptors, building on the clique topology approach. It was previously shown that Betti curves distinguish random from Euclidean geometric matrices - i.e. distance matrices of points randomly distributed in a cube with Euclidean distance. In line with previous experiments, we consider their low-dimensional approximations named integral Betti values, or signatures that effectively distinguish not only Euclidean, but also spherical and hyperbolic geometric matrices, both from purely random matrices as well as among themselves. To prove this, we analyse the behaviour of Betti curves for various geometric matrices – i.e. distance matrices of points randomly distributed on manifolds of constant sectional curvature, considering the classical models of curvature 0, 1, -1, given by the Euclidean space, the sphere, and the hyperbolic space. We further investigate the dependence of integral Betti signatures on factors including the sample size and dimension. This is important for assessment of real-world connectivity matrices, as we show that the standard approach to network construction gives rise to (spurious) spherical geometry, with topology dependent on sample dimensions. Finally, we use the manifolds of constant curvature as comparison models to infer curvature underlying real-world datasets coming from neuroscience, finance and climate. Their associated topological features exhibit a hyperbolic character: the integral Betti signatures associated to these datasets sit in between Euclidean and hyperbolic (of small curvature). The potential confounding ``hyperbologenic effect’’ of intrinsic low-rank modular structures is also evaluated through simulations. ...

Mean-Variance Portfolio Selection in Long-Term Investments with Unknown Distribution: Online Estimation, Risk Aversion under Ambiguity, and Universality of Algorithms ArXiv ID: 2406.13486 “View on arXiv” Authors: Unknown Abstract The standard approach for constructing a Mean-Variance portfolio involves estimating parameters for the model using collected samples. However, since the distribution of future data may not resemble that of the training set, the out-of-sample performance of the estimated portfolio is worse than one derived with true parameters, which has prompted several innovations for better estimation. Instead of treating the data without a timing aspect as in the common training-backtest approach, this paper adopts a perspective where data gradually and continuously reveal over time. The original model is recast into an online learning framework, which is free from any statistical assumptions, to propose a dynamic strategy of sequential portfolios such that its empirical utility, Sharpe ratio, and growth rate asymptotically achieve those of the true portfolio, derived with perfect knowledge of the future data. When the distribution of future data follows a normal shape, the growth rate of wealth is shown to increase by lifting the portfolio along the efficient frontier through the calibration of risk aversion. Since risk aversion cannot be appropriately predetermined, another proposed algorithm updates this coefficient over time, forming a dynamic strategy that approaches the optimal empirical Sharpe ratio or growth rate associated with the true coefficient. The performance of these proposed strategies can be universally guaranteed under stationary stochastic markets. Furthermore, in certain time-reversible stochastic markets, the so-called Bayesian strategy utilizing true conditional distributions, based on past market information during investment, does not perform better than the proposed strategies in terms of empirical utility, Sharpe ratio, or growth rate, which, in contrast, do not rely on conditional distributions. ...

Stock Volume Forecasting with Advanced Information by Conditional Variational Auto-Encoder ArXiv ID: 2406.19414 “View on arXiv” Authors: Unknown Abstract We demonstrate the use of Conditional Variational Encoder (CVAE) to improve the forecasts of daily stock volume time series in both short and long term forecasting tasks, with the use of advanced information of input variables such as rebalancing dates. CVAE generates non-linear time series as out-of-sample forecasts, which have better accuracy and closer fit of correlation to the actual data, compared to traditional linear models. These generative forecasts can also be used for scenario generation, which aids interpretation. We further discuss correlations in non-stationary time series and other potential extensions from the CVAE forecasts. ...

Fees in AMMs: A quantitative study ArXiv ID: 2406.12417 “View on arXiv” Authors: Unknown Abstract In the ever evolving landscape of decentralized finance automated market makers (AMMs) play a key role: they provide a market place for trading assets in a decentralized manner. For so-called bluechip pairs, arbitrage activity provides a major part of the revenue generation of AMMs but also a major source of loss due to the so-called ‘informed orderflow’. Finding ways to minimize those losses while still keeping uninformed trading activity alive is a major problem in the field. In this paper we will investigate the mechanics of said arbitrage and try to understand how AMMs can maximize the revenue creation or in other words minimize the losses. To that end, we model the dynamics of arbitrage activity for a concrete implementation of a pool and study its sensitivity to the choice of fee aiming to maximize the revenue for the AMM. We identify dynamical fees that mimic the directionality of the price due to asymmetric fee choices as a promising avenue to mitigate losses to toxic flow. This work is based on and extends a recent article by some of the authors. ...

Reinforcement Learning for Corporate Bond Trading: A Sell Side Perspective ArXiv ID: 2406.12983 “View on arXiv” Authors: Unknown Abstract A corporate bond trader in a typical sell side institution such as a bank provides liquidity to the market participants by buying/selling securities and maintaining an inventory. Upon receiving a request for a buy/sell price quote (RFQ), the trader provides a quote by adding a spread over a \textit{“prevalent market price”}. For illiquid bonds, the market price is harder to observe, and traders often resort to available benchmark bond prices (such as MarketAxess, Bloomberg, etc.). In \cite{“Bergault2023ModelingLI”}, the concept of \textit{“Fair Transfer Price”} for an illiquid corporate bond was introduced which is derived from an infinite horizon stochastic optimal control problem (for maximizing the trader’s expected P&L, regularized by the quadratic variation). In this paper, we consider the same optimization objective, however, we approach the estimation of an optimal bid-ask spread quoting strategy in a data driven manner and show that it can be learned using Reinforcement Learning. Furthermore, we perform extensive outcome analysis to examine the reasonableness of the trained agent’s behavior. ...

Circular transformation of the European steel industry renders scrap metal a strategic resource ArXiv ID: 2406.12098 “View on arXiv” Authors: Unknown Abstract The steel industry is a major contributor to CO2 emissions, accounting for 7% of global emissions. The European steel industry is seeking to reduce its emissions by increasing the use of electric arc furnaces (EAFs), which can produce steel from scrap, marking a major shift towards a circular steel economy. Here, we show by combining trade with business intelligence data that this shift requires a deep restructuring of the global and European scrap trade, as well as a substantial scaling of the underlying business ecosystem. We find that the scrap imports of European countries with major EAF installations have steadily decreased since 2007 while globally scrap trade started to increase recently. Our statistical modelling shows that every 1,000 tonnes of EAF capacity installed is associated with an increase in annual imports of 550 tonnes and a decrease in annual exports of 1,000 tonnes of scrap, suggesting increased competition for scrap metal as countries ramp up their EAF capacity. Furthermore, each scrap company enables an increase of around 79,000 tonnes of EAF-based steel production per year in the EU. Taking these relations as causal and extrapolating to the currently planned EAF capacity, we find that an additional 730 (SD 140) companies might be required, employing about 35,000 people (IQR 29,000-50,000) and generating an additional estimated turnover of USD 35 billion (IQR 27-48). Our results thus suggest that scrap metal is likely to become a strategic resource. They highlight the need for a massive restructuring of the industry’s supply networks and identify the resulting growth opportunities for companies. ...