Hamilton-Jacobi-Bellman

Joint Stochastic Optimal Control and Stopping in Aquaculture: Finite-Difference and PINN-Based Approaches ArXiv ID: 2510.02910 “View on arXiv” Authors: Kevin Kamm Abstract This paper studies a joint stochastic optimal control and stopping (JCtrlOS) problem motivated by aquaculture operations, where the objective is to maximize farm profit through an optimal feeding strategy and harvesting time under stochastic price dynamics. We introduce a simplified aquaculture model capturing essential biological and economic features, distinguishing between biologically optimal and economically optimal feeding strategies. The problem is formulated as a Hamilton-Jacobi-Bellman variational inequality and corresponding free boundary problem. We develop two numerical solution approaches: First, a finite difference scheme that serves as a benchmark, and second, a Physics-Informed Neural Network (PINN)-based method, combined with a deep optimal stopping (DeepOS) algorithm to improve stopping time accuracy. Numerical experiments demonstrate that while finite differences perform well in medium-dimensional settings, the PINN approach achieves comparable accuracy and is more scalable to higher dimensions where grid-based methods become infeasible. The results confirm that jointly optimizing feeding and harvesting decisions outperforms strategies that neglect either control or stopping. ...

Portfolio and reinsurance optimization under unknown market price of risk ArXiv ID: 2408.07432 “View on arXiv” Authors: Unknown Abstract We investigate the optimal investment-reinsurance problem for insurance company with partial information on the market price of the risk. Through the use of filtering techniques we convert the original optimization problem involving different filtrations, into an equivalent stochastic control problem under the observation filtration only, the so-called separated problem. The Markovian structure of the separated problem allows us to apply a classical approach to stochastic optimization based on the Hamilton-Jacobi-Bellman equation, and to provide explicit formulas for the value function and the optimal investment-reinsurance strategy. We finally discuss some comparisons between the optimal strategies pursued by a partially informed insurer and that followed by a fully informed insurer, and we evaluate the value of information using the idea of indifference pricing. These results are also supported by numerical experiments. ...

Macroscopic Market Making ArXiv ID: 2307.14129 “View on arXiv” Authors: Unknown Abstract We propose a macroscopic market making model à la Avellaneda-Stoikov, using continuous processes for orders instead of discrete point processes. The model intends to bridge the gap between market making and optimal execution problems, while shedding light on the influence of order flows on the optimal strategies. We demonstrate our model through three problems. The study provides a comprehensive analysis from Markovian to non-Markovian noises and from linear to non-linear intensity functions, encompassing both bounded and unbounded coefficients. Mathematically, the contribution lies in the existence and uniqueness of the optimal control, guaranteed by the well-posedness of the strong solution to the Hamilton-Jacobi-Bellman equation and the (non-)Lipschitz forward-backward stochastic differential equation. Finally, the model’s applications to price impact and optimal execution are discussed. ...