Paper: arXiv 2602.04219
Authors: Chung-Han Hsieh
Abstract
This paper investigates the robust optimal control of sampled-data stochastic systems with multiplicative noise and distributional ambiguity. We consider a class of discrete-time optimal control problems where the controller \emph{jointly} selects a feedback policy and a sampling period to maximize the worst-case expected concave utility of the inter-sample growth factor. Modeling uncertainty via a Wasserstein ambiguity set, we confront the structural obstacle of~``concave-max’’ geometry arising from maximizing a concave utility against an adversarial distribution. Unlike standard convex loss minimization, the dual reformulation here requires a minimax interchange within the semi-infinite constraints, where the utility’s concavity precludes exact strong duality. To address this, we utilize a general minimax inequality to derive a tractable convex relaxation. Our approach yields a rigorous lower bound that functions as a probabilistic performance guarantee. We establish an explicit, non-asymptotic bound on the resulting duality gap, proving that the approximation error is uniformly controlled by the Lipschitz-smoothness of the stage reward and the diameter of the disturbance support. Furthermore, we introduce necessary and sufficient conditions for \emph{robust viability}, ensuring state positivity invariance across the entire ambiguity set. Finally, we bridge the gap between static optimization and dynamic performance, proving that the optimal value of the relaxation serves as a rigorous deterministic floor for the asymptotic average utility rate almost surely. The framework is illustrated on a log-optimal portfolio control problem, which serves as a canonical instance of multiplicative stochastic control.
Complexity vs Empirical Score
- Math Complexity: 8.5/10
- Empirical Rigor: 4.5/10
- Quadrant: Lab Rats — theoretically deep, empirically untested
Why this score: The paper presents a mathematically rigorous framework unifying Wasserstein distributionally robust control with sampled-data multiplicative systems, offering explicit duality gap bounds and asymptotic performance guarantees. However, it leans heavily theoretical, with the empirical component limited to an illustrative empirical validation on S&P 500 assets rather than an extensive backtest.
Research Flowchart
flowchart TD
A[Research Goal: Robust Optimal Control for Sampled-Data Systems with Multiplicative Noise] --> B[Inputs: Wasserstein Ambiguity Set, Concave Utility, Sampling Period]
B --> C[Challenge: Dual Reformulation of Concave-Max Geometry]
C --> D[Methodology: Minimax Inequality & Convex Relaxation]
D --> E[Computational Process: Solve Tractable Convex Optimization]
E --> F[Outcomes: Explicit Non-Asymptotic Duality Gap Bound & Viability Conditions]
F --> G[Validation: Guaranteed Asymptotically Floor Rate in Portfolio Control]
Cited References (170)
- The Price of Robustness (2004)
- Quantifying Distributional Model Risk via Optimal Transport (2019)
- A Framework for Stabilization of Nonlinear Sampled-Data Systems based on Their Approximate Discrete-Time Models (2004)
- Discrete-Time Controlled Markov Processes with Average Cost Criterion: A Survey (1993)
- Control of Markov Chains with Long-Run Average Cost Criterion (1988)
- Risk-Sensitive Optimal Control (1990)
- Risk-Sensitive Control on an Infinite Time Horizon (1995)
- Wasserstein Distributionally Robust Control of Partially Observable Linear Stochastic Systems (2024)
and 162 more
- Probability: Theory and Examples (2019)
- Stochastic $H^\infty$ (1998)
- $H_\infty$ Control and Filtering of Discrete-Time Stochastic Systems with Multiplicative Noise (2001)
- $H_\infty$ Output-Feedback Control of Discrete-Time Systems with State-Multiplicative Noise (2008)
- Stationary Optimal Control of Stochastically Sampled Continuous-Time Systems (1988)
- Positive Linear Systems: Theory and Applications (2000)
- Minimax Control of Discrete-Time Stochastic Systems (2002)
- Data-Driven Distributionally Robust LQR with Multiplicative Noise (2020)
- State-Feedback Control of Systems with Multiplicative Noise via Linear Matrix Inequalities (1995)
- Stochastic H_2/H_∞ Control with State-Dependent Noise (2004)
- A Survey of Recent Results in Networked Control Systems (2007)
- Kalman Filtering with Intermittent Observations (2004)
- Control Under Stochastic Multiplicative Uncertainties: Part I, Fundamental Conditions of Stabilizability (2016)
- Inertia-Free Fault-Tolerant Spacecraft Attitude Tracking using Control Allocation (2015)
- Optimal Stochastic Control of linear systems with state-and control-dependent disturbances (1971)
- Control of Linear Discrete-Time Stochastic Dynamic Systems with Multiplicative Disturbances (1975)
- Optimal Control and System Theory in Dynamic Economic Analysis (1976)
- Control under Stochastic Multiplicative Uncertainties: Part II, Optimal Design for Performance (2016)
- On Accelerating Large-Scale Robust Portfolio Optimization — → 2408.07879
- On Positive Solutions of a Delay Equation Arising when Trading in Financial Markets (2019)
- Distributionally Robust Optimization (2025)
- On Cost-Sensitive Distributionally Robust Log-Optimal Portfolio — → 2410.23536
- Computer-Controlled Systems: Theory and Design (2013)
- Continuous-Time Stochastic Control and Optimization with Financial Applications (2009)
- Portfolio Theory and Arbitrage: a course in Mathematical Finance (2021)
- On the Rate of Convergence in Wasserstein Distance of the Empirical Measure (2015)
- Nonlinear Programming (1999)
- Wasserstein Distributionally Robust Stochastic Control: A Data-Driven Approach (2021)
- Markowitz Revisited: Mean-Variance Models in Financial Portfolio Analysis (2001)
- Long-Run Risk-Sensitive Impulse Control (2020)
- A Stochastic Control Approach to Portfolio Problems with Stochastic Interest Rates (2002)
- Optimal Control with State-Space Constraint I (1986)
- Fifty Years of Portfolio Optimization–A European Perspective (2023)
- Portfolio Optimization Applications of Stochastic Receding Horizon Control (2007)
- Linear and Nonlinear Programming (2021)
- On General Minimax Theorems (1958)
- Distributionally Robust Optimization: A Review (2019) — link
- Coherent Measures of Risk (1999)
- Portfolio Selection with Transaction Costs (1990)
- Numerical Methods and Optimization in Finance (2019)
- Portfolio Optimisation with Strictly Positive Transaction Costs and Impulse Control (1998)
- Linear System Theory and Design (1998)
- On the Transfer of Masses (in Russian) (1942)
- M 'e moire sur la th 'e orie des d 'e blais et des remblais (1781)
- A Min-Max Solution of an Inventory Problem (1957)
- Optimal Portfolio Management for Engineering Problems using Nonconvex Cardinality Constraint: A Computing Perspective (2020)
- Ambiguity in Asset Pricing and Portfolio Choice: A Review of the Literature (2013)
- Convex Analysis (1997)
- Optimization of Conditional Value-at-Risk (2000)
- Criteria for Choice Among Risky Ventures (1959)
- Optimal Gambling Systems for Favorable Games (1961)
- Empirical Bayes Stock Market Portfolios (1986)
- Asymptotic Optimality and Asymptotic Equipartition Properties of Log-Optimum Investment (1988)
- An Algorithm for Maximizing Expected Log Investment Return (1984)
- Contributions to the Theory of Kelly Betting with Applications to Stock Trading: A Control-Theoretic Approach (2019)
- The Kelly Criterion in Blackjack Sports Betting, and The Stock Market (2011)
- Universal Portfolios with Side Information (1996)
- An Overview of Value at Risk (1997)
- Cardinality-Constrained Distributionally Robust Portfolio Optimization (2023)
- Large-Scale Portfolio Allocation under Transaction Costs and Model Uncertainty (2019)
- Robust Portfolio Optimization and Management (2007)
- A Review on Ambiguity in Stochastic Portfolio Optimization (2018)
- Large-Scale Minimum Variance Portfolio Allocation Using Double Regularization (2020)
- Large-Scale Portfolio Optimization (1984)
- A New Interpretation of Information Rate (1956)
- Robust Optimization (2009)
- Portfolio Selection: Efficient Diversification of Investments (1959)
- Impact of Error in Parameter Estimations on Large Scale Portfolio Optimization (2019)
- Portfolio Selection (1952)
- On Solving Robust Log-Optimal Portfolio: A Supporting Hyperplane Approximation Approach (2024)
- Robust Solutions of Optimization Problems Affected by Uncertain Probabilities (2013)
- On Trading of Equities: A Robust Control Paradigm (2008)
- On Performance Limits of Feedback Control-Based Stock Trading Strategies (2011)
- On Arbitrage Possibilities via Linear Feedback in an Idealized Brownian Motion Stock Market (2011)
- On a New Paradigm for Stock Trading via a Model-Free Feedback Controller (2015)
- Investment Science (2013)
- On Stock Trading Using a Controller with Delay: The Robust Positive Expectation Property (2016)
- Analysis of Financial Time Series (2005)
- On Stock Trading via Feedback Control when Underlying Stock Returns Are Discontinuous (2016)
- Positive Expected Feedback Trading Gain for All Essentially Linearly Representable Prices (2019)
- A Generalization of Simultaneous Long–Short Stock Trading to PI Controllers (2018)
- On Robustness of Simultaneous Long-Short Stock Trading Control with Time-Varying Price Dynamics (2017)
- A Generalized Framework for Simultaneous Long-Short Feedback Trading (2020)
- A Generalization of the Robust Positive Expectation Theorem for Stock Trading via Feedback Control (2018)
- Continuous-Time Finance (1992)
- Introduction to the Economics and Mathematics of Financial Markets (2004)
- Dynamic Programming and Optimal Control: Volume I (2012)
- Dynamic Programming and Optimal Control, Volume II: Approximate Dynamic Programming (2011)
- On Simultaneous Long-Short Stock Trading Controllers with Cross-Coupling (2020)
- Methods of Mathematical Finance (1998)
- Options Futures and Other Derivatives (2019)
- On Data-Driven Log-Optimal Portfolio: A Sliding Window Approach (2022)
- On Robust Optimal Linear Feedback Stock Trading (2022) — link
- On Robustness of Double Linear Trading with Transaction Costs (2022)
- Stationarity of Random Data: Some Implications for the Distribution of Stock Price Changes (1971)
- The Distribution of Stock Returns (1972)
- Detecting Shifts of Parameter in Gamma Sequences with Applications to Stock Price and Air Traffic Flow Analysis (1979)
- Daily Serial Correlation, Trading Volume and Price Limits: Evidence from the Taiwan Stock Market (1998)
- Speculative Dynamics (1991)
- Feedback Traders and Stock Return Autocorrelations: Evidence from a Century of Daily Data (1992)
- Optimization by Vector Space Methods (1997)
- On Adaptive Portfolio Management with Dynamic Black-Litterman Approach — → 2307.03391
- Introduction to Nonlinear Optimization: Theory, Algorithms, and Applications with MATLAB (2014)
- Trading Volume and Serial Correlation in Stock Returns (1993)
- Liquidity and Autocorrelations in Individual Stock Returns (2006)
- Global Investigation of Return Autocorrelation and Its Determinants (2017)
- Autoregressive Conditional Heteroscedasticity with Estimates of the Variance of United Kingdom Inflation (1982)
- Generalized Autoregressive Conditional Heteroskedasticity (1986)
- Modelling Asymmetry in Stock Returns by a Threshold Autoregressive Conditional Heteroscedastic Model (1995)
- Optimal Pairs Trading: A Stochastic Control Approach (2008)
- On Duality Theory of Conic Linear Problems (2001)
- Data-Driven Distributionally Robust Optimization Using the Wasserstein Metric: Performance Guarantees and Tractable Reformulations (2018)
- Wasserstein-Kelly Portfolios: A Robust Data-Driven Solution to Optimize Portfolio Growth — → 2302.13979
- Analysis of the Rebalancing Frequency in Log-Optimal Portfolio Selection (2010)
- Distributionally Robust Optimization under Moment Uncertainty with Application to Data-Driven Problems (2010)
- Distributionally-Robust Optimization with Noisy Data for Discrete Uncertainties Using Total Variation Distance (2023)
- Effective Scenarios in Multistage Distributionally Robust Optimization with a Focus on Total Variation Distance (2022)
- Nonlinear Distributionally Robust Optimization (2023) — link
- Elements of Information Theory (2012)
- Distributionally Robust Mean-Variance Portfolio Selection with Wasserstein Distances (2022)
- Dynamic Asset Pricing Theory (2010)
- How Does the Fortune’s Formula Kelly Capital Growth Model Perform? (2011)
- Stochastic Optimal Control: the Discrete-Time Case (1996)
- Computational Complexity: a Modern Approach (2009)
- Principles of Mathematical Analysis (1976)
- Optimal Gambling Systems for Favorable Games (1961)
- Lectures on Stochastic Programming: Modeling and Theory (2021)
- A Comment on “Computational Complexity of Stochastic Programming Problems” (2016)
- Kullback-Leibler Divergence Constrained Distributionally Robust Optimization (2013)
- A Distributionally Robust Optimization Approach to Unit Commitment in Microgrids (2021)
- Ambiguous Chance Constrained Problems and Robust Optimization (2006)
- Universal Portfolios with Side Information (1996)
- Robust Wasserstein Profile Inference and Applications to Machine Learning (2019)
- Distributionally Robust Stochastic Optimization with Wasserstein Distance (2023)
- Rebalancing Frequency Considerations for Kelly-Optimal Stock Portfolios in a Control-Theoretic Framework (2018)
- Some Theoretical Insights into Wasserstein GANs (2021)
- Improved Training of Wasserstein Gans (2017)
- On Frequency-Based Log-Optimal Portfolio With Transaction Costs (2023)
- Necessary and Sufficient Conditions for Frequency-Based Kelly Optimal Portfolio (2020)
- Convex Optimization Theory (2009)
- Survey: Market Risk Premium and Risk-Free Rate Used for 95 Countries in 2022 (2022)
- The Impact of Proportional Transaction Costs on Systematically Generated Portfolios (2020)
- Convex Optimization (2004)
- Distributional Robust Kelly Gambling: Optimal Strategy under Uncertainty in the Long-Run (2018) — link
- Distributionally Robust Optimization and its Applications in Power System Energy Storage Sizing (2024)
- Portfolio Optimization with Linear and Fixed Transaction Costs (2007)
- On Asymptotic Log-Optimal Portfolio Optimization (2023)
- Optimal Consumption and Portfolio with Both Fixed and Proportional Transaction Costs (2002)
- A Novel Multi Period Mean-VaR Portfolio Optimization Model Considering Practical Constraints and Transaction Cost (2019)
- Portfolio Selection with Proportional Transaction Costs and Predictability (2018)
- Recent Advances in Robust Optimization: An Overview (2014)
- Theory and Applications of Robust Optimization (2011)
- Selected Topics in Robust Convex Optimization (2008)
- Distributionally Robust Optimization: A Review on Theory and Applications (2022)
- A Generalization of the Classical Kelly Betting Formula to the Case of Temporal Correlation (2020)
- On the Benefit of Nonlinear Control for Robust Logarithmic Growth: Coin Flipping Games as a Demonstration Case (2023)
- A Jump Start to Stock Trading Research for the Uninitiated Control Scientist: A Tutorial (2024)
- First-Order Methods in Optimization (2017)
- Robust Growth-Optimal Portfolios (2016)
- The Kelly Capital Growth Investment criterion: Theory and Practice (2011)
- Optimal Control of Execution Costs (1998)
- Direct Data-Driven Portfolio Optimization with Guaranteed Shortfall Probability (2013)
4 of 170 cited works are in the corpus; resolved via arXiv source bundles, Semantic Scholar and OpenAlex. Corpus-wide: 2518 linked papers.