Paper: arXiv 2602.04219

Authors: Chung-Han Hsieh

Abstract

This paper investigates the robust optimal control of sampled-data stochastic systems with multiplicative noise and distributional ambiguity. We consider a class of discrete-time optimal control problems where the controller \emph{jointly} selects a feedback policy and a sampling period to maximize the worst-case expected concave utility of the inter-sample growth factor. Modeling uncertainty via a Wasserstein ambiguity set, we confront the structural obstacle of~``concave-max’’ geometry arising from maximizing a concave utility against an adversarial distribution. Unlike standard convex loss minimization, the dual reformulation here requires a minimax interchange within the semi-infinite constraints, where the utility’s concavity precludes exact strong duality. To address this, we utilize a general minimax inequality to derive a tractable convex relaxation. Our approach yields a rigorous lower bound that functions as a probabilistic performance guarantee. We establish an explicit, non-asymptotic bound on the resulting duality gap, proving that the approximation error is uniformly controlled by the Lipschitz-smoothness of the stage reward and the diameter of the disturbance support. Furthermore, we introduce necessary and sufficient conditions for \emph{robust viability}, ensuring state positivity invariance across the entire ambiguity set. Finally, we bridge the gap between static optimization and dynamic performance, proving that the optimal value of the relaxation serves as a rigorous deterministic floor for the asymptotic average utility rate almost surely. The framework is illustrated on a log-optimal portfolio control problem, which serves as a canonical instance of multiplicative stochastic control.

Complexity vs Empirical Score

  • Math Complexity: 8.5/10
  • Empirical Rigor: 4.5/10
  • Quadrant: Lab Rats — theoretically deep, empirically untested

Why this score: The paper presents a mathematically rigorous framework unifying Wasserstein distributionally robust control with sampled-data multiplicative systems, offering explicit duality gap bounds and asymptotic performance guarantees. However, it leans heavily theoretical, with the empirical component limited to an illustrative empirical validation on S&P 500 assets rather than an extensive backtest.

Research Flowchart

  flowchart TD
    A[Research Goal: Robust Optimal Control for Sampled-Data Systems with Multiplicative Noise] --> B[Inputs: Wasserstein Ambiguity Set, Concave Utility, Sampling Period]
    B --> C[Challenge: Dual Reformulation of Concave-Max Geometry]
    C --> D[Methodology: Minimax Inequality & Convex Relaxation]
    D --> E[Computational Process: Solve Tractable Convex Optimization]
    E --> F[Outcomes: Explicit Non-Asymptotic Duality Gap Bound & Viability Conditions]
    F --> G[Validation: Guaranteed Asymptotically Floor Rate in Portfolio Control]

Cited References (170)

  1. The Price of Robustness (2004)
  2. Quantifying Distributional Model Risk via Optimal Transport (2019)
  3. A Framework for Stabilization of Nonlinear Sampled-Data Systems based on Their Approximate Discrete-Time Models (2004)
  4. Discrete-Time Controlled Markov Processes with Average Cost Criterion: A Survey (1993)
  5. Control of Markov Chains with Long-Run Average Cost Criterion (1988)
  6. Risk-Sensitive Optimal Control (1990)
  7. Risk-Sensitive Control on an Infinite Time Horizon (1995)
  8. Wasserstein Distributionally Robust Control of Partially Observable Linear Stochastic Systems (2024)
and 162 more
  1. Probability: Theory and Examples (2019)
  2. Stochastic $H^\infty$ (1998)
  3. $H_\infty$ Control and Filtering of Discrete-Time Stochastic Systems with Multiplicative Noise (2001)
  4. $H_\infty$ Output-Feedback Control of Discrete-Time Systems with State-Multiplicative Noise (2008)
  5. Stationary Optimal Control of Stochastically Sampled Continuous-Time Systems (1988)
  6. Positive Linear Systems: Theory and Applications (2000)
  7. Minimax Control of Discrete-Time Stochastic Systems (2002)
  8. Data-Driven Distributionally Robust LQR with Multiplicative Noise (2020)
  9. State-Feedback Control of Systems with Multiplicative Noise via Linear Matrix Inequalities (1995)
  10. Stochastic H_2/H_∞ Control with State-Dependent Noise (2004)
  11. A Survey of Recent Results in Networked Control Systems (2007)
  12. Kalman Filtering with Intermittent Observations (2004)
  13. Control Under Stochastic Multiplicative Uncertainties: Part I, Fundamental Conditions of Stabilizability (2016)
  14. Inertia-Free Fault-Tolerant Spacecraft Attitude Tracking using Control Allocation (2015)
  15. Optimal Stochastic Control of linear systems with state-and control-dependent disturbances (1971)
  16. Control of Linear Discrete-Time Stochastic Dynamic Systems with Multiplicative Disturbances (1975)
  17. Optimal Control and System Theory in Dynamic Economic Analysis (1976)
  18. Control under Stochastic Multiplicative Uncertainties: Part II, Optimal Design for Performance (2016)
  19. On Accelerating Large-Scale Robust Portfolio Optimization — → 2408.07879
  20. On Positive Solutions of a Delay Equation Arising when Trading in Financial Markets (2019)
  21. Distributionally Robust Optimization (2025)
  22. On Cost-Sensitive Distributionally Robust Log-Optimal Portfolio — → 2410.23536
  23. Computer-Controlled Systems: Theory and Design (2013)
  24. Continuous-Time Stochastic Control and Optimization with Financial Applications (2009)
  25. Portfolio Theory and Arbitrage: a course in Mathematical Finance (2021)
  26. On the Rate of Convergence in Wasserstein Distance of the Empirical Measure (2015)
  27. Nonlinear Programming (1999)
  28. Wasserstein Distributionally Robust Stochastic Control: A Data-Driven Approach (2021)
  29. Markowitz Revisited: Mean-Variance Models in Financial Portfolio Analysis (2001)
  30. Long-Run Risk-Sensitive Impulse Control (2020)
  31. A Stochastic Control Approach to Portfolio Problems with Stochastic Interest Rates (2002)
  32. Optimal Control with State-Space Constraint I (1986)
  33. Fifty Years of Portfolio Optimization–A European Perspective (2023)
  34. Portfolio Optimization Applications of Stochastic Receding Horizon Control (2007)
  35. Linear and Nonlinear Programming (2021)
  36. On General Minimax Theorems (1958)
  37. Distributionally Robust Optimization: A Review (2019) — link
  38. Coherent Measures of Risk (1999)
  39. Portfolio Selection with Transaction Costs (1990)
  40. Numerical Methods and Optimization in Finance (2019)
  41. Portfolio Optimisation with Strictly Positive Transaction Costs and Impulse Control (1998)
  42. Linear System Theory and Design (1998)
  43. On the Transfer of Masses (in Russian) (1942)
  44. M 'e moire sur la th 'e orie des d 'e blais et des remblais (1781)
  45. A Min-Max Solution of an Inventory Problem (1957)
  46. Optimal Portfolio Management for Engineering Problems using Nonconvex Cardinality Constraint: A Computing Perspective (2020)
  47. Ambiguity in Asset Pricing and Portfolio Choice: A Review of the Literature (2013)
  48. Convex Analysis (1997)
  49. Optimization of Conditional Value-at-Risk (2000)
  50. Criteria for Choice Among Risky Ventures (1959)
  51. Optimal Gambling Systems for Favorable Games (1961)
  52. Empirical Bayes Stock Market Portfolios (1986)
  53. Asymptotic Optimality and Asymptotic Equipartition Properties of Log-Optimum Investment (1988)
  54. An Algorithm for Maximizing Expected Log Investment Return (1984)
  55. Contributions to the Theory of Kelly Betting with Applications to Stock Trading: A Control-Theoretic Approach (2019)
  56. The Kelly Criterion in Blackjack Sports Betting, and The Stock Market (2011)
  57. Universal Portfolios with Side Information (1996)
  58. An Overview of Value at Risk (1997)
  59. Cardinality-Constrained Distributionally Robust Portfolio Optimization (2023)
  60. Large-Scale Portfolio Allocation under Transaction Costs and Model Uncertainty (2019)
  61. Robust Portfolio Optimization and Management (2007)
  62. A Review on Ambiguity in Stochastic Portfolio Optimization (2018)
  63. Large-Scale Minimum Variance Portfolio Allocation Using Double Regularization (2020)
  64. Large-Scale Portfolio Optimization (1984)
  65. A New Interpretation of Information Rate (1956)
  66. Robust Optimization (2009)
  67. Portfolio Selection: Efficient Diversification of Investments (1959)
  68. Impact of Error in Parameter Estimations on Large Scale Portfolio Optimization (2019)
  69. Portfolio Selection (1952)
  70. On Solving Robust Log-Optimal Portfolio: A Supporting Hyperplane Approximation Approach (2024)
  71. Robust Solutions of Optimization Problems Affected by Uncertain Probabilities (2013)
  72. On Trading of Equities: A Robust Control Paradigm (2008)
  73. On Performance Limits of Feedback Control-Based Stock Trading Strategies (2011)
  74. On Arbitrage Possibilities via Linear Feedback in an Idealized Brownian Motion Stock Market (2011)
  75. On a New Paradigm for Stock Trading via a Model-Free Feedback Controller (2015)
  76. Investment Science (2013)
  77. On Stock Trading Using a Controller with Delay: The Robust Positive Expectation Property (2016)
  78. Analysis of Financial Time Series (2005)
  79. On Stock Trading via Feedback Control when Underlying Stock Returns Are Discontinuous (2016)
  80. Positive Expected Feedback Trading Gain for All Essentially Linearly Representable Prices (2019)
  81. A Generalization of Simultaneous Long–Short Stock Trading to PI Controllers (2018)
  82. On Robustness of Simultaneous Long-Short Stock Trading Control with Time-Varying Price Dynamics (2017)
  83. A Generalized Framework for Simultaneous Long-Short Feedback Trading (2020)
  84. A Generalization of the Robust Positive Expectation Theorem for Stock Trading via Feedback Control (2018)
  85. Continuous-Time Finance (1992)
  86. Introduction to the Economics and Mathematics of Financial Markets (2004)
  87. Dynamic Programming and Optimal Control: Volume I (2012)
  88. Dynamic Programming and Optimal Control, Volume II: Approximate Dynamic Programming (2011)
  89. On Simultaneous Long-Short Stock Trading Controllers with Cross-Coupling (2020)
  90. Methods of Mathematical Finance (1998)
  91. Options Futures and Other Derivatives (2019)
  92. On Data-Driven Log-Optimal Portfolio: A Sliding Window Approach (2022)
  93. On Robust Optimal Linear Feedback Stock Trading (2022) — link
  94. On Robustness of Double Linear Trading with Transaction Costs (2022)
  95. Stationarity of Random Data: Some Implications for the Distribution of Stock Price Changes (1971)
  96. The Distribution of Stock Returns (1972)
  97. Detecting Shifts of Parameter in Gamma Sequences with Applications to Stock Price and Air Traffic Flow Analysis (1979)
  98. Daily Serial Correlation, Trading Volume and Price Limits: Evidence from the Taiwan Stock Market (1998)
  99. Speculative Dynamics (1991)
  100. Feedback Traders and Stock Return Autocorrelations: Evidence from a Century of Daily Data (1992)
  101. Optimization by Vector Space Methods (1997)
  102. On Adaptive Portfolio Management with Dynamic Black-Litterman Approach — → 2307.03391
  103. Introduction to Nonlinear Optimization: Theory, Algorithms, and Applications with MATLAB (2014)
  104. Trading Volume and Serial Correlation in Stock Returns (1993)
  105. Liquidity and Autocorrelations in Individual Stock Returns (2006)
  106. Global Investigation of Return Autocorrelation and Its Determinants (2017)
  107. Autoregressive Conditional Heteroscedasticity with Estimates of the Variance of United Kingdom Inflation (1982)
  108. Generalized Autoregressive Conditional Heteroskedasticity (1986)
  109. Modelling Asymmetry in Stock Returns by a Threshold Autoregressive Conditional Heteroscedastic Model (1995)
  110. Optimal Pairs Trading: A Stochastic Control Approach (2008)
  111. On Duality Theory of Conic Linear Problems (2001)
  112. Data-Driven Distributionally Robust Optimization Using the Wasserstein Metric: Performance Guarantees and Tractable Reformulations (2018)
  113. Wasserstein-Kelly Portfolios: A Robust Data-Driven Solution to Optimize Portfolio Growth — → 2302.13979
  114. Analysis of the Rebalancing Frequency in Log-Optimal Portfolio Selection (2010)
  115. Distributionally Robust Optimization under Moment Uncertainty with Application to Data-Driven Problems (2010)
  116. Distributionally-Robust Optimization with Noisy Data for Discrete Uncertainties Using Total Variation Distance (2023)
  117. Effective Scenarios in Multistage Distributionally Robust Optimization with a Focus on Total Variation Distance (2022)
  118. Nonlinear Distributionally Robust Optimization (2023) — link
  119. Elements of Information Theory (2012)
  120. Distributionally Robust Mean-Variance Portfolio Selection with Wasserstein Distances (2022)
  121. Dynamic Asset Pricing Theory (2010)
  122. How Does the Fortune’s Formula Kelly Capital Growth Model Perform? (2011)
  123. Stochastic Optimal Control: the Discrete-Time Case (1996)
  124. Computational Complexity: a Modern Approach (2009)
  125. Principles of Mathematical Analysis (1976)
  126. Optimal Gambling Systems for Favorable Games (1961)
  127. Lectures on Stochastic Programming: Modeling and Theory (2021)
  128. A Comment on “Computational Complexity of Stochastic Programming Problems” (2016)
  129. Kullback-Leibler Divergence Constrained Distributionally Robust Optimization (2013)
  130. A Distributionally Robust Optimization Approach to Unit Commitment in Microgrids (2021)
  131. Ambiguous Chance Constrained Problems and Robust Optimization (2006)
  132. Universal Portfolios with Side Information (1996)
  133. Robust Wasserstein Profile Inference and Applications to Machine Learning (2019)
  134. Distributionally Robust Stochastic Optimization with Wasserstein Distance (2023)
  135. Rebalancing Frequency Considerations for Kelly-Optimal Stock Portfolios in a Control-Theoretic Framework (2018)
  136. Some Theoretical Insights into Wasserstein GANs (2021)
  137. Improved Training of Wasserstein Gans (2017)
  138. On Frequency-Based Log-Optimal Portfolio With Transaction Costs (2023)
  139. Necessary and Sufficient Conditions for Frequency-Based Kelly Optimal Portfolio (2020)
  140. Convex Optimization Theory (2009)
  141. Survey: Market Risk Premium and Risk-Free Rate Used for 95 Countries in 2022 (2022)
  142. The Impact of Proportional Transaction Costs on Systematically Generated Portfolios (2020)
  143. Convex Optimization (2004)
  144. Distributional Robust Kelly Gambling: Optimal Strategy under Uncertainty in the Long-Run (2018) — link
  145. Distributionally Robust Optimization and its Applications in Power System Energy Storage Sizing (2024)
  146. Portfolio Optimization with Linear and Fixed Transaction Costs (2007)
  147. On Asymptotic Log-Optimal Portfolio Optimization (2023)
  148. Optimal Consumption and Portfolio with Both Fixed and Proportional Transaction Costs (2002)
  149. A Novel Multi Period Mean-VaR Portfolio Optimization Model Considering Practical Constraints and Transaction Cost (2019)
  150. Portfolio Selection with Proportional Transaction Costs and Predictability (2018)
  151. Recent Advances in Robust Optimization: An Overview (2014)
  152. Theory and Applications of Robust Optimization (2011)
  153. Selected Topics in Robust Convex Optimization (2008)
  154. Distributionally Robust Optimization: A Review on Theory and Applications (2022)
  155. A Generalization of the Classical Kelly Betting Formula to the Case of Temporal Correlation (2020)
  156. On the Benefit of Nonlinear Control for Robust Logarithmic Growth: Coin Flipping Games as a Demonstration Case (2023)
  157. A Jump Start to Stock Trading Research for the Uninitiated Control Scientist: A Tutorial (2024)
  158. First-Order Methods in Optimization (2017)
  159. Robust Growth-Optimal Portfolios (2016)
  160. The Kelly Capital Growth Investment criterion: Theory and Practice (2011)
  161. Optimal Control of Execution Costs (1998)
  162. Direct Data-Driven Portfolio Optimization with Guaranteed Shortfall Probability (2013)

4 of 170 cited works are in the corpus; resolved via arXiv source bundles, Semantic Scholar and OpenAlex. Corpus-wide: 2518 linked papers.