Paper: arXiv 2310.04336
Authors: Zoran Stoiljkovic
Abstract
This thesis provides an overview of the recent advances in reinforcement learning in pricing and hedging financial instruments, with a primary focus on a detailed explanation of the Q-Learning Black Scholes approach, introduced by Halperin (2017). This reinforcement learning approach bridges the traditional Black and Scholes (1973) model with novel artificial intelligence algorithms, enabling option pricing and hedging in a completely model-free and data-driven way. This paper also explores the algorithm’s performance under different state variables and scenarios for a European put option. The results reveal that the model is an accurate estimator under different levels of volatility and hedging frequency. Moreover, this method exhibits robust performance across various levels of option’s moneyness. Lastly, the algorithm incorporates proportional transaction costs, indicating diverse impacts on profit and loss, affected by different statistical properties of the state variables.
Complexity vs Empirical Score
- Math Complexity: 7.5/10
- Empirical Rigor: 4.0/10
- Quadrant: Lab Rats — high math complexity, limited empirical testing
Why this score: The paper introduces advanced RL concepts (Q-learning, FQI, offline RL) and mathematical formalisms (MDPs, transition probabilities) which are dense for finance literature, but the testing is limited to theoretical scenarios on European puts without live market data, code, or robust backtesting metrics.
Research Flowchart
flowchart TD
A["Research Goal:<br>Model-Free Option Pricing & Hedging with RL"] --> B["Core Methodology:<br>Q-Learning Black-Scholes Framework"]
B --> C{"Data/Input: European Put Option<br>Variables: Spot Price, Strike, Volatility"}
C --> D["Computational Process:<br>Q-Value Approximation & Policy Optimization"]
D --> E{"Incorporation of<br>Proportional Transaction Costs?"}
E -- Yes --> F["Simulated P&L Analysis"]
E -- No --> G["Simulated P&L Analysis"]
F & G --> H["Key Outcomes:<br>Accurate Estimation<br>Robust to Volatility/Moneyness<br>Transaction Costs Impact P&L"]
Evidence Card
What the authors claim, on what data, and who has checked it. Read from the paper's own text by a language model: every quote is verbatim, nothing was re-run. How to read this card
Proposes
The paper proposes the Q‑Learning Black‑Scholes (QLBS) model for pricing and hedging European options in a model‑free, data‑driven way.
Source sentence
This thesis provides an overview of the recent advances in reinforcement learning in pricing and hedging financial instruments, with a primary focus on a detailed explanation of the Q-Learning Black Scholes approach, introduced by Halperin (2017).
Assumes 2
- Constant volatility of the underlying asset is assumed. model
Source sentence
Since this paper compares the performances of QLBS and BSM, constant volatility of the underlying asset is assumed.
- The QLBS model is not risk‑neutral; stock dynamics are modeled under the real probability measure P. model
Source sentence
The QLBS model is not assumed to be risk neutral, and therefore, the dynamics of the stock price are modeled under the real probability measure P.
Data
- Simulated European put option data synthetic unknown
Source sentence
The algorithm's performance under different state variables and scenarios for a European put option.
Costs
Modeled
Proportional transaction cost c = 0.01 is incorporated via a cash‑flow approach.
Source sentence
Finally, this part discusses a possible effect of transaction costs on QLBS, which are incorporated after the model-based QLBS optimal actions are calculated
Finds 4
- The QLBS model accurately captures the impact of underlying volatility on option prices. performance
Source sentence
The QLBS model accurately captures the impact of underlying volatility on option prices.
- QLBS pricing closely aligns with BSM prices across weekly, bi‑weekly, monthly, and semi‑annual hedging frequencies. pricing-calibration
Source sentence
The algorithm generates prices that closely align with those of the BSM model, regardless of whether the hedging frequency is weekly, bi‑weekly, monthly, or semi‑annually.
- QLBS performs well across various strike prices, with larger deviations from BSM for deep in‑the‑money options when risk aversion increases. performance
Source sentence
The results reveal that QLBS performs well across various strike prices, where QLBS pricing differs more from the BSM model for deep in‑the‑money options when the risk aversion increases.
- Proportional transaction costs can be incorporated using a cash‑flow approach, affecting terminal wealth. other
Source sentence
Finally, it is shown that proportional transaction costs can be considered using the cash flow approach.
Checked by others
No other paper in the archive has been found to support or contradict these findings (compared with 34 related papers). Coverage is partial, so this is neither replication nor refutation.
Code
No repository by the authors found in the paper.
Extracted 2026-11-14 · same card as JSON · A language model chose these items: check the source sentence before relying on one.