{"paper_id":"2511.18076","title":"Reinforcement Learning for Portfolio Optimization with a Financial Goal and Defined Time Horizons","authors":["Fermat Leukam","Rock Stephane Koffi","Prudence Djagba"],"paper_date":"2025-11-22","paper_type":"empirical","paper_url":"https://arxiv.org/pdf/2511.18076v1","page_url":"https://thequant.space/flowcharts/reinforcement-learning-for-portfolio-optimization-with-a-fin/","scores":{"empirical_rigor":3,"math_complexity":8,"quadrant":"Lab Rats"},"proposes":{"status":"available","statement":"The paper proposes an enhanced portfolio optimization approach that combines the G‑Learning algorithm with parametric optimization via the GIRL algorithm to maximize portfolio value by a target date while minimizing periodic contributions.","quote":"This research proposes an enhancement to the innovative portfolio optimization approach using the G-Learning algorithm, combined with parametric optimization via the GIRL algorithm (G-learning approach to the setting of Inverse Reinforcement Learning) as presented by.","summary":"This research proposes an enhancement to the innovative portfolio optimization approach using the G-Learning algorithm, combined with parametric optimization via the GIRL algorithm (G-learning approach to the setting of Inverse Reinforcement Learning) as presented by. The goal is to maximize…","strategy":null},"assumptions":{"status":"available","items":[{"assumption":"The evolution of assets follows a Markov process, i.e., future prices depend only on the current price.","type":"model","stated":"explicit","quote":"To model our market, we start with the assumption that the evolution of assets follows a Markov process."},{"assumption":"Asset price dynamics are modeled by geometric Brownian motion (GBM).","type":"model","stated":"explicit","quote":"This assumption accurately reflects the reality of financial markets. In fact, it is characteristic of geometric Brownian motion (GBM), which is widely used in mathematical finance to model stock prices."},{"assumption":"A predetermined target portfolio value ˆPt+1 exists at each time step.","type":"other","stated":"explicit","quote":"Furthermore, we assume that at each time step t, a predetermined target value ˆPt+1 exists for the portfolio at the subsequent time t + 1."},{"assumption":"Transaction costs are proportional to the squared change in positions via a weighting matrix Ω.","type":"execution","stated":"explicit","quote":"−uT t Ωut: Transaction costs. This term corresponds to the cost of transactions. Each change in the positions in the portfolio ut (buying or selling assets) incurs costs, such as brokerage fees or costs of adjusting the portfolio."},{"assumption":"The market is highly volatile but the portfolio is well‑diversified, leading to a low‑risk level for the investor.","type":"market","stated":"explicit","quote":"Our model operates in a highly volatile market with a well-diversified portfolio, ensuring a low-risk level for the investor."}]},"datasets":{"status":"available","items":[{"name":"Synthetic market data generated from GBM","provider":null,"kind":"synthetic","access":"unknown","period":null,"universe":null,"quote":"To achieve this, we rely on popular financial models, known for their ability to accurately replicate the dynamics of financial markets, to generate our data."}],"known":[],"sample":{"start":null,"end":null,"market":null,"asset_class":null,"frequency":null},"data_resolution":"unclear"},"transaction_costs":{"status":"available","modeled":"yes","headline_net_of_costs":null,"detail":"Costs are represented by the term -uᵀΩu in the reward function, where Ω is a weighting matrix controlling magnitude of costs.","quote":"−uT t Ωut: Transaction costs. This term corresponds to the cost of transactions. Each change in the positions in the portfolio ut (buying or selling assets) incurs costs, such as brokerage fees or costs of adjusting the portfolio.","source":"evidence_card","rule":"R2","candidates":{"front_matter":"unclear","evidence_card":"yes","evidence_card_quoted":true},"card_detail":"Costs are represented by the term -uᵀΩu in the reward function, where Ω is a weighting matrix controlling magnitude of costs.","card_quote":"−uT t Ωut: Transaction costs. This term corresponds to the cost of transactions. Each change in the positions in the portfolio ut (buying or selling assets) incurs costs, such as brokerage fees or costs of adjusting the portfolio.","meaning":"costs are part of the reported headline results"},"results":{"status":"available","evaluation_type":"trading-pnl","findings":[{"finding":"The proposed G‑Learning approach achieved a Sharpe ratio of 0.483, improving over the prior 0.42 benchmark.","kind":"performance","quote":"Results show that we improved the Sharpe Ratio from 0.42, as suggested by recent studies using the same approach, to a value of 0.483 a notable achievement in highly volatile markets with diversified portfolios."},{"finding":"GIRL parameter optimization (λ = 0.0012 vs. 0.002) yields only a marginal improvement in Sharpe ratio.","kind":"performance","quote":"However, we found that the optimal parameters obtained using the GIRL model (e.g., λ = 0.0012 compared to an initial value of 0.002) result in only a marginal improvement in the Sharpe ratio."},{"finding":"The goal‑based formulation aligns better with investors’ needs than classical Markowitz approaches.","kind":"theoretical","quote":"Our results also emphasize that the goal-based formulation (focused on specific objectives) is better aligned with investors’ needs than Markowitz’s classical approaches."}],"reported_performance":null,"out_of_sample":{"method":"none","headline_out_of_sample":null}},"independent_evidence":{"status":"none_found","supports":[],"contradicts":[],"qualifies":[],"compared_with":32,"citations":{"cited_by_in_corpus":0,"by_independent_authors":0,"how_cited":{"used_as_baseline":0,"uses_method_or_data":0,"extends":0,"discusses_findings":0,"mentions":0,"unclassified":0},"independent_papers":[],"scope":"Citations between papers in this corpus only; citations from outside it are not counted."}},"implementation":{"status":"available","public":false,"code_url":null,"note":"No repository presented by the authors as their own was found in the paper. Absence here is not proof that no code exists."},"replication":{"status":"none_found","card":null,"note":"No replication of this paper has been run by thequant.space yet."},"extraction":{"text_source":"fulltext","model":"openai/gpt-oss-120b","version":1,"extracted_at":"2026-11-14T17:21:10Z"},"provenance":{"claims":"Everything here is what the authors state in the paper. Nothing was re-run or reproduced by the platform.","quotes":"Assumptions, datasets, cost detail and findings were extracted by a language model. Every quote is verbatim paper text. Where an item has `support`, \"full\" means every figure in it appears in the quoted sentences and \"partial\" means a figure is stated elsewhere in the paper; items with a figure found nowhere in the paper were discarded.","datasets_known":"datasets.known lists well-known vendors and public datasets by a stable id, found by a dictionary over the full text where the sentence says the data is used; it is independent of the model and covers only names in the dictionary.","flags":"transaction_costs.modeled, results.evaluation_type and results.out_of_sample.method are platform classifications (structured-decision models); see https://thequant.space/score-guide/#penalty-flags","comparisons":"supports / contradicts / qualifies are a language model's reading of two papers' quoted findings, restricted to closely related papers that share no author. They are pointers to read, not verified replications, and coverage is partial.","implementation":"code_url is a repository the paper itself presents as its own (rule-scored, ambiguous cases judged by a model), checked for liveness when it was recorded."},"docs":"https://thequant.space/agents/"}