Paper: arXiv 2408.06361
Authors: Han Ding, Yinheng Li, Junhao Wang, Hang Chen, Doudou Guo, Yunbai Zhang
Abstract
Trading is a highly competitive task that requires a combination of strategy, knowledge, and psychological fortitude. With the recent success of large language models(LLMs), it is appealing to apply the emerging intelligence of LLM agents in this competitive arena and understanding if they can outperform professional traders. In this survey, we provide a comprehensive review of the current research on using LLMs as agents in financial trading. We summarize the common architecture used in the agent, the data inputs, and the performance of LLM trading agents in backtesting as well as the challenges presented in these research. This survey aims to provide insights into the current state of LLM-based financial trading agents and outline future research directions in this field.
Complexity vs Empirical Score
- Math Complexity: 3.0/10
- Empirical Rigor: 5.5/10
- Quadrant: Street Traders — empirical and applied, lower math complexity
Why this score: The paper is a survey discussing agent architectures and data inputs for trading, presenting low mathematical density but referencing backtesting results and implementation-heavy frameworks like reinforcement learning.
Research Flowchart
flowchart TD
A["Research Goal: Assessing LLM Agents<br>in Financial Trading"] --> B["Methodology: Literature Survey<br>Architecture & Data Synthesis"]
B --> C["Data Inputs:<br>Market Data & News/Text"]
C --> D["Computational Process:<br>LLM Agent Architecture<br>Analysis & Backtesting"]
D --> E{"Outcome: Performance<br>in Backtesting"}
E -->|"Success/Failure"| F["Key Findings:<br>Current State & Future Directions"]
F --> G["Challenges:<br>Data, Regulation, &<br>Model Limitations"]
Evidence Card
What the authors claim, on what data, and who has checked it. Read from the paper's own text by a language model: every quote is verbatim, nothing was re-run. How to read this card
Proposes
We provide a comprehensive review of current research on using large language models as agents in financial trading.
Source sentence
In this survey, we provide a comprehensive review of the current research on using LLMs as agents in financial trading.
Assumes 1
- Trading results are evaluated without accounting for transaction costs. execution
Source sentence
One observation we had is that while both risk and profit metrics are commonly used, few studies consider trading costs in their evaluations. • Cumulative Return: Cumulative Return = 𝑃𝑡−𝑃0 𝑃0 × 100% where: – 𝑃𝑡is the ending price (or value) at time 𝑡 – 𝑃0 is the initial price (or value) at the beginning • Annualized Return Annualized Return = 𝑃𝑡 𝑃0 1 𝑡 −1 where: – 𝑃𝑡is the ending price (or value) at time 𝑡 –
Data
No dataset named in the text.
Costs
Unclear - sources disagree
Source sentence (the authors' words)
One observation we had is that while both risk and profit metrics are commonly used, few studies consider trading costs in their evaluations. • Cumulative Return: Cumulative Return = 𝑃𝑡−𝑃0 𝑃0 × 100% where: – 𝑃𝑡is the ending price (or value) at time 𝑡 – 𝑃0 is the initial price (or value) at the beginning • Annualized Return Annualized Return = 𝑃𝑡 𝑃0 1 𝑡 −1 where: – 𝑃𝑡is the ending price (or value) at time 𝑡 –
Finds 3
- LLM agents have achieved annualized returns ranging from 15% to 30% over the strongest baseline in backtesting with real market data. performance
Source sentence
Our survey[8, 29, 53, 57] shows that LLM agents have achieved annualized return ranging from 15% to 30% over the strongest baseline during backtesting period with real market data, which demonstrates the great potential of using LLM in financial trading.
- GPT‑3.5 is used more frequently than GPT‑4, indicating a preference for its cost‑effectiveness and lower latency. other
Source sentence
Notably, GPT3.5 is even used more frequently than GPT4, indicating a preference on its cost-effectiveness and lower latency.
- All surveyed LLM‑powered agents use textual financial data as input. other
Source sentence
We found all LLM powered agents reviewed in this paper use textual financial data as input.
Checked by others
No other paper in the archive has been found to support or contradict these findings. Coverage is partial, so this is neither replication nor refutation.
10 papers in the archive : Can LLM-based Financial Investing Strategies Outperform the …
Code
No repository by the authors found in the paper.
Extracted 2026-11-14 · same card as JSON · A language model chose these items: check the source sentence before relying on one.
Cited References (71)
- Can ChatGPT Forecast Stock Price Movements? Return Predictability and Large Language Models — → 2304.07619
- FinMem: A Performance-Enhanced LLM Trading Agent with Layered Memory and Character Design — → 2311.13743
- A Multimodal Foundation Agent for Financial Trading: Tool-Augmented, Diversified, and Generalist — → 2402.18485
- FinLlama: Financial Sentiment Classification for Algorithmic Trading Applications — → 2403.12285
- Portfolio Performance Based on LLM News Scores and Related Economical Analysis (2024) — link
- GPT’s idea of stock factors (2024) — link
- Unveiling the Potential of Sentiment: Can Large Language Models Predict Chinese Stock Price Movements? — → 2306.14222
- Sentiment trading with large language models — → 2412.19245
and 63 more
- Mutual Fund Performance (1966) — link
- How can we use ChatGPT better: A research of API-Enhanced ChatGPT in stock prediction (2024) — link
- Can Large Language Models Beat Wall Street? Unveiling the Potential of AI in Stock Selection — → 2401.03737
- Information Coefficient as a Performance Measure of Stock Selection Models (2020) — link
- QuantAgent: Seeking Holy Grail in Trading by Self-Improving Large Language Model — → 2402.03755
- LLMFactor: Extracting Profitable Factors through Prompts for Explainable Stock Movement Prediction (2024) — link
- Generative Agents: Interactive Simulacra of Human Behavior (2023) — link
- S&P 500 Index (2024) — link
- CSI 300 Index (2024) — link
- Ethereum: A Decentralized Platform (2024) — link
- TradingGPT: Multi-Agent System with Layered Memory and Distinct Characters for Enhanced Financial Trading Performance — → 2309.03736
- Designing Heterogeneous LLM Agents for Financial Sentiment Analysis (2024) — link
- Improving Factuality and Reasoning in Language Models through Multiagent Debate (2023) — link
- Alpha-gpt: Human-ai interactive alpha mining for quantitative investment — → 2308.00016
- Good debt or bad debt: Detecting semantic orientations in economic texts (2014)
- Financial sentiment analysis: an investigation into common mistakes and silver bullets (2020)
- Understanding emojis for financial sentiment analysis (2023)
- Www'18 open challenge: financial opinion mining and question answering (2018)
- SEntFiN 1.0: Entity-aware sentiment analysis for financial news (2022)
- Training language models to follow instructions with human feedback (2022) — link
- RLAIF: Scaling Reinforcement Learning from Human Feedback with AI Feedback (2023) — link
- Learning to Generate Explainable Stock Predictions using Self-Reflective Large Language Models — → 2402.03659
- StockGPT: A GenAI Model for Stock Prediction and Trading — → 2404.05101
- A Deep Reinforcement Learning Framework for the Financial Portfolio Management Problem (2017) — link
- Integrating Stock Features and Global Information via Large Language Models for Enhanced Stock Return Prediction — → 2310.05627
- A Practical Survey on Zero-shot Prompt Design for In-context Learning (2023) — link
- LightGBM: A Highly Efficient Gradient Boosting Decision Tree (2017) — link
- Long Short-Term Memory (1997) — link
- Attention Is All You Need (2023) — link
- Understanding Random Forests: From Theory to Practice (2015) — link
- A General Framework on Enhancing Portfolio Management with Reinforcement Learning (2023) — link
- Proximal Policy Optimization Algorithms (2017) — link
- Playing Atari with Deep Reinforcement Learning (2013) — link
- BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding (2019) — link
- Large Language Models can Strategically Deceive their Users when Put Under Pressure (2024)
- FinVerse: An Autonomous Agent System for Versatile Financial Analysis (2024) — link
- Alpha-GPT 2.0: Human-in-the-Loop AI for Quantitative Investment — → 2402.09746
- The Prompt Report: A Systematic Survey of Prompting Techniques (2024) — link
- Towards Mitigating Hallucination in Large Language Models via Self-Reflection (2023) — link
- A survey on large language model based autonomous agents (2024) — link
- Evaluating large language models as agents in the clinic (2024) — link
- Large Language Models in Finance: A Survey — → 2311.10723
- Simulating Classroom Education with LLM-Empowered Agents (2024) — link
- A Survey of Large Language Models in Finance (FinLLMs) (2024) — link
- Language Models are Few-Shot Learners (2020) — link
- LLMs for Financial Advisement: A Fairness and Efficacy Study in Personal Decision Making (2023) — link
- Value and Momentum Everywhere (2013) — link
- Qwen Technical Report (2023) — link
- Baichuan 2: Open Large-scale Language Models (2023) — link
- The Antisocial Network: The GameStop Short Squeeze and the Ragtag Group of Amateur Traders That Brought Wall Street to Its Knees (2021) — link
- When AI Meets Finance (StockAgent): Large Language Model- based Stock Trading in Simulated Real-world Environments — → 2407.18957
- Relative Strength Index (RSI) — link
- MACD (Moving Average Convergence Divergence) (2023) — link
- Proximal Policy Optimization Algorithms (2017) — link
- Measuring Mathematical Problem Solving With the MATH Dataset (2021) — link
- GPT-4V(ision) System Card (2023) — link
- Predicting Stock Market Indicators Through Twitter “I hope it is not as bad as I fear” (2011) — link
- Stock Price Prediction Leveraging Reddit: The Role of Trust Filter and Sliding Window (2021) — link
- Evaluating Impact of Social Media Posts by Executives on Stock Prices (2023) — link
- Memory: enduring traces of perceptual and reflective attention (2011) — link
- Visual Instruction Tuning (2023) — link
- GPT-4 Technical Report (2024) — link
- Generative Agents: Interactive Simulacra of Human Behavior (2023) — link
16 of 71 cited works are in the corpus; resolved via arXiv source bundles, Semantic Scholar and OpenAlex. Corpus-wide: 2596 linked papers.