Paper: arXiv 2408.06361

Authors: Han Ding, Yinheng Li, Junhao Wang, Hang Chen, Doudou Guo, Yunbai Zhang

Abstract

Trading is a highly competitive task that requires a combination of strategy, knowledge, and psychological fortitude. With the recent success of large language models(LLMs), it is appealing to apply the emerging intelligence of LLM agents in this competitive arena and understanding if they can outperform professional traders. In this survey, we provide a comprehensive review of the current research on using LLMs as agents in financial trading. We summarize the common architecture used in the agent, the data inputs, and the performance of LLM trading agents in backtesting as well as the challenges presented in these research. This survey aims to provide insights into the current state of LLM-based financial trading agents and outline future research directions in this field.

Complexity vs Empirical Score

  • Math Complexity: 3.0/10
  • Empirical Rigor: 5.5/10
  • Quadrant: Street Traders — empirical and applied, lower math complexity

Why this score: The paper is a survey discussing agent architectures and data inputs for trading, presenting low mathematical density but referencing backtesting results and implementation-heavy frameworks like reinforcement learning.

Research Flowchart

  flowchart TD
  A["Research Goal: Assessing LLM Agents<br>in Financial Trading"] --> B["Methodology: Literature Survey<br>Architecture & Data Synthesis"]
  B --> C["Data Inputs:<br>Market Data & News/Text"]
  C --> D["Computational Process:<br>LLM Agent Architecture<br>Analysis & Backtesting"]
  D --> E{"Outcome: Performance<br>in Backtesting"}
  E -->|"Success/Failure"| F["Key Findings:<br>Current State & Future Directions"]
  F --> G["Challenges:<br>Data, Regulation, &<br>Model Limitations"]

Evidence Card

What the authors claim, on what data, and who has checked it. Read from the paper's own text by a language model: every quote is verbatim, nothing was re-run. How to read this card

Proposes

We provide a comprehensive review of current research on using large language models as agents in financial trading.

Source sentence
In this survey, we provide a comprehensive review of the current research on using LLMs as agents in financial trading.

Assumes 1

  • Trading results are evaluated without accounting for transaction costs. execution
    Source sentence
    One observation we had is that while both risk and profit metrics are commonly used, few studies consider trading costs in their evaluations. • Cumulative Return: Cumulative Return = 𝑃𝑡−𝑃0 𝑃0  × 100% where: – 𝑃𝑡is the ending price (or value) at time 𝑡 – 𝑃0 is the initial price (or value) at the beginning • Annualized Return Annualized Return =  𝑃𝑡 𝑃0  1 𝑡 −1 where: – 𝑃𝑡is the ending price (or value) at time 𝑡 –

Data

No dataset named in the text.

Costs

Unclear - sources disagree The platform classifier and the paper-text extraction give different answers, so no value is asserted.

Platform classifier: Not applicable

Paper text extraction: Not modeled

Source sentence (the authors' words)
One observation we had is that while both risk and profit metrics are commonly used, few studies consider trading costs in their evaluations. • Cumulative Return: Cumulative Return = 𝑃𝑡−𝑃0 𝑃0  × 100% where: – 𝑃𝑡is the ending price (or value) at time 𝑡 – 𝑃0 is the initial price (or value) at the beginning • Annualized Return Annualized Return =  𝑃𝑡 𝑃0  1 𝑡 −1 where: – 𝑃𝑡is the ending price (or value) at time 𝑡 –

Finds 3

  • LLM agents have achieved annualized returns ranging from 15% to 30% over the strongest baseline in backtesting with real market data. performance
    Source sentence
    Our survey[8, 29, 53, 57] shows that LLM agents have achieved annualized return ranging from 15% to 30% over the strongest baseline during backtesting period with real market data, which demonstrates the great potential of using LLM in financial trading.
  • GPT‑3.5 is used more frequently than GPT‑4, indicating a preference for its cost‑effectiveness and lower latency. other
    Source sentence
    Notably, GPT3.5 is even used more frequently than GPT4, indicating a preference on its cost-effectiveness and lower latency.
  • All surveyed LLM‑powered agents use textual financial data as input. other
    Source sentence
    We found all LLM powered agents reviewed in this paper use textual financial data as input.

Checked by others

No other paper in the archive has been found to support or contradict these findings. Coverage is partial, so this is neither replication nor refutation.

Cited by 10 papers in the archive (10 by independent authors): Can LLM-based Financial Investing Strategies Outperform the … (uses its method or data)

Code

No repository by the authors found in the paper.

Extracted 2026-11-14 · same card as JSON · A language model chose these items: check the source sentence before relying on one.

Cited References (71)

  1. Can ChatGPT Forecast Stock Price Movements? Return Predictability and Large Language Models — → 2304.07619
  2. FinMem: A Performance-Enhanced LLM Trading Agent with Layered Memory and Character Design — → 2311.13743
  3. A Multimodal Foundation Agent for Financial Trading: Tool-Augmented, Diversified, and Generalist — → 2402.18485
  4. FinLlama: Financial Sentiment Classification for Algorithmic Trading Applications — → 2403.12285
  5. Portfolio Performance Based on LLM News Scores and Related Economical Analysis (2024) — link
  6. GPT’s idea of stock factors (2024) — link
  7. Unveiling the Potential of Sentiment: Can Large Language Models Predict Chinese Stock Price Movements? — → 2306.14222
  8. Sentiment trading with large language models — → 2412.19245
and 63 more
  1. Mutual Fund Performance (1966) — link
  2. How can we use ChatGPT better: A research of API-Enhanced ChatGPT in stock prediction (2024) — link
  3. Can Large Language Models Beat Wall Street? Unveiling the Potential of AI in Stock Selection — → 2401.03737
  4. Information Coefficient as a Performance Measure of Stock Selection Models (2020) — link
  5. QuantAgent: Seeking Holy Grail in Trading by Self-Improving Large Language Model — → 2402.03755
  6. LLMFactor: Extracting Profitable Factors through Prompts for Explainable Stock Movement Prediction (2024) — link
  7. Generative Agents: Interactive Simulacra of Human Behavior (2023) — link
  8. S&P 500 Index (2024) — link
  9. CSI 300 Index (2024) — link
  10. Ethereum: A Decentralized Platform (2024) — link
  11. TradingGPT: Multi-Agent System with Layered Memory and Distinct Characters for Enhanced Financial Trading Performance — → 2309.03736
  12. Designing Heterogeneous LLM Agents for Financial Sentiment Analysis (2024) — link
  13. Improving Factuality and Reasoning in Language Models through Multiagent Debate (2023) — link
  14. Alpha-gpt: Human-ai interactive alpha mining for quantitative investment — → 2308.00016
  15. Good debt or bad debt: Detecting semantic orientations in economic texts (2014)
  16. Financial sentiment analysis: an investigation into common mistakes and silver bullets (2020)
  17. Understanding emojis for financial sentiment analysis (2023)
  18. Www'18 open challenge: financial opinion mining and question answering (2018)
  19. SEntFiN 1.0: Entity-aware sentiment analysis for financial news (2022)
  20. Training language models to follow instructions with human feedback (2022) — link
  21. RLAIF: Scaling Reinforcement Learning from Human Feedback with AI Feedback (2023) — link
  22. Learning to Generate Explainable Stock Predictions using Self-Reflective Large Language Models — → 2402.03659
  23. StockGPT: A GenAI Model for Stock Prediction and Trading — → 2404.05101
  24. A Deep Reinforcement Learning Framework for the Financial Portfolio Management Problem (2017) — link
  25. Integrating Stock Features and Global Information via Large Language Models for Enhanced Stock Return Prediction — → 2310.05627
  26. A Practical Survey on Zero-shot Prompt Design for In-context Learning (2023) — link
  27. LightGBM: A Highly Efficient Gradient Boosting Decision Tree (2017) — link
  28. Long Short-Term Memory (1997) — link
  29. Attention Is All You Need (2023) — link
  30. Understanding Random Forests: From Theory to Practice (2015) — link
  31. A General Framework on Enhancing Portfolio Management with Reinforcement Learning (2023) — link
  32. Proximal Policy Optimization Algorithms (2017) — link
  33. Playing Atari with Deep Reinforcement Learning (2013) — link
  34. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding (2019) — link
  35. Large Language Models can Strategically Deceive their Users when Put Under Pressure (2024)
  36. FinVerse: An Autonomous Agent System for Versatile Financial Analysis (2024) — link
  37. Alpha-GPT 2.0: Human-in-the-Loop AI for Quantitative Investment — → 2402.09746
  38. The Prompt Report: A Systematic Survey of Prompting Techniques (2024) — link
  39. Towards Mitigating Hallucination in Large Language Models via Self-Reflection (2023) — link
  40. A survey on large language model based autonomous agents (2024) — link
  41. Evaluating large language models as agents in the clinic (2024) — link
  42. Large Language Models in Finance: A Survey — → 2311.10723
  43. Simulating Classroom Education with LLM-Empowered Agents (2024) — link
  44. A Survey of Large Language Models in Finance (FinLLMs) (2024) — link
  45. Language Models are Few-Shot Learners (2020) — link
  46. LLMs for Financial Advisement: A Fairness and Efficacy Study in Personal Decision Making (2023) — link
  47. Value and Momentum Everywhere (2013) — link
  48. Qwen Technical Report (2023) — link
  49. Baichuan 2: Open Large-scale Language Models (2023) — link
  50. The Antisocial Network: The GameStop Short Squeeze and the Ragtag Group of Amateur Traders That Brought Wall Street to Its Knees (2021) — link
  51. When AI Meets Finance (StockAgent): Large Language Model- based Stock Trading in Simulated Real-world Environments — → 2407.18957
  52. Relative Strength Index (RSI) — link
  53. MACD (Moving Average Convergence Divergence) (2023) — link
  54. Proximal Policy Optimization Algorithms (2017) — link
  55. Measuring Mathematical Problem Solving With the MATH Dataset (2021) — link
  56. GPT-4V(ision) System Card (2023) — link
  57. Predicting Stock Market Indicators Through Twitter “I hope it is not as bad as I fear” (2011) — link
  58. Stock Price Prediction Leveraging Reddit: The Role of Trust Filter and Sliding Window (2021) — link
  59. Evaluating Impact of Social Media Posts by Executives on Stock Prices (2023) — link
  60. Memory: enduring traces of perceptual and reflective attention (2011) — link
  61. Visual Instruction Tuning (2023) — link
  62. GPT-4 Technical Report (2024) — link
  63. Generative Agents: Interactive Simulacra of Human Behavior (2023) — link

16 of 71 cited works are in the corpus; resolved via arXiv source bundles, Semantic Scholar and OpenAlex. Corpus-wide: 2596 linked papers.