Paper: arXiv 2602.23330

Authors: Kunihiro Miyazaki, Takanobu Kawahara, Stephen Roberts, Stefan Zohren

Abstract

The advancement of large language models (LLMs) has accelerated the development of autonomous financial trading systems. While mainstream approaches deploy multi-agent systems mimicking analyst and manager roles, they often rely on abstract instructions that overlook the intricacies of real-world workflows, which can lead to degraded inference performance and less transparent decision-making. Therefore, we propose a multi-agent LLM trading framework that explicitly decomposes investment analysis into fine-grained tasks, rather than providing coarse-grained instructions. We evaluate the proposed framework using Japanese stock data, including prices, financial statements, news, and macro information, under a leakage-controlled backtesting setting. Experimental results show that fine-grained task decomposition significantly improves risk-adjusted returns compared to conventional coarse-grained designs. Crucially, further analysis of intermediate agent outputs suggests that alignment between analytical outputs and downstream decision preferences is a critical driver of system performance. Moreover, we conduct standard portfolio optimization, exploiting low correlation with the stock index and the variance of each system’s output. This approach achieves superior performance. These findings contribute to the design of agent structure and task configuration when applying LLM agents to trading systems in practical settings.

Complexity vs Empirical Score

  • Math Complexity: 2.0/10
  • Empirical Rigor: 7.5/10
  • Quadrant: Street Traders — practical and empirical, lighter on theory

Why this score: The paper provides a strong empirical framework for evaluating multi-agent LLM systems in trading through fine-grained task decomposition, explicitly accounting for look-ahead bias and backtesting on Japanese equities. While mathematical formulas and theoretical proofs are minimal, the empirical design, agent ablation studies, and qualitative analysis make it a highly practical and solid contribution.

Research Flowchart

  flowchart TD
    A["Research Goal: Improve LLM Trading Performance via Fine-Grained Task Decomposition"] --> B["Data Inputs: Japanese Stock Data<br><i>(Prices, Financials, News, Macro)</i>"]
    B --> C["Methodology: Multi-Agent LLM Framework<br><i>(Coarse vs. Fine-Grained Task Decomposition)</i>"]
    C --> D["Computational Process: Leakage-Controlled Backtesting & Output Variance Analysis"]
    D --> E["Portfolio Optimization: Exploiting Low Index Correlation & Model Variance"]
    E --> F["Key Findings: Superior Risk-Adjusted Returns & Importance of Agent-Decision Alignment"]

Cited References (74)

  1. When Wording Steers the Evaluation: Framing Bias in LLM judges (2026) — link
  2. Large Language Model Agents for Investment Management: Foundations, Benchmarks, and Research Frontiers (2025) — link
  3. LLM Company Policies and Policy Implications in Software Organizations (2025) — link
  4. QTMRL: An Agent for Quantitative Trading Decision-Making Based on Multi-Indicator Guided Reinforcement Learning — → 2508.20467
  5. TradingGroup: A Multi-Agent Trading System with Self-Reflection and Data-Synthesis (2025) — link
  6. AlphaAgents: Large Language Model based Multi-Agents for Equity Portfolio Constructions — → 2508.11152
  7. Blueprint First, Model Second: A Framework for Deterministic LLM Workflow (2025) — link
  8. Your AI, Not Your View: The Bias of LLMs in Investment Analysis — → 2507.20957
and 66 more
  1. GUARDIAN: Safeguarding LLM Multi-Agent Collaborations with Temporal Graph Modeling (2025) — link
  2. Using semantic similarity to measure the echo of strategic communications (2025) — link
  3. Finding Optimal Trading History in Reinforcement Learning for Stock Market Trading (2025) — link
  4. HedgeAgents: A Balanced-aware Multi-agent Financial Trading System — → 2502.13165
  5. Decision-informed Neural Networks with Large Language Model Integration for Portfolio Optimization — → 2502.00828
  6. Decomposed Opinion Summarization with Verified Aspect-Aware Modules (2025) — link
  7. TradingAgents: Multi-Agents LLM Financial Trading Framework — → 2412.20138
  8. Agent S: An Open Agentic Framework that Uses Computers Like a Human (2024) — link
  9. Language Models Learn to Mislead Humans via RLHF (2024) — link
  10. Non-Determinism of"Deterministic"LLM Settings (2024) — link
  11. Enhancing Stock Market Forecasts with Double Deep Q-Network in Volatile Stock Market Environments (2024) — link
  12. Aligning Language Models to Explicitly Handle Ambiguity (2024) — link
  13. A Multimodal Foundation Agent for Financial Trading: Tool-Augmented, Diversified, and Generalist — → 2402.18485
  14. FinMem: A Performance-Enhanced LLM Trading Agent With Layered Memory and Character Design — → 2311.13743
  15. An Empirical Study of the Non-Determinism of ChatGPT in Code Generation (2023) — link
  16. MetaGPT: Meta Programming for A Multi-Agent Collaborative Framework (2023)
  17. Alpha-GPT: Human-AI Interactive Alpha Mining for Quantitative Investment — → 2308.00016
  18. Plan-and-Solve Prompting: Improving Zero-Shot Chain-of-Thought Reasoning by Large Language Models (2023) — link
  19. Generative Agents: Interactive Simulacra of Human Behavior (2023) — link
  20. CAMEL: Communicative Agents for “Mind” Exploration of Large Language Model Society (2023) — link
  21. The Impact of AI on Developer Productivity: Evidence from GitHub Copilot (2023) — link
  22. Evaluating Large Language Models Trained on Code (2021) — link
  23. Fightin’ Words: Lexical Feature Selection and Evaluation for Identifying the Content of Political Conflict (2008) — link
  24. Financial Statement Analysis and Security Valuation (2001)
  25. Quanta-gent: Price-driven multi-agent llms for high-frequency trading (2025)
  26. Large Language Model Agents in Finance: A Survey Bridging Research, Practice, and Real-World Deployment (2025) — link
  27. Multi-Agent LLM Debate Unveils the Premise Left Unsaid (2025) — link
  28. A Multi-Agent Framework for Quantitative Finance : An Application to Portfolio Management Analytics (2025) — link
  29. EvanRatliff (2025)
  30. . Large Language Models in Equity Markets:Applications,Techniques,andInsights (2025)
  31. Quantitative vs. fundamental equity investing (2019)
  32. Implementationof awordsegmentationdictionarycalledmecab-ipadic-NEologdandstudyonhowtouseiteffectivelyforinformationretrieval(inJapanese) (2017)
  33. Comparing the post–earnings announcementdriftforsurprisescalculatedfromanalystandtimeseriesforecasts (2006)
  34. MeCab : Yet Another Part-of-Speech and Morphological Analyzer (2005)
  35. Valueinvesting:Theuseofhistoricalfinancialstatement informationtoseparatewinnersfromlosers (2000)
  36. Items (1964) — link
    1. Fincon: A synthesized llm multi-agent system with conceptual verbal reinforcement for enhanced financial decision making
    1. FinHEAR:HumanExpertiseandAdaptiveRisk-AwareTem-poral Reasoning for Financial Decision-Making
    1. Thought communication in multiagent collaboration
  37. 2025.Theillusionofthinking:Understandingthestrengthsandlimitationsofreasoningmodelsviathelensofproblemcomplexity
  38. text-embedding-3-small Model | OpenAI API
    1. Transmission With Machine Language Tokens: A Paradigm forTask-OrientedAgentCommunication
  39. Sector Context: Compare metrics against sector averages to identify Leaders vs. Laggards
    1. From words to returns: sentiment analysis of Japanese 10-K reports using advanced large language models
    1. Generative AI at work
    1. WhartonProfessorSaysAIIsLikean’Intern’Who’LiesaLittle
  40. 2024 GPT-4o system card
    1. FinRobot: An open-source ai agent platform for financial applications using large language models
    1. CanLargeLanguageModelsTrade?TestingFinancial TheorieswithLLMAgentsinMarketSimulations
  41. EDINET
    1. Time machine GPT
    1. Explainabilityforlargelan-guage models: A survey
  42. St. Louis Fed Web Services: FRED® API
  43. AIWikiEditorialTeam.2025.LLMBenchmarkRankings2025|AIModelCompari-sonGuide
  44. : (RoC: ) 1y Ago: 3y Ago: <val [B/S: Assets] Total Assets: (RoC: ) Cash: (RoC )
    1. The State of AI: Global Survey 2025 | McKinsey
    1. The Memo-rization Problem: Can We Trust LLMs’ Economic Forecasts?
  45. ranaroussi/yfinance: Download market data from Yahoo! Finance’s API
  46. The signal line % 𝐷 is computed as the 3-day simple moving average (SMA) of % 𝐾 : % 𝐷 𝑡 = 1 2 ∑︁ % 𝐾 𝑡 − 𝑖
    1. Towards Transparent AI: A Survey on Explainable Large Language Models
    1. Value investing: integrating theory and practice
  47. 2022.React:Synergizingreasoningandactinginlanguagemodels
    1. Proagent: building proactive cooperative agents with large language models
    1. Unleashing Diverse Thinking Modes in LLMs through Multi-Agent Collaboration
    1. A survey of large language models for financial applications: Progress, prospects and challenges
    1. Stock trading strategy developing based on reinforcement learning

9 of 74 cited works are in the corpus; resolved via arXiv source bundles, Semantic Scholar and OpenAlex. Corpus-wide: 2518 linked papers.