Paper: arXiv 2508.18427

Authors: Fabrizio Dimino, Krati Saxena, Bhaskarjit Sarmah, Stefano Pasquali

Abstract

The growing adoption of large language models (LLMs) in finance exposes high-stakes decision-making to subtle, underexamined positional biases. The complexity and opacity of modern model architectures compound this risk. We present the first unified framework and benchmark that not only detects and quantifies positional bias in binary financial decisions but also pinpoints its mechanistic origins within open-source Qwen2.5-instruct models (1.5B-14B). Our empirical analysis covers a novel, finance-authentic dataset revealing that positional bias is pervasive, scale-sensitive, and prone to resurfacing under nuanced prompt designs and investment scenarios, with recency and primacy effects revealing new vulnerabilities in risk-laden contexts. Through transparent mechanistic interpretability, we map how and where bias emerges and propagates within the models to deliver actionable, generalizable insights across prompt types and scales. By bridging domain-specific audit with model interpretability, our work provides a new methodological standard for both rigorous bias diagnosis and practical mitigation, establishing essential guidance for responsible and trustworthy deployment of LLMs in financial systems.

Complexity vs Empirical Score

  • Math Complexity: 4.0/10
  • Empirical Rigor: 7.5/10
  • Quadrant: Street Traders — empirical and applied, lower math complexity

Why this score: The paper employs sophisticated but applied machine learning concepts (positional bias, mechanistic interpretability) without heavy theoretical derivations or dense mathematical formalisms. It demonstrates high empirical rigor with a novel finance-authentic dataset, cross-scale model testing (1.5B-14B parameters), multiple prompt designs, and a clear path to actionable, implementation-ready insights.

Research Flowchart

  flowchart TD
  A["Research Goal: Trace positional bias in LLM financial decisions"] --> B["Methodology: Mechanistic interpretability<br>(Qwen2.5 1.5B-14B)"]
  B --> C["Input: Finance-authentic<br>binary decision dataset"]
  C --> D["Computational Process: Detect, quantify & trace bias"]
  D --> E["Key Findings:<br>- Pervasive & scale-sensitive bias<br>- Mechanistic origins mapped<br>- Recency/Primacy effects in risk contexts"]

Evidence Card

What the authors claim, on what data, and who has checked it. Read from the paper's own text by a language model: every quote is verbatim, nothing was re-run. How to read this card

Proposes

The paper proposes the first unified framework and benchmark to detect, quantify, and mechanistically interpret positional bias in binary financial decisions using Qwen2.5 models.

Source sentence
We present the first unified framework and benchmark that not only detects and quantifies positional bias in binary financial decisions but also pinpoints its mechanistic origins within open-source Qwen2.5-instruct models (1.5B–14B).

Assumes

No explicit assumptions found in the text.

Data

  • novel, finance-authentic dataset benchmark unknown
    Source sentence
    Our empirical analysis covers a novel, finance-authentic dataset revealing that positional bias is pervasive, scale-sensitive, and prone to resurfacing under nuanced prompt designs and investment scenarios, with recency and primacy effects revealing new vulnerabilities in risk-laden contexts.

Costs

Not applicable The paper reports no trading or execution result.

Finds 5

  • Positional bias is pervasive, scale‑sensitive, and exhibits recency and primacy effects across financial prompts. statistical
    Source sentence
    Our empirical analysis covers a novel, finance-authentic dataset revealing that positional bias is pervasive, scale-sensitive, and prone to resurfacing under nuanced prompt designs and investment scenarios, with recency and primacy effects revealing new vulnerabilities in risk-laden contexts.
  • Increasing model size from 1.5B to 14B reduces bias overall, but the Risk category remains stubbornly biased even at large scale. statistical
    Source sentence
    stubbornly biased even at a large scale, suggesting domain-specific factors like volatility and exposure anchor the model to positional cues.
  • Prompt ordering independently influences bias magnitude; simple reordering causes significant shifts, especially for Innovation prompts. statistical
    Source sentence
    Prompt ordering independently influences bias magnitude, with simple reordering causing significant shifts, especially in Innovation, emphasizing the need for deterministic prompt templates or randomized prompting with correction.
  • Prompt framing affects bias: conservative strong wording amplifies primacy bias, while moderate phrasing reduces bias. statistical
    Source sentence
    Conservative, strong wording amplifies positional heuristics, likely reinforcing primacy bias, while Moderate phrasing promotes balanced evaluation and reduces bias.
  • Mechanistic analysis shows bias consistently originates in a stable set of mid‑to‑late transformer layers and a small recurrent group of attention heads acting as core bias engines. other
    Source sentence
    positional bias consistently centers on a stable set of mid-to-late transformer layers and a small, recurrent group of attention heads that act as core “bias engines.”

Checked by others

No other paper in the archive has been found to support or contradict these findings (compared with 28 related papers). Coverage is partial, so this is neither replication nor refutation.

Cited by 5 papers in the archive (3 by independent authors): Eliciting ESG Preferences for Reinforcement Learning-Based … (discusses its findings)

Code

No repository by the authors found in the paper.

Extracted 2026-11-14 · same card as JSON · A language model chose these items: check the source sentence before relying on one.

Cited References (63)

  1. Large language models in finance: Opportunities and challenges (2023)
  2. Predictably biased: The influence of position bias on language model predictions (2020)
  3. Large language models exhibit systematic position bias in multiple-choice questions (2023)
  4. Calibrating factual knowledge in pretrained language models (2021)
  5. Fairness in financial AI: Detecting and mitigating algorithmic bias (2023)
  6. Judgment in managerial decision making (2013)
  7. Global Sustainable Investment Review 2020 (2021)
  8. Social Group Bias in AI Finance (2025) — link
and 55 more
  1. Grammar prompting for domain-specific language generation with large language models (2023)
  2. Grammar-constrained decoding for structured NLP tasks without finetuning (2023) — link
  3. Simulating the Survey of Professional Forecasters (2024)
  4. Large language models as simulated economic agents: What can we learn from homo silicus? (2023)
  5. AI and Operational Losses: Evidence from US Bank Holding Companies (2024)
  6. Analysing the generalisation and reliability of steering vectors (2024)
  7. Fragile Preferences: A Deep Dive Into Order Effects in Large Language Models (2025) — link
  8. Humans or llms as the judge? a study on judgement biases, 2024 (2024)
  9. Are LLMs Rational Investors? A Study on Detecting and Reducing the Financial Bias in LLMs (2024) — link
  10. Evaluating Company-specific Biases in Financial Sentiment Analysis using Large Language Models — → 2411.00420
  11. Assessing look-ahead bias in stock return predictions generated by gpt sentiment analysis — → 2309.17322
  12. Individual comparisons by ranking methods (1945)
  13. Portfolio Selection (1952)
  14. Prospect Theory: An Analysis of Decision under Risk (1979)
  15. Are large language models strategic decision makers? a study of performance and bias in two-player non-zero-sum games (2024) — link
  16. Mechanistic interpretability of large language models with applications to the financial services industry (2024)
  17. Eliminating position bias of language models: A mechanistic approach (2024) — link
  18. Serial position effects of large language models (2024) — link
  19. Unveiling selection biases: Exploring order and token sensitivity in large language models (2024) — link
  20. Fairer preferences elicit improved human-aligned large language model judgments (2024) — link
  21. Can many-shot in-context learning help long-context llm judges? see more, judge better! (2024)
  22. Attention Speaks Volumes: Localizing and Mitigating Bias in Language Models (2024) — link
  23. Small Language Models are the Future of Agentic AI (2025) — link
  24. On positional bias of faithfulness for long-form summarization (2024) — link
  25. How susceptible are llms to influence in prompts? (2024) — link
  26. Decision-making behavior evaluation framework for llms under uncertain context (2024)
  27. Prompt position really matters in few-shot and zero-shot NLU tasks (2023) — link
  28. Estimates of Location Based on Rank Tests (1963) — link
  29. Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing (1995) — link
  30. Bootstrap Methods and Their Application (1997) — link
  31. Systematic evaluation of llm-as-a-judge in llm alignment tasks: Explainable metrics and diverse prompt templates (2024) — link
  32. Dissecting Disposition Effect of Large Language Models in Financial Decisions (2024)
  33. How robust are LLMs to in-context majority label bias? (2023) — link
  34. Social bias evaluation for large language models requires prompt variations (2024) — link
  35. Judging the judges: A systematic investigation of position bias in pairwise comparative assessments by llms (2024)
  36. Mitigate position bias in large language models via scaling a single dimension (2024) — link
  37. Position engineering: Boosting large language models through positional information manipulation (2024) — link
  38. Do RAG Systems Suffer From Positional Bias? (2025) — link
  39. Eliminating Position Bias of Language Models: A Mechanistic Approach (2025) — link
  40. Position of Uncertainty: A Cross-Linguistic Study of Positional Bias in LLMs (2025) — link
  41. Order Matters: Investigate the Position Bias in Multi-constraint Instruction Following (2025) — link
  42. Wait, that’s not an option: LLMs Robustness with Incorrect Multiple-Choice Options (2024) — link
  43. Qwen2.5 Technical Report (2024) — link
  44. Self-Debiasing Models by Conditioning on Their Own Biases (2023)
  45. Interpretability in the Wild: A Circuit for Indirect Object Identification in GPT-2 Small (2022)
  46. Reducing Bias in Language Models via Domain Adapted LoRA Fine-Tuning (2023)
  47. Mitigating Positional Bias in Multiple-Choice QA with Permutation-Based Calibration (2022)
  48. LangFair: A Python Package for Assessing Bias and Fairness in Large Language Model Use Cases (2025) — link
  49. Interpretable LLMs for Credit Risk: A Systematic Review and Taxonomy — → 2506.04290
  50. Dissecting Bias in LLMs: A Mechanistic Interpretability Perspective (2025) — link
  51. Beyond the black box: Interpretability of llms in finance — → 2505.24650
  52. Understanding and mitigating gender bias in llms via interpretable neuron editing (2025) — link
  53. Interpreting bias in large language models: a feature-based approach (2024) — link
  54. Evaluate Bias without Manual Test Sets: A Concept Representation Perspective for LLMs (2025) — link
  55. Unibias: Unveiling and mitigating llm bias through internal attention and ffn manipulation (2024)

4 of 63 cited works are in the corpus; resolved via arXiv source bundles, Semantic Scholar and OpenAlex. Corpus-wide: 2596 linked papers.