What LLM Trading Agents Actually Do in Production: A Six-Month, Population-Scale Record from Two Fleets
Summary
This paper presents a six-month, population-scale analysis of LLM trading agents in production, finding that their behavior is primarily driven by interface design, exhibits volatility-blind sizing, and lacks a directional trading edge.
View Cached Full Text
Cached at: 09/09/26, 04:30 AM
Paper page - What LLM Trading Agents Actually Do in Production: A Six-Month, Population-Scale Record from Two Fleets
Source: https://huggingface.co/papers/2609.05663 Published on Sep 4
·
Submitted byhttps://huggingface.co/poofuse
Poofon Sep 9
Abstract
Autonomous language-model trading agents across production systems show behavior driven by interface design rather than strategy, exhibit volatility-blind sizing, fail to capture favorable price excursions, and display no directional edge, with frontier model decision quality statistically indistinguishable across families.
We present a continuous, population-scale measurement record of autonomous language-model trading agents operating in production across two systems with one design lineage: DX Terminal Pro (3,505 user-funded vaults trading real ETH in Base memecoin markets for 21 days, February to March 2026) and the DXAP live alpha fleet (500 to 599 user-created agents all-history, 91 to 117 concurrently active, trading Hyperliquid perpetuals, June to August 2026). The record spans roughly six months, 7.5M single-model invocationswith about 300K onchain actions, and a further 231,638multi-tool turnsproducing 14,596 fills. Four findings carry the paper. First, the operating layer determines behavior more than anything written in strategy text: a risk slider explains leverage (+0.425 per level), agent fixed effects absorb 60% of variance, and a leaderboard render boundary causally routes selection (regression discontinuity 1.75x at the top-3 cut). Second, sizing is volatility-blind: median leverage is 5.0x in every volatility sextile, and one posture-slider cell (11% of the book) holds 62% of liquidations. Third, agents capture almost none of the upside they reach: 43.2% of positions saw at least +300 bps of favorable excursion within 24h, yet 49.3% of those closed with a negative trade return; a mechanical bracket recovers +39.0 bps per position. Fourth, neither fleet shows a directional edge. The DXAP fleet is not profitable and trails a matched Hyperliquid retail benchmark (41% vs. 50% roundtrip win rate). A paired-replay league offrontier modelson 416 captured production scenarios findsdecision qualitystatistically indistinguishable at this horizon, whilechoice stabilitydiffers sharply acrossmodel families. Every headline survives day-clustered inference, permutation nulls, and a common-fee restatement; the paper closes with a 17-rule methodology canon bought with our own retractions.
View arXiv pageView PDFProject pageGitHub0Add to collection
Get this paper in your agent:
hf papers read 2609\.05663
Don’t have the latest CLI?curl \-LsSf https://hf\.co/cli/install\.sh \| bash
Models citing this paper0
No model linking this paper
Cite arxiv.org/abs/2609.05663 in a model README.md to link it from this page.
Datasets citing this paper0
No dataset linking this paper
Cite arxiv.org/abs/2609.05663 in a dataset README.md to link it from this page.
Spaces citing this paper0
No Space linking this paper
Cite arxiv.org/abs/2609.05663 in a Space README.md to link it from this page.
Collections including this paper0
No Collection including this paper
Add this paper to acollectionto link it from this page.
Similar Articles
Agentic Trading: When LLM Agents Meet Financial Markets
This paper presents a systematic survey and evidence map of 77 studies on LLM-based trading agents, finding that architectural experimentation is expanding rapidly but evaluation protocols, execution semantics, and reproducibility remain critical bottlenecks.
TradingAgents: Multi-Agents LLM Financial Trading Framework
This paper introduces TradingAgents, a multi-agent LLM framework that simulates real-world trading firms to improve stock trading performance. It utilizes specialized agents for analysis and risk management, demonstrating superior results in cumulative returns and Sharpe ratio compared to baselines.
Beyond Agent Architecture: Execution Assumptions and Reproducibility in LLM-Based Trading Systems
This paper reviews and audits execution realism in LLM-based trading research, proposing clearer reporting standards for reproducibility and evaluation comparability.
@DanKornas: A single LLM can blur market data, debate, and risk into one opaque answer. This repo splits the work across specialize…
TradingAgents is an open-source multi-agent LLM framework for financial market analysis, routing market data through specialized agents for research.
QuantAgent: Price-Driven Multi-Agent LLMs for High-Frequency Trading
QuantAgent is a multi-agent LLM framework designed specifically for high-frequency trading, using four specialized agents (Indicator, Pattern, Trend, Risk) to make rapid, risk-aware decisions based on short-horizon signals. In zero-shot evaluations across ten financial instruments including Bitcoin and Nasdaq futures, it outperforms existing neural and rule-based baselines in predictive accuracy and cumulative return.