Eluna: An Agentic LLM System for Automating Warehouse Operations with Reasoning and Task Execution

arXiv cs.AI Papers

Summary

Eluna is a graph-guided, multi-agent framework for automating warehouse standard operating procedures, using asymmetric episodic distillation to fine-tune a smaller model that matches or exceeds larger baselines and achieves 94% expert agreement on ticket processing.

arXiv:2607.08960v1 Announce Type: cross Abstract: Warehouse operations are governed by Standard Operating Procedures (SOPs) that encode complex, multi-system decision logic, which must be executed reliably under strict time constraints, yet LLM agents lack mechanisms to enforce procedural compliance and degrade under the context overload full SOP specifications introduce. We present Eluna, a production-deployed agentic system for reliable SOP execution. Eluna is a graph-guided, multi-agent framework that encodes SOPs as directed acyclic graphs with progressive disclosure and delegates independent tasks to parallel sub-agents, each with persistent code execution and live data access. To meet production latency and accuracy needs, we use asymmetric episodic distillation where a strong teacher is improved through episodic error memories, then a smaller student is fine-tuned on the corrected trajectories with memory stripped, internalizing corrections without inference-time overhead. On a 13-task benchmark and two production applications, our fine-tuned models match or exceed their teacher, beat all larger off-the-shelf baselines, and reach 94% expert agreement on the ticket processing application.
Original Article
View Cached Full Text

Cached at: 07/13/26, 07:56 AM

# Eluna: An Agentic LLM System for Automating Warehouse Operations with Reasoning and Task Execution
Source: [https://arxiv.org/html/2607.08960](https://arxiv.org/html/2607.08960)
Ning LiuKalle Kujanpää11footnotemark:1Zhaoxuan Zhu11footnotemark:1P Aditya Sreekar11footnotemark:1Kaiwen Liu Chuanneng SunJorge Marchena MenendezMatthew BalesTianyu Yang Shahnawaz AlamRose YuBaoyuan LiuKristina KlinknerShervin Malmasi

Amazon\.com, Inc\. Fulfillment Technologies and Robotics \{ningliun,malmasi\}@amazon\.com

###### Abstract

Warehouse operations are governed by Standard Operating Procedures \(SOPs\) that encode complex, multi\-system decision logic, which must be executed reliably under strict time constraints, yet LLM agents lack mechanisms to enforce procedural compliance and degrade under the context overload full SOP specifications introduce\. We present Eluna, a production\-deployed agentic system for reliable SOP execution\. Eluna is a graph\-guided, multi\-agent framework that encodes SOPs as directed acyclic graphs with progressive disclosure and delegates independent tasks to parallel sub\-agents, each with persistent code execution and live data access\. To meet production latency and accuracy needs, we use asymmetric episodic distillation where a strong teacher is improved through episodic error memories, then a smaller student is fine\-tuned on the corrected trajectories with memory stripped, internalizing corrections without inference\-time overhead\. On a 13\-task benchmark and two production applications, our fine\-tuned models match or exceed their teacher, beat all larger off\-the\-shelf baselines, and reach 94% expert agreement on the ticket processing application\.

Eluna: An Agentic LLM System for Automating Warehouse Operations with Reasoning and Task Execution

Ning Liu††thanks:Equal contribution\.Kalle Kujanpää11footnotemark:1Zhaoxuan Zhu11footnotemark:1P Aditya Sreekar11footnotemark:1Kaiwen LiuChuanneng SunJorge Marchena MenendezMatthew BalesTianyu YangShahnawaz AlamRose YuBaoyuan LiuKristina KlinknerShervin MalmasiAmazon\.com, Inc\. Fulfillment Technologies and Robotics\{ningliun,malmasi\}@amazon\.com

## 1Introduction

Modern warehouse operations require continuous monitoring, multi\-step diagnosis, and timely intervention across dozens of systems, ranging from robotic conveyance operators tracing threshold breaches to root causes within minutes, to inventory ticket processing that queries state, validates constraints, and submits physical item picks across many systems per ticket\. Robotic conveyance diagnosis and ticket processing are two among many such workflows, each governed by Standard Operating Procedures \(SOPs\): directed decision pathways with prescribed steps, dependencies, quantitative thresholds, and constraints that must be followed faithfully\. Today much of their execution is manual, slow, and error\-prone, and delays in diagnosis directly degrade throughput, making automated SOP execution a pressing business need\.

Large language models reason wellWeiet al\.\([2022](https://arxiv.org/html/2607.08960#bib.bib1)\); Kojimaet al\.\([2022](https://arxiv.org/html/2607.08960#bib.bib3)\), but agentic frameworks such as ReActYaoet al\.\([2023](https://arxiv.org/html/2607.08960#bib.bib15)\)and ReflexionShinnet al\.\([2024](https://arxiv.org/html/2607.08960#bib.bib28)\)rely on loosely structured prompts with no mechanism to strongly guide SOP compliance, so a capable model can still deviate from prescribed decision paths\. Recent benchmarks confirm this gap on workflow\-guided tasksXiaoet al\.\([2024](https://arxiv.org/html/2607.08960#bib.bib48)\); Wanget al\.\([2025](https://arxiv.org/html/2607.08960#bib.bib51)\), industrial SOP\-followingNandiet al\.\([2025](https://arxiv.org/html/2607.08960#bib.bib50)\), and operational diagnostics where even SOP\-enhanced multi\-agent systems plateau in performancePeiet al\.\([2025](https://arxiv.org/html/2607.08960#bib.bib49)\)\. A core bottleneck is context overload: with the full SOP in view, performance degrades as complex workflows overwhelm the model’s ability to select relevant actionsXiaoet al\.\([2024](https://arxiv.org/html/2607.08960#bib.bib48)\); Peiet al\.\([2025](https://arxiv.org/html/2607.08960#bib.bib49)\)\. This plateau holds regardless of model scale, and prompting alone is insufficient without domain\-specific trainingNandiet al\.\([2025](https://arxiv.org/html/2607.08960#bib.bib50)\)\.

We present a graph\-guided agent framework that addresses these challenges through a unified execution model\. SOPs are encoded as directed acyclic graphs, and progressive disclosure surfaces only the reachable subgraph and node\-level specifications on demand\. A main agent orchestrates traversal and delegates independent node evaluations to parallel sub\-agents in isolated contexts, each with a persistent code interpreter \(the CodeAct paradigm ofWanget al\.\([2024](https://arxiv.org/html/2607.08960#bib.bib20)\)\) and access to real\-time data via the Model Context ProtocolAnthropic \([2024](https://arxiv.org/html/2607.08960#bib.bib10)\), providing context isolation and parallelism while guiding the agent toward procedural compliance\. Together, progressive disclosure and sub\-agent isolation address context overload\. Each operational use case is packaged as a self\-contained*Skill*111[https://agentskills\.io/](https://agentskills.io/): a bundle comprising the decision graph, use\-case\-specific tools, node specifications, and execution instructions\.loaded on demand, so new workflows need no bespoke systems\. Since prompting alone is insufficientNandiet al\.\([2025](https://arxiv.org/html/2607.08960#bib.bib50)\), we pair the framework with a trajectory\-centric training pipeline where episodic learning corrects a strong teacher’s trajectories without weight updates, and a smaller, low\-latency student is fine\-tuned without episodic memory \(asymmetric episodic distillation\), internalizing the episodic corrections in its weights rather than depending on them at inference\. We make three contributions:

- •Agraph\-guided skill\-based agent frameworkthat encodes SOPs as directed acyclic graphs with progressive disclosure, and uses hierarchical multi\-agent execution with parallel sub\-agent delegation for scalable, procedurally compliant reasoning across multiple operational use cases\.
- •Atrajectory\-centric training pipeline with asymmetric episodic distillation: episodic learning iteratively improves teacher trajectory quality, and the student is fine\-tuned on per\-turn decomposed trajectories filtered by rejection sampling, with episodic memory stripped, internalizing the episodic corrections in its weights and eliminating inference\-time memory dependence\.
- •Real\-world performanceon a 13\-task operational reasoning benchmark and two production warehouse applications \(robotic conveyance and ticket processing\), demonstrating that a fine\-tuned 32B model outperforms all baselines including its teacher and larger off\-the\-shelf models\. A fine\-tuned 355B model achieves a 94% human\-match on the ticket processing application\.

## 2Related Work

#### Tool\-Augmented Agents and Multi\-Step Reasoning\.

LLM agents have been equipped with code executionGaoet al\.\([2023](https://arxiv.org/html/2607.08960#bib.bib21)\); Wanget al\.\([2024](https://arxiv.org/html/2607.08960#bib.bib20)\), APIsPatilet al\.\([2023](https://arxiv.org/html/2607.08960#bib.bib17)\); Qinet al\.\([2024](https://arxiv.org/html/2607.08960#bib.bib18)\), and standardized tool protocolsAnthropic \([2024](https://arxiv.org/html/2607.08960#bib.bib10)\)\. Multi\-step reasoning methods range from chain\-of\-thoughtWeiet al\.\([2022](https://arxiv.org/html/2607.08960#bib.bib1)\)and tree\-of\-thoughtsYaoet al\.\([2024](https://arxiv.org/html/2607.08960#bib.bib9)\)to interleaved reasoning and actionYaoet al\.\([2023](https://arxiv.org/html/2607.08960#bib.bib15)\)and hierarchical decompositionKhotet al\.\([2023](https://arxiv.org/html/2607.08960#bib.bib13)\); Bestaet al\.\([2024](https://arxiv.org/html/2607.08960#bib.bib12)\)\. These approaches improve general reasoning but rely on loosely structured prompts without mechanisms to enforce deterministic procedural constraints\.

#### Structured Reasoning and Operational AI\.

Multi\-agent frameworks such as AutoGenWuet al\.\([2023](https://arxiv.org/html/2607.08960#bib.bib23)\)and MetaGPTHonget al\.\([2024](https://arxiv.org/html/2607.08960#bib.bib24)\)enable task decomposition across specialized agents\. SOPStructGarget al\.\([2025](https://arxiv.org/html/2607.08960#bib.bib4)\)converts unstructured SOPs into DAGs, but focuses only on structuring rather than execution\. Agent\-SKulkarni \([2025](https://arxiv.org/html/2607.08960#bib.bib5)\)navigates SOPs via prompt\-driven state machines but lacks graph\-guided progressive disclosure, code execution, and post\-training\. Our work integrates SOP graphs into both inference and training\.

#### Trajectory\-Centric Training\.

ReflexionShinnet al\.\([2024](https://arxiv.org/html/2607.08960#bib.bib28)\)and Self\-RefineMadaanet al\.\([2024](https://arxiv.org/html/2607.08960#bib.bib29)\)use iterative feedback to improve trajectories at inference time\. FireActChenet al\.\([2023](https://arxiv.org/html/2607.08960#bib.bib30)\)and AgentTuningZenget al\.\([2024](https://arxiv.org/html/2607.08960#bib.bib31)\)show that fine\-tuning on agent trajectories improves generalization\. Our pipeline differs in two ways: episodic learning improves the*teacher*trajectories used for distillation rather than the deployed model, and training is aligned with graph\-structured procedural logic rather than free\-form tasks\.

## 3A Graph\-Guided Operational Agent

Eluna is a hierarchical multi\-agent framework that addresses the two challenges above \(context overload and use\-case generality\) through graph\-structured progressive disclosure, parallel sub\-agent delegation, and skill packaging\. Figure[1](https://arxiv.org/html/2607.08960#S3.F1)provides an overview\.

![Refer to caption](https://arxiv.org/html/2607.08960v1/x1.png)Figure 1:Overview of the Eluna framework\.Left:Training strategy combining episodic learning for teacher trajectory improvement with turn\-level decomposition for supervised fine\-tuning via LoRA\.Right:system architecture featuring graph\-structured SOP representation, hierarchical multi\-agent design with parallel sub\-agent delegation, and tool\-augmented reasoning through persistent code execution and MCP\-based data access\.### 3\.1Graph\-Structured SOP Representation

Each SOP is a directed acyclic graphG=\(V,E\)G=\(V,E\)with five node types:observations\(detectable conditions\),root causes\(diagnosed causes\),calculations\(metric analysis\),constraints\(preconditions\), andactions\(remediation\)\. Each node has a parameterized specification defining its evaluation procedure, which produces a structured outcome: a boolean, a classification \(e\.g\., a category that routes downstream traversal\), or a computed value\. Edges encode directed dependencies: a single\-node edge activates the child on the boolean outcome of one parent \(holding, or not holding for fallback paths\), while a multi\-node edge requires several parents to hold simultaneously\. A node may have multiple outgoing edges\.

#### Progressive Disclosure\.

Presenting the full graph degrades traversal accuracyLiuet al\.\([2024](https://arxiv.org/html/2607.08960#bib.bib57)\), especially with parallel paths, where the agent conflates branches, omits nodes, or explores irrelevant subtrees\. We disclose the graph at two levels\. First, a retrieval tool runs BFS from the triggered node and returns only the reachable subgraph \(node types, edge relationships, brief descriptions\)\. Second, each node’s full procedural specification \(evaluation logic, required tool calls, thresholds\) is fetched only when the agent begins evaluating it, bounding working context to one node at a time\.

### 3\.2Hierarchical Multi\-Agent Architecture

Eluna uses a two\-level hierarchy: a main agent orchestrates traversal while sub\-agents evaluate individual nodes in parallel\. The main agent holds the retrieved subgraph, selects the next nodes to evaluate from edge dependencies, and issues delegation calls; each sub\-agent receives a fresh context with only the assigned node’s procedural specification, role instructions, and tools\. Action nodes remain with the main agent because they require graph\-level state for sequencing and constraint checking\.

Multiple delegation calls issued in one turn execute in parallel, reducing wall\-clock time to roughly the slowest single evaluation\. Only each sub\-agent’s structured conclusion is returned, so the main agent’s context grows by one summary per node rather than the full investigation history; sub\-agent sessions persist so the main agent can query one for detail without re\-running it, and sub\-agents cannot spawn further sub\-agents\. This isolates tool outputs and intermediate computation within sub\-agent sessions, addressing context overload by construction while the main agent holds only graph structure and node conclusions\. In a parallel effort, we reduce the per\-node sub\-agent overhead by compiling repeated SOP steps into reusable tools at build timeKujanpääet al\.\([2026](https://arxiv.org/html/2607.08960#bib.bib58)\)\.

### 3\.3Skill Packaging

Each warehouse workflow needs its own decision logic, prompts, data sources, and actions\. A custom agent per use case duplicates the execution engine and training pipeline, while a single agent loaded with all use cases suffers context overload and tool\-space conflicts\. The workflow is a more natural packaging unit: we bundle per\-workflow artifacts into a self\-contained*skill*loaded at runtime, following the standardized skill format models are increasingly trained to use\. The framework stays use\-case\-agnostic so the same agent and execution logic serve any loaded skill, and adding a workflow means authoring a skill, not modifying the agent\.

A skill comprises five components: \(1\) the decision graph encoding the SOP as a DAG, \(2\) use\-case\-specific tools accessed via the Model Context ProtocolAnthropic \([2024](https://arxiv.org/html/2607.08960#bib.bib10)\)for querying data and executing actions, \(3\) node detail specifications containing per\-node evaluation logic, \(4\) CodeAct functionsWanget al\.\([2024](https://arxiv.org/html/2607.08960#bib.bib20)\), and \(5\) execution instructions directing traversal strategy \(e\.g\., when to delegate, how to handle constraints\); reference documents for knowledge retrievalSchicket al\.\([2024](https://arxiv.org/html/2607.08960#bib.bib16)\)are bundled as readable files\. When a trigger fires, a skill\-loading tool registers the skill’s tools under a namespace prefix, injects its CodeAct functions into the persistent interpreter as importable modules, and appends its execution instructions, after which the agent has exactly the tools and instructions for the current use case\.

### 3\.4Tool Ecosystem

The agent operates over five tools: a persistent code interpreter for programmatic data manipulation and metric computation; a task\-tracking list that doubles as a steering mechanism to keep traversal on the intended path; MCP\-based data and action accessAnthropic \([2024](https://arxiv.org/html/2607.08960#bib.bib10)\)to operational dashboards; agentic RAGSchicket al\.\([2024](https://arxiv.org/html/2607.08960#bib.bib16)\)for on\-demand knowledge retrieval; and an operative memory that persists across invocations, accumulating knowledge and enabling deduplication of redundant investigations\. Appendix[A](https://arxiv.org/html/2607.08960#A1)details each one\.

Table 1:Operational benchmark: % improvement over the GLM\-4\.5\-Air baseline across 13 tasks\.

## 4Training Strategy

The graph\-guided framework \(Section[3](https://arxiv.org/html/2607.08960#S3)\) is model\-agnostic, but even the largest available models fail to reach reliable accuracy on graph\-structured procedural reasoningNandiet al\.\([2025](https://arxiv.org/html/2607.08960#bib.bib50)\), motivating domain\-specific training\. We design a trajectory\-centric pipeline: a strong teacher generates trajectories within the full framework, episodic learningShinnet al\.\([2024](https://arxiv.org/html/2607.08960#bib.bib28)\)iteratively corrects the teacher’s errors without weight updates, and rejection samplingYuanet al\.\([2023](https://arxiv.org/html/2607.08960#bib.bib55)\)with LLM\-judge evaluationZhenget al\.\([2024a](https://arxiv.org/html/2607.08960#bib.bib32)\)filters the improved trajectories for correctness before fine\-tuning a smaller student that meets the production latency SLA\. Crucially, the episodic memory is used only during teacher trajectory generation and stripped from student training and inference \(asymmetric episodic distillation\), forcing the student to internalize the episodic corrections in its weights and eliminating any runtime memory dependence\. We detail each stage in Appendix[B](https://arxiv.org/html/2607.08960#A2)\.

## 5Experiments

### 5\.1Experimental Setup

The agent framework is implemented using the Strands Agents SDKStrands Agents \([2025](https://arxiv.org/html/2607.08960#bib.bib54)\), following the design in Section[3](https://arxiv.org/html/2607.08960#S3)\. We fine\-tune Qwen3\-32BYanget al\.\([2025](https://arxiv.org/html/2607.08960#bib.bib7)\)and GLM\-4\.5\-AirZenget al\.\([2025](https://arxiv.org/html/2607.08960#bib.bib2)\)with LoRAHuet al\.\([2022](https://arxiv.org/html/2607.08960#bib.bib39)\)on 8,525 training samples \(expanded from trajectories via turn\-level decomposition, Appendix[B](https://arxiv.org/html/2607.08960#A2)\)\. Training and inference details are in Appendix[D](https://arxiv.org/html/2607.08960#A4)\.

#### Datasets

We evaluate on three tasks: anoperational reasoning benchmarkof 13 task types testing capabilities required for warehouse operational reasoning \(1,400 evaluation samples; Table[1](https://arxiv.org/html/2607.08960#S3.T1)\), arobotic conveyance applicationcovering end\-to\-end SOP execution over 1,500 real scenarios, and aticket processing applicationexecuting a 46\-node inventory consolidation SOP on 410 real tickets evaluated against expert annotations\. For the first two, ground truth is generated from real operational data by sampling timestamps, checking root\-node conditions, and running a deterministic SOP implementation where they hold, with temporal partitioning separating training from evaluation\. Ticket processing has no deterministic ground truth, so correctness is estimated from expert review of sampled agent traces\.

#### Evaluation

Claude Sonnet 4 is used as the automated judge of answer correctness for the first two tasks\. On the benchmark, the judge scores model outputs against reference answers\. On the robotic conveyance application, node classifications are extracted from agent trajectories and compared against ground\-truth labels, reporting binary correctness \(per\-node accuracy\) and exact match \(all nodes of a type correct within a scenario\)\. All results are reported as percentage improvement over the GLM\-4\.5\-Air off\-the\-shelf \(OTS\) baseline\.

#### Models

All models are evaluated within the same framework, with identical tools and skills and with episodic memory stripped at inference \(Section[3](https://arxiv.org/html/2607.08960#S3)\)\. Thebaselineis OTS GLM\-4\.5\-Air, a 106B parameter model that meets the production latency SLA, hence the reference point for what is achievable under operational constraints\. GLM\-4\.7 \(355B\), theteacherthat generated training trajectories, is too large to meet that SLA, so it serves as a trajectory generator and upper reference rather than a deployable baseline\. We additionally compare OTS Qwen3\-235B\-A22B\-Thinking and OTS Qwen3\-32B, against our two fine\-tuned models Eluna\-Q \(Qwen3\-32B\) and Eluna\-G \(GLM\-4\.5\-Air\)\. For the ticket task, which runs on a longer interval, we additionally fine\-tune the teacher itself into Eluna\-G\-XL, whose latency meets that interval\.

### 5\.2Results

#### Operational Benchmark\.

Table[1](https://arxiv.org/html/2607.08960#S3.T1)reports per\-task results\. Eluna\-G improves 6\.5% and Eluna\-Q improves 6\.0% over the baseline on average\. Eluna\-Q, trained on GLM\-4\.7 trajectories, matches the teacher \(\+6\.0% vs\. \+6\.1%\) despite being a different and smaller architecture, showing that our pipeline transfers operational reasoning across model families, while OTS Qwen3\-32B averages 38\.0% below the baseline, showing the gap that domain\-specific training closes\. The largest gains concentrate on complex multi\-step tasks like Causal Chain Analysis \(Task 5\), Query Understanding \(Task 8\), and Query Decomposition \(Task 10\)\. These require chaining tool calls and synthesizing across data sources, indicating that training instills operational reasoning rather than single\-step retrieval\.

Table 2:Robotic conveyance application: % improvement over GLM\-4\.5\-Air baseline, averaged over 4 runs\.
#### Robotic Conveyance Application\.

End\-to\-end SOP execution is far harder than isolated benchmark tasks: even with full framework access, the OTS baseline compounds per\-node errors across the traversal and degrades sharply\. We report binary correctness and exact match \(Section[5\.1](https://arxiv.org/html/2607.08960#S5.SS1)\) per node type—observations, root causes, and actions—to reflect the distinct sub\-tasks of detection, diagnosis, and remediation\. Fine\-tuning on complete trajectories closes the gap \(Table[2](https://arxiv.org/html/2607.08960#S5.T2)\): all trained models improve observation binary correctness by over \+49%, root\-cause binary correctness by over \+73%, and exact match by \+84% on root causes and \+165% on actions, with our 32B model matching the GLM\-4\.7 teacher across all metrics—evidence that trajectory distillation transfers full SOP traversal behavior, not just isolated skills\.

Median end\-to\-end execution latency \(wall\-clock from query to final action\) is also reduced by 54\.3% \(Eluna\-Q\) and 54\.8% \(Eluna\-G\) relative to GLM\-4\.7, meeting the latency constraints for real\-time diagnostic support\.

### 5\.3Ablation Studies

Table[3](https://arxiv.org/html/2607.08960#S5.T3)isolates the contribution of episodic learning \(EL\) by varying where EL memory is applied\. Results on Tasks 5 and 10 are reported as percentage change relative to the no\-EL variant\.

Table 3:Episodic learning \(EL\) ablation: % change relative to the no\-EL variant\.Applying EL only to the teacher \(our approach\) yields \+16\.2% on Task 5 and \+28\.6% on Task 10, matching the variant that also feeds EL to the student at inference \(Task 5: \+16\.6%, Task 10: \+25\.3%\) but without its runtime memory dependence\. Training the student with EL yet removing it at inference degrades catastrophically \(Task 5:−\-52\.7%, Task 10:−\-40\.0%\), confirming that our asymmetric design must distill episodic knowledge into parameters rather than expose it as a brittle inference\-time dependency\. Appendix[C](https://arxiv.org/html/2607.08960#A3)details the four variants\.

## 6Deployment and Business Impact

Our framework is deployed in production across multiple operational applications, served on Amazon Bedrock AgentCoreAmazon Web Services \([2026](https://arxiv.org/html/2607.08960#bib.bib56)\)\. The two applications below apply it in contrasting regimes: robotic conveyance is latency\-critical metric analysis, while ticket processing is latency\-insensitive but needs complex reasoning\.

### 6\.1Robotic Conveyance

This metric\-analysis task queries live dashboards to compute metrics, and compares them against thresholds over a 63\-node SOP graph whose high branching factor drives parallel sub\-agent delegation\. A degraded station can back up the main conveyor and erode facility\-wide throughput in minutes, so diagnosis must be fast and correct\.

In production deployment at a warehouse, the agent has processed roughly 8,000 triggers, producing 3,435 process alerts and 1,078 maintenance tickets\. SOP adherence is near\-perfect: SME review of agent trajectories finds the execution correct\. The remaining errors trace to gaps in the SOP specification and upstream data quality rather than to agent reasoning\. Prior to deployment, operators manually interpreted dashboards, navigated SOPs, and coordinated corrective actions\. Early deployment feedback indicates a300%300\\%speedup in resolution time while reducing cognitive load and improving SOP adherence consistency\.

### 6\.2Ticket Processing

Table 4:Ticket processing: Eluna\-G\-XL \(open\-weight 355B fine\-tune\) correctness \(Appendix[E](https://arxiv.org/html/2607.08960#A5)\)\.This is a language\-reasoning task\. The agent interprets free\-text ticket requests \(expiration, damage, recalls, audits\) and performs multi\-step reasoning over structured inventory records—validating constraints, resolving eligibility, and deciding consolidation—rather than merely parsing the request\. Each request type routes differently, and eligibility depends jointly on item condition and storage\-location type\. The SOP graph contains 46 nodes and is predominantly sequential, with mutually exclusive conditional paths\. The network processes tens of thousands of these tickets daily\. Approximately 80% are handled through an existing scanning workflow\. The remaining 20% require manual desk processing at≈\\approx6 minutes per ticket\. We deploy Eluna\-G\-XL, an open\-weight 355B fine\-tune from the same pipeline\. The agent’s median generation duration is 187s \(p90: 257s, mean: 210s\), below the manual rate\.

The agent automates the digital triage preceding physical inspection: interpreting the request, querying inventory, validating constraints, and submitting the pick, leaving the associate only the inspection\. Precision \(Table[4](https://arxiv.org/html/2607.08960#S6.T4)\) is the operationally critical metric, as a false consolidation submits a pick that cannot be processed, wasting labor and blocking the queue\. Only a small fraction of tickets need manual handling, freeing capacity for substantially larger volumes\.

## 7Conclusion

Deploying Eluna in production surfaced two lessons that generalize beyond our setting\. First, within the graph\-guided framework, distillation beats scale for procedural compliance: a fine\-tuned 32B model matches a far larger teacher and surpasses every OTS model tested, which plateau regardless of size\. Second, the operational constraint of low latency under a production SLA is what forced the asymmetric distillation design, since exposing episodic memory at inference proved a brittle dependency rather than just an accuracy gain\. The residual errors we observe trace to SOP\-specification gaps and upstream data quality rather than agent reasoning, pointing to the SOP authoring and data\-integrity pipeline as the next bottleneck for reliable operational automation\.

## Limitations

Our system is currently deployed on two operational domains; while the skill\-based architecture is designed for generality, transfer to substantially different operational environments remains to be validated empirically\. The episodic learning pipeline assumes access to a capable teacher model and sufficient compute for multiple trajectory generation rounds, which may limit adoption in resource\-constrained settings\. Finally, both episodic learning and fine\-tuning rely on ground\-truth labels, which are expensive and time\-consuming to obtain at scale; reducing this dependence is important future work\.

## References

- Amazon Web Services \(2026\)Amazon bedrock agentcore developer guide\.Note:Accessed: 2026\-06\-04External Links:[Link](https://docs.aws.amazon.com/bedrock-agentcore/latest/devguide/what-is-bedrock-agentcore.html)Cited by:[§6](https://arxiv.org/html/2607.08960#S6.p1.1)\.
- Anthropic \(2024\)Model context protocol\.Note:[https://modelcontextprotocol\.io](https://modelcontextprotocol.io/)Cited by:[Appendix A](https://arxiv.org/html/2607.08960#A1.SS0.SSS0.Px3.p1.1),[§1](https://arxiv.org/html/2607.08960#S1.p3.1),[§2](https://arxiv.org/html/2607.08960#S2.SS0.SSS0.Px1.p1.1),[§3\.3](https://arxiv.org/html/2607.08960#S3.SS3.p2.1),[§3\.4](https://arxiv.org/html/2607.08960#S3.SS4.p1.1)\.
- M\. Besta, N\. Blach, A\. Kubicek, R\. Gerstenberger, M\. Podstawski, L\. Gianinazzi, J\. Gajda, T\. Lehmann, H\. Niewiadomski, P\. Nyczyk, and T\. Hoefler \(2024\)Graph of thoughts: solving elaborate problems with large language models\.InAAAI Conference on Artificial Intelligence,Cited by:[§2](https://arxiv.org/html/2607.08960#S2.SS0.SSS0.Px1.p1.1)\.
- B\. Chen, C\. Shu, E\. Shareghi, N\. Collier, K\. Narasimhan, and S\. Yao \(2023\)FireAct: toward language agent fine\-tuning\.arXiv preprint arXiv:2310\.05915\.Cited by:[§2](https://arxiv.org/html/2607.08960#S2.SS0.SSS0.Px3.p1.1)\.
- L\. Gao, A\. Madaan, S\. Zhou, U\. Alon, P\. Liu, Y\. Yang, J\. Callan, and G\. Neubig \(2023\)PAL: program\-aided language models\.InInternational Conference on Machine Learning,Cited by:[§2](https://arxiv.org/html/2607.08960#S2.SS0.SSS0.Px1.p1.1)\.
- D\. Garg, S\. Zeng, S\. Ganesh, and L\. Ardon \(2025\)Generating structured plan representation of procedures with LLMs\.arXiv preprint arXiv:2504\.00029\.Cited by:[§2](https://arxiv.org/html/2607.08960#S2.SS0.SSS0.Px2.p1.1)\.
- S\. Hong, M\. Zhuge, J\. Chen, X\. Zheng, Y\. Cheng, C\. Zhang, J\. Wang, Z\. Wang, S\. K\. S\. Yau, Z\. Lin,et al\.\(2024\)MetaGPT: meta programming for a multi\-agent collaborative framework\.InInternational Conference on Learning Representations,Cited by:[§2](https://arxiv.org/html/2607.08960#S2.SS0.SSS0.Px2.p1.1)\.
- E\. J\. Hu, Y\. Shen, P\. Wallis, Z\. Allen\-Zhu, Y\. Li, S\. Wang, L\. Wang, and W\. Chen \(2022\)LoRA: low\-rank adaptation of large language models\.InInternational Conference on Learning Representations,Cited by:[Appendix D](https://arxiv.org/html/2607.08960#A4.p1.3),[§5\.1](https://arxiv.org/html/2607.08960#S5.SS1.p1.1)\.
- T\. Khot, H\. Trivedi, M\. Finlayson, Y\. Fu, K\. Richardson, P\. Clark, and A\. Sabharwal \(2023\)Decomposed prompting: a modular approach for solving complex tasks\.InInternational Conference on Learning Representations,Cited by:[§2](https://arxiv.org/html/2607.08960#S2.SS0.SSS0.Px1.p1.1)\.
- T\. Kojima, S\. S\. Gu, M\. Reid, Y\. Matsuo, and Y\. Iwasawa \(2022\)Large language models are zero\-shot reasoners\.InAdvances in Neural Information Processing Systems,Vol\.35\.Cited by:[§1](https://arxiv.org/html/2607.08960#S1.p2.1)\.
- K\. Kujanpää, N\. Liu, S\. Alam, Y\. R\. Sura, T\. Yang, K\. Klinkner, and S\. Malmasi \(2026\)Tool making and self\-evolving LLM agents in low\-latency systems\.arXiv preprint\.Cited by:[§3\.2](https://arxiv.org/html/2607.08960#S3.SS2.p2.1)\.
- M\. Kulkarni \(2025\)Agent\-S: LLM agentic workflow to automate standard operating procedures\.arXiv preprint arXiv:2503\.15520\.Cited by:[§2](https://arxiv.org/html/2607.08960#S2.SS0.SSS0.Px2.p1.1)\.
- W\. Kwon, Z\. Li, S\. Zhuang, Y\. Sheng, L\. Zheng, C\. H\. Yu, J\. E\. Gonzalez, H\. Zhang, and I\. Stoica \(2023\)Efficient memory management for large language model serving with pagedattention\.InProceedings of the ACM SIGOPS 29th Symposium on Operating Systems Principles,Cited by:[Appendix D](https://arxiv.org/html/2607.08960#A4.p1.3)\.
- P\. Lewis, E\. Perez, A\. Piktus, F\. Petroni, V\. Karpukhin, N\. Goyal, H\. Küttler, M\. Lewis, W\. Yih, T\. Rocktäschel,et al\.\(2020\)Retrieval\-augmented generation for knowledge\-intensive NLP tasks\.InAdvances in Neural Information Processing Systems,Vol\.33\.Cited by:[Appendix A](https://arxiv.org/html/2607.08960#A1.SS0.SSS0.Px4.p1.1)\.
- N\. F\. Liu, K\. Lin, J\. Hewitt, A\. Paranjape, M\. Bevilacqua, F\. Petroni, and P\. Liang \(2024\)Lost in the middle: how language models use long contexts\.Transactions of the Association for Computational Linguistics \(TACL\)12,pp\. 157–173\.Cited by:[§3\.1](https://arxiv.org/html/2607.08960#S3.SS1.SSS0.Px1.p1.1)\.
- A\. Madaan, N\. Tandon, P\. Gupta, S\. Hallinan, L\. Gao, S\. Wiegreffe, U\. Alon, N\. Dziri, S\. Prabhumoye, Y\. Yang,et al\.\(2024\)Self\-refine: iterative refinement with self\-feedback\.InAdvances in Neural Information Processing Systems,Vol\.36\.Cited by:[§2](https://arxiv.org/html/2607.08960#S2.SS0.SSS0.Px3.p1.1)\.
- S\. Nandi, A\. Datta, N\. Vichare, I\. Bhattacharya, H\. Raja, J\. Xu, S\. Ray, G\. Carenini, A\. Srivastava, A\. Chan,et al\.\(2025\)Sop\-bench: complex industrial sops for evaluating llm agents\.arXiv preprint arXiv:2506\.08119\.Cited by:[§1](https://arxiv.org/html/2607.08960#S1.p2.1),[§1](https://arxiv.org/html/2607.08960#S1.p3.1),[§4](https://arxiv.org/html/2607.08960#S4.p1.1)\.
- S\. G\. Patil, T\. Zhang, X\. Wang, and J\. E\. Gonzalez \(2023\)Gorilla: large language model connected with massive apis\.arXiv preprint arXiv:2305\.15334\.Cited by:[§2](https://arxiv.org/html/2607.08960#S2.SS0.SSS0.Px1.p1.1)\.
- C\. Pei, Z\. Wang, F\. Liu, Z\. Li, Y\. Liu, X\. He, R\. Kang, T\. Zhang, J\. Chen, J\. Li,et al\.\(2025\)Flow\-of\-action: sop enhanced llm\-based multi\-agent system for root cause analysis\.InCompanion Proceedings of the ACM on Web Conference 2025,pp\. 422–431\.Cited by:[§1](https://arxiv.org/html/2607.08960#S1.p2.1)\.
- Y\. Qin, S\. Liang, Y\. Ye, K\. Zhu, L\. Yan, Y\. Lu, Y\. Lin, X\. Cong, X\. Tang, B\. Qian,et al\.\(2024\)ToolLLM: facilitating large language models to master 16000\+ real\-world apis\.InInternational Conference on Learning Representations,Cited by:[§2](https://arxiv.org/html/2607.08960#S2.SS0.SSS0.Px1.p1.1)\.
- T\. Schick, J\. Dwivedi\-Yu, R\. Dessì, R\. Raileanu, M\. Lomeli, E\. Hambro, L\. Zettlemoyer, N\. Cancedda, and T\. Scialom \(2024\)Toolformer: language models can teach themselves to use tools\.InAdvances in Neural Information Processing Systems,Vol\.36\.Cited by:[Appendix A](https://arxiv.org/html/2607.08960#A1.SS0.SSS0.Px4.p1.1),[§3\.3](https://arxiv.org/html/2607.08960#S3.SS3.p2.1),[§3\.4](https://arxiv.org/html/2607.08960#S3.SS4.p1.1)\.
- N\. Shinn, F\. Cassano, A\. Gopinath, K\. Narasimhan, and S\. Yao \(2024\)Reflexion: language agents with verbal reinforcement learning\.InAdvances in Neural Information Processing Systems,Vol\.36\.Cited by:[Appendix B](https://arxiv.org/html/2607.08960#A2.SS0.SSS0.Px1.p1.1),[§1](https://arxiv.org/html/2607.08960#S1.p2.1),[§2](https://arxiv.org/html/2607.08960#S2.SS0.SSS0.Px3.p1.1),[§4](https://arxiv.org/html/2607.08960#S4.p1.1)\.
- Strands Agents \(2025\)Strands agents sdk\.Note:[https://github\.com/strands\-agents/harness\-sdk](https://github.com/strands-agents/harness-sdk)Accessed: 2026\-06\-04Cited by:[§5\.1](https://arxiv.org/html/2607.08960#S5.SS1.p1.1)\.
- J\. Wang, Z\. Tang, Z\. Jin, H\. Chen, Y\. Jin, P\. Ding, X\. Li, and X\. Cao \(2025\)SOP\-maze: evaluating large language models on complicated business standard operating procedures\.arXiv preprint arXiv:2510\.08942\.Cited by:[§1](https://arxiv.org/html/2607.08960#S1.p2.1)\.
- X\. Wang, Y\. Chen, L\. Yuan, Y\. Zhang, Y\. Li, H\. Peng, and H\. Ji \(2024\)Executable code actions elicit better LLM agents\.InInternational Conference on Machine Learning,Cited by:[Appendix A](https://arxiv.org/html/2607.08960#A1.SS0.SSS0.Px1.p1.1),[§1](https://arxiv.org/html/2607.08960#S1.p3.1),[§2](https://arxiv.org/html/2607.08960#S2.SS0.SSS0.Px1.p1.1),[§3\.3](https://arxiv.org/html/2607.08960#S3.SS3.p2.1)\.
- J\. Wei, X\. Wang, D\. Schuurmans, M\. Bosma, B\. Ichter, F\. Xia, E\. Chi, Q\. Le, and D\. Zhou \(2022\)Chain\-of\-thought prompting elicits reasoning in large language models\.InAdvances in Neural Information Processing Systems,Vol\.35\.Cited by:[§1](https://arxiv.org/html/2607.08960#S1.p2.1),[§2](https://arxiv.org/html/2607.08960#S2.SS0.SSS0.Px1.p1.1)\.
- Q\. Wu, G\. Bansal, J\. Zhang, Y\. Wu, B\. Li, E\. Zhu, L\. Jiang, X\. Zhang, S\. Zhang, J\. Liu,et al\.\(2023\)AutoGen: enabling next\-gen LLM applications via multi\-agent conversation\.arXiv preprint arXiv:2308\.08155\.Cited by:[§2](https://arxiv.org/html/2607.08960#S2.SS0.SSS0.Px2.p1.1)\.
- R\. Xiao, W\. Ma, K\. Wang, Y\. Wu, J\. Zhao, H\. Wang, F\. Huang, and Y\. Li \(2024\)Flowbench: revisiting and benchmarking workflow\-guided planning for llm\-based agents\.InFindings of the Association for Computational Linguistics: EMNLP 2024,pp\. 10883–10900\.Cited by:[§1](https://arxiv.org/html/2607.08960#S1.p2.1)\.
- A\. Yang, B\. Yang, B\. Zhang,et al\.\(2025\)Qwen3 technical report\.arXiv preprint arXiv:2505\.09388\.Cited by:[§5\.1](https://arxiv.org/html/2607.08960#S5.SS1.p1.1)\.
- S\. Yao, D\. Yu, J\. Zhao, I\. Shafran, T\. L\. Griffiths, Y\. Cao, and K\. Narasimhan \(2024\)Tree of thoughts: deliberate problem solving with large language models\.InAdvances in Neural Information Processing Systems,Vol\.36\.Cited by:[§2](https://arxiv.org/html/2607.08960#S2.SS0.SSS0.Px1.p1.1)\.
- S\. Yao, J\. Zhao, D\. Yu, N\. Du, I\. Shafran, K\. Narasimhan, and Y\. Cao \(2023\)ReAct: synergizing reasoning and acting in language models\.InInternational Conference on Learning Representations,Cited by:[§1](https://arxiv.org/html/2607.08960#S1.p2.1),[§2](https://arxiv.org/html/2607.08960#S2.SS0.SSS0.Px1.p1.1)\.
- Z\. Yuan, H\. Yuan, C\. Li, G\. Dong, K\. Lu, C\. Tan, C\. Zhou, and J\. Zhou \(2023\)Scaling relationship on learning mathematical reasoning with large language models\.arXiv preprint arXiv:2308\.01825\.Cited by:[Appendix B](https://arxiv.org/html/2607.08960#A2.SS0.SSS0.Px2.p1.4),[§4](https://arxiv.org/html/2607.08960#S4.p1.1)\.
- A\. Zeng, M\. Liu, R\. Lu, B\. Wang, X\. Liu, Y\. Dong, and J\. Tang \(2024\)AgentTuning: enabling generalized agent abilities for LLMs\.arXiv preprint arXiv:2310\.12823\.Cited by:[§2](https://arxiv.org/html/2607.08960#S2.SS0.SSS0.Px3.p1.1)\.
- A\. Zeng, X\. Lv, Q\. Zheng, Z\. Hou, B\. Chen, C\. Xie, C\. Wang, D\. Yin, H\. Zeng, J\. Zhang,et al\.\(2025\)Glm\-4\.5: agentic, reasoning, and coding \(arc\) foundation models\.arXiv preprint arXiv:2508\.06471\.Cited by:[§5\.1](https://arxiv.org/html/2607.08960#S5.SS1.p1.1)\.
- Y\. Zhao, J\. Huang, J\. Hu, X\. Wang, Y\. Mao, D\. Zhang, Z\. Jiang, Z\. Wu, B\. Ai, A\. Wang, W\. Zhou, and Y\. Chen \(2024\)SWIFT:a scalable lightweight infrastructure for fine\-tuning\.External Links:2408\.05517,[Link](https://arxiv.org/abs/2408.05517)Cited by:[Appendix D](https://arxiv.org/html/2607.08960#A4.p1.3)\.
- L\. Zheng, W\. Chiang, Y\. Sheng, S\. Zhuang, Z\. Wu, Y\. Zhuang, Z\. Lin, Z\. Li, D\. Li, E\. Xing,et al\.\(2024a\)Judging LLM\-as\-a\-judge with MT\-Bench and chatbot arena\.InAdvances in Neural Information Processing Systems,Vol\.36\.Cited by:[Appendix B](https://arxiv.org/html/2607.08960#A2.SS0.SSS0.Px2.p1.4),[§4](https://arxiv.org/html/2607.08960#S4.p1.1)\.
- L\. Zheng, L\. Yin, Z\. Xie, C\. Sun, J\. Huang, C\. H\. Yu, S\. Cao, C\. Kozyrakis, I\. Stoica, J\. E\. Gonzalez, C\. Barrett, and Y\. Sheng \(2024b\)SGLang: efficient execution of structured language model programs\.Advances in neural information processing systems37,pp\. 62557–62583\.Cited by:[Appendix D](https://arxiv.org/html/2607.08960#A4.p1.3)\.

## Appendix

## Appendix ATool Ecosystem Details

#### Code Interpreter\.

The agent performs data manipulation and metric computation through a persistent Python interpreter \(CodeActWanget al\.\([2024](https://arxiv.org/html/2607.08960#bib.bib20)\)\) whose state—variables, imports, and intermediate results—is retained across tool invocations within an investigation\. Operational data retrieved through MCP tools is analyzed programmatically—filtering, aggregating, and computing derived quantities—so that only the resulting view enters the model’s input context rather than the full table\. Executing comparisons and threshold checks in code eliminates arithmetic errors that arise when models perform these operations in natural language, and loops over CodeAct functions \(programmatic wrappers exposed within the interpreter\) let the agent batch repeated queries without issuing a separate tool call per iteration\.

#### Task Tracking\.

ATodoListtool, exposed within the interpreter, lets the agent record and update the steps of an investigation as it traverses the decision graph\. Beyond bookkeeping, this serves as a steering mechanism: maintaining an explicit plan keeps the agent on the intended path through parallel branches, surfaces which nodes remain to be evaluated, and reduces premature termination on multi\-step procedures\.

#### MCP Tools\.

Data retrieval and actions are implemented through the Model Context ProtocolAnthropic \([2024](https://arxiv.org/html/2607.08960#bib.bib10)\), providing a standardized interface to warehouse operational dashboards\. Aquery\_metricinterface abstracts tool invocation, accepting a tool name, warehouse identifier, and time range, and returning results as pandas DataFrames for the interpreter to consume\. Decoupling the agent’s reasoning from data\-source implementation lets dashboard backends evolve independently, and thread\-safe connection management enables concurrent queries from parallel sub\-agents\.

#### Agentic RAG\.

The agent augments its decision\-making with domain knowledge retrieved on demand\. Unlike static pipelines that prepend fixed contextLewiset al\.\([2020](https://arxiv.org/html/2607.08960#bib.bib25)\), the agentic RAG component operates via tool\-callingSchicket al\.\([2024](https://arxiv.org/html/2607.08960#bib.bib16)\): when the agent detects a knowledge gap, it formulates a query and invokes a knowledge\-base tool, receiving relevant passages as a tool response\. This grounds reasoning in operational definitions, site\-specific configurations, and historical incident documentation, and lets these definitions be updated without modifying the core SOP structure\.

#### Memory\.

The framework includes an operative memory that persists across agent invocations, accumulating knowledge over time rather than treating each investigation in isolation\. The agent queries memory for prior findings on an entity before investigating and writes its outcome afterward, so observations build into patterns that are not visible within a single run\. Deduplication follows as a direct consequence: when a prior invocation already resolved the same condition or determined that no remediation is possible, the current agent omits the redundant investigation\. Memory entries expire after a configurable window so that stale findings do not suppress legitimate re\-evaluation\.

## Appendix BTraining Pipeline Details

#### Episodic Learning for Teacher Improvement\.

Initial teacher trajectories contain errors such as missed branches and threshold misinterpretations\. Rather than manually correcting these, we iteratively improve the teacher through episodic learningShinnet al\.\([2024](https://arxiv.org/html/2607.08960#bib.bib28)\)without weight updates\. The episodic memory is used only during teacher trajectory generation and is excluded from student training and inference\. After each batch of teacher runs, trajectories are evaluated against ground truth\. For failures, a separate LLM analyzes the error and generates candidate memory entries that would prevent recurrence\. New entries are added, and a consolidation step merges redundant entries to keep the memory compact\. The teacher is re\-run with updated memory injected into its prompt, iterating forNNrounds until convergence\. Providing the memory at inference would yield equivalent accuracy \(our ablation in Section[5\.3](https://arxiv.org/html/2607.08960#S5.SS3)confirms this\), but adds prompt overhead and requires maintaining a growing memory store\. Training on improved trajectories without the memory forces the student to internalize the episodic corrections in its weights, eliminating runtime context dependence\.

#### Trajectory Decomposition and Fine\-Tuning\.

Training trajectories are generated by running the teacher on labeled scenarios within the full framework \(skills, MCP tools, code execution\)\. For each scenario, the teacher queries operational data through the same tools used at inference time, producing a multi\-turn trajectory of reasoning, tool calls, and tool outputs\. Scenarios are sampled with balanced representation across outcome categories, and temporal partitioning enforces train\-test separation\. We decompose each trajectory intoTTtraining samples \(one per agent turn\): thett\-th sample takes as input the conversation history up to turntt\(system prompt, all prior tool calls and outputs, with the model’s own reasoning from prior turns stripped\) and targets the complete reasoning and action for turntt\. Retaining tool outputs is necessary: omitting them would desynchronize the model’s state from the actual execution trace\. Stripping prior reasoning forces independent generation at each turn, focusing the loss on single\-turn decision quality\. Not all trajectories are correct even after episodic improvement\. We apply rejection samplingYuanet al\.\([2023](https://arxiv.org/html/2607.08960#bib.bib55)\)with LLM\-judge evaluationZhenget al\.\([2024a](https://arxiv.org/html/2607.08960#bib.bib32)\): numerical outputs are compared with 2% tolerance, and categorical outputs require exact match\. Only fully correct trajectories are retained for fine\-tuning\.

## Appendix CEpisodic Learning Ablation Details

To isolate the impact of episodic learning and understand whether asymmetric distillation is necessary, an ablation is performed on Tasks 5 and 10 from the benchmark \(Table[3](https://arxiv.org/html/2607.08960#S5.T3)\)\. Four variants are tested: \(1\) no EL anywhere, \(2\) EL in teacher only \(our approach\), \(3\) EL memory provided to the student during both training and inference, and \(4\) EL memory provided during student training only, removed at inference\. Applying EL only to the teacher \(our approach\) yields \+16\.2% on Task 5 and \+28\.6% on Task 10 over the no\-EL variant\. When EL is given to the student at both training and evaluation, comparable accuracy is reached \(\+16\.6%, \+25\.3%\), but an inference\-time dependence on the growing EL context is introduced, adding latency for no accuracy gain\. Training with EL but evaluating without it degrades catastrophically \(−\-52\.7%,−\-40\.0%\), falling below even the no\-EL variant\. This shows that naively exposing the student to episodic context creates a brittle dependency\. Our asymmetric design distills the episodic corrections into the student’s weights, removing any inference\-time memory requirement\.

## Appendix DTraining and Inference Details

Models are fine\-tuned using MS\-SWIFTZhaoet al\.\([2024](https://arxiv.org/html/2607.08960#bib.bib53)\)with LoRAHuet al\.\([2022](https://arxiv.org/html/2607.08960#bib.bib39)\)\. For Qwen3\-32B, we use rank and alpha of 256, learning rate2×10−42\{\\times\}10^\{\-4\}, and train on 64 H100 GPUs\. For GLM\-4\.5\-Air, we use rank and alpha of 32, learning rate1×10−41\{\\times\}10^\{\-4\}, and train on 128 H100 GPUs\. Both use a batch size of 64, 5% linear warmup followed by cosine annealing to zero, and train for 2 epochs\. The ticket\-processing model Eluna\-G\-XL fine\-tunes GLM\-4\.7 \(355B\) with the same MS\-SWIFT/LoRA pipeline \(rank and alpha 64, learning rate5×10−55\{\\times\}10^\{\-5\}, batch size 64, 1 epoch\) on 128 H100 GPUs\. LoRA weights are merged after training, eliminating inference overhead\. At inference, Eluna\-G and Eluna\-Q are served via vLLMKwonet al\.\([2023](https://arxiv.org/html/2607.08960#bib.bib52)\)on 8 H100 GPUs, and Eluna\-G\-XL via SGLangZhenget al\.\([2024b](https://arxiv.org/html/2607.08960#bib.bib59)\)on 8 H200 GPUs\.

## Appendix ETicket Processing Evaluation

#### Model\.

The deployed ticket\-processing agent is Eluna\-G\-XL, an open\-weight GLM\-4\.7 \(355B\) fine\-tuned with the same trajectory\-centric pipeline as Eluna\-G and Eluna\-Q \(Appendix[B](https://arxiv.org/html/2607.08960#A2), config in Appendix[D](https://arxiv.org/html/2607.08960#A4)\)\. Ticket processing runs on a longer interval than robotic conveyance, so a larger fine\-tune is admissible: Eluna\-G\-XL’s median generation duration \(Section[6\.2](https://arxiv.org/html/2607.08960#S6.SS2)\) meets that requirement\. All results in Table[4](https://arxiv.org/html/2607.08960#S6.T4)are from this single fine\-tuned model\.

#### Evaluation setup\.

The 410 tickets are an unbiased sample of open consolidation tickets at one fulfillment center on a single day, processed by the agent in the production framework with live inventory access\. The task has no deterministic ground truth \(the correct solution depends on live inventory state at processing time\), so correctness is estimated by expert review of agent traces\.

Similar Articles

EASy: Towards Efficient LLM-Based Agentic System

arXiv cs.CL

The paper proposes EASy, a trainable agentic framework that uses reinforcement learning to jointly optimize task performance and computational efficiency, introducing a milestone-plan-act workflow, dependency-aware execution graphs, and tree-structured rollout for training.

UrbanAgent: A Tool-Augmented Agent for Cross-System Urban Tasks

arXiv cs.AI

UrbanAgent is a tool-augmented agent framework that uses LLMs with code execution, API calls, and MCP to handle cross-system urban requests. The authors also introduce UrbanEval, a benchmark for evaluating task results and execution quality, achieving 71% success rate over baselines.

UrbanDS: A Graph-Guided LLM Multi-Agent System for Data-Intensive Urban Tasks

arXiv cs.AI

This paper introduces UrbanDS, a graph-guided LLM multi-agent system designed for data-intensive urban tasks, along with UrbanDS-Bench, a benchmark for evaluating such systems. Experiments show it outperforms existing data science agents and has been deployed in a real-world urban operations platform.