multi-step-pipelines

Tag

Cards List
#multi-step-pipelines

How Consistent Are LLM Agents? Measuring Behavioral Reproducibility in Multi-Step Tool-Calling Pipelines

arXiv cs.CL · 2026-05-29 Cached

This paper systematically measures behavioral reproducibility of LLM agents in multi-step tool-calling pipelines across 1,140 traces, finding a 'structural consistency, parametric variance' pattern where agents reliably select tools in the same order but vary in arguments, and that structural consistency predicts task success.

0 favorites 0 likes
← Back to home

Submit Feedback