llm-invocation

Tag

Cards List
#llm-invocation

Uncertainty-Aware Sequential Decision Rules for Event-Triggered LLM Invocation in Streaming Systems

arXiv cs.LG ↗ · 2026-07-16 Cached

This paper formalizes the problem of when to invoke LLMs in streaming inference systems as a risk-based sequential stopping problem. It proves theoretical guarantees and empirically validates the framework on turbofan degradation data.

0 favorites 0 likes
← Back to home

Submit Feedback