single-token-output

Tag

Cards List
#single-token-output

Koa-action: Fast and Consistent Structured Decision Making with Generative LLMs

arXiv cs.LG ↗ · 2026-09-30 Cached

Koa-action is a Salesforce AI framework that formulates low-latency atomic decision tasks (classification, scoring, endpointing) as single-token constrained generation via atomic label tokens and supervised fine-tuning, achieving competitive accuracy with several-fold faster inference than frontier models like GPT-5 and Claude-4.8-Opus.

0 favorites 0 likes
← Back to home

Submit Feedback