Has anyone here used SLMs inside agent workflows?
Summary
A user asks the community about using small/local language models within agent workflows for specific tasks like routing, classification, and extraction, and shares thoughts on whether larger models are always necessary.
Similar Articles
Does size really matter? (LLMs vs. SLMs)
Discusses the trade-offs between large language models (LLMs) and small language models (SLMs), questioning whether larger models are always necessary for production use cases and exploring the future of AI deployment.
Are small local models for automation a thing?
A Reddit user discusses the potential of small local language models (1B-4B parameters) for automation and scripting, and asks for resources focused on this use case.
The power of structured workflows and small local models
The author details their experience building a custom agent loop using a small local model (Qwen3.5 9B) with structured workflows and a map-reduce pattern to manage context limits, replacing Claude Code for most tasks.
Large Language Models Are Overkill For Some Marketing Tasks. Enter The Small Language Model
ZeroGPU launches specialized small language models (SLMs) for ad tech tasks, offering lower costs and faster performance compared to large language models. The SLMs run on CPUs and have already reduced expenses for early adopter Dappier by 50%.
SLMs as Multi-Agent Routers: A Progressive SFT and Reinforcement Learning Approach
This paper proposes training small language models as multi-agent routers via progressive supervised fine-tuning and reinforcement learning, achieving better retrieval relevance and lower latency compared to LLM baselines that route on intent alone.