@nathanhabib1011: ifstruct by @liquidai, an instruction-following benchmark for structured output. Why is this important? Because smaller…
Summary
ifstruct is an instruction-following benchmark for structured output by Liquid AI, designed to push the field toward better small models that can run locally.
View Cached Full Text
Cached at: 07/02/26, 10:22 AM
ifstruct by @liquidai, an instruction-following benchmark for structured output.
Why is this important? Because smaller models can struggle with exactly this.
This will push the field in the direction of better small models that can run locally, making correct tool call, write good config file and so much more! I’m super excited for the future of local models..
Winners @Google’s gemma4 31B @OpenAI’s gpt-oss-20b @NVIDIAAI nemotron-3-Nano
Similar Articles
@maximelabonne: IFStruct now has a leaderboard on @huggingface!
IFStruct, an instruction-following benchmark for structured output by Liquid AI, now has a leaderboard on Hugging Face, aimed at improving small models for local execution and correct tool use.
@maximelabonne: We're open-sourcing a new benchmark on @huggingface: IFStruct The goal is to measure output validity and schema followi…
We are open-sourcing a new benchmark called IFStruct on Hugging Face, designed to measure output validity and schema following across diverse prompts. The blog post details its generation and design choices.
@liquidai: Introducing LFM2.5-230M: our smallest model yet, built to run fast anywhere (CPUs, NPUs, and GPUs) to enable agentic ta…
Liquid AI releases LFM2.5-230M, a small 230M parameter model optimized for fast inference on CPUs, NPUs, and GPUs, targeting agentic tasks on devices like phones and robots.
@IntuitMachine: The One Change That Lets Small Models Outperform Their Size 1/ Everyone knows you need a 70B model to beat GPT-4 on com…
A thread introducing the Atomic Task Graph (ATG), a DAG-based execution substrate that allows a small 8B model to outperform GPT-4 on complex agent tasks by storing plan structure in a graph instead of linear text, reducing context bloat and enabling localized failure recovery.
@h100envy: Liquid AI's head of post-training explained how they built a small model that runs on-device under 1 GB in 20 minutes -…
Liquid AI's head of post-training explains how to build a sub-1GB on-device model in 20 minutes using LFM2.5, on-policy preference alignment, agentic RL, curriculum training, and iterative model merging, achieving tool-calling reliability that beats much larger models.