@akshay_pachaar: The next step after Jev: A decision model like Jev bills and computes the full context on every call, so a 40-message c…
Summary
Levanto Labs introduces Sage2, a streaming decision model that computes each token of a conversation only once, reusing cached context so each new message adds only its own token cost. It delivers typed answers with calibrated probabilities and claims 3x faster decisions on progressive context, plus extraction that is 166x cheaper than Opus 5.5.
View Cached Full Text
Cached at: 11/02/26, 08:13 PM
The next step after Jev:
A decision model like Jev bills and computes the full context on every call, so a 40-message chat checked after each message processes the early messages 40 times.
Devs just built Sage2, a streaming decision model that computes each token of a conversation once.
The setup is closer to a database cursor than an API call. A session holds the context on the server, and new messages are appended to it, not re-sent.
The cached computation over the earlier context is reused. Each new message adds only its own tokens to the cost, and every registered question is re-evaluated against the full history.
Each question returns a typed answer with a calibrated probability, so thresholds and routing stay in plain application code.
On progressive context, this makes decisions 3x faster, with responses in tens of ms.
Sage2 is built by @levantolabs, the team behind the first decision model, launched before Jev.
The video below depicts the model in action on a car dealership chat, and I partnered with the team to put this together.
More details below.
Levanto Labs (@levantolabs): Software can now understand human language and act on it, in real time.
Introducing Sage2
- Extract: natural language in, structured data out. 166x cheaper than Opus 5.5, beats @Cloudflare’s Clairic
- Decide: the first decision model with streaming. 3x faster, because it reads
Similar Articles
Amazon releases its own Jev clone as decision models flood the web
Amazon Web Services released Strands Decider 2B, an open-source decision model inspired by TypeSafe's Jev, built on Qen3.5-2B to provide fast, low-cost, calibrated choice-making for agentic workflows instead of full LLM generation.
@akshay_pachaar: https://x.com/akshay_pachaar/status/2102087107410002345
The article explains how to use Jev, a model for structured decisions, as an efficient judge for evaluating AI agent responses, reducing latency and cost compared to traditional LLM judges.
@akshay_pachaar: https://x.com/akshay_pachaar/status/2101037514945597645
TypeSafe AI released Jev, a semantic decision engine designed for fast, low-cost AI decisions in software systems, avoiding the inefficiencies of generative LLMs for simple choices.
@svpino: This is pretty cool: You get the speed/cost/structural benefits of a decisions API like Jev. On top of that, you also g…
SVPino highlights Parallel Web Systems' new Decisions API, which combines the speed and cost-efficiency of decision models like Jev with real-time web-grounded news context, available at $0.001 per request.
Replacing Large Language Models with Jev Decision Models for Low-Latency Edge Service Orchestration
This paper replaces LLM-based decision making in edge service orchestration with Jev decision models, reporting 22.7–64.5% lower median decision latency and far higher request completion rates under load, while noting wide contracts mark the limit of substitution.