@akshay_pachaar: NVIDIA and Stanford just challenged Jev. (their new System 1 architecture runs up to 9x faster.) It is called a Contras…

X AI KOLs Timeline Papers

Summary

NVIDIA and Stanford developed a Contrastive Language Model (CLM) that frames decision-making in AI as a retrieval problem, achieving up to 9x lower latency compared to existing systems like Jev by caching action embeddings.

NVIDIA and Stanford just challenged Jev. (their new System 1 architecture runs up to 9x faster.) It is called a Contrastive Language Model, or CLM. Like Jev, CLM is not designed to generate text. It handles the small, repeated decisions inside AI systems, such as choosing a tool, ranking a patch, routing a request, or selecting the next action. But CLM reaches those decisions differently. Instead of generating an answer token by token, it treats decision-making as a retrieval problem. Here is how it works. 1) Encode the state CLM takes the current situation, such as an agent’s context or the state of a game, and converts it into a vector. It uses a frozen Qwen3-8B model with a small trainable state projection head. 2) Encode every possible action A separate action head converts each candidate into the same vector space. In the Mario example, the candidates are left, jump, and right run. CLM does not invent a fourth option. It only evaluates the actions supplied by the application. 3) Learn which states and actions belong together During training, the correct state-action pair is pulled closer while incorrect pairs are pushed apart. A batch of B examples produces a B × B similarity matrix. The matching pairs sit on the diagonal. Every other pairing becomes a negative example. This contrastive training uses InfoNCE, the same general mechanism behind systems such as CLIP and dense retrieval. 4) Turn similarity into a decision At inference, CLM measures the cosine similarity between the state and every candidate action. A softmax converts those scores into a probability distribution. The application can choose the winner, apply a confidence threshold, or escalate an uncertain result. The real speed advantage comes from separating states and actions. Actions can be embedded once and cached. If an agent repeatedly chooses between the same tools, CLM only needs to encode the changing state and compare it with stored action vectors. That replaces repeated generation with one embedding pass and a set of cheap dot products. The researchers report that CLM-8B matches Jev across computer-use, gaming, and tool-calling evaluations while reaching up to 9x lower latency. The improvement is largest when actions repeat or the candidate set grows. CLM still has limits. It cannot generate new actions, its probabilities are relative to the supplied candidates, and its strongest verifier results require task-specific fine-tuning. But its central idea is powerful. The entire research is open-source, including the code. Read more here: https://contrastive-lm.notion.site When software already knows the possible answers, an AI model should score them instead of generating more words. I also wrote a full breakdown on how system one models like Jev work. The article is quoted below.
Original Article
View Cached Full Text

Cached at: 09/25/26, 10:47 PM

NVIDIA and Stanford just challenged Jev.

(their new System 1 architecture runs up to 9x faster.)

It is called a Contrastive Language Model, or CLM.

Like Jev, CLM is not designed to generate text. It handles the small, repeated decisions inside AI systems, such as choosing a tool, ranking a patch, routing a request, or selecting the next action.

But CLM reaches those decisions differently.

Instead of generating an answer token by token, it treats decision-making as a retrieval problem.

Here is how it works.

  1. Encode the state

CLM takes the current situation, such as an agent’s context or the state of a game, and converts it into a vector.

It uses a frozen Qwen3-8B model with a small trainable state projection head.

  1. Encode every possible action

A separate action head converts each candidate into the same vector space.

In the Mario example, the candidates are left, jump, and right run. CLM does not invent a fourth option. It only evaluates the actions supplied by the application.

  1. Learn which states and actions belong together

During training, the correct state-action pair is pulled closer while incorrect pairs are pushed apart.

A batch of B examples produces a B × B similarity matrix. The matching pairs sit on the diagonal. Every other pairing becomes a negative example.

This contrastive training uses InfoNCE, the same general mechanism behind systems such as CLIP and dense retrieval.

  1. Turn similarity into a decision

At inference, CLM measures the cosine similarity between the state and every candidate action.

A softmax converts those scores into a probability distribution. The application can choose the winner, apply a confidence threshold, or escalate an uncertain result.

The real speed advantage comes from separating states and actions.

Actions can be embedded once and cached. If an agent repeatedly chooses between the same tools, CLM only needs to encode the changing state and compare it with stored action vectors.

That replaces repeated generation with one embedding pass and a set of cheap dot products.

The researchers report that CLM-8B matches Jev across computer-use, gaming, and tool-calling evaluations while reaching up to 9x lower latency. The improvement is largest when actions repeat or the candidate set grows.

CLM still has limits. It cannot generate new actions, its probabilities are relative to the supplied candidates, and its strongest verifier results require task-specific fine-tuning.

But its central idea is powerful.

The entire research is open-source, including the code.

Read more here: https://contrastive-lm.notion.site

When software already knows the possible answers, an AI model should score them instead of generating more words.

I also wrote a full breakdown on how system one models like Jev work.

The article is quoted below.

Similar Articles

JEV almost dead: CLM vs JEV

Reddit r/LocalLLaMA

Contrastive Language Models (CLM) is introduced as an open-weights alternative to TypeSafe AI's JEV, offering functional parity with improved latency and fine-tuning capabilities, though with trade-offs in generalization.