BDH-CQ: In-Context Learning with Recurrent Latent Reasoning
Summary
This paper introduces BDH-CQ, a 150M-parameter reasoning model that combines in-context learning with recurrent latent reasoning, achieving 29.5% pass@2 on ARC-AGI-1 at very low inference cost and establishing a new cost-accuracy frontier.
View Cached Full Text
Cached at: 08/11/26, 10:20 AM
Paper page - BDH-CQ: In-Context Learning with Recurrent Latent Reasoning
Source: https://huggingface.co/papers/2608.09888
Abstract
A 150M-parameter reasoning model using recurrent latent reasoning and in-context learning achieves a new cost-accuracy frontier on ARC-AGI-1.
We introduce BDH-CQ, a reasoning model that combinesin-context learningwithrecurrent latent reasoning. Inputs presented at inference time continuously update the model’s recurrent memory; the model then solves a query through iterative computation in ahigh-dimensional latent space, without verbalizing its intermediate reasoning. We evaluate the model on the publicARC-AGI-1evaluation set and use controlled ARC-like interventions to study what it learns from demonstrations, how consistently it applies an inferred transformation, and which concepts remain difficult. A 150M-parameter configuration reaches 29.5% pass@2 at a computed inference cost of \$0.0007 per task. This operating point breaks through the previously reportedARC-AGI-1cost-accuracy Pareto frontier, establishing a new state of the art in benchmark cost efficiency.
View arXiv pageView PDFGitHub2Add to collection
Get this paper in your agent:
hf papers read 2608\.09888
Don’t have the latest CLI?curl \-LsSf https://hf\.co/cli/install\.sh \| bash
Models citing this paper0
No model linking this paper
Cite arxiv.org/abs/2608.09888 in a model README.md to link it from this page.
Datasets citing this paper0
No dataset linking this paper
Cite arxiv.org/abs/2608.09888 in a dataset README.md to link it from this page.
Spaces citing this paper0
No Space linking this paper
Cite arxiv.org/abs/2608.09888 in a Space README.md to link it from this page.
Collections including this paper0
No Collection including this paper
Add this paper to acollectionto link it from this page.
Similar Articles
A 150M param recurrent model scores 29.5% on ARC-AGI-1 at $0.0007 per task
The article introduces BDH-CQ, a 150M parameter recurrent model that combines in-context learning with latent reasoning, achieving 29.5% on ARC-AGI-1 at a cost of $0.0007 per task, setting a new standard for cost efficiency.
GradCuit: Credit-Assigned Gradient Flow Enables Robust and Interpretable Test-Time Latent Reasoning
This paper introduces GradCuit, a method for test-time latent reasoning that inserts optimizable latent states at a selected Transformer layer. It achieves 64.5% average accuracy across five backbones and three reasoning benchmarks, outperforming chain-of-thought prompting and showing improved robustness and interpretability.
@burny_tech: A Survey on Latent Reasoning "Large Language Models (LLMs) have demonstrated impressive reasoning capabilities, especia…
This survey provides a comprehensive overview of latent reasoning in LLMs, exploring methods that perform multi-step inference in continuous hidden states without explicit token-level supervision.
Enhanced and Efficient Reasoning in Large Learning Models
This paper proposes a method for improving reasoning in large language models by recoding data to explicitly represent relationships, enabling efficient principled reasoning with polynomial-time learnability for relational rules, which addresses hallucinations and supports sound reasoning across multiple calls.
CosmicFish-HRM: Adaptive Reasoning via Hierarchical Recurrent Mechanisms in Compact Language Models
This paper presents CosmicFish-HRM, a compact 82.77M parameter language model with a hierarchical reasoning module that dynamically allocates reasoning compute during inference, learning when to halt based on input complexity.