@lateinteraction: The "harness" is starting to blur with the neural architecture, in terms of who carries the inductive biases that unloc…
Summary
Researchers propose that the harness (training setup) should carry inductive biases for generalization, showing that training RLMs is far superior to vanilla Transformers for scaling and generalization to harder tasks.
View Cached Full Text
Cached at: 07/20/26, 05:30 PM
The “harness” is starting to blur with the neural architecture, in terms of who carries the inductive biases that unlock generalization.
We show that training RLMs specifically is far superior at scaling and generalization to harder tasks than training vanilla Transformers.
alex zhang (@a1zhang): Transformers struggle to generalize to tasks they were not explicitly trained on. Instead, we propose in 2026 that it is the job of the harness to generalize through composition.
We observe a powerful property when training RLMs: for tasks with shared structure that look
Similar Articles
@a1zhang: Transformers struggle to generalize to tasks they were not explicitly trained on. Instead, we propose in 2026 that it i…
The article proposes that Transformers can generalize to new tasks through a well-designed harness that induces composition, without needing intrinsic model generalization. It shows RLMs can generalize from short tasks to 8-32x longer tasks and across domains.
Language model harnesses are compositional generalizers (49 minute read)
This blog post argues that better generalization in language models should come from the 'harness' — the interface program — rather than just scaling training data. Experiments show that a Recursive Language Model harness enables length and domain generalization far beyond what the base Transformer achieves.
@omarsar0: Highly recommended. I've often claimed there's huge alpha in building agent harnesses. Turns out harnesses are composit…
Discusses the concept of agent harnesses as compositional generalizers for scaling generalization in models, referencing the RLM harness.
Training a harness for model-agnostic and task-environment-agnostic capability improvements with PyTorch-like framework [P]
Introduces a framework for training a harness to improve task LLM capabilities in a model-agnostic and task-environment-agnostic way, with results on Terminal Bench and SWE-Bench.
best of the best agentic harnesses do this…
The author shares insights on building effective agent harnesses: the best ones minimize LLM reliance for trivial tasks and reserve LLMs for complex reasoning, distinguishing genuine harnesses from simple wrappers.