@rohanpaul_ai: New Stanford + Carnegie paper. Screen recordings of real work look like free training data for agents. They aren't, bec…
Summary
The paper presents Task Model Induction, a method that decomposes screen recordings of real computer work into separate tasks and goal trees to better train AI agents, improving performance by 30% on unseen tasks compared to current summarizers.
View Cached Full Text
Cached at: 08/24/26, 01:43 AM
New Stanford + Carnegie paper.
Screen recordings of real work look like free training data for agents. They aren’t, because nobody works in one clean sequence of steps.
People switch between unrelated tasks and redo the same fix until it passes. Most tools flatten that into one list, so the agent learns a workflow nobody performed.
Task Model Induction, from Stanford and CMU, first pulls a recording apart into the separate tasks that were running, then rebuilds each as a goal tree with its loops intact.
It works out the goals and the running order in separate passes and merges them, because asking one model for both at once flattens the detail.
That recovers 74.9% of what actually happened, more than double the best current summarizer, and skills built from it did 30% better on unseen tasks.
It’s weakest where sessions get messy, on error fixing and dead ends.
So if you’re mining demonstrations for agent skills, feed the goal structure, not the transcript.
– arxiv. org/abs/2608.20319
Title: “Inducing Task Models from Computer-Use Traces”
Similar Articles
@rohanpaul_ai: Great Stanford + MIT + Harvard + Anthropic paper. Gives a clear training-based reason for why larger models learn abili…
A Stanford, MIT, Harvard, and Anthropic paper explains that larger AI models learn rare skills better because they forget them less during training; their extra capacity protects weak learning signals from being overwritten by common tasks.
@rohanpaul_ai: Very important Meta paper brings Autodata, an agentic data scientist to create high quality synthetic data. The main re…
Meta's new paper 'Autodata' introduces an agentic data scientist that generates and meta-optimizes synthetic training data, significantly outperforming standard methods and enabling a small 4B model to beat a 397B baseline in legal tasks.
@rohanpaul_ai: New Apple paper finds that, as training data grows, tool-use agents gain more from diverse apps and database states tha…
Apple's new paper introduces SynthAPI, showing that for tool-use agents, diversity of apps and database states matters more than raw task count, deriving a data-mix scaling law that predicts held-out generalization far better than task-count-only laws.
@rohanpaul_ai: New John Hopkins and Carnegie Mellon University Paper Shows that a small model can learn to improve an agent's harness …
A Johns Hopkins and Carnegie Mellon paper shows a 4B editor model can learn to rewrite an agent's harness code from failure reports, with edits transferring to unseen tasks and outperforming its 35B teacher on average edit scores.
@rohanpaul_ai: Meta paper shows that coding agents get much better when they reuse short summaries of past attempts instead of raw log…
A Meta paper shows that coding agents improve significantly when they reuse short summaries of past attempts instead of raw logs, achieving strong gains on SWE-Bench and Terminal-Bench with Claude 4.5 Opus.