Dr. Claw: An AI Scientist Workspace for Vibe Research
Summary
Dr. Claw is an open-source AI workspace that wraps coding agents in a controllable, auditable human-in-the-loop workflow for research, improving completeness with a traceable process trail.
View Cached Full Text
Cached at: 09/02/26, 06:01 AM
# An AI Scientist Workspace for Vibe Research
Source: [https://arxiv.org/html/2609.00365](https://arxiv.org/html/2609.00365)
Hanrong ZhangAffiliation:University of Illinois ChicagoDawei LiuAffiliation:University of PennsylvaniaYixin LiuAffiliation:Lehigh UniversityZongxia LiAffiliation:University of MarylandZhengqing YuanAffiliation:University of Notre DameSiqi ZhangAffiliation:Lehigh UniversityHenry Peng ZouAffiliation:University of Illinois ChicagoZhiling YanAffiliation:Lehigh UniversityYuxuan ZhangAffiliation:University of British ColumbiaYanfang YeAffiliation:University of Notre DamePhilip S\. YuAffiliation:University of Illinois ChicagoLichao SunAffiliation:Lehigh University
###### Abstract
Command\-line coding agents \(e\.g\., Claude Code, Gemini CLI\) can already read and write files and sustain long sessions, yet end\-to\-end research still fragments across chat tools, IDEs, terminals, and writing environments, and the decisions that make it auditable are rarely preserved\. We presentDr\. Claw, an open\-source workspace that wraps existing coding\-agent executors in a*controllable*and*auditable*human\-in\-the\-loop workflow rather than introducing another autonomous agent\. Persistent state objects, a reusable skill library, and multi\-executor coordination link human decisions to AI execution, turning planning, execution, and writing into one traceable, recoverable loop\. We demonstrate Dr\. Claw through an interactive three\-view scenario and a failure\-recovery walkthrough, and evaluate it against a bare command\-line agent sharing the same backend executor, so the comparison contrasts the whole orchestration layer \(task graph, state objects, and skill library\) with the agent it wraps\. Holding the executor fixed, Dr\. Claw scores higher on research completeness while persisting an auditable, recoverable process trail\. Demo access: repository[https://github\.com/OpenLAIR/dr\-claw](https://github.com/OpenLAIR/dr-claw), released under AGPL\-3\.0 with GPL\-3\.0 upstream components\.
## 1Introduction
Large foundation models and agentic tools have improved the five core AI research operations—literature review, idea generation, code implementation, results analysis, and drafting\([OpenAI, 2023](https://arxiv.org/html/2609.00365#bib.bib14);[Brown et al\., 2020](https://arxiv.org/html/2609.00365#bib.bib1);[Yao et al\., 2022](https://arxiv.org/html/2609.00365#bib.bib2);[Schick et al\., 2023](https://arxiv.org/html/2609.00365#bib.bib3);[Lu et al\., 2024](https://arxiv.org/html/2609.00365#bib.bib7);[Yu et al\., 2025](https://arxiv.org/html/2609.00365#bib.bib12);[Yang and Weng, 2025](https://arxiv.org/html/2609.00365#bib.bib13);[Schmidgall et al\., 2025](https://arxiv.org/html/2609.00365#bib.bib18);[Baek et al\., 2025](https://arxiv.org/html/2609.00365#bib.bib21)\)\. Command\-line coding agents such as Claude Code and Gemini CLI push this further, living in the terminal, reading and writing project files, and sustaining context across long sessions\([Chen et al\., 2021](https://arxiv.org/html/2609.00365#bib.bib15);[Barke et al\., 2022](https://arxiv.org/html/2609.00365#bib.bib16);[Dakhel et al\., 2022](https://arxiv.org/html/2609.00365#bib.bib17);[Jimenez et al\., 2024](https://arxiv.org/html/2609.00365#bib.bib5);[Yang et al\., 2024](https://arxiv.org/html/2609.00365#bib.bib6)\)\. Yet these agents optimize execution, not*control*: the plan, intermediate decisions, and artifacts that make a research process reviewable are scattered or lost, and the human has few explicit takeover points\.
Figure 1:Control split in Dr\. Claw: the Human\-Controlled side sets goals, constraints, and acceptance decisions; the AI\-Execution side runs the five core AI operations \(Plan→\\rightarrowExecute\), connected through four state objects and checkpoint feedback \(Verify/Revise/Retry/Handoff\)\.The bottleneck is now full\-process orchestration rather than isolated capability: researchers still switch across tools for decomposition, scheduling, tracking, validation, and writing, which weakens reproducibility and delivery reliability\. HCI evidence consistently shows that collaboration cost is dominated by verification and context maintenance, and that process visibility and interruptible control are critical\([Gu et al\., 2024](https://arxiv.org/html/2609.00365#bib.bib22);[Kazemitabaar et al\., 2024a](https://arxiv.org/html/2609.00365#bib.bib23);[Xie et al\., 2024](https://arxiv.org/html/2609.00365#bib.bib24);[Kazemitabaar et al\., 2024b](https://arxiv.org/html/2609.00365#bib.bib25);[Flores\-Saviaga et al\., 2025](https://arxiv.org/html/2609.00365#bib.bib26)\); existing demos improve usability but leave cross\-stage state continuity and artifact closed\-loop management limited\([Dibia et al\., 2024](https://arxiv.org/html/2609.00365#bib.bib10);[Cai et al\., 2024](https://arxiv.org/html/2609.00365#bib.bib20)\)\.
We target a mode of work we callVibe Research: a controllable, human\-in\-the\-loop paradigm in which a researcher states high\-level goals and constraints in natural language, AI compiles them into an executable research loop and carries out the five core operations, and final acceptance rests on observable outputs, with humans governing direction and final decisions throughout\. The paradigm is defined not by full autonomy but by an operational human–AI division of labor: AI handles high\-throughput, parallelizable, templatable execution \(retrieval, coding, running, summarizing, drafting\), while humans own research direction, evaluation criteria, key trade\-offs, and final acceptance\. Unlike end\-to\-end autonomous research agents\([Lu et al\., 2024](https://arxiv.org/html/2609.00365#bib.bib7);[Yamada et al\., 2025](https://arxiv.org/html/2609.00365#bib.bib8);[Tang et al\., 2025](https://arxiv.org/html/2609.00365#bib.bib9);[Schmidgall et al\., 2025](https://arxiv.org/html/2609.00365#bib.bib18)\)or general multi\-agent frameworks\([Wu et al\., 2023](https://arxiv.org/html/2609.00365#bib.bib4);[Qian et al\., 2024](https://arxiv.org/html/2609.00365#bib.bib19)\), we emphasize sustained human takeover and research\-centric artifact management \(Section 2\)\. Crucially, Dr\. Claw does not introduce yet another executor: it*wraps*an existing command\-line coding agent, adding the state, control, and audit layer that such agents lack while reusing their execution capability\.
We proposeDr\. Claw, a one\-stop workspace that unifies planning, execution, and writing into one controllable, traceable, recoverable, and auditable research loop \(Figure[1](https://arxiv.org/html/2609.00365#S1.F1)\)\. In each cycle, users provide goals, constraints, and acceptance criteria; the system decomposes tasks, executes actions, writes back artifacts, and supports revise/retry/handoff without losing process state\. We evaluate this loop in Section 5, holding the backend executor fixed so that the comparison contrasts the orchestration layer as a whole with the bare executor, and complement it with a retrospective human study on efficiency, output quality, and integrated experience \(Appendix[A](https://arxiv.org/html/2609.00365#A1)\)\. Our contributions are as follows:
- •We formalize*Vibe Research*, a controllable, human\-in\-the\-loop research\-orchestration paradigm that clarifies the boundary between AI execution and human decision responsibilities, distinguishing it from end\-to\-end autonomous approaches\.
- •We implement this paradigm in Dr\. Claw, with a task\-graph\-centric orchestration, a chat\-driven planner, a modular skill library \(5858stage\-mapped skills across five research stages,171171in the deployed catalogue\), and a multi\-agent execution layer compatible with mainstream coding\-agents\.
- •We provide a controlled pilot evaluation and a scenario\-based demonstration\. Holding the executor fixed, Dr\. Claw scores higher than the bare agent on completeness by closing its research\-hygiene gaps \(consistent across tasks, though not statistically powered at one run per task\), while uniquely persisting an auditable, recoverable process trail; a retrospective study additionally associates the integrated workflow with gains in efficiency, quality, and usability over non\-integrated ones\.
## 2Related Work
Table 1:Design\-space comparison\.● supported, ◐ partial, ○ absent, – out of scope by design\.*Built\-in research state*: research\-artifact objects \(task graph, artifact store, decision log, execution trace\) shipped with the system rather than a schema the developer declares\.*Mid\-run takeover*: intervention at arbitrary points during a run, not only at stage boundaries or developer\-placed pause nodes\. Marks are assessed from published papers, official documentation, and public repositories as of August 2026, not from runs of these systems\. Each dimension is realized, fully or in part, by prior systems; Dr\. Claw differs by combining them\.### 2\.1Research Agents and End\-to\-End Automation
End\-to\-end systems automate the path from ideas to papers with minimal human intervention\([Lu et al\., 2024](https://arxiv.org/html/2609.00365#bib.bib7);[Yamada et al\., 2025](https://arxiv.org/html/2609.00365#bib.bib8);[Schmidgall et al\., 2025](https://arxiv.org/html/2609.00365#bib.bib18);[Baek et al\., 2025](https://arxiv.org/html/2609.00365#bib.bib21)\), but rarely prioritize controllability in sustained collaboration within real local engineering environments\. A parallel line lowers the barrier to building or steering agents: no\-/low\-code authoring\([Dibia et al\., 2024](https://arxiv.org/html/2609.00365#bib.bib10);[Cai et al\., 2024](https://arxiv.org/html/2609.00365#bib.bib20);[FlowiseAI, 2026](https://arxiv.org/html/2609.00365#bib.bib29)\)and general orchestration runtimes such as LangGraph\([LangChain, 2026](https://arxiv.org/html/2609.00365#bib.bib28)\), which give developers durable checkpointing, human\-in\-the\-loop interrupts, and replay over a state schema they declare themselves; TinyScientist\([Yu et al\., 2025](https://arxiv.org/html/2609.00365#bib.bib12)\), ResearStudio\([Yang and Weng, 2025](https://arxiv.org/html/2609.00365#bib.bib13)\), and IRIS\([Garikaparthi et al\., 2025](https://arxiv.org/html/2609.00365#bib.bib11)\)add intervenable agents\. Dr\. Claw differs along three axes taken together: it \(i\)*wraps*an existing command\-line coding agent rather than introducing a new executor; \(ii\) makes the research process a first\-class object through four persistent state objects \(Task Graph, Artifact Store, Decision Log, Execution Trace\); and \(iii\) sustains human takeover across the full ideation→\\rightarrowexperiment→\\rightarrowpublication arc \(Table[1](https://arxiv.org/html/2609.00365#S2.T1)\)\. Each axis has precedent taken alone—TinyScientist also delegates to an external coding agent, AI Scientist\-v2 persists a structured experiment tree, and ResearStudio allows a pause at any moment rather than at checkpoints, where it is stronger than Dr\. Claw—but prior work optimizes end\-to\-end autonomy, agent*construction*, or steering within a single stage, whereas Dr\. Claw optimizes*controllability and auditability of an existing agent*over a long\-horizon workflow\.
### 2\.2Human–AI Collaboration and Context\-Switching Costs
Recent HCI research has shifted from code\-generation utility to process controllability and verification burden\. In data analysis and knowledge work, the key bottlenecks are cross\-step interpretation, validation, and correction rather than one\-off generation quality, and interactive decomposition and process visualization improve monitoring and intervention\([Gu et al\., 2024](https://arxiv.org/html/2609.00365#bib.bib22);[Kazemitabaar et al\., 2024a](https://arxiv.org/html/2609.00365#bib.bib23);[Xie et al\., 2024](https://arxiv.org/html/2609.00365#bib.bib24)\); in programming settings, CHI evidence shows the added reading, confirming, and revising of assistant outputs harms fluency, cognitive load, and confidence\([Kazemitabaar et al\., 2024b](https://arxiv.org/html/2609.00365#bib.bib25);[Flores\-Saviaga et al\., 2025](https://arxiv.org/html/2609.00365#bib.bib26)\)\. These converge on a design requirement—clear supervision affordances, interpretable intermediate states, and timely takeover—that aligns with Dr\. Claw’s goal of reducing context\-switching costs\. Accordingly, we evaluate the systemic effect of workflow integration on efficiency, quality, and usability rather than intrinsic model gains\.
## 3System Overview
Dr\. Claw is designed around one central question: how to let researchers complete problem definition, experiment progression, and paper production in a continuous workflow rather than switching among isolated tools\. It models research as an explicitly traceable workflow that organizes human decisions with AI execution into a stable collaboration structure\. Additional implementation, failure\-recovery, and reproducibility details are in Appendix[B\.2](https://arxiv.org/html/2609.00365#A2.SS2), Appendix[B\.2](https://arxiv.org/html/2609.00365#A2.SS2), and Appendix[B\.2](https://arxiv.org/html/2609.00365#A2.SS2)\.
Figure 2:Overall system view of Dr\. Claw\.Top: four state objects \(Task Graph, Artifact Store, Decision Log, Execution Trace\)\.Middle: three system layers \(Interaction, Orchestration, Execution\)\.Bottom: iterative workflow steps \(Plan–Execute–Verify–Write\-back\)\.Lowest: safety policy constraint \(Actiont∈𝒜\(Policyt\)\\mathrm\{Action\}\_\{t\}\\in\\mathcal\{A\}\(\\mathrm\{Policy\}\_\{t\}\)\)\.### 3\.1Design Goals and System Abstraction
Dr\. Claw orchestrates four state objects:Task Graph,Artifact Store,Decision Log, andExecution Trace\. Together they convert interaction history into a reviewable process supporting iterative orchestration rather than one\-shot generation: users provide high\-level goals/constraints, and the system maps them to executable tasks with continuous inspection and takeover\. One task interaction is a state transition:
Statet\+1=f\(Statet,Actiont,Obst\),\\mathrm\{State\}\_\{t\+1\}=f\(\\mathrm\{State\}\_\{t\},\\mathrm\{Action\}\_\{t\},\\mathrm\{Obs\}\_\{t\}\),\(1\)whereStatet\\mathrm\{State\}\_\{t\}denotes the workflow state at timett\(jointly formed by Task Graph, Artifact Store, Decision Log, and Execution Trace\),Actiont\\mathrm\{Action\}\_\{t\}is a system\- or user\-triggered action, andObst\\mathrm\{Obs\}\_\{t\}is the observed feedback\. This formulation highlights that Dr\. Claw optimizes iterative state updates rather than single responses\.
### 3\.2Three\-Layer System Architecture
Dr\. Claw uses three collaborative layers:
- •Interaction: unified workspace for chat, task views, files, and version operations\.
- •Orchestration: state and lifecycle management from high\-level intent to stage tasks\.
- •Execution: backend invocation, result return, and exception handling across heterogeneous executors\.
This design enables backend switching without changing workflow semantics while preserving unified state and audit views\.
### 3\.3Workflow\-Centric Interaction Loop
Given a research idea, the system generates a structured brief and dependency\-aware task plan, then runs workflow steps of Plan–Execute–Verify–Write\-back\. Execution outputs are written intoArtifact Store, task states are updated inTask Graph, and all interventions are retained inDecision Log/Execution Trace\. This workflow supports long\-horizon iteration with explicit human checkpoints\.
### 3\.4Skill\-Based Capabilities and Multi\-Executor Coordination
Dr\. Claw provides a reusable skill library \(5858stage\-mapped skills across five research stages—survey, ideation, experiment, publication, promotion—and171171skills in the deployed catalogue\) covering ideation, literature processing, experimentation, analysis, and writing\. Each skill is a directory with aSKILL\.mdmanifest whose YAML frontmatter declares a name and description, and commonly a version, license, allowed tools, and stage/domain tags\. Skills are versioned and schema\-checked before activation, and reach a task by three routes: a stage\-skill map resolves the task’s stage and type to a set of suggested skills, which are attached to the task node and injected into its next\-action prompt; keyword detection over user instructions and task text can auto\-load a skill; and users may invoke any catalogue skill manually from the Skills dashboard\. Authoring, validation, and transfer are detailed in Appendix[B\.2](https://arxiv.org/html/2609.00365#A2.SS2)\. Dr\. Claw also coordinates multiple executors in one project context, so users switch execution strategy by task type, and on failure or constraint violation can retry, revise, or take over without breaking global state\. Formalization of artifact updates is in Appendix[B](https://arxiv.org/html/2609.00365#A2)\.
Figure 3:Three\-view scenario diagram\.Left: Skills Dashboard for capability discovery and filtering\.Center: main orchestration interface for planning, execution feedback, and human approval\.Right: Task List for progress tracking and next\-step selection\.
### 3\.5Safety and Controllability Mechanisms
Given risks from external calls and code execution, Dr\. Claw treats permission management as a first\-class mechanism, supporting fine\-grained tool/command policies that distinguish secure defaults from trusted extended settings\. Actions are allowed only if they belong to the action set defined by the current policy:
Actiont∈𝒜\(Policyt\),\\mathrm\{Action\}\_\{t\}\\in\\mathcal\{A\}\(\\mathrm\{Policy\}\_\{t\}\),\(2\)wherePolicyt\\mathrm\{Policy\}\_\{t\}is the permission configuration at timettand𝒜\(Policyt\)\\mathcal\{A\}\(\\mathrm\{Policy\}\_\{t\}\)is the executable action space, guaranteeing consistency between execution capability and safety boundaries\.
## 4Demo Scenario
We use a research task to illustrate Dr\. Claw under human\-in\-the\-loop conditions—whether high\-level research intent can be stably transformed into executable workflows while preserving controllability, recoverability, and auditability—focusing on workflow orchestration quality rather than one\-shot model output\.
### 4\.1Main Interface Demonstration
The center interface is the primary orchestration view\. It uses one unified research prompt with explicit goals, constraints, and acceptance criteria\. The user acts as research lead \(goal confirmation and key decisions\), while Dr\. Claw handles decomposition, dispatch, and state feedback\. We monitor four state objects throughout the process:Task Graph,Artifact Store,Decision Log, andExecution Trace\.
Figure[3](https://arxiv.org/html/2609.00365#S3.F3)summarizes the resulting cross\-view loop, in which discovered capabilities flow into goal/intent processing and explicit human decisions and are finally reflected as execution progress and synchronized task cards\.
### 4\.2Skills Interface Demonstration
The left panel validates capability management during workflow execution, corresponding to annotations \(1\) and \(2\) in Figure[3](https://arxiv.org/html/2609.00365#S3.F3)\. This sub\-scenario contains three interactions:
- •Skills board browsing: users browse available skills by research stage to quickly locate suitable capabilities\.
- •Tag\-based filtering: users filter skills by theme \(e\.g\., Ideation, Experiment, Publication\) to shorten retrieval paths\.
- •Manual skill addition: users add new skills into the current project so they can be explicitly invoked in subsequent tasks\.
This sub\-scenario tests not skill count but whether users can perform*Capability Discovery & Customization*and*Tag\-based Filtering*in context, then convert selected skills into executable steps\.
### 4\.3Task List Interface Demonstration
The right panel \(Task List\) is the execution\-control view, corresponding to annotations \(5\) and \(6\) in Figure[3](https://arxiv.org/html/2609.00365#S3.F3)\. It presents synchronized task status—overall counts \(Total,Done,In Progress,Pending\), a progress bar, and stage\-grouped*Synchronized Task Cards*—and supports three operations during execution:\(1\) progress inspection\(assess stage completion and backlog\);\(2\) task\-level traceability\(each card exposes task ID, objective, and linked skill tags\); and\(3\) direct action entry\(trigger the next step from pending items\)\.
## 5Evaluation
We evaluate Dr\. Claw against the*bare command\-line coding agent it wraps*\. The question is not whether the wrapper runs faster, since an orchestration layer that records state necessarily does more work, but whether, at a bounded time cost, it leaves the delivered output no less complete while turning a flat pile of files into an auditable, recoverable trail\. The operator\-facing context\-switch reduction the paper claims is measured by the retrospective three\-condition human study \(Appendix[A](https://arxiv.org/html/2609.00365#A1)\), not by this automated comparison\.
### 5\.1Research Completeness Under Open\-Ended Goals
A fully enumerated instruction leaves little room for orchestration to add value: when every requirement is spelled out in the prompt, a capable backend executor simply reads them off\. We therefore evaluate Dr\. Claw against the bare command\-line agent it wraps in the regime where a research assistant should matter—an*open\-ended*goal, where best practices must be supplied rather than transcribed\. We hold the backend executor fixed \(thecodexprovider with modelgpt\-5\.4under a matcheddanger\-full\-access/approval\-never profile\), so barecodexanddrclawdiffer only by Dr\. Claw’s task graph, artifact store, decision log, execution trace, and skill library\. These arrive as one bundle: the comparison measures what the orchestration layer adds*as a whole*, and cannot attribute the difference to any single component of it\. Each task gives an identical, unenumerated instruction \(“conduct a rigorous, publication\-quality study…”\) across three medical problems: melanoma and nevus classification on Derm7pt\([Kawahara et al\., 2019](https://arxiv.org/html/2609.00365#bib.bib27)\), and a clinical\-note risk baseline\. Neither prompt is told the rubric\.*Completeness*is the fraction of21research best\-practice elements spontaneously included—code and reproducibility, multiple models, cross\-validation, calibration, ablation, statistical rigor, figures, a write\-up citing its own numbers, plus research\-hygiene elements \(a limitations section, subgroup analysis, real related\-work citations\)—scored deterministically against the produced files, with no model\-in\-the\-loop judgment\. In the Dr\. Claw condition the task graph was verified active \(mean 17 tracked tasks; the executor read∼\\sim12 skill files per run\)\.
Figure 4:Open\-ended completion per task \(fraction of 21 elements\); dotted lines are pooled means\.Figure 5:Pooled pass rate on the three research\-hygiene elements where the conditions diverge\.#### What the open\-ended test shows\.
Dr\. Claw wins two of three tasks and ties the third, pooling 0\.952 against the bare agent’s 0\.873 \(Figure[4](https://arxiv.org/html/2609.00365#S5.F4)\)\. The advantage is*not*in modeling: both conditions train three\-plus models with cross\-validation, calibration, ablation, and statistical rigor—those elements pass at 1\.00 on both sides\. It lives entirely in research hygiene \(Figure[5](https://arxiv.org/html/2609.00365#S5.F5)\): Dr\. Claw’s reference\-audit, analysis, and paper\-writing skills reliably add a limitations section \(0\.33→\\to1\.00 pooled pass rate\), subgroup analysis \(0\.33→\\to1\.00\), and real literature citations \(0\.00→\\to0\.67, the bare agent producing*zero*across the three tasks\)\. On the one tie \(the clinical\-note task\), Dr\. Claw’s reference audit did not fire, so it too missed citations—the mechanism, when engaged, is exactly what closes the gap\.
#### Triggering reliability\.
Skill*selection*is deterministic given a task’s stage and type, but skill*invocation*is not enforced: the resolver can only place a suggestion in the task prompt\. Across the three runs the executor read∼\\sim12 skill files per run, yet the one non\-firing reference audit above accounts for the single task on which Dr\. Claw failed to beat the bare agent\. Suggestion is guaranteed; invocation is best\-effort, and closing that gap—by verifying skill execution rather than recommending it—is the clearest reliability improvement the current design admits\.
#### Auditability is an architectural affordance, not a score\.
The conditions also differ in whether a completed run can be*re\-traced*\(Figure[6](https://arxiv.org/html/2609.00365#S5.F6)\)\. Every Dr\. Claw run persists aqueryable task graph\(mean 14 nodes\), a timestamped execution trace \(mean 14 transitions\), a decision\-log brief \(mean 10 entries\), and named research stages with explicit claim→\\toevidence maps;the bare agent persists none\. We read this as adesign affordance for human oversight, not a performance score: these objects are Dr\. Claw’s own file format, so “bare = absent” holds by construction\. On*format\-neutral*traceabilitywe claim no superiority—write\-up file references resolve at 100% versus 62%, but this is volume\-confounded \(4848vs88references\) and non\-decisive at thisnn\. Both results are an exploratory pilot: with one replicate per task the pooled completionΔ=\+0\.079\\Delta=\+0\.079has a 95% bootstrap CI of \[\-0\.00, \+0\.14\] that includes zero, so the direction is consistent \(Dr\. Claw≥\\geqbare on all three tasks\) but not yet significant, and Dr\. Claw remains slower—a bounded overhead the orchestration layer incurs by recording state\.
Figure 6:Whether a run persists a queryable process model \(present/absent by design, not scored\)\.
### 5\.2Non\-Destructive Failure Recovery Under Audit
We run one coherent Derm7pt mini\-project through Dr\. Claw and recover it from an induced failure, on the same backend executor \(codex/gpt\-5\.4\)\. The advantage on display is not speed or accuracy but the auditable, structured artifact trail the orchestration layer maintains: when a step fails, the captured execution trace and preserved prior state let the project recover in place rather than restart\.
Figure 7:Captured failure and non\-destructive recovery inside a project\. Left: the induced wrong\-path error, captured in the execution trace\. Right: the in\-place fix and recovered result, with all prior files retained\.#### Failure and recovery\.
The same project also shows what happens when a step fails \(Figure[7](https://arxiv.org/html/2609.00365#S5.F7)\)\. Halting on an induced wrong\-path error rather than silently self\-correcting, then recovering to a real result \(accuracy0\.8920\.892\) with all55pre\-existing files retained \(2323tool events\), the workspace*adds*the corrected artifacts rather than wiping the failed attempt—the prior pipeline state survives the fix\. We report this as a single\-condition design demonstration, without a matched bare\-agent recovery run\.
### 5\.3Human Study
To measure the operator\-facing effect that the automated comparison cannot, we retain a retrospective study of seven AI PhD researchers across three research stages \(Ideation, Experiment, Publication\), comparing Dr\. Claw against working with no AI tools and with general\-purpose web/desktop AI assistants \(e\.g\., ChatGPT, Gemini, Claude\) on completion time, blind\-rated output quality, tool\-switching count, and self\-reported experience\. Under this hybrid, exploratory protocol, Dr\. Claw is associated withshorter completion\-time bands, the highest output\-quality ratings, and fewer tool switches with higher experience scores; the effect isstrongest and fully pairwise\-significant for experience\. Full setup, figures, and stage\-wise statistics are in Appendix[A](https://arxiv.org/html/2609.00365#A1)\.
## 6Conclusion
We presented Dr\. Claw, an integrated system for end\-to\-end AI research that unifies state\-object management and skill\-based execution in one workspace to reduce cross\-tool orchestration costs and improve workflow continuity\. Evaluated with the same backend executor run inside versus outside Dr\. Claw, which compares the whole orchestration layer against the agent it wraps rather than ablating its parts, the layer preserves the measured completeness of the output \(a count of which research components are present, not a correctness check\) while producing a more auditable, better\-structured artifact trail, as shown through a persisted\-process\-model analysis and a non\-destructive failure\-recovery walkthrough; a retrospective human study over three stages provides complementary evidence on time, output quality, and integrated experience\.
## Limitations
Our evaluation is a small\-scale, exploratory demonstration rather than a powered comparative study: the pilot uses a limited number of tasks and participants, so the reported differences are directional evidence about workflow orchestration, not causal or statistically powered effects\. Three limits deserve to be stated plainly\. First, holding the backend executor fixed is not an ablation: Dr\. Claw adds a task graph, persistent state objects, a skill library, and workflow instructions as one bundle, so the observed gap cannot be attributed to any single component, and a skill\-only versus orchestration\-only ablation remains the natural next experiment\. Second, completeness counts how many of2121expected research components a run produces; it is a coverage measure, not a correctness check, and establishing scientific soundness would require expert per\-artifact review\. Third, our comparison target is the bare executor that Dr\. Claw wraps: the matched control for what the wrapper adds, but not a state\-of\-the\-art orchestration framework\. Other confounds remain, such as prior familiarity with either interface, and the operator\-facing context\-switch and intervention reductions are measured separately in the human study \(Appendix[A](https://arxiv.org/html/2609.00365#A1)\)\. Our tasks also come from a single domain \(medical\), so transfer of the skill library and the structured Task Graph abstraction to other research areas, particularly open\-ended work where rigid structure may add friction, remains to be shown\. We do not claim model\-level innovation; our contribution is workflow integration, and observed gains depend on configuration choices \(backend model, permission settings, and skill coverage\)\.
## Acknowledgments
This work was partially supported by the National Science Foundation Grants CRII\-2246067, ATD\-2427915, NSF POSE\-2346158, and NSF POSE\-2449280\.
## Ethics Statement
Dr\. Claw is designed to*assist*research under sustained human control, not to autonomize it\. A recurring concern with AI research systems is that they may flood the literature with unverified or low\-quality output\. Our design responds to this concern directly rather than amplifying it: every stage passes through explicit human checkpoints, final acceptance rests with the researcher, and the Decision Log and Execution Trace keep a complete, auditable record of what was generated, approved, revised, or rejected\. We view this human\-in\-the\-loop, fully\-traceable structure as a safeguard for verifiability, not a shortcut around it\. Critical content \(citations, experimental conclusions, and manuscript claims\) requires human verification before use\. When sensitive data are involved, users should follow least\-privilege permission settings and retain operation traces; in our own study, the medical datasets remain on the authors’ server and are not redistributed, and no patient\-level data are released\. For high\-risk domains such as healthcare, system outputs must not be used directly for real\-world clinical decisions\. Human participation in the user study was voluntary and based on informed consent\. We used AI\-based coding assistants as part of the system under study and for writing assistance, consistent with venue policy\.
## References
- Baeket al\.\(2025\)J\. Baek, S\. K\. Jauhar, S\. Cucerzan, and S\. J\. HwangResearchAgent: iterative research idea generation over scientific literature with large language models\.InProceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies \(Volume 1: Long Papers\),Albuquerque, New Mexico,pp\. 6709–6738\.External Links:[Link](https://aclanthology.org/2025.naacl-long.342/),[Document](https://dx.doi.org/10.18653/v1/2025.naacl-long.342)Cited by:[§1](https://arxiv.org/html/2609.00365#S1.p1.1),[§2\.1](https://arxiv.org/html/2609.00365#S2.SS1.p1.1)\.
- Barkeet al\.\(2022\)S\. Barke, M\. B\. James, and N\. PolikarpovaGrounded copilot: how programmers interact with code\-generating models\.arXiv preprint arXiv:2206\.15000\.External Links:[Link](https://arxiv.org/abs/2206.15000)Cited by:[§1](https://arxiv.org/html/2609.00365#S1.p1.1)\.
- Brownet al\.\(2020\)T\. B\. Brown, B\. Mann, N\. Ryder, M\. Subbiah, J\. Kaplan, P\. Dhariwal, A\. Neelakantan, P\. Shyam, G\. Sastry, A\. Askell, S\. Agarwal, A\. Herbert\-Voss, G\. Krueger, T\. Henighan, R\. Child, A\. Ramesh, D\. M\. Ziegler, J\. Wu, C\. Winter, C\. Hesse, M\. Chen, E\. Sigler, M\. Litwin, S\. Gray, B\. Chess, J\. Clark, C\. Berner, S\. McCandlish, A\. Radford, I\. Sutskever, and D\. AmodeiLanguage models are few\-shot learners\.arXiv preprint arXiv:2005\.14165\.External Links:[Link](https://arxiv.org/abs/2005.14165)Cited by:[§1](https://arxiv.org/html/2609.00365#S1.p1.1)\.
- Caiet al\.\(2024\)Y\. Cai, S\. Mao, W\. Wu, Z\. Wang, Y\. Liang, T\. Ge, C\. Wu, W\. You, T\. Song, Y\. Xia, N\. Duan, and F\. WeiLow\-code LLM: graphical user interface over large language models\.InProceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies \(Volume 3: System Demonstrations\),Mexico City, Mexico,pp\. 12–25\.External Links:[Link](https://aclanthology.org/2024.naacl-demo.2/),[Document](https://dx.doi.org/10.18653/v1/2024.naacl-demo.2)Cited by:[§1](https://arxiv.org/html/2609.00365#S1.p2.1),[§2\.1](https://arxiv.org/html/2609.00365#S2.SS1.p1.1)\.
- Chenet al\.\(2021\)M\. Chen, J\. Tworek, H\. Jun, Q\. Yuan, H\. P\. de Oliveira Pinto, J\. Kaplan, H\. Edwards, Y\. Burda, N\. Joseph, G\. Brockman, A\. Ray, R\. Puri, G\. Krueger, M\. Petrov, H\. Khlaaf, G\. Sastry, P\. Mishkin, B\. Chan, S\. Gray, N\. Ryder, M\. Pavlov, A\. Power, L\. Kaiser, M\. Bavarian, C\. Winter, P\. Tillet, F\. P\. Such, D\. Cummings, M\. Plappert, F\. Chantzis, E\. Barnes, A\. Herbert\-Voss, W\. Guss, A\. Nichol, A\. Paino, N\. Tezak, J\. Tang, I\. Babuschkin, S\. Balaji, S\. Jain, W\. Saunders, C\. Hesse, A\. N\. Carr, J\. Leike, J\. Hilton, R\. Nakano, C\. Hesse, and J\. SchulmanEvaluating large language models trained on code\.arXiv preprint arXiv:2107\.03374\.External Links:[Link](https://arxiv.org/abs/2107.03374)Cited by:[§1](https://arxiv.org/html/2609.00365#S1.p1.1)\.
- Dakhelet al\.\(2022\)A\. M\. Dakhel, V\. Majdinasab, A\. Nikanjam, F\. Khomh, M\. C\. Desmarais, and Z\. M\. JiangGitHub copilot ai pair programmer: asset or liability?\.arXiv preprint arXiv:2206\.15331\.External Links:[Link](https://arxiv.org/abs/2206.15331)Cited by:[§1](https://arxiv.org/html/2609.00365#S1.p1.1)\.
- Dibiaet al\.\(2024\)V\. Dibia, J\. Chen, G\. Bansal, S\. Syed, A\. Fourney, E\. Zhu, C\. Wang, and S\. AmershiAUTOGEN STUDIO: a no\-code developer tool for building and debugging multi\-agent systems\.InProceedings of the 2024 Conference on Empirical Methods in Natural Language Processing: System Demonstrations,pp\. 72–79\.External Links:[Link](https://aclanthology.org/2024.emnlp-demo.8/),[Document](https://dx.doi.org/10.18653/v1/2024.emnlp-demo.8)Cited by:[§1](https://arxiv.org/html/2609.00365#S1.p2.1),[§2\.1](https://arxiv.org/html/2609.00365#S2.SS1.p1.1)\.
- Flores\-Saviagaet al\.\(2025\)C\. Flores\-Saviaga, B\. V\. Hanrahan, K\. Imteyaz, S\. Clarke, and S\. SavageThe impact of generative AI coding assistants on developers who are visually impaired\.InProceedings of the CHI Conference on Human Factors in Computing Systems,New York, NY, USA\.External Links:[Document](https://dx.doi.org/10.1145/3706598.3714008),[Link](https://doi.org/10.1145/3706598.3714008)Cited by:[§1](https://arxiv.org/html/2609.00365#S1.p2.1),[§2\.2](https://arxiv.org/html/2609.00365#S2.SS2.p1.1)\.
- FlowiseAI \(2026\)FlowiseAIFlowise: build AI agents, visually\.Note:[https://github\.com/FlowiseAI/Flowise](https://github.com/FlowiseAI/Flowise)Open\-source project; repository archived 13 August 2026Cited by:[§2\.1](https://arxiv.org/html/2609.00365#S2.SS1.p1.1)\.
- Garikaparthiet al\.\(2025\)A\. Garikaparthi, M\. Patwardhan, L\. Vig, and A\. CohanIRIS: interactive research ideation system for accelerating scientific discovery\.InProceedings of the 63rd Annual Meeting of the Association for Computational Linguistics \(Volume 3: System Demonstrations\),pp\. 592–603\.Cited by:[§2\.1](https://arxiv.org/html/2609.00365#S2.SS1.p1.1)\.
- Guet al\.\(2024\)K\. Gu, R\. Shang, T\. Althoff, C\. Wang, and S\. M\. DruckerHow do analysts understand and verify ai\-assisted data analyses?\.InProceedings of the CHI Conference on Human Factors in Computing Systems,New York, NY, USA\.External Links:[Document](https://dx.doi.org/10.1145/3613904.3642497),[Link](https://doi.org/10.1145/3613904.3642497)Cited by:[§1](https://arxiv.org/html/2609.00365#S1.p2.1),[§2\.2](https://arxiv.org/html/2609.00365#S2.SS2.p1.1)\.
- Jimenezet al\.\(2024\)C\. E\. Jimenez, J\. Yang, A\. Wettig, S\. Yao, K\. Pei, O\. Press, and K\. NarasimhanSWE\-bench: can language models resolve real\-world GitHub issues?\.InInternational Conference on Learning Representations,External Links:[Link](https://arxiv.org/abs/2310.06770)Cited by:[§1](https://arxiv.org/html/2609.00365#S1.p1.1)\.
- Kawaharaet al\.\(2019\)J\. Kawahara, S\. Daneshvar, G\. Argenziano, and G\. HamarnehSeven\-point checklist and skin lesion classification using multitask multimodal neural nets\.IEEE Journal of Biomedical and Health Informatics23\(2\),pp\. 538–546\.External Links:[Document](https://dx.doi.org/10.1109/JBHI.2018.2824327),[Link](https://doi.org/10.1109/JBHI.2018.2824327)Cited by:[§5\.1](https://arxiv.org/html/2609.00365#S5.SS1.p1.1)\.
- Kazemitabaaret al\.\(2024a\)M\. Kazemitabaar, J\. Williams, I\. Drosos, T\. Grossman, A\. Henley, C\. Negreanu, and A\. SarkarImproving steering and verification in ai\-assisted data analysis with interactive task decomposition\.InProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology,New York, NY, USA\.External Links:[Document](https://dx.doi.org/10.1145/3654777.3676345),[Link](https://doi.org/10.1145/3654777.3676345)Cited by:[§1](https://arxiv.org/html/2609.00365#S1.p2.1),[§2\.2](https://arxiv.org/html/2609.00365#S2.SS2.p1.1)\.
- Kazemitabaaret al\.\(2024b\)M\. Kazemitabaar, R\. Ye, X\. Wang, A\. Z\. Henley, P\. Denny, M\. Craig, and T\. GrossmanCodeAid: evaluating a classroom deployment of an LLM\-based programming assistant that balances student and educator needs\.InProceedings of the CHI Conference on Human Factors in Computing Systems,New York, NY, USA\.External Links:[Document](https://dx.doi.org/10.1145/3613904.3642773),[Link](https://doi.org/10.1145/3613904.3642773)Cited by:[§1](https://arxiv.org/html/2609.00365#S1.p2.1),[§2\.2](https://arxiv.org/html/2609.00365#S2.SS2.p1.1)\.
- LangChain \(2026\)LangChainLangGraph: a low\-level orchestration framework for stateful agents\.Note:[https://docs\.langchain\.com/oss/python/langgraph/overview](https://docs.langchain.com/oss/python/langgraph/overview)Software documentation; accessed 30 August 2026Cited by:[§2\.1](https://arxiv.org/html/2609.00365#S2.SS1.p1.1)\.
- Luet al\.\(2024\)C\. Lu, C\. Lu, R\. T\. Lange, J\. Foerster, J\. Clune, and D\. HaThe AI scientist: towards fully automated open\-ended scientific discovery\.arXiv preprint arXiv:2408\.06292\.External Links:[Link](https://arxiv.org/abs/2408.06292)Cited by:[§1](https://arxiv.org/html/2609.00365#S1.p1.1),[§1](https://arxiv.org/html/2609.00365#S1.p3.1),[§2\.1](https://arxiv.org/html/2609.00365#S2.SS1.p1.1)\.
- OpenAI \(2023\)OpenAIGPT\-4 technical report\.arXiv preprint arXiv:2303\.08774\.External Links:[Link](https://arxiv.org/abs/2303.08774)Cited by:[§1](https://arxiv.org/html/2609.00365#S1.p1.1)\.
- Qianet al\.\(2024\)C\. Qian, W\. Liu, H\. Liu, N\. Chen, Y\. Dang, J\. Li, C\. Yang, W\. Chen, Y\. Su, X\. Cong, J\. Xu, D\. Li, Z\. Liu, and M\. SunChatDev: communicative agents for software development\.InProceedings of the 62nd Annual Meeting of the Association for Computational Linguistics \(Volume 1: Long Papers\),Bangkok, Thailand,pp\. 15174–15186\.External Links:[Link](https://aclanthology.org/2024.acl-long.810/),[Document](https://dx.doi.org/10.18653/v1/2024.acl-long.810)Cited by:[§1](https://arxiv.org/html/2609.00365#S1.p3.1)\.
- Schicket al\.\(2023\)T\. Schick, J\. Dwivedi\-Yu, R\. Dessì, R\. Raileanu, M\. Lomeli, E\. Hambro, L\. Zettlemoyer, N\. Cancedda, and T\. ScialomToolformer: language models can teach themselves to use tools\.arXiv preprint arXiv:2302\.04761\.External Links:[Link](https://arxiv.org/abs/2302.04761)Cited by:[§1](https://arxiv.org/html/2609.00365#S1.p1.1)\.
- Schmidgallet al\.\(2025\)S\. Schmidgall, Y\. Su, Z\. Wang, X\. Sun, J\. Wu, X\. Yu, J\. Liu, M\. Moor, Z\. Liu, and E\. BarsoumAgent laboratory: using LLM agents as research assistants\.InFindings of the Association for Computational Linguistics: EMNLP 2025,Suzhou, China,pp\. 5977–6043\.External Links:[Link](https://aclanthology.org/2025.findings-emnlp.320/),[Document](https://dx.doi.org/10.18653/v1/2025.findings-emnlp.320)Cited by:[§1](https://arxiv.org/html/2609.00365#S1.p1.1),[§1](https://arxiv.org/html/2609.00365#S1.p3.1),[§2\.1](https://arxiv.org/html/2609.00365#S2.SS1.p1.1)\.
- Tanget al\.\(2025\)J\. Tang, L\. Xia, Z\. Li, and C\. HuangAI\-researcher: autonomous scientific innovation\.arXiv preprint arXiv:2505\.18705\.External Links:[Link](https://arxiv.org/abs/2505.18705)Cited by:[§1](https://arxiv.org/html/2609.00365#S1.p3.1)\.
- Wuet al\.\(2023\)Q\. Wu, G\. Bansal, J\. Zhang, Y\. Wu, B\. Li, E\. Zhu, L\. Jiang, X\. Zhang, S\. Zhang, J\. Liu, A\. H\. Awadallah, R\. W\. White, D\. Burger, and C\. WangAutoGen: Enabling Next\-Gen LLM Applications via Multi\-Agent Conversation\.arXiv\.Note:arXiv:2308\.08155 \[cs\]External Links:[Link](http://arxiv.org/abs/2308.08155),[Document](https://dx.doi.org/10.48550/arXiv.2308.08155)Cited by:[§1](https://arxiv.org/html/2609.00365#S1.p3.1)\.
- Xieet al\.\(2024\)L\. Xie, C\. Zheng, H\. Xia, H\. Qu, and C\. Zhu\-TianWaitGPT: monitoring and steering conversational llm agent in data analysis with on\-the\-fly code visualization\.InProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology,New York, NY, USA\.External Links:[Document](https://dx.doi.org/10.1145/3654777.3676374),[Link](https://doi.org/10.1145/3654777.3676374)Cited by:[§1](https://arxiv.org/html/2609.00365#S1.p2.1),[§2\.2](https://arxiv.org/html/2609.00365#S2.SS2.p1.1)\.
- Yamadaet al\.\(2025\)Y\. Yamada, R\. T\. Lange, C\. Lu, S\. Hu, C\. Lu, J\. Foerster, J\. Clune, and D\. HaThe AI scientist\-v2: workshop\-level automated scientific discovery via agentic tree search\.arXiv preprint arXiv:2504\.08066\.External Links:[Link](https://arxiv.org/abs/2504.08066)Cited by:[§1](https://arxiv.org/html/2609.00365#S1.p3.1),[§2\.1](https://arxiv.org/html/2609.00365#S2.SS1.p1.1)\.
- Yanget al\.\(2024\)J\. Yang, C\. E\. Jimenez, A\. Wettig, K\. Lieret, S\. Yao, K\. Narasimhan, and O\. PressSWE\-agent: agent\-computer interfaces enable automated software engineering\.arXiv preprint arXiv:2405\.15793\.External Links:[Link](https://arxiv.org/abs/2405.15793)Cited by:[§1](https://arxiv.org/html/2609.00365#S1.p1.1)\.
- Yang and Weng \(2025\)L\. Yang and Y\. WengResearStudio: a human\-intervenable framework for building controllable deep\-research agents\.InProceedings of the 2025 Conference on Empirical Methods in Natural Language Processing: System Demonstrations,pp\. 896–905\.External Links:[Link](https://aclanthology.org/2025.emnlp-demos.69/),[Document](https://dx.doi.org/10.18653/v1/2025.emnlp-demos.69)Cited by:[§1](https://arxiv.org/html/2609.00365#S1.p1.1),[§2\.1](https://arxiv.org/html/2609.00365#S2.SS1.p1.1)\.
- Yaoet al\.\(2022\)S\. Yao, J\. Zhao, D\. Yu, N\. Du, I\. Shafran, K\. Narasimhan, and Y\. CaoReAct: synergizing reasoning and acting in language models\.arXiv preprint arXiv:2210\.03629\.External Links:[Link](https://arxiv.org/abs/2210.03629)Cited by:[§1](https://arxiv.org/html/2609.00365#S1.p1.1)\.
- Yuet al\.\(2025\)H\. Yu, K\. Xuan, F\. Li, K\. Zhu, Z\. Lei, J\. Zhang, Z\. Qi, K\. Richardson, and J\. YouTINYSCIENTIST: an interactive, extensible, and controllable framework for building research agents\.InProceedings of the 2025 Conference on Empirical Methods in Natural Language Processing: System Demonstrations,pp\. 558–590\.External Links:[Link](https://aclanthology.org/2025.emnlp-demos.41/),[Document](https://dx.doi.org/10.18653/v1/2025.emnlp-demos.41)Cited by:[§1](https://arxiv.org/html/2609.00365#S1.p1.1),[§2\.1](https://arxiv.org/html/2609.00365#S2.SS1.p1.1)\.
## Appendix AHuman\-Study Evaluation \(Retrospective Three\-Condition Study\)
As complementary evidence to the automated evaluation in Section 5, we retain the retrospective three\-condition human study from the prior submission\. It compares no AI tools \(No\-AI\), general\-purpose web/desktop AI assistants \(e\.g\., ChatGPT, Gemini, Claude;Web/Desktop\-AI\), andDr\. Clawover three research stages \(Ideation, Experiment, Publication\), on four metrics: completion\-time bands, stage output score \(blind rating, 1–5\), switching\-count bands, and experience score\. The study uses a hybrid design—live logs for Dr\. Claw and retrospective reports for the two controls—so all statistics are exploratory rather than causal\.
\(a\)Time\-band distributions \(h/d/w/m: hour/day/week/month\)\.
\(b\)Switching\-count band distributions\.
\(c\)Mean performance \(Perf\) and experience \(Exp\); error bars: SE\.
Figure 8:Human\-study results across three systems and three stages\. Heatmap intensity denotes percentage within each system\-stage cell\.#### Results\.
Across all three stages, Dr\. Claw is associated with shorter completion\-time bands \(Figure[8\(a\)](https://arxiv.org/html/2609.00365#A1.F8.sf1); mainly<<1h and 1h–1d\), the highest stage output scores \(Figure[8\(c\)](https://arxiv.org/html/2609.00365#A1.F8.sf3); Dr\. Claw\>\>Web/Desktop\-AI\>\>No\-AI\), and lower switching bands with higher experience scores \(Figure[8\(b\)](https://arxiv.org/html/2609.00365#A1.F8.sf2)\)\. The omnibus signal is strongest and fully pairwise\-significant for Experience, with Time Band also significant in Stages 2–3\.
### A\.1Participants and Data Collection
We recruited seven AI PhD participants \(subfields: high\-performance AI, medical AI, and large language models\), all with stable research and paper\-writing experience and informed consent\. To reduce unfamiliarity bias, each was given a three\-week free\-use period for Dr\. Claw before formal comparison\. Under the hybrid design, C3 \(Dr\. Claw\) participants performed tasks under a unified task framework with live logs, while C1 \(No\-AI\) and C2 \(Web/Desktop\-AI\) were reported retrospectively \(time, switching\-count, and experience ranges\) using the same stage definitions\. Stage outputs in all conditions were scored by blind raters with the same stage\-specific rubrics; to reduce recall bias, we required recallable tasks within the most recent month and a unified timing protocol\.
### A\.2Stage Definitions and Rubrics
We divide the workflow into three research stages:Stage 1 \(Ideation\)idea generation and problem framing;Stage 2 \(Experiment\)experiment setup, data processing, and analysis \(excluding model runtime\); andStage 3 \(Publication\)drafting and final polishing\. Stage output is rated on a 1–5 scale by blind raters using stage\-specific rubrics: Stage 1 on novelty, feasibility, literature coverage, and clarity of problem definition; Stage 2 on reasonableness of setup, correctness of analysis, and quality of interpretation; Stage 3 on structural completeness, technical accuracy, readability, and reproducibility information\.
#### Logging and statistics\.
Logs are organized at participant–system–stage granularity: Dr\. Claw live logs record start/end time, stage duration, and switching count, while retrospective questionnaire values for the controls are normalized to the same metric definitions\. Because retrospective data are included, statistics are exploratory: we apply Friedman tests for overall comparisons and Holm\-corrected pairwise Wilcoxon tests post\-hoc\.
### A\.3Detailed Statistical Results
Stage\-wise Friedman tests usen=7n=7matched participants; each entry reportsχ2\(2\),p\\chi^\{2\}\(2\),pper stage \(S1/S2/S3\), followed by Holm\-corrected pairwiseppversus Dr\. Claw for No\-AI and Web/Desktop\-AI \(each as \{S1,S2,S3\}\)\.
- •Time Band:8\.96,0\.01148\.96,0\.0114/13\.56,0\.001113\.56,0\.0011/14\.00,<0\.00114\.00,\{<\}0\.001\. Pairwise: No\-AI \{0\.1250,0\.0469,0\.0469\}, Web/Desktop\-AI \{0\.1250,0\.0469,0\.0469\}\.
- •Switching Band:1\.50,0\.47241\.50,0\.4724/11\.57,0\.003111\.57,0\.0031/10\.75,0\.004610\.75,0\.0046\. Pairwise: No\-AI \{1\.0000,0\.0938,0\.0625\}, Web/Desktop\-AI \{1\.0000,0\.0938,0\.0469\}\.
- •Performance:9\.25,0\.00989\.25,0\.0098/11\.57,0\.003111\.57,0\.0031/11\.31,0\.003511\.31,0\.0035\. Pairwise: No\-AI \{0\.0938,0\.0938,0\.0469\}, Web/Desktop\-AI \{0\.1250,0\.0938,0\.0625\}\.
- •Experience:12\.29,0\.002112\.29,0\.0021/13\.56,0\.001113\.56,0\.0011/12\.07,0\.002412\.07,0\.0024\. Pairwise: both controls \{0\.0469,0\.0469,0\.0469\}\.
Key validity threats: limited sample size, system\-familiarity differences, recall bias in retrospective controls, exclusion of model runtime in Stage 2, and subjectivity in experience scores\.
## Appendix BSystem Overview Details
### B\.1Formal Model
The write\-back step isArtifactt\+1=Artifactt∪ΔArtifactt\\mathrm\{Artifact\}\_\{t\+1\}=\\mathrm\{Artifact\}\_\{t\}\\cup\\Delta\\mathrm\{Artifact\}\_\{t\}, whereΔArtifactt\\Delta\\mathrm\{Artifact\}\_\{t\}is the set of newly added or revised artifacts in one iteration; task\-node statuses update along dependencies \(pending→\\rightarrowrunning→\\rightarrowdone\) with full histories retained inExecution Trace\. Dr\. Claw’s target follows: lowering orchestration overhead while preserving output quality and controllability\.
### B\.2Implementation, Recovery, and Reproducibility
Implementation\.Project initialization creates a fixed stage\-folder layout for Ideation, Experiment, and Publication, plus a persistent pipeline\-state store holding configuration, the research brief, and the task list\. Task nodes store normalized fields \(ID, status, priority, dependencies, stage, type, required inputs, suggested skills, next\-action prompt\); the server resolves status aliases and selects the next task by dependency completion, reading stage\-specific skill recommendations from a stage\-skill map\.Skill lifecycle\.The catalogue holds171171skills,8787of them top\-level entries with their ownSKILL\.md; three in\-house families supply most \(aris\-\*,4444;inno\-\*,1616;ds\-\*,1414\), the rest imported from public collections\.*Authoring*is file\-based: a skill is a directory whose frontmatter carriesnameanddescription, commonlyversion,license,allowed\-tools, andargument\-hint, plus optionalstage/domainkeys feeding the dashboard tag index\.*Validation*parses the frontmatter, rejects aSKILL\.mdlacking aname, applies pre\-flight schema and dependency checks, and version\-stamps activated skills for replay and audit\.*Selection*runs by stage\-map resolution, keyword auto\-load, or manual invocation: the resolver unions a stage’s base skills with those for the task’s type and writes them to the task node, reaching5858skills across five stages \(survey1111, ideation1414, experiment1818, publication2222, promotion33\);3030top\-level skills are not yet stage\-mapped\.*Transfer*to a new domain edits one JSON map rather than code\. Dr\. Claw uses backend adapters for the Claude and Codex SDKs \(with Cursor hooks\) and enforces action constraints via explicit policy settings \(allowed/disallowed tools, permission mode, sandbox/approval\)\. Pipeline mutations are written to persistent state first, then broadcast over WebSocket, keeping the interface synchronized to the same source of truth\.
Failure handling and recoveryoperate at three levels:*pipeline/file*\(missing paths, unreadable files, and JSON parse errors return explicit 4xx/5xx responses; initialization recreates pipeline\-state defaults\),*permission*\(allow/deny checks with explicit denial reasons and bounded approval timeouts\), and*session*\(abort\-supported execution with structured error events and consistent lifecycle states\)\. Recovery relies on non\-destructive task mutation APIs—update status, revise content, append tasks, continue from pending/in\-progress nodes—supporting*revise/retry/handoff*recovery without deleting prior states\.
Reproducibility\.Setup requires Node\.js LTS \(v22 recommended\), a standard install\-and\-run command sequence, and environment configuration\. Each run should archive the instance metadata and pipeline\-state files together with stage artifacts from Ideation, Experiment, and Publication\. A minimum replication checklist: fix the same repository revision, lockfile, and runtime versions \(Node, backend SDK/model\); keep the same permission profile, three\-stage task definitions with Stage\-2 model\-runtime exclusion, and time\-/switching\-band discretization; preserve blinded rubrics and rater instructions; and export raw pipeline state and run\-time logs as supplementary material\.Similar Articles
AutoResearchClaw: Self-Reinforcing Autonomous Research with Human-AI Collaboration
AutoResearchClaw is a multi-agent autonomous research system that improves scientific discovery through structured debate, self-healing execution, and human collaboration, outperforming previous systems on the ARC-Bench benchmark by 54.7%.
VisualClaw: A Real-Time, Personalized Agent for the Physical World
VisualClaw is a self-evolving multimodal agent that reduces deployment costs through hybrid encoding and skill evolution, while improving video-QA accuracy across multiple benchmarks.
@steipete: People freaking out over my AI spend. What nobody sees: Part of what excites me so much about working on OpenClaw is th…
A developer shares how they extensively use multiple Codex AI agents to automate PR reviews, issue dedup, security scanning, and more for the OpenClaw project, while also introducing Crabbox, a tool for remote agent workspaces.
I’m building DystopAI, a Nexus for OpenClaw agents that can work, schedule, communicate, and adapt to real workflows
DystopAI is a local desktop command center for managing OpenClaw AI agents with an intuitive UI. It enables agent creation, role assignment, scheduling, and multi-channel communication to streamline real-world workflows.
@clerk: Vibe coding your next app? Your AI agent can add production auth in minutes. Clerk Skills gives it the context to get a…
Clerk launches Clerk Skills, installable packages for AI coding agents that enable them to implement production authentication across multiple frameworks. The skills work with popular AI agents like Claude Code, Cursor, and GitHub Copilot, allowing developers to automate auth setup, custom sign-in flows, and user management.