@Xudong07452910: Open-Source Project Recommendation: Agent-Learning-Hub — A Systematic Learning Roadmap and Resource Repository for Building Reliable AI Agents
Summary
Agent-Learning-Hub by DataWhale is a systematic learning roadmap and resource repository for AI Agent development, featuring 8 learning stages and 11 progressive projects to help developers build reliable AI agents from scratch. It has gained 3.9k+ stars.
View Cached Full Text
Cached at: 06/20/26, 02:37 PM
Open Source Project Recommendation: Agent-Learning-Hub —— A Systematic Learning Roadmap and Resource Library for Building Reliable AI Agents
The AI Agent learning roadmap and resource library produced by DataWhale, systematically organizing official documentation, top conference papers, open-source projects, and engineering practices to help developers build practical and reliable AI agents from scratch. Avoid fragmented learning — get an executable growth path directly.
Core Highlights:
- Learning Todo List: 8 stages (from understanding the Agent loop → building a minimal Agent → evaluation & safety), step-by-step from foundations to production level
- Project Ladder: 11 progressive projects (from a simple calculator Agent to a production-level personal Agent), learn by doing
- Curated Resources: Official guides from Anthropic/OpenAI/Google, papers like ReAct/SWE-bench, open-source projects like Claude Code/OpenClaw/LangGraph, and modern skill protocols like MCP/A2A/ACP
- Claude Code Dedicated Path: official docs + replica projects + source code analysis, focusing on harness engineering and tool calling
- Focus on Modern Agent Directions (Claude Code, Skills, RAG, multi-agent), rejecting outdated frameworks
Currently has 3.9k+ stars, active community, continuously updated. It’s a complete roadmap for “how to systematically learn to build tools”. After completing it, you’ll better understand, customize, and build your own AI Agent workflows.
Especially suitable for developers, graduate students, and AI learners who want to systematically master AI Agent engineering from scratch.
https://github.com/datawhalechina/Agent-Learning-Hub…
#AIAgent #ClaudeCode #AI教程 #codex #开源项目
datawhalechina/Agent-Learning-Hub
Source: https://github.com/datawhalechina/Agent-Learning-Hub
Agent Learning Hub
A curated AI Agent learning roadmap for people who want to build useful, reliable agents instead of collecting random links.
This repo only maintains one core display: README. The goal is to organize excellent shares from the community, official blogs, papers, open-source projects, and real engineering experience into an actionable AI Agent learning todo list.
Maintainer
Curated by 陈思州 (https://github.com/jjyaoao) (Datawhale member)
How To Use
- If you’re a beginner: follow the “Learning Todo List” from top to bottom, check off each item.
- If you already know LLM applications: start from Stage 2 or Stage 3, focus on Agent loop, tool calling, evaluation, and engineering.
- If you want to build projects: directly go to “Project Ladder” and build a working project for each level.
- If you only want to find resources: check “Curated Resources”, prioritize official docs and classic papers.
What To Learn Now
The agent field changes quickly. What’s worth investing in now is not the old “role-playing multi-agent framework”, but these directions closer to real productivity:
| Priority | Learn | Why |
|---|---|---|
| 1 | Claude Code / Codex-style coding agents | Real codebases, shell, file editing, testing, permissions, context compression — the best agent engineering samples. |
| 2 | Agent harness engineering | A large part of an agent’s capability comes from the harness: tool protocols, permissions, state, feedback, replay, CI, evaluation. |
| 3 | OpenClaw / Hermes-style personal agents | Long-running, local-first, cross-app, memory, skills, message entry — more like a “personal OS”. |
| 4 | Skills / MCP / A2A / ACP | Skills handle capability reuse, MCP connects tools, A2A connects agents, ACP connects host applications. |
| 5 | Evaluation and safety | An agent without eval, trace, and permission boundaries is just a demo. |
It is not recommended to heavily invest in old crew/role-play frameworks that have become generic templates. They can be understood, but should not be the main line.
Learning Todo List
Stage 0: Understand What An Agent Is
- Distinguish chatbot, workflow, agent, multi-agent.
- Understand the basic agent loop: observe -> think -> act -> observe.
- Know when not to use an agent: when the task is predictable, the process is stable, or a normal script can solve it — using an agent adds uncertainty.
- Read Anthropic: Building effective agents (https://www.anthropic.com/engineering/building-effective-agents).
- Read OpenAI: A practical guide to building agents (https://openai.com/business/guides-and-resources/a-practical-guide-to-building-ai-agents/).
Output: Write a one-page short note answering “Why does my scenario need an agent instead of a normal workflow?”
Stage 1: Build A Minimal Agent Loop
- Use an LLM API for normal conversation.
- Make the model output structured JSON.
- Define a tool function, e.g., search, calculator, read_file.
- Parse the model’s tool call / function call.
- Execute the tool and feed the tool result back to the model.
- Add max steps, timeout, and error handling to the agent loop.
Recommended reading:
- OpenAI Function Calling (https://platform.openai.com/docs/guides/function-calling)
- Gemini API Function Calling (https://ai.google.dev/gemini-api/docs/function-calling)
- Claude Tool Use (https://docs.anthropic.com/en/docs/agents-and-tools/tool-use/overview)
Output: A minimal agent of 50-150 lines that can select tools, execute them, and return the final answer.
Stage 2: Learn Tool Use, RAG, And Memory
- Do retrieval augmented generation: chunk, embed, retrieve, answer with citations.
- Connect search, database, file, browser, code execution as tools.
- Differentiate short-term context, session memory, long-term memory.
- Handle tool failures, empty results, repeated calls, hallucinated citations.
- Make the agent provide sources or evidence in its answer.
Recommended reading:
- LlamaIndex Agents (https://docs.llamaindex.ai/en/stable/use_cases/agents/)
- LangChain Docs (https://docs.langchain.com/)
- Gemini API Code Execution (https://ai.google.dev/gemini-api/docs/code-execution)
- Model Context Protocol (https://modelcontextprotocol.io/)
Open-source project references:
| Project | Why It Fits Stage 2 |
|---|---|
| GPT Researcher (https://github.com/assafelovic/gpt-researcher) | Closest to a “research assistant” product: search, scrape, filter, cite, generate long reports. |
| Open Deep Research (https://github.com/langchain-ai/open_deep_research) | Deep research example written in LangGraph, good for learning multi-turn search, state management, and citation output. |
| STORM (https://github.com/stanford-oval/storm) | Stanford OVAL’s research writing system, good for learning outlines, question asking, multi-perspective synthesis. |
| Khoj (https://github.com/khoj-ai/khoj) | Personal second brain, good for learning local docs, web, semantic search, and long-term memory. |
| Onyx (https://github.com/onyx-dot-app/onyx) | Enterprise-grade RAG/search assistant, good for learning connectors, hybrid search, permissions, and productionization. |
| AnythingLLM (https://github.com/Mintplex-Labs/anything-llm) | Local RAG + agents product, good for beginners to quickly understand the full application form. |
| RAGFlow (https://github.com/infiniflow/ragflow) | Document understanding RAG engine, good for learning ingestion, chunking, retrieval, grounded answers. |
| mem0 (https://github.com/mem0ai/mem0) | Memory layer component, good for learning how to add long-term memory to an agent. |
| Letta (https://github.com/letta-ai/letta) | Memory/context platform for stateful agents, good for learning context management. |
Output: A research assistant that automatically searches, filters, summarizes, and outputs cited links given a topic.
Stage 3: Study One Modern Agent Harness
First, pick one modern agent system to study in depth. The focus here is not “how to call the framework API”, but how it organizes tools, context, permissions, state, logs, subtasks, and feedback.
| System | Best For | Learn This If You Want To |
|---|---|---|
| Claude Code Docs (https://code.claude.com/docs/en/overview) | Coding agent product | Learn CLI, tools, permissions, hooks, subagents, MCP of a real coding agent. |
| learn-claude-code (https://github.com/shareAI-lab/learn-claude-code) | From-scratch agent harness | Replicate a Claude Code-like harness from scratch. |
| claw0 (https://github.com/shareAI-lab/claw0) | From-scratch OpenClaw gateway | Build everything from agent loop to session, channel, gateway, memory, heartbeat, delivery, resilience, concurrency. |
| hello-agents (https://github.com/datawhalechina/hello-agents) | Chinese agent tutorial | Build agents from scratch, suitable for systematically understanding agent principles and practice. |
| OpenClaw (https://github.com/openclaw/openclaw) | Local-first personal agent | Learn local long-running agent, skills, message entry, system tools, and security boundaries. |
| Hermes Agent (https://github.com/NousResearch/hermes-agent) | Self-hosted growing agent | Learn long-term memory, skills, toolsets, multi-platform message gateway, and migration capabilities. |
| CyberClaw (https://github.com/ttguy0707/CyberClaw) | Transparent agent architecture | Learn full behavior auditing, two-stage security calls, dual-level memory, and heartbeat tasks. |
| LangGraph (https://langchain-ai.github.io/langgraph/) | Stateful graph orchestration | Learn state graphs, resumable execution, and controllable orchestration. |
- Read the directory structure of an agent harness.
- Identify its agent loop, tool registry, permission gate, session store, context compaction.
- Run its minimal example and add your own tool.
- Observe a complete trace, explain why each step happens.
- Implement the same task with both a “bare agent loop” and the “harness”, compare the differences.
Output: A debuggable agent harness demo, including README, run steps, example input/output, and failure logs.
Stage 4: Multi-Agent Is Coordination, Not Magic
- Understand common roles: planner / executor / reviewer / critic / router.
- Learn to manage multiple agents using a supervisor or graph, not just letting agents chat randomly.
- Define each agent’s responsibility boundary, input/output schema, and stopping condition.
- Handle loops, arguments, task drift, context bloat.
- Determine when a single agent is better.
Recommended reading:
- Claude Code Subagents (https://code.claude.com/docs/en/sub-agents)
- Claude Code Hooks (https://code.claude.com/docs/en/hooks)
- Google Agent Development Kit (https://google.github.io/adk-docs/)
- Agent2Agent Protocol (https://a2a-protocol.org/latest/specification/)
- Agent Client Protocol (https://agentclientprotocol.com/)
Output: A small multi-agent system, e.g., research -> write -> review -> revise.
Stage 5: Learn Skills, Protocols, And Capability Packaging
Modern agent capabilities come not only from models and tools but also from reusable skills. A good skill is like a small operating manual: tells the agent when to use it, how to use it, which scripts/resources are needed, and how to verify results.
- Understand the difference between Skill and Tool: a tool is a callable interface, a skill is reusable process knowledge.
- Understand the difference between Skill and Prompt: a prompt is usually a one-time instruction, a skill is a discoverable, versioned, and distributable capability package.
- Understand the difference between Skill and MCP: MCP connects external tools/data sources, a skill tells the agent how to complete a class of tasks.
- Read Claude Code Skills file structure and trigger mechanism.
- Read OpenClaw Skills loading, scope, and security boundaries.
-
Write a minimal
SKILL.md, containing name, description, when to use, steps, acceptance criteria. - Add a script or template file to the skill, and explain when the agent should load it.
- Write a smoke test for the skill to verify if it truly improves task success rate.
Recommended reading:
- Claude Code Skills (https://code.claude.com/docs/en/skills)
- Claude Agent Skills (https://docs.claude.com/en/docs/agents-and-tools/agent-skills)
- Claude Code Agent SDK Skills (https://code.claude.com/docs/en/agent-sdk/skills)
- OpenClaw Skills (https://github.com/openclaw/openclaw/blob/main/docs/tools/skills.md)
- Model Context Protocol (https://modelcontextprotocol.io/)
- Agent2Agent Protocol (https://a2a-protocol.org/latest/specification/)
- Agent Client Protocol (https://agentclientprotocol.com/)
Output: A reusable skill, e.g., code-review, research-report, migration-helper, pdf-extraction, or release-note-writer.
Stage 6: Browser And Computer-Use Agents
- Understand the difference between a browser agent and a normal API tool.
- Use Playwright or browser-use for web observation and clicking.
- Add security restrictions to browser operations: not logging into sensitive accounts, not overstepping permissions, not bypassing platform rules.
- Handle page changes, popups, load failures, element location failures.
- Record screenshots, DOM, action logs for review.
Recommended reading:
- Claude Computer Use (https://docs.anthropic.com/en/docs/agents-and-tools/tool-use/computer-use-tool)
- browser-use (https://github.com/browser-use/browser-use)
- WebArena (https://arxiv.org/abs/2307.13854)
- VisualWebArena (https://arxiv.org/abs/2401.13649)
Output: A browser agent that only operates on public web pages, e.g., opening a page, extracting information, generating a summary.
Stage 7: Evaluation, Observability, And Safety
- Prepare a fixed test set for the agent, not just watch demos.
- Record success rate, failure reasons, tool call count, cost, latency.
- Read traces, know if failure occurs in prompt, tool, retrieval, model, or state management.
- Add human confirmation for dangerous tools, e.g., sending emails, deleting files, making payments, publishing content.
- Understand risks like prompt injection, data exfiltration, tool abuse.
- Use regression tests to prevent capability degradation after prompt or tool changes.
Recommended reading:
- OpenAI Evals (https://platform.openai.com/docs/guides/evals)
- OpenAI Agent platform (https://openai.com/agent-platform/)
- LangSmith (https://docs.smith.langchain.com/)
- AgentBench (https://arxiv.org/abs/2308.03688)
- SWE-bench (https://arxiv.org/abs/2310.06770)
Output: An agent eval table with at least 20 tasks, expected results, actual results, failure classification.
Stage 8: Ship A Real Agent
- Has a clear user, clear task, clear success criteria.
- Has logs, traces, error retries, timeout, cost limit.
- Has permission boundaries and human confirmation mechanisms.
- Has a deployment method: CLI, Web app, Slack bot, GitHub Action, or background task.
- Has a README: how to run, how to configure keys, how to extend tools, what limitations.
Output: An agent project that others can clone and run.
Project Ladder
| Level | Project | What You Learn |
|---|---|---|
| 1 | Calculator Agent | Minimal tool call loop |
| 2 | Web Research Agent | Search, filter, cite, summarize |
| 3 | PDF QA Agent | RAG, chunk, retrieval, citation |
| 4 | Coding Review Agent | Read diff, risk ranking, test suggestions |
| 5 | Browser Agent | Page observation, click, extraction, failure recovery |
| 6 | Claude Code-like Nano Agent | Shell, file editing, permissions, session, compact |
| 7 | OpenClaw-like Gateway | Channel, routing, session, memory, heartbeat, delivery |
| 8 | Reusable Skill Pack | SKILL.md, scripts, templates, trigger conditions, smoke test |
| 9 | Multi-Agent Writer | Planner, writer, reviewer collaboration |
| 10 | Personal Agent | OpenClaw/Hermes-style memory, skills, message entry |
| 11 | Production Harness | Evals, trace, permissions, CI, runner, replay |
Curated Resources
Official Guides And Blogs
| Resource | Why It Matters |
|---|---|
| Anthropic: Building effective agents (https://www.anthropic.com/engineering/building-effective-agents) | Must-read introduction to agent design, clarifies the boundary between workflow and agent. |
| Claude Code Overview (https://code.claude.com/docs/en/overview) | Entry point to the most worth-studying coding agent product documentation. |
| Claude Code Subagents (https://code.claude.com/docs/en/sub-agents) | Learn task decomposition, context isolation, dedicated subagents. |
| Claude Code Hooks (https://code.claude.com/docs/en/hooks) | Learn how to intercept, validate, and extend agent behavior. |
| Claude Code GitHub Actions (https://docs.claude.com/en/docs/claude-code/github-actions) | Learn how coding agents enter PR / issue workflows. |
| Claude Code Advanced Patterns (https://resources.anthropic.com/hubfs/Claude%20Code%20Advanced%20Patterns_%20Subagents%2C%20MCP%2C%20and%20Scaling%20to%20Real%20Codebases.pdf) | Official Anthropic material covering subagents, MCP, and scaling to real codebases. |
| OpenAI: A practical guide to building agents (https://openai.com/business/guides-and-resources/a-practical-guide-to-building-ai-agents/) | Product and engineering team oriented agent implementation guide. |
| OpenAI: New tools for building agents (https://openai.com/index/new-tools-for-building-agents/) | Official introduction of Responses API, Agents SDK, tools, and tracing. |
| OpenAI Agents SDK (https://platform.openai.com/docs/guides/agents-sdk/) | OpenAI’s native agent development entry. |
| Claude Tool Use (https://docs.anthropic.com/en/docs/agents-and-tools/tool-use/overview) | Claude tool calling mechanism. |
| Claude Computer Use (https://docs.anthropic.com/en/docs/agents-and-tools/tool-use/computer-use-tool) | Official reference for computer-use agents. |
| Gemini Function Calling (https://ai.google.dev/gemini-api/docs/function-calling) | Gemini tool calling official docs. |
| Gemini Code Execution (https://ai.google.dev/gemini-api/docs/code-execution) | Gemini code execution tool. |
| Google Agent Development Kit (https://google.github.io/adk-docs/) | Google’s agent development framework. |
| Model Context Protocol (https://modelcontextprotocol.io/) | Important protocol for connecting agents to tools and data sources. |
Project Map
Don’t read projects by star count randomly; suggest layering by learning purpose:
| Layer | Study These | Learn |
|---|---|---|
| Build From Scratch | learn-claude-code (https://github.com/shareAI-lab/learn-claude-code), claw0 (https://github.com/shareAI-lab/claw0), hello-agents (https://github.com/datawhalechina/hello-agents) | agent loop, tool registry, session, context compaction, gateway, trace, subagents. |
| Personal / Always-On Agents | OpenClaw (https://github.com/openclaw/openclaw), Hermes Agent (https://github.com/NousResearch/hermes-agent), CyberClaw (https://github.com/ttguy0707/CyberClaw) | long-running, skills, memory, message entry, permissions, security auditing. |
| Coding Agents | Claude Code (https://code.claude.com/docs/en/overview), OpenAI Codex (https://github.com/openai/codex), OpenCode (https://github.com/opencode-ai/opencode), OpenHands (https://github.com/All-Hands-AI/OpenHands), SWE-agent (https://github.com/SWE-agent/SWE-agent), pi (https://github.com/earendil-works/pi) | real codebase editing, shell, testing, sandbox, PR workflows. |
| Agent Harness / SuperAgent Runtime | DeerFlow (https://github.com/bytedance/deer-flow), LangGraph (https://langchain-ai.github.io/langgraph/) | long task execution, sandbox, memory, skills, subagents, message gateway, trace. |
| Deep Research / RAG Agents | GPT Researcher (https://github.com/assafelovic/gpt-researcher), Open Deep Research (https://github.com/langchain-ai/open_deep_research), LlamaIndex (https://docs.llamaindex.ai/) | search, scraping, retrieval, rerank, citation, report generation. |
| Tutorial Encyclopedias | GenAI_Agents (https://github.com/NirDiamant/GenAI_Agents), hello-agents (https://github.com/datawhalechina/hello-agents), smolagents (https://github.com/huggingface/smolagents), agents-towards-production (https://github.com/NirDiamant/agents-towards-production) | horizontally learn ReAct, Plan-and-Execute, Multi-Agent, production patterns. |
| Browser / Multimodal Agents | browser-use (https://github.com/browser-use/browser-use), UI-TARS-desktop (https://github.com/bytedance/UI-TARS-desktop) | browser/desktop operation, visual understanding, action space, failure recovery. |
Skills, Protocols, And Tooling
| Concept | Learn From | What It Solves |
|---|---|---|
| Skills | Claude Code Skills (https://code.claude.com/docs/en/skills), OpenClaw Skills (https://github.com/openclaw/openclaw/blob/main/docs/tools/skills.md) | Package process knowledge, scripts, templates, and acceptance criteria of a class of tasks into reusable capabilities. |
| MCP | Model Context Protocol (https://modelcontextprotocol.io/) | Standardize agent connection to external tools, data sources, and services. |
| A2A | Agent2Agent Protocol (https://a2a-protocol.org/latest/specification/) | Enable discovery, communication, and collaboration between different agents. |
| ACP | Agent Client Protocol (https://agentclientprotocol.com/) | Create a unified interface between editors, terminals, IDEs, host applications, and agents. |
| Skill Quality | SWE-Skills-Bench (https://arxiv.org/abs/2603.15401), Agent Skills analysis (https://arxiv.org/abs/2602.08004) | Evaluate whether skills truly improve success rate rather than create new prompt noise. |
Modern Agent Systems
| System | Why It Is Useful |
|---|---|
| Claude Code (https://code.claude.com/docs/en/overview) | Learn the productized form of coding agents: shell, files, permissions, hooks, subagents, MCP. |
| learn-claude-code (https://github.com/shareAI-lab/learn-claude-code) | Build a Claude Code-like nano agent from scratch, suitable for understanding harness engineering. |
| claw0 (https://github.com/shareAI-lab/claw0) | Build an OpenClaw-like agent gateway from scratch, covering channel, routing, session, memory, delivery, concurrency. |
| hello-agents (https://github.com/datawhalechina/hello-agents) | Chinese agent system tutorial, suitable for systematically filling in agent principles and practice. |
| OpenClaw (https://github.com/openclaw/openclaw) | Local-first personal agent, suitable for researching long-running agents and system-level tool calling. |
| Hermes Agent (https://github.com/NousResearch/hermes-agent) | Self-hosted, long-term memory, skills, message gateway, and toolsets. |
| CyberClaw (https://github.com/ttguy0707/CyberClaw) | Transparent and controllable agent architecture, suitable for researching auditing, two-stage execution, and security boundaries. |
| DeerFlow (https://github.com/bytedance/deer-flow) | ByteDance open-source long-horizon SuperAgent harness. The 2.0 main branch is a general-purpose agent runtime rewritten from scratch, suitable for researching sandbox, memory, skills, subagents, message gateway, and long task execution; the original Deep Research framework is on the 1.x branch. |
| smolagents (https://github.com/huggingface/smolagents) | Hugging Face lightweight agent framework, the CodeAgent idea is worth studying. |
| LangGraph (https://langchain-ai.github.io/langgraph/) | State graphs and controllable agent orchestration, still worth learning as an engineering foundation. |
| Qwen-Agent (https://github.com/QwenLM/Qwen-Agent) | Domestic model ecosystem agent framework for tool calling, RAG, MCP. |
| Pydantic AI (https://pydantic.dev/docs/ai/core-concep | Pydantic AI for building production-grade agents with type safety and structured outputs. |
Similar Articles
@xiaojianjian567: Introduction to the Excellent GitHub Project with 45k Stars: hello-agents. Produced by Datawhale, it gained 1,200+ stars in 7 days and is surging. What does this project do? One-sentence description: Teaches you from scratch how to build real AI Agents—not just by calling APIs, but by understanding core principles, system design, and…
Datawhale's open-source project, hello-agents, is gaining rapid popularity on GitHub. It aims to systematically teach developers the core principles, multi-agent collaboration, and system design required to build AI Agents from scratch, going beyond mere API usage.
@vintcessun: Tonight I came across a learning roadmap project that redefined where to start learning Agent. I used to think Agent was just a pile of tools and frameworks, but its core is the "observe-think-execute" loop and the harness engineering's organization of permissions, state, and backtracking. It breaks down learning into building a minimal Agent loop from scratch all the way to deploying a real Agent, with 8 stages, each with clear deliverables and recommended resources — not just links but an actionable todo list. This systematic approach made me realize my previous learning was too fragmented.
An open-source learning roadmap project called Agent-Learning-Hub, which breaks down AI Agent learning into 8 stages from building a minimal Agent loop to production deployment, providing executable todo lists and recommended resources, maintained by members of the Datawhale community.
datawhalechina/hello-agents
Datawhale社区发布的开源中文教程《从零开始构建智能体》,系统性讲解AI原生智能体的理论与实践,涵盖从基础原理到自研框架HelloAgents的完整学习路径。
@gyro_ai: Most people learn about agents either staying at the conceptual level or jumping directly into frameworks, leaving the middle layer—"why design it this way"—empty. On GitHub, the book "Building Agents from Scratch" by Datawhale covers 16 chapters from basics to multi-agent systems, with its own HelloAgents framework to learn by doing…
Datawhale's open-source tutorial "Building Agents from Scratch" covers memory systems, RAG, context engineering, etc. in 16 chapters, including the HelloAgents framework, suitable for learners who want to deeply understand the internal mechanisms of agents.
@Xudong07452910: Free and Open-Source High-Quality Tutorial Recommendation: 'Building an Agent from Scratch' - A systematic tutorial on Agent principles and practice from zero to advanced, covering: 1. Basic concepts and mainstream paradigms (ReAct, Plan-and-Solve, Reflection, etc.) 2.…
Recommend the free and open-source tutorial 'Building an Agent from Scratch', which systematically explains AI Agent principles and practice, covering mainstream frameworks such as ReAct, AutoGen, LangGraph, and multiple hands-on projects. It has received 53,000+ stars.