Tag
文章主张评测(evals)是企业成为 AI-native 的最大障碍,并给出了 eval-driven development 的指南:定义好的行为、对 agent 进行测试、将失败案例转化为回归测试,并介绍了 grader、case、run、trace 四个核心概念以及确定性检查、参考答案比对等四种打分方式。
Andrew Ng has released the latest AI Engineer skill map, detailing six core competencies for building and deploying AI applications, and emphasizing the importance of the Eval loop in AI system engineering.
Rippling shared how they built Rippling AI, a natural language assistant for HR and payroll, using a flat LangGraph agent, generic tools, SQL-based data retrieval, and eval-driven development.