@LangChain: You can use the LangSmith CLI to pull your flagged traces, classify each one by issue type, and build an eval dataset w…
Summary
This article explains how to use the LangSmith CLI to manage traces and build evaluation datasets through a quick tutorial.
View Cached Full Text
Cached at: 09/10/26, 06:11 AM
You can use the LangSmith CLI to pull your flagged traces, classify each one by issue type, and build an eval dataset with a split for each.
A 3 minute tutorial ⤵️ https://t.co/sXLOImwVZJ
Similar Articles
@LangChain: .@AdamRLucek on how we use traces to build evals for production agents.
Adam Łucek discusses how LangChain uses trace data to build evaluations for production agents.
@LangChain: Point a coding agent at the LangSmith CLI and it can build you an online LLM-as-a-judge: define the rubric, wire it to …
A tutorial on using a coding agent with LangSmith CLI to set up an online LLM-as-a-judge for evaluating LLM traces, all configurable from the terminal.
@LangChain: We built a tracing plugin that turns every @cursor_ai agent session into a structured trace in LangSmith: the model run…
LangChain released a tracing plugin that converts every Cursor AI agent session into a structured trace in LangSmith, including model runs, tool calls, and nested subagent work, part of a series comparing coding-agent traces.
@LangChain: .@CreditGenie_US has debugged thousands of agent traces with LangSmith. LangSmith traceability allows them to see exact…
CreditGenie uses LangSmith to debug thousands of agent traces and generate targeted test questions from production data.
@LangChain: We built a tracing plugin for every Codex session into LangSmith. Now every turn (tool calls, token usage, subagent thr…
LangChain released a tracing plugin for Codex sessions in LangSmith, enabling detailed traces of every turn including tool calls and token usage, configurable with just two blocks and a flag.