trace-judge

A joint study by LangChain Labs and Fireworks AI demonstrates fine-tuning an open Qwen model to create a trace judge that detects 'perceived error' in production traces, achieving frontier performance at up to 100x lower cost. The model is evaluated on two internal datasets and shows generality across applications.