Revalvo
Summary
Revalvo is a local-first workbench for prompt engineering and LLM evaluation that allows running prompts against multiple models in parallel, scoring responses, versioning prompts, and batch-testing datasets.
View Cached Full Text
Cached at: 08/28/26, 07:35 AM
Similar Articles
smevals (GitHub Repo)
smevals is an open-source framework for running evals against small and large models, with a structured vocabulary for tasks, configs, runs, and graders, plus a CLI for execution and grading.
@kapicode: I've been using Claude as the "human" prompting @opencode to rebuild reference projects, evaluating four LLMs on the sa…
An evaluation of four LLMs (Qwen, MiniMax, GLM) using Claude as a prompter for the Opencode agent tool reveals that a smaller local model (Qwen 27B on a 3090) outperforms a larger pruned model in coding quality and reliability.
smevals - a small eval suite for evaluating models, prompts, and harnesses
Simon Willison introduces smevals, a small eval suite from Prime Radiant for evaluating models, prompts, and harnesses, with commands to run evals, grade results, and serve static HTML reports.
RECAP: Regression Evaluation for Continual Adaptation of Prompts
Introduces RECAP, a benchmark for evaluating continual learning of prompts under evolving constraints in a proactive adaptation setting. Results show that existing prompt optimization methods fail in this setting, highlighting the need for new methods.
We built an automated QA/eval engine for agent prompts. Help us test it out!
Built an automated QA/eval engine for agent prompts called Baseline that treats prompts like software for regression testing, allowing non-coders to define rubrics and automatically optimize prompts. Currently in limited beta with a 30-day free trial.