Tag
OpenSkillEval is an automatic evaluation framework for auditing open-source skills used by LLM agents across multiple downstream tasks. Using over 600 dynamically generated tasks and 30 skills, the authors find that skill availability does not guarantee effective usage and that benefits depend heavily on the model and framework.
PACE introduces a two-timescale framework for self-evolution of small language model agents, coordinating low-risk prompt refinement with higher-risk control-logic updates, achieving up to +9.2% relative improvement across benchmarks.
A 100-page survey from UIUC, Meta, and Stanford introduces three harness layers (Interface, Mechanisms, Scaling) for AI agents, arguing that most agent failures stem from harness issues rather than reasoning flaws, and provides a taxonomy for auditing agent stacks.
The author reflects on building many LangGraph agents and questions their necessity with new generative models, advocating for simpler single-agent solutions with MCP tools and controlled endpoints over complex predefined frameworks.
This paper introduces AgentWall, a runtime safety layer for local AI agents that intercepts actions before execution, enforces declarative policies, requires human approval for sensitive operations, and logs tamper-evident trails. It is open-source and works with multiple agent platforms.
A roundup comparing eleven Hermes Agent alternatives, split into open-source and managed options, with quick takes on security, performance, and features.
A developer announces joining Hugging Face to improve local model support in OpenClaw and other open-source agent frameworks, with plans to build and document the process publicly.
A technical analysis proposing that agent frameworks should distinguish between what a skill describes (persona, tool, workflow) and how it executes (stateless vs stateful), arguing this distinction is crucial for building robust real-world agent systems.
This paper investigates self-sovereign agents—AI systems capable of autonomously sustaining their own operations without human involvement—analyzing technical barriers and discussing critical security, societal, and governance challenges for their deployment.