middleware

A concept for a privacy middleware that anonymizes sensitive data before sending to LLMs to protect privacy, with local placeholder mapping, seeking feedback on feasibility.

The author developed a personal data scrubber middleware for MCP servers to redact personal information before it reaches AI, improving privacy and helping with EU regulatory compliance.

This article provides 10 steps to optimize AI agent decision-making by using the langchain-typesafe tool, reducing LLM call costs to $0.042 per million tokens and latency to 70-500ms while preventing hallucinations.

German defense company Rheinmetall has open-sourced its Battlesuite connected weapon system protocol, releasing the onboardapi library and middleware for seamless communication between sensor systems and software components, built on the DDS standard.

LangChain and AWS have partnered to release AgentCore Payments middleware, allowing AI agents to automatically handle payments for API usage through the x402 protocol, with integrated budgeting and tracking in LangSmith.

An essay celebrating Django's middleware and model abstractions, explaining how they provide long-term leverage in the Buttondown codebase.

A new middleware layer for agent memory called Collapse Aware AI moves retained-state influence into the behavior-selection layer, separating memory storage from memory influence. The system allows comparison between baseline and governed behavior, and offers inspectable intermediate states.

A blog post from Inngest detailing how adding a second middleware corrupts TypeScript types due to a loophole in type constraint checking, and explaining the root cause involving optional properties and conditional types.

This paper proposes Sentinel Gateway, a middleware layer that enforces strict separation between trusted instruction channels and untrusted data channels to mitigate prompt injection in LLM agents, using signed runtime authorization tokens and offering audit logging capabilities.

Gjallarhorn is a from-scratch web framework for the Odin programming language, providing an HTTP server, router, middleware, template engine, and ORM with PostgreSQL support, all with no external dependencies.

A guide on building custom agent harnesses using LangChain's create_agent, focusing on middleware for customization.

ActionFence is an open-source middleware that enforces spend caps, policy limits, and security checks for AI agents and MCP servers, with v0.2 adding rolling-window caps, circuit breaker, and schema drift detection.

Introduces PHI // DRIFT, a cognitive middleware that enhances LLMs with persistent homeostatic needs, salience-weighted memory, and a Jungian shadow module, claiming that architecture produces measurably different behavior than model scale. Preprint under review.

Relay is a ledger-based middleware for secure and auditable agent handoffs in multi-agent systems, featuring append-only context, snapshot recovery, and hard-cap budgeting to prevent context corruption and data leaks.

Presents S-Bus, an HTTP middleware that uses a DeliveryLog mechanism to automatically reconstruct read sets and enforce Observable-Read Isolation consistency, preventing structural race conditions in multi-agent LLM coordination.

Google announces Genkit middleware, composable hooks that intercept AI generation calls enabling retries, fallbacks, tool approval, and skills for building reliable agentic applications.

Google announces Genkit Middleware, a composable middleware system for the Genkit open-source framework to add retries, fallbacks, human-in-the-loop approvals, and observability to agentic applications. It is available now for TypeScript, Go, and Dart, with Python support coming soon.

The article introduces Sentinel Gateway, a security middleware designed to guarantee safety for AI agents by restricting actions to predefined scopes, preventing data leaks, and ensuring full traceability of agent actions.

Introduces Sentinel Gateway, a security middleware designed to enforce strict scope and safety constraints on AI agents, preventing unauthorized actions like data deletion or leakage while ensuring full traceability.

ActionFence is an open-source middleware tool for enforcing security policies, such as spend caps and identity tiers, on MCP servers and Express APIs to protect against agent misuse.