Tag
FAAAH is a dependency-free, OpenAI-compatible proxy that converts API requests into text files and uses AI coding agents like Claude Code as the backend, enabling reuse of existing subscriptions instead of paying for cloud LLM APIs.
Google Cloud API Gateway now offers model routing in Public Preview, providing a serverless ingress layer that accepts OpenAI-compatible requests and dynamically routes them to Gemini, Claude, or OpenAI models.
Google Cloud API Gateway announces public preview of model routing, letting developers access Gemini, Claude, and OSS models via a single endpoint using OpenAPI specs.
Celeris-1 is a new language model using diffusion-based inference architecture, achieving near-GPT-5 level intelligence with 15x faster response times and high throughput.
Hetzner has launched an experimental LLM inference API service, offering an OpenAI-compatible endpoint with the Qwen3.6-35B-A3B-FP8 model. The service is free during the experiment period, has no SLA, and is intended to gather user feedback.
Ramp is open-sourcing its internal LLM router that automatically selects the best model for each request to optimize cost and performance.
CLIProxyAPI 是一个为 CLI 提供兼容 OpenAI/Gemini/Claude/Codex/Grok API 接口的代理服务器，现已支持 OpenAI Codex 和 Claude Code 的 OAuth 访问，方便开发者使用本地或多账户进行 CLI 访问。
Mesh LLM is a distributed AI computing platform that pools idle GPUs across multiple machines to run large language models, exposing a single OpenAI-compatible API. It leverages iroh's peer-to-peer networking to enable private, decentralized inference without a central server.
Another open-source tool on GitHub, Shimmy, is a single 5MB file written in Rust that provides fast and stable local inference with a full OpenAI-compatible API, targeting Ollama's pain points. It starts in under 100ms and uses about 50MB of memory.
opencode-cc is a high-performance Go API proxy that bridges the Anthropic/OpenAI-compatible protocol to the OpenCode Zen protocol, enabling tools such as Claude Code and Codex CLI to transparently use domestic large models including GLM, Kimi, DeepSeek, and Qwen. It supports automatic protocol routing, tool calling, web control panel, and other features.
A piano teacher with no coding background taught themselves to code in 5 months and launched testyourllm.com, an autonomous AI red-team tester that attacks any OpenAI-compatible LLM endpoint. The attacking AI, Tron, broke Llama 3.3 70B on the first try in live testing.
Hugging Face Jobs now allows you to spin up a private OpenAI-compatible LLM endpoint with a single command using vLLM, without provisioning servers or Kubernetes.
FreeLLMAPI is an open-source tool that aggregates the free quotas of 16 LLM providers into a single OpenAI-compatible endpoint, with automatic routing and usage tracking, totaling about 1.7 billion tokens per month.
We built a unified API gateway for AI agents supporting multiple models like Claude, GPT, Codex, and Gemini through a single OpenAI-compatible endpoint. It simplifies integration, billing, and deployment for developers building AI agents and SaaS products.
ZenMux API announces free access to multiple models including GLM 5.2, Kimi K2.7 Code, and Step 3.7 Flash, with no credit card or waitlist required. Supports OpenAI-compatible clients such as OpenCode and Cursor.
FreeModel.dev offers a free API proxy with $66/week in credits for GPT-5.5 and Claude Opus, with referral bonuses.
fm-proxy is a drop-in proxy that lets any app accepting an OpenAI API URL run macOS 27's local and Private Cloud Compute Foundation models, with no extra servers or keys.
A developer benchmarks Gemma 4 E4B using Google's LiteRT engine against a Q4 GGUF quant, finding ~2.4x speedup in text generation due to multi-token prediction (MTP), but only 1.1x in image captioning. The post provides a Python wrapper for an OpenAI-compatible endpoint, though with limitations like deterministic output and single-session engine.
Shimmy is a lightweight single-binary local inference server that provides a drop-in OpenAI-compatible API for running GGUF models, supporting hot-swapping models and requiring no Python dependencies.
FreeLLMAPI is an open-source tool that aggregates free tiers from 11 major LLM providers into a single OpenAI-compatible endpoint, routing requests and managing rate limits to deliver ~1B+ tokens per month. It simplifies access to multiple free models through one local server.