Tag
Netflix shares their in-house LLM serving method using vLLM and Triton inference server, providing an OpenAI-compatible API and detailing deployment strategies and production trade-offs.
This article details the reverse engineering of Microsoft's Windows Copilot to create a free API compatible with OpenAI's interface, allowing access to GPT-4 without an API key or billing.