Tag
Delta Inference Engine 是一个 Windows 原生推理引擎，可在单张消费级 NVIDIA GPU 上以 2-bit 量化运行 5520 亿参数的 DeepSeek-V4.1-Flash-1017，RTX 3090 上生成速度达 41 tok/s，并提供 OpenAI 兼容 API。
开源工具 workbuddy2api-hub 将腾讯 WorkBuddy/CodeBuddy 的原生模型服务反向代理为标准 OpenAI 兼容接口（含 Anthropic Messages），支持多账号调度、设备指纹隔离与 Web 看板，可直接接入 ClaudeCode 等终端 Agent 工具。
The author benchmarks a local coding agent setup—Qwen3.8-27B Q4_K_M on a 24GB RTX 3090 via llama.cpp with OpenCode—reporting throughput figures, four bounded Python coding tasks (three passing checks), and a reasoning-budget failure where the model exhausted its 8K output allowance without producing a patch.
Albertsons Companies is expanding its partnership with OpenAI, launching a new Safeway grocery shopping experience inside ChatGPT that lets shoppers plan meals, build carts, and check out with AI-driven recommendations, while also rolling out ChatGPT Enterprise internally.
OpenAI has released GPT-6 Sol, a new AI model, which is now accessible through their API.
A tweet outlines key skills such as LangChain, LangGraph, and OpenAI API needed for a six-figure AI Engineer position, with a link to a project for hands-on learning.
WebLLM is a high-performance in-browser LLM inference engine that leverages WebGPU for hardware acceleration and is fully compatible with the OpenAI API, enabling local execution of open-source language models.
This article describes an experiment showing that GPT-5.6 Sol can consistently stop before making a tool call by setting a numeric threshold just above a boundary, with all 25 test pairs demonstrating the expected behavior.
OpenAI introduces Zero Data Retention for eligible API customers and previews Private Safety Processing to identify patterns across interactions without accessing customer content, enhancing safety while preserving privacy.
Simon Willison releases llm-chat-completions-server 0.1a0, a plugin that runs a local OpenAI Chat Completions-compatible server backed by any installed LLM models, using content-addressable logs for efficient conversation state.
Feiteng Li announces the release of EdgeSpeak, a local-first, privacy-preserving accurate transcription service. It supports drag-and-drop audio/video or microphone recording transcription, semantic segmentation, word-level timestamps, and export to JSON/SRT/MD. It is compatible with OpenAI Audio API, CLI, SKILL, and MCP workflows.
parakeet.cpp enables running NVIDIA Parakeet ASR behind the OpenAI API locally with prebuilt Docker images, supporting CPU and CUDA (including arm64) for real-time transcription with word timestamps.
The article discusses the high cost of developing OpenClaw, an AI-driven tool, with its creator spending over $1.3 million on OpenAI API tokens in a single month, leading to painful updates.
NVIDIA offers free AI inference via DGX Cloud with OpenAI-compatible API for popular models like DeepSeek, MiniMax, Kimi, GLM, and Llama, claimable in 5 minutes.
SwiftLM is a Swift-native LLM inference server for Apple Silicon that runs large models without Python, using SSD streaming to load MoE weights and enabling 122B models on 64 GB Macs.
TRUSTBANK has integrated AI agents powered by OpenAI's API into its Furusato Choice platform to help users personalize hometown tax donation gifts through conversational recommendations and intelligent search.
India-based fintech CRED partnered with OpenAI to build AI-powered tools—Cleo (customer-facing chatbot), Thea (agent support), and Stark (operations SOP management)—resulting in a 14-point CSAT improvement and 98% resolution accuracy. The company is expanding these AI capabilities across all business lines to deliver concierge-like experiences at scale.
Rogo, an enterprise AI finance platform, scales its AI-driven financial research using OpenAI's models (GPT-4o, o1, o1-mini) to serve 5,000+ bankers across investment banks and private equity firms. The platform has achieved 27x ARR growth by automating financial analysis tasks and saving analysts 10+ hours weekly on meeting prep, company profiling, and market research.
Rox, a startup leveraging OpenAI's models and APIs, launches an AI-powered sales platform that unifies fragmented data and uses agent swarms to boost sales rep productivity by 50% and increase customer engagement by 35%.
Ada uses GPT-4 and a multi-agent system powered by OpenAI's API to improve customer service quality, doubling resolution rates from 30% to 60-80% while maintaining high containment rates, establishing a new industry standard beyond traditional metrics.