Tag
HardenedLinux 发布开源编译器优先的 AI 推理运行时 SonicBoom v0.0.3，声称在 RTX 3050 上解码速度超过 llama.cpp，并呼吁社区贡献 GPU 基准测试结果。
NVIDIA BioNeMo Inference Runtime accelerates biomolecular structure-prediction models using optimized kernels, CUDA Graphs, and Ray for high throughput while maintaining PyTorch workflow integration.
mere.run is a local-first inference runtime for Apple Silicon and headless Linux that provides a single CLI for text, image, video, music, 3D, and more without requiring Python.
Embodied.cpp is a portable C++ inference runtime that enables efficient deployment of vision-language-action and world-action models across heterogeneous edge devices and robots through modular execution layers and optimized inference.
Conifer launches as an open-source local AI runtime and IDE, offering native inference on Mac, Linux, and Windows with its own Metal engine and a sandboxed local agent called Typhoon.