localai

#localai

@ivanfioravanti: Another reason to try vllm.cpp!

X AI KOLs Timeline ↗ · 2026-09-19 Cached

Ettore Di Giacinto announces support for GLiNER2.5 in vllm.cpp and LocalAI, enabling easy model swapping via systemone API.

0 favorites 0 likes

#localai

@mudler_it: LocalAI ( @LocalAI_API ) 4.2.0 is out, just few numbers and facts: - +392 commits ( we squash these ) - +11 Backends: v…

X AI KOLs Following ↗ · 2026-05-11

LocalAI 4.2.0 is released, featuring over 392 commits, 11 new backends including voice and face recognition, improved support for sglang and VLLM, and contributions from over 16 new developers.

0 favorites 0 likes

#localai

@no_stp_on_snek: turboquant+ is now a swappable backend in LocalAI alongside tinygrad and sglang. if you're running GGUF models and want…

X AI KOLs Following ↗ · 2026-04-20

turboquant+ backend added to LocalAI, enabling longer context for GGUF models without hardware upgrade.

0 favorites 0 likes

localai

@ivanfioravanti: Another reason to try vllm.cpp!

@mudler_it: LocalAI ( @LocalAI_API ) 4.2.0 is out, just few numbers and facts: - +392 commits ( we squash these ) - +11 Backends: v…

@no_stp_on_snek: turboquant+ is now a swappable backend in LocalAI alongside tinygrad and sglang. if you're running GGUF models and want…

Submit Feedback