Tag
A fully offline, CPU-only voice loop for local LLMs using Silero VAD, Parakeet STT, and Supertonic TTS, integrated via a one-command installer. Works with Ollama, LM Studio, and various agent frameworks.
The author released a pure Rust, CPU-only inference implementation of the LFM2.5-8B-A1B model (4-bit Q4KM quantization), achieving a decode speed of approximately 37 tokens/s and memory usage around 7GB. The goal is to make LLMs runnable on cheap VPS or older machines. The implementation is open source and published as a cargo crate.
Open-source PDF parser OpenDataLoader converts 100 pages to Markdown per second, runs on CPU only, free and open-source, developed by the PDF Association and veraPDF team, ranking first in benchmarks.
Tsplat is a Rust-based CLI tool that renders 3D Gaussian Splatting scenes directly in the terminal using only the CPU, even over SSH. It supports Unicode half-blocks and graphics protocols, with controls for navigation and auto-orbit.
Describes PHI // DRIFT, a cognitive architecture with seven homeostatic state variables that drift between sessions, memory scored by emotional salience and time decay, and a Jungian shadow module, built on a CPU-only mini tower and submitted as a preprint to SSRN.
A preprint on SSRN presents PHI // DRIFT, a cognitive middleware architecture for AI companions with persistent internal state and salience-weighted memory retrieval, claiming 14.8% more context per prompt versus cosine-only RAG on consumer hardware.
yapsnap is a command-line tool for transcribing video/audio from various sources (YouTube, TikTok, etc.) to plain text using only CPU, no GPU or cloud required. It leverages sherpa-onnx and yt-dlp for offline, fast transcription.