21 GPU's benchmarked running a small TTS model (vram peak: 5GB)
Summary
A user benchmarks 21 consumer GPUs on vast.ai running a small TTS model (OmniVoice) with peak VRAM of 5GB, comparing performance relative to real-time and to an RTX 3090.
Similar Articles
Benchmarks of 20 small LLMs on a 6GB RTX 4050
A detailed benchmark of 20 small LLMs quantized for a 6GB GPU, measuring speed and VRAM usage at various context lengths, with qualitative probing for tool-use and instruction following. The report aims to help users with modest hardware choose models for local, private automation tasks.
4090 + 5060 Ti + 64GB RAM: 206 t/s on a 35B-A3B, and a 122B at 37 t/s
A user shares benchmark results for running large language models (Qwen 27B-122B) on a dual-GPU setup with RTX 4090 and RTX 5060 Ti, achieving high token generation speeds (e.g., 206 t/s on 35B-A3B, 37-41 t/s on 122B). The post includes setup details and a link to a GitHub repo with scripts and raw data.
I built a local GPU benchmark server for 4B to 35B models because I was tired of synthetic cloud leaderboards and tiny sample tests
A developer built a local GPU benchmark server with two RTX 5060 Ti cards (32GB VRAM) running vLLM to test 12 quantized open-weight models from 4B to 35B across full benchmark datasets, adding wall-clock time efficiency scores and publishing sortable results at llmbenchmarks.io.
@superalesha: Most of you dont know what an 8.4GB model can do on a 12GB RTX 3080 Ti. Qwen3.8-27B made this voxel Japanese pagoda gar…
Showcases the performance of the Qwen3.8-27B AI model running on a 12GB RTX 3080 Ti GPU, achieving 47 tokens per second at 128K context using llama.cpp with specific quantization settings.
Nine models, five coding tasks, one 16GB GPU
A benchmark ran five hard self-contained coding tasks against nine models on a single 16GB RX 9060 XT GPU, grading hidden test cases, randomized oracles, and performance gates. DeepSeek-v4.1-flash and a quantized Qwen3.8-27B (kvstream fork) scored a perfect 5/5, while several other open-weight models failed on algorithmic design tasks like interval scheduling and star-pile pattern matching.