Tag
A curated collection of LLM inference recipes and performance benchmarks for popular hardware configurations, including NVIDIA RTX Pro 6000 Blackwell, H100, AMD Strix Halo, and RTX 5090, with detailed batch size, quantization, and throughput data.