Tag
A tool that estimates which LLMs fit on a user's GPU memory, ranking models by performance while considering memory constraints and quantization levels.
llmfit is a terminal tool that detects your hardware and recommends compatible LLM models by scoring quality, speed, fit, and context. It includes an interactive TUI and CLI, supports multiple runtimes, and allows users to benchmark and share performance results.