Tag
llmfit is an open-source CLI tool that detects your hardware and ranks over 200 LLMs by which ones will actually run on your system, automatically choosing the best quantization that fits.