Tag
This work integrates ggml's Metal kernels into the transformers library, allowing GGUF models to run directly with improved compatibility and performance for fast local inference on Mac.
OpenBMB has launched the MiniCPM-V 4.6 vision language model, which features immediate day-0 support on the MLX-VLM package for high-speed inference on Apple Silicon Macs.