Tag
A test of the open-weight MiniMax M3 model using MLX-VLM on a Mac Studio shows it can autonomously fill out a US customs form from a driver's license photo and a scanned document, using tool calls for fields, checkboxes, and signature.
MLX-VLM v0.6.0 is released, adding speculative decoding, an agent-ready server compatible with Anthropic's API, new models (DeepSeek V4, ZAYA1-VL, etc.), image generation/editing, and audio input support, enabling local AI agents on Apple devices.
Next MLX-VLM release includes improvements with a preview of Eagle3 speculative decoding for Gemma 4 models.
A user benchmarked MTP (Multi-Token Prediction) on Gemma 4 with mlx-vlm on M4 Max Studio, finding it excellent for code generation (1.53x faster, 66% acceptance) but detrimental for JSON output (50% slower, only 8% acceptance) and neutral for long-form prose, suggesting MTP benefits vanish when acceptance drops below 50%.