Is Qwen3-VL-2B the only viable VLM for JSON extraction on a "potato"?
Summary
The author claims Qwen3-VL-2B is the only viable vision-language model for JSON extraction on low-end hardware, outperforming larger models like Qwen3-VL-4B, yet it is absent from major benchmarks.
Similar Articles
Can Qwen3.6-35B-A3B on an RTX 3060 Replace Google Vision for Receipt-to-JSON Extraction?
A developer shares their experience using a local Qwen VL model on an RTX 3060 to parse Japanese receipts into JSON, replacing Google Vision, with results showing accurate extraction of key fields at ~31 seconds per receipt.
@liquidai: Introducing LFM2.5-VL-1.6B-Extract and LFM2.5-VL-450M-Extract: Vision-language models that return structured JSON, not …
Liquid AI released LFM2.5-VL-1.6B-Extract and LFM2.5-VL-450M-Extract, vision-language models that output structured JSON from images and field lists. The models are open-weight and available in two sizes.
I ran Qwen3.5-0.8B on a sub-$20 CPU chip in under 512MiB of memory
The author ran Qwen3.5-0.8B on a $10-20 Amlogic A113X CPU chip with a custom C runtime, achieving 1.82 tok/s decode and under 490 MiB peak RSS, demonstrating that small LLM inference can run on deployed edge hardware without a GPU.
Running Qwen3.6 35b a3b on 8gb vram and 32gb ram ~190k context
The author shares a high-performance local inference configuration for running Qwen3.6 35B A3B on limited hardware (8GB VRAM, 32GB RAM) using a modified llama.cpp with TurboQuant support, achieving ~37-51 tok/sec with ~190k context.
Qwen3.5 122B is the best?
A user shares their experience comparing several large language models (Qwen, Gemma) on complex tool-calling tasks, finding Qwen3.5 122B the most reliable, while criticizing smaller MoE models for instability.