moondream3.1-9B-A2B

Reddit r/LocalLLaMA Models

Summary

Moondream 3.1 is a vision language model with mixture-of-experts architecture (9B total parameters, 2B active), delivering state-of-the-art visual reasoning, detection, pointing, and captioning, deployable locally via the Photon inference engine or through the Moondream Cloud API.

No content available
Original Article
View Cached Full Text

Cached at: 07/12/26, 07:02 PM

moondream/moondream3.1-9B-A2B · Hugging Face

Source: https://huggingface.co/moondream/moondream3.1-9B-A2B Moondream 3.1 is a vision language model with a mixture-of-experts architecture (9B total parameters, 2B active). It delivers state-of-the-art visual reasoning and detection while staying fast and cheap to deploy. Skills includequery,detect,point, andcaption, all native and all returning structured output.

For the full story on what’s new — including how we trained it and how it holds up on your own tasks — see the release notes.

✨ Playground·☁️ Cloud API·📝 Release notes·📄 License

https://huggingface.co/moondream/moondream3.1-9B-A2B#run-locally-with-photonRun locally with Photon

Photonis Moondream’s high-performance inference engine. It runs the model locally on NVIDIA GPUs (Ampere or newer) and Apple Silicon Macs, with the same API asMoondream Cloud.

pip install moondream
import moondream as md
from PIL import Image

# Runs locally via Photon. Weights download from Hugging Face on first use.
model = md.vl(local=True, model="moondream3.1-9B-A2B")

image = Image.open("photo.jpg")

# Caption
print(model.caption(image)["caption"])

# Visual question answering
print(model.query(image, "What's in this image?")["answer"])

# Open-vocabulary detection
for obj in model.detect(image, "person")["objects"]:
    print(obj)

# Pointing
for point in model.point(image, "person")["points"]:
    print(point)

No API key is required to run the base model locally. (You’ll only need one to run finetunes or to callMoondream Cloud.) For supported hardware, streaming, finetunes, and production serving with Triton, see thelocal inference guide.

https://huggingface.co/moondream/moondream3.1-9B-A2B#cloud-apiCloud API

Prefer a hosted endpoint? The same skills are available throughMoondream Cloudwith a generous free tier. See thequickstartto make your first call.

https://huggingface.co/moondream/moondream3.1-9B-A2B#licenseLicense

Moondream 3.1 is released under theMoondream Model License.

Similar Articles

lucataco/moondream2

Replicate Explore

moondream2 is a compact vision language model designed for efficient edge device inference, with benchmark results and usage instructions provided.

stepfun-ai/Step-3.7-Flash

Hugging Face Models Trending

Step 3.7 Flash is a 198B-parameter sparse MoE vision-language model with 11B active parameters per token, supporting 256k context and three reasoning levels, designed for high-throughput agentic workflows.

Kwai-Keye/Keye-VL-2.0-30B-A3B

Hugging Face Models Trending

Kwai-Keye releases Keye-VL-2.0-30B-A3B, a 30B-class vision-language model with advanced video understanding, sparse attention, and agent capabilities, achieving top benchmarks.

JetBrains/Mellum2-12B-A2.5B-Thinking

Hugging Face Models Trending

JetBrains releases Mellum2-12B-A2.5B-Thinking, an open-source Mixture-of-Experts reasoning model with 131k context length, trained with RLVR for explicit chain-of-thought reasoning.