Glimmer 1 - Glint Research. A foundational 10,000 parameter language model

Reddit r/LocalLLaMA Models
language-model small-model open-source research huggingface fineweb-edu

Summary

Introduces Glimmer, a 10,000 parameter language model trained on 500K tokens of FineWeb-Edu with a standard Llama architecture, available on HuggingFace.

We introduce Glimmer, a 10k base model trained on 500K tokens of FineWeb-Edu. The context window is 512 tokens The arch is standard llama (LlamaForCausalLM) 16 hidden dims 2 layers 4 attention heads 1 KV head (GQA) And the rest is on [https://huggingface.co/Glint-Research/Glimmer-1-Base](https://huggingface.co/Glint-Research/Glimmer-1-Base) AMA for as long as this post is up. Have fun! \# Benchmarks * arc\_easy (acc): 25.46% * wikitext-2 (word\_perplexity): 1,765,201 * wikitext-2 (byte\_perplexity): 14.73 * wikitext-2 (bits\_per\_byte): 3.8806 * BLiMP (acc): 52.43%
Original Article

Similar Articles

Introducing Muse Glimmer

Simon Willison's Blog

Meta introduces Muse Glimmer, a new 30B open-weights model under Apache 2.0, optimized for agentic task completion, reliable tool use, and multi-step reasoning. Simon Willison tests it locally with LM Studio and llm-coding-agent.

unsloth/GLM-5.3-Flash-GGUF

Hugging Face Models Trending

GLM-5.3-Flash is the first natively multimodal model in the GLM-5 series, with 320B total parameters and 18B active, utilizing a hybrid sparse-linear attention architecture to reduce costs while outperforming previous versions and approaching Claude Opus 4.8 on benchmarks.

zai-org/GLM-5.3-Flash

Hugging Face Models Trending

GLM-5.3-Flash is the first natively multimodal model in the GLM-5 series, with 320B total parameters and 18B active parameters, outperforming previous versions and approaching Claude Opus 4.8 through a redesigned hybrid architecture for improved efficiency.