Tag
The author trained a small language model to replace Gemini Flash for a summarization task, achieving 97% accuracy with 0.06s latency, suitable for deployment in an internal app.
AgentJev-0.6B is a small open-source AI decision model that outperforms Laya on Typed Decisions with improved accuracy and significant computation reduction, enabling faster local inference.
The paper introduces NepLEGiT, a specialized small language model pre-trained from scratch on Nepali legal text to enhance legal knowledge accessibility and service delivery in Nepal.
This article details the release of NVIDIA's Nemotron-3-Nano-4B-GGUF model, a small language model designed for both reasoning and non-reasoning tasks with reasoning controllable via system prompts.
OpenBMB has open-sourced MiniCPM5-2B, a 2B-parameter AI model optimized for reasoning, coding, and tool use on resource-constrained hardware, achieving state-of-the-art performance in its size class and demonstrating effective local deployment capabilities.
Release of MiniCPM5-2B-GGUF, a 2B parameter AI model optimized for on-device deployment, achieving state-of-the-art performance in its class with open-source training datasets.
This article provides a detailed test of the local deployment and performance of the Ling-3.0-tiny model on an Apple M5 chip Mac, demonstrating the feasibility of running a 7.9B parameter model at 47 tokens per second without a discrete GPU.
A developer created a 250M parameter quantized LLM from scratch, trained on 30B tokens, deployable in 60 MB on CPU with a novel disk-based long context system supporting up to 100M tokens.
This paper introduces Daedalus-150M, a hybrid language model combining convolution and attention mechanisms optimized for CPU inference, achieving better benchmark performance than larger models with significantly less training data.
This paper addresses deployment bugs in the Nanbeige4.2-3B Looped Transformer model on Apple Silicon and introduces a memory-efficient chunked-prefill strategy to enable agentic tasks.
Cactus Compute releases Needle 2, a 45M-parameter agentic LLM compressed to a 14MB binary for phones, wearables, smart home and robots, achieving 500+ tokens/sec on a Raspberry Pi 5 and running in 28MB RAM.
Liquid AI releases LFM2.5-2.6B, a compact agentic model designed to run entirely on-device, enabling free inference, low latency, and privacy. The post details its training pipeline including SFT, teacher specialization, distillation, and agentic RL.
Liquid AI releases LFM2.5-2.6B, a compact agentic model designed for on-device deployment, supporting tool calling and multi-step workflows with efficient inference on CPUs and GPUs.
SupraLabs releases Supra2-100M Base and Instruct models, a new small language model family with community-driven improvements, benchmarks, and a GGUF version.
Presents B1ade, a minimalist RAG architecture with a 335M zero-training embedding model and a 1B SLM trained via GRPO on 723M tokens, showing emergent attribution behavior and competitive QA performance without large-scale pretraining.
Nanbeige4.2-3B is a compact 3B parameter general agentic model pretrained from scratch with a Looped Transformer, achieving strong agentic and reasoning performance, outperforming larger models on diverse benchmarks. The model and code are open-sourced.
Compares two new AI models for agentic workloads: the compact Nanbeige4.2-3B with a looped transformer architecture and the large Mixture-of-Experts Laguna S2.1, both released on Hugging Face.
OpenLanguageModel (OLM) is an open-source PyTorch library for building and pretraining small language models with readable, composable architecture code, bridging education and research.
OpenBMB released MiniCPM5-2B, a 2 billion parameter language model, currently not yet available on Hugging Face.
This paper investigates whether GRPO post-training improves a small (4B-8B) language and vision-language model web agent. It finds a controlled null result: no configuration yields credible gains on mastered tasks, and moderate-to-high learning rates cause degradation or collapse, revealing a double dissociation between degrade and collapse regimes.