Tag
EdgeWise 是一个边缘-云协作框架,在本地部署小语言模型(SLM)作为主要求解器,并通过强化学习在关键步骤选择性地将任务委派给云端大模型,从而在 SWE-Rebench 上降低高达 62%、在 Terminal-Bench 2.1 上降低 34% 的推理成本,同时保持与纯 LLM 执行相当或更好的性能。
Liquid AI is anticipated to release a new 100B parameter Liquid Foundation Model soon, leveraging their fast LLM architectures and high-utility SLMs.
A step-by-step guide on building and fine-tuning small language models, designed for beginners, researchers, and non-programmers, with hands-on examples and Colab notebooks.
Discusses the trade-offs between large language models (LLMs) and small language models (SLMs), questioning whether larger models are always necessary for production use cases and exploring the future of AI deployment.
A 270M parameter language model trained from scratch on English Wikipedia and instruction-tuned for conversational AI, developed as an independent research project.
Explores whether small language models (SLMs) can achieve lossless data compression by deliberately overfitting on training data, rethinking the typical aversion to overfitting in machine learning.
A discussion about Hashicorp founder Mitchell Hashimoto's claim that local AI models aren't good enough yet, countered by evidence that small language models have been effective for coding for over a year.
CogGuard is a proactive-warning framework for edge intelligent services that decouples offline LLM-based profile construction from online SLM-based score prediction, reducing construction time by 48% and fine-tuning time by 19% while achieving lower prediction errors on education and operation datasets.
The user is working on implementing reasoning training with verifiers using Unsloth and TRL, reporting progress on locally generating GRPO-like rollouts with a small SLM and a tiny RM, and promises a video soon.
Neural_avb releases a lightweight Answer-eq Reward Model for RL training on QA tasks, claiming 80% agreement with external judge LM and faster than F1/ROUGE/BertScore.
A user shares a workflow for training a 9B LLM on an A100 GPU using Google Colab for $13.99 CAD, noting the overnight process and the ease of training small language models.
SupraLabs announces its founding with a focus on training and releasing open-source small language models (SLMs) for edge devices, already publishing models like Supra-Mini-v4-2M on Hugging Face.
User shares a personal list of AI models they use daily (Codex 5.5, Deepseek v4 pro, Kimi 2.6) and for fine-tuning (Qwen 3.5 variants, Gemma4 E4B, GPT-oss 20B), aiming to fine-tune Small Language Models into Expert Language Models.
Two new open-source small language models are being released: one matches state-of-the-art accuracy at up to 93x smaller size, and the other outperforms a recent OpenAI model. The first model drops tomorrow.
A novice asks for recommendations on small language models and prompting strategies to build an employee note summarization engine under 2000 tokens, after experiencing hallucinations with Qwen2.5-7B-Instruct.
Empirical study shows small language models achieve 100% adversarial robustness with System 1 intuition but collapse under System 2 reasoning when used as edge-native governance firewalls in decentralized autonomous organizations.