[RELEASE] Supra-Router-51M - a tiny prompt routing model/orchestrator

Reddit r/LocalLLaMA Models

Summary

SupraLabs releases Supra-Router-51M, a tiny 51M parameter model for routing prompts to appropriate larger or smaller models, enabling low-latency orchestration. A companion dataset is also released.

Hey r/LocalLLaMA ! SupraLabs is back with a new model. Supra-Router-51M. Basically, this is a model which is made for routing requests to smaller or bigger models - based on the user prompt/request. This is so cool, because it has only 51M parameters and so it can be used in low-latency environments. Here are some samples: Samples Link to the HF Hub model: https://huggingface.co/SupraLabs/Supra-Router-51M With this model, we also shipped a dataset (which we trained our model on!): https://huggingface.co/datasets/SupraLabs/Prompt-Routing-Dataset Have fun! Feel free to give us feedback! ❤️ 🤗
Original Article

Similar Articles

SupraLabs/Supra-Router-51M

Hugging Face Models Trending

SupraLabs releases Supra-Router-51M, a 51.7M parameter micro-LLM for multi-task infrastructure routing, designed to decide whether to process prompts locally on edge or send them to cloud-hosted models. Fine-tuned on a small dataset, it uses multi-task sequence generation for robust routing.

[NEW] Supra-50M Released!

Reddit r/LocalLLaMA

SupraLabs released Supra-50M, a compact 50M-parameter causal language model with base and instruct versions, trained on 20B tokens from fineweb-edu, achieving competitive benchmarks against larger models like GPT-2 and SmolLM.