SupraLabs releases Supra2-100M Base and Instruct models, a new small language model family with community-driven improvements, benchmarks, and a GGUF version.
Hey guys! After a LOT of good feedback on our previous models like Supra-50M-Instruct and -Reasoning, many community likes, follows and upvotes we saw many community requests asking for new models. We've inspired a lot of people with our work - and now we're presenting the all new Supra2 family. And our first release here is: Supra2-100M base and Instruct. Here are some samples: Prompt: "What is google?" Answer: Google is a web-based platform that allows users to search and find information on the web. It's a social media platform that uses algorithms to make recommendations based on various factors such as location, time of day, and interests. Google has a number of features that make it easy to find information, including: - Searching for keywords and phrases related to various topics, like books, movies, or music - Analyzing website traffic and traffic patterns - Creating a custom search interface - Suggesting alternative ways to find the information - Providing recommendations for books, articles, and other content - Allowing users to customize the search results One of the main advantages of Google is that it's easy to use, as users can search for the information they need, and then filter the results based on their interests. This makes it accessible to a wider audience. More in the README on HF: Link to the HF models: Base: https://huggingface.co/SupraLabs/Supra2-100M instruct: https://huggingface.co/SupraLabs/Supra2-100M-Instruct Here are benchmarks of how the model compares to smaller and even LARGER models: https://preview.redd.it/gbkjvw07j6hh1.png?width=919&format=png&auto=webp&s=09bdb05952e28915726d1ca9c5ec7971f5a14f28 Have fun using this! 🤗🔥 GGUF version of the instruct model is already in the HF repo! What's next? --> Supra2-Nano, -Small, -Medium ... and ... IMG! Stay tuned for the next relaeses!! You can support us with a follow and a like if you want! 😺
SupraLabs released Supra-50M, a compact 50M-parameter causal language model with base and instruct versions, trained on 20B tokens from fineweb-edu, achieving competitive benchmarks against larger models like GPT-2 and SmolLM.
Supra Labs released Supra Title, a 350M parameter model specialized for generating chat conversation titles. Built on LFM2.5, it runs on any hardware in GGUF format and requires no system prompt.
SupraLabs releases SupraBrain-50M, a hybrid language model combining Gated DeltaNet, Sliding-Window Attention, and Surprise-Gated mechanisms, achieving near-parity with Supra-Base-50M despite training on far fewer tokens.
SupraLabs announces its founding with a focus on training and releasing open-source small language models (SLMs) for edge devices, already publishing models like Supra-Mini-v4-2M on Hugging Face.
SupraLabs released Supra-A2A-Nano-Exp, a small any-to-any autoregressive model that unifies text and image tokenization into a single Transformer, serving as an educational prototype rather than a production-ready system.