[BIG DATASET RELEASE] - SupraLabs/reasoning-corpus-4K-5M-v1 - Train your tiny SLMs to think!

Reddit r/LocalLLaMA Tools
dataset-release reasoning chain-of-thought hugging-face open-source fine-tuning tiny-models

Summary

SupraLabs releases reasoning-corpus-4K-5M-v1, a 5M-sample reasoning dataset for training small language models (SLMs), featuring chain-of-thought traces and ChatML format, hosted on Hugging Face.

https://preview.redd.it/b7ybs7nqx5fh1.png?width=3440&format=png&auto=webp&s=e6aaaa15cbe59debaae1ebb7fcd708167e86dc35 Hey r/LocalLLaMA ! We are back and we have something really amazing today. Our big 5M samples Reasoning Corpus dataset. This dataset features 5 million rows of: - repo_id --> where it's from - tok_len --> how many tokens it is in total - user --> the user promot - thought_trace --> the exact chain-of-thought of the model - assistant --> the final AI models' answer - ChatML --> the user, thought_trace and assistant in ChatML format All samples are within a 5k sequence length to make it fit perfectly for SFT/finetuning a tiny model. Link to the dataset on Hugging Face 🤗: https://huggingface.co/datasets/SupraLabs/reasoning-corpus-4K-5M-v1 Link to the SupraLabs Hugging Face org 🤗: https://huggingface.co/SupraLabs Also, if you want to support our work, give us a follow on Hugging Face, share and review our work, and give us as much feedback as you want ❤️🔥🤗 Already more 250 people are trusting in us and our work! We hope, this dataset is useful for you all and we'd love to see your creations upon this. This dataset has already >1k downloads and over 80 likes - be the next one to use it 🔥🎉
Original Article

Similar Articles

A Very Big Video Reasoning Suite

Papers with Code Trending

This paper introduces the Very Big Video Reasoning (VBVR) dataset and benchmark, a large-scale resource with over one million video clips across 200 reasoning tasks, enabling systematic study of spatiotemporal reasoning and showing early signs of emergent generalization.

GigaChat-3.5-Reasoning

Reddit r/LocalLLaMA

This article presents a collection on Hugging Face featuring GigaChat 3.5 Reasoning models, which are large AI models optimized for reasoning tasks in various formats.

Domyn-Small: A European 10B Reasoning Language Model

arXiv cs.CL

Domyn-Small is a 10-billion-parameter open-weight reasoning language model released under MIT license, trained on 9 trillion tokens and optimized for reasoning, instruction following, and tool use. It achieves strong accuracy-efficiency balance against peers like Qwen3.5-9B and OLMo-3-7B-Think.