Laion Big Video Dataset

Hacker News Top Papers

Summary

LAION-BVD is a massive open video dataset for multimodal pre-training, containing 80 million videos and achieving competitive performance on standard benchmarks, released to support open research in AI.

No content available
Original Article
View Cached Full Text

Cached at: 08/27/26, 03:19 AM

# LAION Big Video Dataset Source: [https://projects.laion.ai/bvd/](https://projects.laion.ai/bvd/) Open Research Dataset ·Marianna Nezhurina2,3,\*·Mehdi Cherti2,3·Andrej Radonjic4·Thaddäus Wiedemer5,1·Christoph Schuhmann2·Romain Beaumont2·Wieland Brendel5·Bernhard Schölkopf5·A\. Sophia Koepke1,6,◇·Jenia Jitsev2,3,◇·Matthias Bethge1,◇ [Read Paper](https://arxiv.org/abs/2608.24845)[Download Dataset](https://projects.laion.ai/bvd/download.html)[GitHub](https://github.com/LAION-AI/BVD) [https://projects.laion.ai/bvd/#scale](https://projects.laion.ai/bvd/#scale) \*Shared first authors•◇Shared last authors 1Tübingen AI Center, University of Tübingen2LAION3JSC, FZJ4Wynd Labs5MPI for Intelligent Systems, ELLIS Institute Tübingen6MCML, Technical University Munich Affiliated Institutions Overview ## Abstract We present**LAION\-BVD**\(LAION — Big Video Dataset\), a large\-scale open video dataset for multimodal learning, containing*1\.3B platform\-specific video URLs*collected from CommonCrawl\. From these, we download 80M videos with a total duration of*10 million hours*\. The dataset is designed for multimodal pre\-training across video, audio, and image modalities\. Using content\-aware scene detection, we extract clips for which we synthetically generate video and audio captions\. Models trained on these data achieve competitive performance on standard video\-text and audio\-text benchmarks, with consistent improvements as training or model scale increases\. Additionally, we explore video frames as an alternative source of image\-text data by extracting scene\-changing frames\. These frames exhibit a visual distribution distinct from standard web image corpora, and models trained on this dataset achieve strong image\-text retrieval performance\. We release LAION\-BVD to the research community\. It significantly expands open access to multimodal videos at an unprecedented scale\. By the Numbers ## Unprecedented Scale The largest openly accessible video corpus for multimodal learning research 🔗 0 Video URLs Platform\-specific URLs collected from Common Crawl 🎬 0 Downloaded Videos Successfully downloaded and processed videos ⏱️ 0 Total Duration Combined video content across all downloads ✂️ 0 Annotated Clips Clips with generated video captions 🖼️ 0 Extracted Frames Video frames for image\-text pre\-training Benchmarks ## Experimental Results Models trained on LAION\-BVD achieve competitive performance across video, audio, and image\-text benchmarks ### Video\-Language Benchmarks ViCLIP models trained on LAION\-BVD match or exceed InternVid\-trained models by up to 2\.1% on standard video\-text benchmarks, with consistent improvements as training scale grows from 10M to 50M clips\. - Up to \+2\.1% over InternVid \(FLT\) baseline - Consistent gains across 10M\-50M clips - 55M clips with synthetic video captions ### Audio\-Language Benchmarks CLAP models trained on LAION\-BVD achieve competitive performance against other large\-scale uncurated audio datasets, leveraging rich in\-the\-wild soundscapes extracted directly from video\. - Competitive with uncurated audio datasets - Audio\-text pairs from diverse video - Good scaling trends on when increasing model and data scale ### Image\-Text Benchmarks Frame\-based CLIP models achieve strong image\-text retrieval performance on standard benchmarks\. Video frames exhibit a visual distribution distinct from typical web corpora, complementing existing image pre\-training sources\. - Strong retrieval on standard benchmarks - 300M frames with unique visual distribution - Complements standard web image datasets Responsible Use ## Ethics & Release Statement LAION\-BVD is released to support open and reproducible multimodal research at scale\. Large\-scale video datasets and the models trained on them are increasingly concentrated within a small number of predominantly proprietary technology companies, limiting independent scientific investigation and reproducibility\. By providing an open resource for academic research, we aim to broaden access to multimodal training data and enable more transparent evaluation of large\-scale video, audio, and image models\. LAION\-BVD is released*exclusively for research purposes and not for commercial use*\. The dataset is intended to support scientific research, reproducibility, safety analysis, and the study of multimodal foundation models and related systems\. We encourage users to respect the rights and copyright of content creators and to use the dataset responsibly and in accordance with applicable laws and platform terms\. Like other large\-scale web datasets, LAION\-BVD may contain biases, stereotypes, and uneven representation across languages, regions, and topics\. Models trained on this data may inherit such biases\. Researchers using the dataset should be aware of these limitations and, where relevant, evaluate and report them alongside model capabilities\. Reference ## Citation ``` @misc{laionbvd2026, title={LAION-BVD: A 10-Million-Hour Open Video Dataset for Multimodal Pre-training}, author={Andreas Hochlehnert and Marianna Nezhurina and Mehdi Cherti and Andrej Radonjic and Thaddäus Wiedemer and Christoph Schuhmann and Romain Beaumont and Wieland Brendel and Bernhard Schölkopf and A. Sophia Koepke and Jenia Jitsev and Matthias Bethge}, year={2026}, eprint={2608.24845}, archivePrefix={arXiv}, primaryClass={cs.CV}, url={https://arxiv.org/abs/2608.24845}, } ```

Similar Articles

HumanNet: Scaling Human-centric Video Learning to One Million Hours

Hugging Face Daily Papers

HumanNet is a large-scale human-centric video dataset with one million hours of annotated footage, designed to train vision-language-action models. It demonstrates that egocentric human video can effectively replace robot data for embodied intelligence tasks.

VideoChat3: Fully Open Video MLLM for Efficient and Generalist Video Understanding

Papers with Code Trending

VideoChat3 is a fully open, efficient, and generalist video-centric multimodal large language model that introduces Inflated 3D Vision Transformer (I3D-ViT) and Adaptive Frame Resolution for streaming video perception, along with scalable video data synthesis pipelines, achieving superior performance with only 4B parameters.

PHANTOM: A Large-Scale Dataset of Multimodal Adversarial Attacks for Vision-Language Models

arXiv cs.AI

Introduces PHANTOM, a large-scale open-source dataset of pre-generated adversarial attacks for vision-language models, covering 1010 high-level categories and 55 subcategories of harmful intents with 47,524 adversarial samples. The dataset aims to lower the barrier for adversarial research and enable systematic evaluation of VLM robustness and safety.