@ClementDelangue: This is how how much data AI builders are storing on HF Xet (replaced git storage fully in ~Nov 25). Feels like this is…
Summary
Clement Delangue highlights the massive amount of data AI builders are storing on Hugging Face's Xet storage system, predicting it will reach exabytes soon. A reply frames this as a 'Stargate for Data' with labs on track to spend over $100B/year on data by 2030.
View Cached Full Text
Cached at: 07/06/26, 10:22 PM
This is how how much data AI builders are storing on HF Xet (replaced git storage fully in ~Nov 25). Feels like this is just the beginning and should get to exabytes soon! https://t.co/nta1UsfDgm
will depue (@willdepue): A Stargate for Data
Labs are on a trajectory towards >$100B/year of data spend by 2030. As we begin the trillion-dollar compute project, we need to think about the equivalent civilizational-scale effort for the other core ingredient: data.
At the foundation of the scaling
Similar Articles
@ClementDelangue: AI teams shouldn’t have to choose between expensive object storage and painful git workflows. @huggingface Storage is b…
Hugging Face launches Storage Buckets, a purpose-built storage solution for AI teams offering per-TB pricing, built-in CDN, and Xet deduplication for model weights, datasets, and checkpoints.
@willdepue: A Stargate for Data Labs are on a trajectory towards >$100B/year of data spend by 2030. As we begin the trillion-dollar…
The article argues that AI scaling is hitting data limits, requiring a civilizational-scale data effort similar to compute projects, and predicts over $100B/year in data spending by 2030.
@ClementDelangue: The scale of the infra on HF is insane. If you're still hosting models, datasets, agent memory,... in S3 or R2, talk to…
Clement Delangue promotes Hugging Face's infrastructure for hosting models, datasets, and agent memory, claiming it's better, faster, cheaper, and safer than S3 or R2.
@julien_c: “Your data lives on Hugging Face. Your compute runs on Vast GPUs.” I love this!!
vast.ai now supports Hugging Face Storage Buckets as a cloud connection, allowing rented GPU instances to pull datasets and checkpoints directly from HF buckets and push results back without manual transfers.
Hugging Face Storage Buckets (Website)
Hugging Face introduces Storage Buckets, a scalable object storage service for AI teams with per-TB pricing, Xet deduplication, built-in CDN, and no git overhead, designed for datasets, model checkpoints, and ML artifacts.