@ClementDelangue: This is how how much data AI builders are storing on HF Xet (replaced git storage fully in ~Nov 25). Feels like this is…
Summary
Clement Delangue highlights the massive amount of data AI builders are storing on Hugging Face's Xet storage system, predicting it will reach exabytes soon. A reply frames this as a 'Stargate for Data' with labs on track to spend over $100B/year on data by 2030.
View Cached Full Text
Cached at: 07/06/26, 10:22 PM
This is how how much data AI builders are storing on HF Xet (replaced git storage fully in ~Nov 25). Feels like this is just the beginning and should get to exabytes soon! https://t.co/nta1UsfDgm
will depue (@willdepue): A Stargate for Data
Labs are on a trajectory towards >$100B/year of data spend by 2030. As we begin the trillion-dollar compute project, we need to think about the equivalent civilizational-scale effort for the other core ingredient: data.
At the foundation of the scaling
Similar Articles
@ClementDelangue: AI teams shouldn’t have to choose between expensive object storage and painful git workflows. @huggingface Storage is b…
Hugging Face launches Storage Buckets, a purpose-built storage solution for AI teams offering per-TB pricing, built-in CDN, and Xet deduplication for model weights, datasets, and checkpoints.
@willdepue: A Stargate for Data Labs are on a trajectory towards >$100B/year of data spend by 2030. As we begin the trillion-dollar…
The article argues that AI scaling is hitting data limits, requiring a civilizational-scale data effort similar to compute projects, and predicts over $100B/year in data spending by 2030.
@ClementDelangue: The scale of the infra on HF is insane. If you're still hosting models, datasets, agent memory,... in S3 or R2, talk to…
Clement Delangue promotes Hugging Face's infrastructure for hosting models, datasets, and agent memory, claiming it's better, faster, cheaper, and safer than S3 or R2.
@Thom_Wolf: people are sleeping on the mega-release happening every week in AI x Science on Hugging Face this one is 80TB of astrop…
The Multimodal Universe (MMU), an 80TB+ collection of astronomical survey data, has been converted to the HATS parquet format, enabling crossmatching on a laptop via LSDB and Hugging Face ecosystems without bulk downloads.
1M datasets on HF !
Celebrating a community milestone of 1 million datasets on Hugging Face, highlighting the collaborative effort to advance AI through open data.