Tag
Zyphra Research releases PUFFER, an incremental fuzzy deduplication system for LLM-scale datasets that runs entirely on CPU with 11-35x speedup over existing methods, open-sourced under Apache 2.0.