DistribAI v2

Reddit r/LocalLLaMA Tools
distributed-training c++-libtorch pytorch edge-case-handling free-gpu-training github colab-kaggle

Summary

DistribAI v2 is a platform for distributed training of AI models across multiple consumer devices, featuring improved hosting options and robust handling of edge cases.

DistribAI is a platform for distributed training! You can train massive or tiny models across tiny or massive amounts of consumer devices with ease! DistribAI is a platform I've been working on for a while, and V2 made its release today. DistribAI is C++ and Libtorch for speed, with the ability to run pytorch trainers distributed! Edge-cases(crashing, malicious actors, unstable connections, ect) are handled for you. On a free Colab, Kaggle, and Molab GPU, plus a local 4070 SUPER, we got the free training compute of ~2 fully loaded 5090s and the VRAM of ~5 full 5090s for free, all as one. Hosting is also now easier with shareable join links, and Cloudflared/ngrok support for 100% free server hosting for your DistribAI setup. Train with your community, with friends, with your free GPUs, and more! Try it out! Questions(and stars) are welcome; https://github.com/naxium-oss/DistribAI
Original Article

Similar Articles

Distributed Local Agents Benchmark.

Reddit r/LocalLLaMA

The article introduces a distributed benchmarking website for AI agents, allowing community members to test and share results across various local models and hardware configurations.