hardware-build

Jeff Geerling built a portable homelab in a carry-on suitcase using Ubiquiti UniFi networking gear for a demo at VCF Midwest, featuring high-speed networking, 5G backup, and travel-ready design.

A showcase of a personal local AI inference build featuring Intel Arc B140 GPUs and custom hardware, running llama.cpp with SYCL back-end on Ubuntu.

The author shares their storage server build optimized for local AI inference, anticipating a rumored 26T-a3b model called "Le Chaton FAT" and using high-capacity NVMe drives with ZFS for model storage.

A grad student shares their experience building a multi-GPU workstation with 4x3090 Ti running on a single US wall outlet, detailing constraints, power-limiting challenges, and component choices.

A community member details a custom PC build using discontinued Intel Optane Persistent Memory to successfully run the 1-trillion parameter Kimi K2.5 model locally at roughly 4 tokens per second via llama.cpp.