Tag
A hardware tip for running local AI models: using two GPUs as independent instances is faster than tying them together with tensor-parallel over PCIe, which was 23% slower than a single card alone. Tensor parallel is only beneficial for models too large for one GPU.