Tag
This paper explores using retired GPUs to build low-cost clusters for serving LLaMA-70B, finding economic viability in regions with cheap electricity but highlighting potential high carbon emissions without clean energy sources.