DumpsterCluster: using retired GPUs to serve LLaMA-70B on 60 GPUs
Read the original at arxiv.org→arXiv:2608.14614v1 Announce Type: new Abstract: As AI datacenters retire functional GPUs, vast quantities of still capable accelerators enter secondary markets. This paper investigates whether these retired GPUs can...
Original headline: "DumpsterCluster: From Dumpster Diving to Serving LLaMA-70B on $60 GPUs"
Coverage timeline
- Aug 18, 04:00 UTC arXiv cs.LG lead source DumpsterCluster: From Dumpster Diving to Serving LLaMA-70B on $60 GPUs