Sam Altman says local inference is a terrible allocation of scarce resources due to global DRAM demand for running models locally.
Read the original at www.reddit.com→Sam Altman: “Local inference is a terrible allocation of scarce resources. A lot of people want local inference, and somehow they assume that the problem is solved now because we have open-source models, we're going...
Original headline: "Sam Altman: “Local inference is a terrible allocation of scarce resources”"
Coverage timeline
- Oct 29, 23:11 UTC r/LocalLLaMA lead source Sam Altman: “Local inference is a terrible allocation of scarce resources”