Running a 35B LLM at 128K context on €870 of used hardware, full speed
Read the original at medium.com→Original headline: "Running a 35B LLM at 128K Context, Full Speed, on €870 of Used Hardware"
Coverage timeline
- Aug 2, 08:27 UTC Hacker News (AI) lead source Running a 35B LLM at 128K Context, Full Speed, on €870 of Used Hardware