AMD 395+ CPU with 128 GB RAM for local LLM inference; assessment of suitability for 30B–70B models and agent use cases
Read the original at www.reddit.com→Hello everyone! I don’t follow the market super closely, but I can see how quickly everything is getting more expensive—and apparently this is going to last a few more years. RAM, GPUs, and even SSDs and HDDs have...
Original headline: "[Hardware] Is a AMD 395+ AI with 128 GB RAM still good choice for local LLMs? (inference mostly)"
Coverage timeline
- Nov 5, 15:25 UTC r/LocalLLaMA lead source [Hardware] Is a AMD 395+ AI with 128 GB RAM still good choice for local LLMs? (inference mostly)