Dell PowerEdge R820 server with 4x E5-4640 CPUs and 768GB RAM used for inference; user asks about running big models on monolithic DDR3 server for GPU-assisted inference.

Hi all. Do any of you guys run a server like this for inference of big models. Given deepseek is down to 8/16b active I'm curious as to whether this could start to make sense if I was to add a gpu. This server is...