Local AI on a R7 5700X with 48GB RAM and RTX 3090 24GB: best OS and framework/model?
Read the original at old.reddit.com→Hi everyone, I have a system which I have been using for gaming, R7 5700X, 48GB DDR4, RTX3090 24GB. But I want to use it for Local AI to reduce my reliance on cloud AI providers (mainly usage limits - accepting some...
Original headline: "5700, 48GB RAM and a 3090 24Gb. Best OS and framework/model?"
Coverage timeline
- Jul 25, 22:59 UTC r/LocalLLaMA lead source 5700, 48GB RAM and a 3090 24Gb. Best OS and framework/model?