Advice on models for a RAG use case: selecting open-weight models for ingestion and querying on CPU-only setup
Read the original at www.reddit.com→Hi all, I'm looking for some advice picking models. I'm looking to try a project to ingest quite a large amount of docments into a knowledgebase, allowing me and others to ask questions about the data. I'm thinking...
Original headline: "Advice on models for RAG use case"
Coverage timeline
- Sep 27, 09:11 UTC r/LocalLLaMA lead source Advice on models for RAG use case