Local agent workspace on a 4GB laptop GPU (RTX 3050 Ti) shows small model struggles when calling tools, artifacts, and RAG
Read the original at old.reddit.com→In-chat interactive/previewable artifacts Disclosure: I work on Bike4Mind, a source-available (BUSL-1.1) AI workspace you can self-host with Docker. Nothing to buy to run any of it. I run it on a regular laptop with...
Original headline: "Local agent workspace on a 4GB laptop GPU (RTX 3050 Ti): the tok/s and where a small model struggles once it has to call tools, build artifacts, and RAG"
Coverage timeline
- Jul 25, 21:57 UTC r/LocalLLaMA lead source Local agent workspace on a 4GB laptop GPU (RTX 3050 Ti): the tok/s and where a small model struggles once it has to call tools, build artifacts, and RAG