I made Pumpkin, a graphical manager for llama.cpp, for my girlfriend and released it on GitHub.
Read the original at www.reddit.com→As the title says, my girlfriend needed a local model for privacy reasons, but her terminal skills are... nonexistent, so I made an all-in-one graphical manager for llama.cpp that gets you up and running in around 5...
Original headline: "I made Pumpkin, a graphical manager for llama.cpp for my girlfriend. It turned out well, so I put it on github"
Coverage timeline
- Oct 27, 09:05 UTC r/LocalLLaMA lead source I made Pumpkin, a graphical manager for llama.cpp for my girlfriend. It turned out well, so I put it on github