High-Performance llama.cpp fork adds Kepler support, CUDA Graphs & Windows NCCL for legacy GPUs
Read the original at www.reddit.com→I've been working on improving llama.cpp support and performance on older NVIDIA GPUs, particularly Kepler and other pre-Ampere architectures. The goal is simple: get more life out of older CUDA hardware instead of...
Original headline: "High-Performance llama.cpp fork for Legacy GPUs: Kepler Support, CUDA Graphs & Windows NCCL!"
Coverage timeline
- Oct 24, 20:01 UTC r/LocalLLaMA lead source High-Performance llama.cpp fork for Legacy GPUs: Kepler Support, CUDA Graphs & Windows NCCL!