Alternative approaches to base llama.cpp for RDNA2 GPUs in local LLM usage; user notes WMMA requires RDNA3+ and seeks broader RDNA2 support
Read the original at www.reddit.com→Most of the stuff built for amd gpus posted here or ai in general depends on WMMA which exists only from RDNA3 and up. In image-video generation I can bypass it with triton some of the time. But here, a thing works...
Original headline: "Is there an alternative to base llama.cpp for RDNA2 gpus in general with local LLM usage ?"
Coverage timeline
- Oct 19, 13:06 UTC r/LocalLLaMA lead source Is there an alternative to base llama.cpp for RDNA2 gpus in general with local LLM usage ?