CUDA+ROCm dual-backends LLM inference for mixed-vendor GPUs (up to 48% faster)
Read original on r/LocalLLaMA ↗I have seen potential in combining Strix Halo's iGPU with RTX 5090 for LLM inferencing. Initially I found no inference engine that can run LLM inference on both these GPUs at the same time, inference engine such as...
Timeline
- November 10, 2026 CUDA+ROCm dual-backends LLM inference for mixed-vendor GPUs (up to 48% faster) r/LocalLLaMA