RunanywhereAI/trnrt: open LLM inference engine for AWS Trainium with NKI megakernels, 1M-token context, and OpenAI-compatible API
Read the original at github.com→★ 203 stars
Original headline: "RunanywhereAI/trnrt: The open LLM inference engine for AWS Trainium: NKI megakernels, 1M-token context, OpenAI-compatible API. By RunAnywhere."
Coverage timeline
- Oct 30, 18:30 UTC GitHub Trending (AI) lead source RunanywhereAI/trnrt: The open LLM inference engine for AWS Trainium: NKI megakernels, 1M-token context, OpenAI-compatible API. By RunAnywhere.