A from-scratch, dependency-free GPT implementation in pure NumPy with a byte-level tokenizer, multi-head self-attention, Adam trainer, and top-k sampler.
Read original on GitHub Trending (AI) ↗★ 51 stars
Original headline: "prabeakarve/microgpt: A from-scratch, dependency-free GPT implementation in pure NumPy: byte-level tokenizer, multi-head self-attention, Adam trainer, and top-k sampler."