Softmax for models on FPGAs evaluated with Taylor series and Padé approximants; authors discuss speed–accuracy tradeoffs

My weekend sideproject was implementing the paper 'Approximating Softmax for FPGAs with Taylor Series and Pade Approximants' The paper’s motivation is the hardware constraints limiting exponential operations on...