Operator-aware mixed-precision tolerance calibration for tensor kernels
Read the original at arxiv.org→arXiv:2607.16228v2 Announce Type: new Abstract: Most tensor-kernel correctness tests go through a fixed-shape all close-style check with hand-picked absolute and relative tolerances. The thresholds are copied across...
Original headline: "Operator-Aware Mixed-Precision Tolerance Calibration for Tensor Kernels"
Coverage timeline
- Jul 21, 04:00 UTC arXiv cs.LG lead source Operator-Aware Mixed-Precision Tolerance Calibration for Tensor Kernels