Serving-context nondeterminism in text classifiers
Read the original at arxiv.org→arXiv:2610.09111v1 Announce Type: new Abstract: Deterministic inference is essential for reliable and trustworthy machine learning. Prior studies of text generation have shown that changing factors such as batch...
Original headline: "Same Text, Different Prediction: Serving-Context Nondeterminism in Text Classifiers"
Coverage timeline
- Oct 8, 04:00 UTC arXiv cs.CL lead source Same Text, Different Prediction: Serving-Context Nondeterminism in Text Classifiers