Beyond output matching: preserving internal geometry in NVFP4 LLM distillation

Demand for low-precision inference, including NVFP4-based approaches, has grown as large language models are increasingly deployed in latency and cost constrained production environments. Quantization-aware...