NVIDIA's GLM-5.3-Flash-FP4-Local: the QAD re-quant decoded, and why it can't swap into the 4× switchless NVFP4 lane

NVIDIA’s new FP4-Local checkpoint re-quantizes GLM-5.3-Flash with quantization-aware distillation and compressed expert scales, cutting it to 164.6 GiB with near-baseline accuracy — but it requires a forked vLLM stack (B12X kernels, modelopt_mixed loader), and the checkpoint’s own author says 4× Spark clusters gain little from it: the quant exists to buy back KV cache on 2-node setups, a constraint four nodes don’t have.

GLM-5.3-Flash quants compared: five NVFP4 checkpoints in depth, the top-20 of every precision on accuracy, and a W4A16-int4 vs NVFP4 head-to-head

RadixArk, NVIDIA, RedHatAI, LibertAI and local-inference-lab all ship an NVFP4 GLM-5.3-Flash that differs far less in size (195-204 GB) than in quantization scheme: W4A4 vs weight-only, what stays BF16, MTP handling, calibration, and one checkpoint whose expert weights are actually retrained — with the tensor-scale math to verify each card’s claims. A same-day appendix widens the lens to the 20 most-downloaded quants of any precision, accuracy only; a second-day appendix puts the two most heavily audited cards — canada-quant’s int4 W4A16 and NVIDIA’s NVFP4 — side by side on evidence quality and scheme mechanics, and explains why no honest head-to-head number exists yet.