Gguf Q4k
1 mentions across 0 people
All mentions
Unknown speaker
Recommendedpaper · 2026-06-11
“Our GGUF Q4_K quantization beats NF4 at equal on-disk size and is the Pareto winner on the quality-memory frontier, with paired confidence intervals excluding zero (Q8_0 is quality neutral).”
INT8 Quantization Matches FP8 Quality for 9.3B Diffusion Transformers on Consume ↗