absorb.md

Lcqat

2 mentions across 0 people

Unknown speaker
paper · 2026-06-10
Recommended

“We propose LC-QAT, a 2-bit weight-only VQ-QAT framework that represents quantized weights via a learned affine mapping over discrete vectors, which yields a high-quality PTQ initialization and enables fully differentiable end-to-end optimization without explicit codebook lookup in the training forward pass.”

LC-QAT: Differentiable 2-Bit Vector Quantization for LLMs via Linear-Constrained ↗