What’s Trending in AI?

ResidualQuant: KV Cache Quantization for Looped Transformers with 2-Bit Residuals · Bharat Hunt