5+ hour, 47+ min ago  (470+ words) KIPOST - Introduces a low-rank-based approach to KV cache compression, one of the key bottlenecks in long-context AI - Speeds up attention computation by up to 6. 9x and overall generation throughput by up to 3. 1x, moving beyond memory savings to faster inference - Selected as…...