AI News

DropKV: per-token KV-cache eviction with provable approx and fused Triton scoring

ABC2 min read
Research