AI News

TRACE: use residual-layer VQ + KV table lookup to cut activation traffic in distributed Transformer inference

ABC3 min read
Local LLMs