Grinder12: 0.96-Bit Lossless Streaming KV-Cache (16.55x VRAM Savings

 (github.com)

3 points | by AMICLLC  12 hours ago

1 comments