Right-sizes LLM models to your system's RAM, CPU, and GPU

(github.com)

46 points | by bilsbie  5 hours ago

5 comments