Show HN: Shoehorn – Quantize any model down to run on your machine
Working on Mac, Linux, and Windows now. I include a simple GUI to find new models and get things built and set up. It is working quite well across a few models for me. The GitHub README and DESIGN.
Brief by WorldPing · Original reporting by Hacker News
WorldPing
