Hacker News

Show HN: Running 104GB Qwen3.8-Flash-Next on 48GB Mac with at ~12 tok/s

I built slotstream, a way to run Qwen3.8-Flash-Next 4-bit on a low-memory mac starting from 16GB, a 125B parameter model that would need 100GB+ memory/RAM, thanks to expert-offloading/ssd-streaming. Easy to install/update, and mac-native using MLX and Swift.

This is a short WorldPing brief. The full report was published by Hacker News.

Read the full report at Hacker News

Related news

UK chalks up hottest summer on record for second year runningWorldPing
Phys.org

UK chalks up hottest summer on record for second year running

Britain experienced its hottest summer on record for the second year in a row, the UK's national weather agency announced Tuesday, after weeks of successive heat waves and widespread drought conditions.

Brief by WorldPing · Original reporting by Phys.org