Frontier-scale open-weight models now run on two desktop machines: this week’s sparse mixture-of-experts releases explained
An 816-billion-parameter open-weight model that activates only 42 billion parameters per request, and fits on a pair of desktop workstations, shows how sparse architectures are changing the economics of self-hosted AI.
5 min read
Read the article