A lab releases a better model. The weights are public, the benchmarks look good, and developers start figuring out what they can build with it.

Then they check the memory requirements.

I think this is going to become one of the harder problems for the open-source AI community. Models can become more efficient at generating tokens while becoming harder for individuals and small teams to host. We could gain access to increasingly capable weights while losing the practical ability to run them ourselves.