Discussion about this post

User's avatar
Mark Vickers's avatar

Thanks for the cogent reporting on this. I think my biggest question is about the depreciation mismatch portion: that is, H200s purchased today will compete against Rubin chips delivering ~9x the compute within 2-3 years

In an inference and energy constrained system, does this really matter? Even if you're competing against more efficient chips, aren't you still making money if there's an ongoing demand for your product?

Seems like the problem only appears if supply catches up with demand. If demand exceeds total available compute, then doesn’t even less efficient chips command premium pricing? Seems like for the financing to break, equilibrium pricing must arrive before the debt matures.

Or am I missing something?

Expand full comment
Feisal Nanji's avatar

Missing the point entirely. AI investment is mostly about who gets to provide compute to the Western world . Only 3 companies have the legitimate power to furnish tokens to the western world. It’s about tokens . And the volume of tokens has exploded. Msft , goog and AWS , are the only capable providers of compute. The rest is small share and therefore noise .. think about a world where only 3 providers have the heft to provide most compute. Oligopoly confirmed. Oligopolistic rents are confirmed.

All this talk about financing is silly . This is the biggest economic transformation ever .. token volumes will explode as we make entire movies from a single context window..

Expand full comment
10 more comments...

No posts

Ready for more?