Discussion about this post

User's avatar
Mairi Robertson's avatar

Really enjoyed this, Andy. I hadn't fully appreciated the shift from training-focused to inference-focused scaling laws change the infrastructure requirements.

A bunch of unstructured questions that came to mind while reading:

1. Could photonics actually accelerate AI power consumption (i.e., Jevens Paradox)?

2. How feasible are distributed, lower-capacity installations near population centers given grid constraints and real estate costs?

3. If data residency and latency issues continue to abound, does compute become a 'grid tied' asset like electrons? And could AI infra players participate in grid services by selling marginal energy? And, come to think of it, could you have a similar model for marginal local compute?

4. If multi-GW AI clusters start competing for the same finite grid access points, could we see a bifurcation where only vertically integrated players (who can control land, power development, and compute) can actually execute at scale? + then does that create a new category of infrastructure asset - some kind of "shovel-ready AI site"

5. To what extent will energy demand from hyperscalers lead them to pay higher energy prices that anchor technologies which otherwise wouldn't deploy commercially, at scale, soon)? (e.g., LDES, SMRs, hydrogen turbines)

Expand full comment
T Stands For's avatar

This analysis highlights why we need diverse forecasting approaches. We should be developing projections based on two parallel scenarios:

Scenario 1: Unconstrained AI Demand - Bottom-up modeling based on factors like wafer fabrication, GPU sales volume, token demand, and development-related compute budgets. This shows us where the AI industry wants to go without ceilings.

Scenario 2: Grid-Constrained Reality - Top-down analysis of actual generation capacity additions, interconnection queue timelines, transmission bottlenecks, and regional supply shortfalls. This shows us what's actually possible.

The gap between these scenarios would be incredibly revealing - not just for energy planning, but for understanding which AI development paths are viable versus which are fantasies. Solutions that push the second scenario closer to the first are essential for American leadership in this space.

Expand full comment

No posts