NVIDIA's moat is CUDA's install base, and extreme co-design keeps scaling compute as AI becomes agentic.
Install base beats elegant architecturex86 drew more criticism than any architecture yet defined its era, while beautifully designed RISC architectures largely failed.
Shape belief before you announceHuang had been laying the stepping stones for Grok for two and a half years, so announcements land with 100% buy-in and a 'what took you so long?'.
Measure everything against the speed of lightA 30-year-old method: ask what physics allows, so a 74-day process gets rebuilt from a six-day baseline rather than trimmed to 72 days.
Executive SummaryAI
Huang explains that extreme co-design is necessary because the problem no longer fits in one computer: once you distribute across 10,000 machines and want a million times the speed, Amdahl's Law means CPU, GPU, networking, switching, power and cooling all have to be optimized together.
The existential bet was putting CUDA on GeForce, which raised cost by 50% at a 35% gross margin company, consumed all of NVIDIA's gross profit dollars and dropped the market cap from roughly $8 billion to about $1.5 billion, but it bought the install base Huang calls the company's single most important advantage.
He now counts four scaling laws — pre-training, post-training, test time and agentic — arguing synthetic data removes the data limit, that inference is thinking and therefore compute-heavy, and that agents spawning sub-agents multiplies AI the way hiring employees scales NVIDIA.
On the power blocker, Huang says the grid runs around 60% of peak and sits on idle excess 99% of the time, so he wants customers, data centers and utilities to accept gracefully degrading capacity — dropping to about 80%, shifting workloads or running slower — instead of contracts demanding six nines.
Asked about a $10 trillion valuation, he argues a $3 trillion revenue company is possible because computing shifted from retrieval to generation and from warehouse to factory, tokens are segmenting into free and premium tiers with $1,000 per million tokens around the corner, and 200 partner companies share the supply-chain burden.
Key Quote
“Install base defines an architecture.”
— Jensen Huang
Key Quote
“And that was always illogical to me because inference is thinking.”