# Huang's Law

> Huang's Law observes that GPU performance for AI workloads has been more than doubling every two years — outpacing Moore's Law and powering the exponential growth of AI capabilities.

Source: https://metavert.io/huangs-law  
Published: 2026-03-17  
Updated: 2026-03-17

**Huang's Law** is the observation that the performance of GPUs for AI and deep learning workloads has been advancing at a rate that significantly *outpaces* Moore's Law. Named after [NVIDIA](https://metavert.io/nvidia) CEO Jensen Huang, who first highlighted the trend, Huang's Law describes how GPU-accelerated computing performance for AI inference and training has been roughly **doubling every year** or faster — compared to Moore's Law's historical pace of doubling transistor density every two years.

## Beyond Moore's Law

Moore's Law, Gordon Moore's 1965 observation that the number of transistors on a chip doubles approximately every two years, drove the semiconductor industry for five decades. But Moore's Law is fundamentally about *transistor density* — and as feature sizes have approached atomic limits, the pace of improvement has slowed. More transistors no longer automatically translate into proportionally faster single-threaded performance due to power and heat constraints (a limit sometimes called Dennard Scaling's end).

Huang's Law sidesteps this wall. GPU performance gains come not just from smaller transistors but from architectural innovation — specialized tensor cores optimized for matrix multiplication (the core operation of neural networks), improved memory bandwidth and hierarchy, better interconnects between chips (NVLink, NVSwitch), new numerical formats (FP8, FP4) that trade precision for throughput, and software optimizations in the CUDA and TensorRT stacks that extract more useful computation from the same silicon. The combination of hardware specialization and software co-optimization produces performance curves far steeper than general-purpose CPU improvements.

The numbers are striking. NVIDIA's AI inference performance has improved roughly **1,000×** over the past decade — a pace that would take Moore's Law over 20 years to match. The jump from A100 (2020) to H100 (2022) to Blackwell (2024) delivered roughly 30× improvement in inference throughput for [large language model](https://metavert.io/large-language-model) workloads in just four years, through a combination of more transistors, architectural redesign, and sparsity exploitation.

## Why Huang's Law Matters for the Agentic Economy

Huang's Law is the supply-side engine that makes [Jevons' Paradox](https://metavert.io/jevons-paradox) in AI so explosive. Every generation of GPU that delivers 2–3× more inference performance at comparable cost effectively halves or thirds the price of intelligence — which, per Jevons, stimulates dramatically more than 2–3× more demand. Huang's Law feeds [Wright's Law](https://metavert.io/wrights-law) (more production drives costs down further), which feeds Jevons (cheaper inference expands usage), which finances the next round of GPU R&D and manufacturing — the full [flywheel](https://metavert.io/flywheel-economics).

The law also underpins the [Scaling Hypothesis](https://metavert.io/scaling-hypothesis) — the bet that continued increases in compute, data, and parameters will produce continued capability improvements in AI. If Huang's Law stalls, the economics of training ever-larger models break. If it continues, each new GPU generation makes previously impossible model architectures feasible, enabling new capability frontiers that generate new demand for the *next* generation of silicon. This is the [Red Queen Effect](https://metavert.io/red-queen-effect) encoded in hardware roadmaps: NVIDIA must deliver Huang's Law-pace improvements or risk competitors catching up as architectural advantages narrow.

For the broader economy, Huang's Law is the reason AI capabilities feel like they're arriving "all at once." When performance improves 10× every few years rather than 2× every few years, capabilities that seemed decades away become available in a single product cycle. Real-time [AI inference](https://metavert.io/ai-inference-infrastructure) on consumer devices, photorealistic [3D rendering](https://metavert.io/3d-rendering) in real time, and AI agents that can reason through complex multi-step tasks — all depend on Huang's Law continuing to deliver [exponential](https://metavert.io/exponentials) improvements in the price-performance of parallel computation.

## Related Topics

- [NVIDIA](https://metavert.io/nvidia) — The company whose GPU roadmap embodies Huang's Law
- [Wright's Law](https://metavert.io/wrights-law) — The learning curve that compounds with Huang's Law improvements
- [Jevons' Paradox](https://metavert.io/jevons-paradox) — The demand explosion that GPU performance gains trigger
- [Exponentials](https://metavert.io/exponentials) — The broader pattern of accelerating technological improvement
- [Scaling Hypothesis](https://metavert.io/scaling-hypothesis) — The AI thesis that depends on continued Huang's Law gains
- [Deflationary Technology](https://metavert.io/deflationary-technology) — How Huang's Law drives cost collapse in AI compute

## Further Reading

- [Compute Capital Markets](https://meditations.metavert.io/p/compute-capital-markets) — Jon Radoff
- [Wright's Law: Cloud, Blockchain, and the Metaverse](https://meditations.metavert.io/p/wrights-law-cloud-blockchain-and) — Jon Radoff