GPUs / NVIDIA A100 40GB PCIe / Anatomy
The anatomy of a NVIDIA A100 40GB PCIe-hour
One NVIDIA A100 40GB PCIe rents for $1.57 per hour today. This is where that money goes — the parts that can be sourced, and the residual that can’t.
Anatomy: why it costs this
Everything that has to exist before one A100 40GB PCIe-hour can be rented — then the arithmetic on the parts that can be priced honestly.
Electricity$0.03/hr2.1%0.39 kWh from the grid
Water (upper bound)$0.002/hr0.1%≤ 0.5 L, priced high on purpose
Capital · facility · network · staff · margin$1.53/hr97.7%everything the operating inputs don't explain
Power basis: vendor GPU TDP only — full-server draw runs meaningfully higher × PUE 1.54 × 8.71¢/kWh (0.39 kWh from the grid). Water bounded at 1.8 L/kWh and $5/m³ — deliberately high. The residual is hardware amortization, facility, staff, and margin — presented as a residual because vendors don’t publish server street prices, and we don’t print numbers we can’t stand behind.
Verified inputs & sources
- NVIDIA A100 40GB PCIe power basis: 0.25 kW — NVIDIA specifications
- US industrial electricity, average retail: 0.0871 $/kWh — EIA Electric Power Monthly (May 2026, preliminary) (checked 2026-08-10)
- Industry average PUE: 1.54 × — Uptime Institute Global Survey 2025 (weighted avg; ~flat six years) (checked 2026-08-10)
- Best-in-class fleet PUE (Google, 2025): 1.09 × — Google data center efficiency (2025 fleet average) (checked 2026-08-10)
- Water usage effectiveness, evaporative-cooling upper range: 1.8 L/kWh — Operator-reported WUE ranges (~0.2 hyperscaler best → ~1.8 evaporative) (checked 2026-08-10)
- Industrial water price, generous upper bound: 5 $/m³ — Upper-bound assumption (US industrial rates are typically well below this) (checked 2026-08-10)
- Reference context with the arithmetic shown — never fed into the Index or any published series (see methodology).