NVIDIA H100 (cloud, 80 GB)

Rented NVIDIA H100 SXM GPU with 80 GB of HBM3 at 3.35 TB/s, 989 TFLOPS of FP16 dense compute, and NVLink at 900 GB/s when rented as an 8-GPU node.

Designed for bursty training and inference with no capital outlay, billed per GPU-hour from $1.38 per GPU-hour on Vast.ai and boutique clouds to $8 on hyperscalers; RunPod $1.99, and scalable from one GPU to hundreds in minutes with CUDA, PyTorch, and the NVIDIA container stack preinstalled by every provider.

Lives in someone else's data center: nothing to power, cool, or secure, and the trade is per-hour cost and data leaving your premises. Runs a 70-billion-parameter model at 8-bit on one GPU; 405 billion on eight.

$1.38/hr floor (Vast.ai), $1.99 RunPod, $2.30–3.10 median, $8 hyperscaler. Price verified September 2026.