NVIDIA H100
Introduced FP8 and the Transformer Engine, which NVIDIA said can speed up transformer networks as much as 6x versus the previous generation.
Silicon from NVIDIA
11 chips on record, newest first.
-
2026
NVIDIA RTX Spark
Not stated by NVIDIA NVIDIA Blackwell RTX GPU, 6,144 CUDA cores, fifth-generation Tensor Cores with FP4 precision; 20-core NVIDIA Grace CPU via NVLink-C2C
up to 1 petaflop of FP4 AI performance
Absolute -
2026
NVIDIA Groq 3 LPX (LP30 LPU)
Not stated by NVIDIA LP30 language processing unit, 500 MB on-chip SRAM per chip, 256 LPUs per rack
315 PFLOPS AI inference per LPX rack
Absolute -
2026
NVIDIA Rubin GPU
Not stated by NVIDIA Third-gen Transformer Engine, 336bn transistors across two dies, NVLink 6 at 3.6 TB/s
Rubin GPU delivers 50 petaflops of NVFP4 compute for AI inference
Absolute -
2026
NVIDIA Vera Rubin Superchip
Not stated by NVIDIA One Vera CPU (88 custom Olympus Arm cores) joined to two Rubin GPUs over NVLink-C2C
100 PFLOPS NVFP4 inference
Absolute -
2025
NVIDIA Rubin CPX
Not stated by NVIDIA Monolithic GPU for long-context inference, 128 GB GDDR7, hardware attention acceleration
up to 30 petaflops of compute with NVFP4 precision
Absolute -
2025
NVIDIA B300 (Blackwell Ultra)
TSMC 4NP Enhanced fifth-gen Tensor Cores with 2x attention-layer acceleration, 208bn transistors across two dies
15 PetaFLOPS dense NVFP4 compute
Absolute -
2024
NVIDIA Jetson AGX Thor (T5000)
Not stated by NVIDIA Blackwell GPU on the Thor SoC, 130 W, 128 GB LPDDR5X
up to 2,070 FP4 teraflops of AI compute
Absolute -
2024
NVIDIA GB200 Grace Blackwell Superchip
TSMC 4NP (GPU dies) One Grace CPU joined to two B200 GPUs over 900 GB/s NVLink-C2C
40 | 20 PFLOPS NVFP4 Tensor Core
Absolute -
2024
NVIDIA B200
TSMC 4NP Fifth-gen Tensor Cores, second-gen Transformer Engine, 208bn transistors across two dies joined at 10 TB/s
Blackwell delivers 2.5x its predecessor's performance in FP8 for training, per chip, and 5x with FP4 for inference.
Relative only -
2023
NVIDIA H200
Not stated by NVIDIA Hopper GPU, the first with HBM3e (141 GB)
3,958 TFLOPS FP8 Tensor Core (H200 SXM)
Absolute -
2022
NVIDIA H100
TSMC 4N Fourth-gen Tensor Cores with the first Transformer Engine (FP8), 80bn transistors
3,958 teraFLOPS FP8 Tensor Core (H100 SXM)
Absolute