The NVIDIA H100 set records on every workload in the MLPerf training and inference benchmarks, while NVIDIA’s A100 and L4 GPUs provided healthy inference results. NVIDIA MLPerf v3.0 Results.

In that round of training benchmarks, an eight-way Nvidia system took almost 40 minutes to train ResNet-50. In this week's results, that time had been cut to under 30 minutes.

NVIDIA's new Eos supercomputer uses more than 10,000 H100 Tensor Core GPUs to train a 175 billion-parameter ... That's three times faster than the previous benchmark on the MLPerf AI industry ...