This year we started to see the growth of inference to the point where we sold more T4 units for inference than we sold V100s, which we sell for training, and both were record highs,' Nvidia CEO ...
Unlike Nvidia's previous V100 and T4 GPUs, which were respectively designed for training and inference, the A100 was designed to unify training and inference performance. This breakthrough ...