They do have graphics rendering circuitry, but e.g. fewer shading units and more graphics memory, or support for faster interconnects. You can look up the specs and compare. The differences are varied, but IMO not enough to claim they're not GPUs anymore. Even gaming focused GPUs are GPGPUs these days: the RTX 4090 has as many Tensor Core units as the A100. And you can still use e.g. DirectX, OpenGL with a datacenter grade GPU.
This is incorrect. NVIDIA uses a unified graphics and compute engine. A CUDA core is a shading unit. These datacenter GPUs have a shit ton of these (CUDA cores).
Edit: actually the point I want to make is the A100 only retains those hardware units which can be used for compute. Some of these units may have a (dual) use for graphics processing but that is besides the point (since this is true of all CUDA enabled NVIDIA GPUs).
