From a developer tool perspective GPUs have followed similar path to that of general purpose CPUs. First we had assemblers, then command-line compilers, IDE tool support, and finally advanced specialty tools. Over the years NVIDIA has made a wide range of tools following this arc. Their latest offering is NVPerfHUD 3.
GameDev
GameDev