Kombatant over at Rage 3D has thrown up his new editorial entitled Has Futuremark lost its focus?, which looks at latest developments in the 3DMark, Futuremark and the "optimizations" issue as a whole.
Why don?t we stop for a second and remember one more time the definition of what constitutes a benchmark. It is a standard by which others are measured or judged. When a graphics card driver replaces one or more shaders that the benchmark uses with a similar one, even if the output is exactly the same, the benchmark stops being a standard. It stops being the constant by which others are measured, and consequently it stops being a benchmark!
Why don?t we stop for a second and remember one more time the definition of what constitutes a benchmark. It is a standard by which others are measured or judged. When a graphics card driver replaces one or more shaders that the benchmark uses with a similar one, even if the output is exactly the same, the benchmark stops being a standard. It stops being the constant by which others are measured, and consequently it stops being a benchmark!