DJ Ware adds detailed performance statistics to his reviews.
I don't think it's very useful. Easily changeable default choices should make the most notable differences. The filesystem for example. Another big factor should be the configuration and the version of the kernel and it probably changes more between updates than between distributions.