How about taking into account different gravitational levels of different planets?
They're not listed in the wiki, but it would be fair to assume people would develop different physical appearance on different planets. Dwarves on high g-level planets and so on. 8-|