there would have to be balance, with speed come less manueverability....like a dragster. all that momentum from going so fast would make it harder to turn. along the same lines of thinking, the slower they are the faster they turn.
EDIT: and that's only thinking about fighter's. i'm not sure about cap ships and freightors/transports