You still have to accelerate/decelerate said mass. Unfortunately, there isn't a way to make ship handling dependent of the equipment/cargo.
Besides, the turret itself may be considered only part of the weapon with extra equipment inside the ship that is needed to transfer energy from the power core. (Or something like that)
