First of all, you probably don't need to switch character for 4 hours. If your enemy leaves the system, then your character can come back online in that system.
Second, the 4 hour rule applies only for PVP. If you die to NPCs or asteroids or whatnot, nobody cares, and you can continue to play as normal. Handy for when you get jumped by a hostile battleship patrol...