Guess what, caps are balanced to be killable this easily because there are many of them out there because everybody and their mom can fly one. Make them more rare, buff them to realistic strenghts and your problem is gone already.
I've killed Rheinlander gunboats in a Patriot in the Vanilla storyline. Several of them. I've taken out Battleships in a Fighter, even. That's how realistic it was.