I'd honestly say that if you pick a reasonable (small) number, you shouldn't run into any issues; ALS)Cerulean, my Bretonian trader, carries six - one for each crew member and one for the captain. Never once been questioned about them.
Though it does help that I almost never even go into Leeds on that character...