As far as banding together into a House-like organization, the Harvesters aren't a large enough threat to cause such a thing. They're a pretty small group, relatively speaking, and probably less of a threat to Zoner lives and wellbeing than the nomads.
