I think only about 30% really do.

Your downvote margin suggests otherwise.

People would fiercely defend the existence of their national borders, but for some reason they don’t much like the idea of being fenced into their house, for example.

People talk a lot of shit. The overwhelming majority will be grumpy if their borders change, but have no interest in bleeding over it.