Sadly, bad behavior from owners are the cause. I have several fruit trees in my backyard and the pest presence is high. If they aren’t harvested and maintained the impact on your neighbors is high. I hate HOAs, but I get why they would prohibit it, and it’s not a class thing, after all…you’re a property owner.