They absolutely did notice, because the legions weren’t sitting around twiddling their thumbs before going away; they were fighting the various barbarians. When the legions left, the barbarians rolled in and that was pretty bad, to put it lightly. Not to make it seem like the Romans were innocent defenders of civilization, but when an invading army rolls into a conquered/raided territory in this period they rape and pillage everything that isn’t nailed down, and of course it’s no fun to have your city sieged or sacked. The loss of trade (since the Roman state wasn’t there to crack down on banditry and piracy) also reduced the complexity and prosperity of the Roman economy, leading to population decline that wouldn’t be made up for centuries. Here’s a good read on the topic by a Roman historian, but the short of it is that it would’ve absolutely sucked to live anywhere in the Roman Empire within a century before or after its fall in the West. Here’s a relevant quote:
Living standards thus declined back down to the pre-Roman Iron Age norm while at the same time the carrying capacity of the empire also declined down to that norm, leading to what must have been decades of brutal misery as food ran short, malnourished infants died before their time, cities shrank and the world grew poor.
The folks out in the provinces didn’t necessarily notice that. They just noticed the legion garrisons went away and the roads quit being maintained.
They absolutely did notice, because the legions weren’t sitting around twiddling their thumbs before going away; they were fighting the various barbarians. When the legions left, the barbarians rolled in and that was pretty bad, to put it lightly. Not to make it seem like the Romans were innocent defenders of civilization, but when an invading army rolls into a conquered/raided territory in this period they rape and pillage everything that isn’t nailed down, and of course it’s no fun to have your city sieged or sacked. The loss of trade (since the Roman state wasn’t there to crack down on banditry and piracy) also reduced the complexity and prosperity of the Roman economy, leading to population decline that wouldn’t be made up for centuries. Here’s a good read on the topic by a Roman historian, but the short of it is that it would’ve absolutely sucked to live anywhere in the Roman Empire within a century before or after its fall in the West. Here’s a relevant quote: