Thats not how it works. If a server is streaming ads to you then it shouldnt be a problem detecting that and blocking out that server.

What Google is doing is baking in the ad into the video so that the video itself has the ad embedded into it. This way you cant block a certain server from serving ads. And if those ads baked in have different duration for each user, then SponsorBlock stop behaving properly as it uses timestamps to skip segments.