Yes. They own the vehicle.

You are free to do whatever you want when you finish the transaction. Which typically is actually a few days later after the bank clears it. Or you can ask for them to take it off. Dealerships just let it go early because they rarely run into issues closing the finance. And NOBODY ever brings their own plate holder. But yeah, “vandalism” 🙄