1. In Outlook, enable your out-of-office message, set it to start right now.
2. Click Save.
3. Immediately see a pop-up asking if you want to turn that off.

WTF Microsoft? Who would ever do that?

I suppose someone might have turned it on for the wrong dates, but 99.99% of the time this is just annoying.