I’ll say the nonsense phrase back at the person

I do this too sometimes. My wife in particular hates it.