When I’m typing an email, I am mostly a next word predictor too. It’s amazing how many tasks you can catch in this simple formalism.

If transformers models actually were any good at word prediction, then they would be useful.