- cross-posted to:
- [email protected]
- cross-posted to:
- [email protected]
Generative AI services like Midjourney and OpenAI’s DALL-E can deliver the unimaginable when it comes to stunning artifacts produced from simple text prompts. Sketching complex art imagery may be AI’s specialty, yet some of the simplest tasks are evidently what AI struggles with the most.
I don’t know much about image generators, but it’s not surprising to me at all that ChatGPT can’t fulfill the request to respond with nothing. Your prompt gets converted into tokens, tokens get processed by the model, it outputs a resulting set of tokens, and those get converted into text. Expecting the token-outputting-machine not to output any tokens is going to lead to disappointment.
But that’s not the full picture. There is a token to end the response, so the LLM decides when the answer is over. So it’s technically possible for ChatGPT to answer with “nothing” by just emitting a single token, namely the “end-answer” token. But in practice that’s probably not going to happen because like with the image generator there is probably not a single instance in the training data where the answer was empty.
Update: Ok I just tested it and it looks like ChatGPT can do it. I asked the following:
And it created an truly empty response (I checked with browser inspection tool if there are any hidden white spaces)
Update 2: I’d didn’t even respond after writing “Great, thank you!” - It probably doesn’t want to lose the game 🤣
This isn’t asking for nothing though. It’s asking for a very specific uniform thing. A better analogy to text generation would be asking for an uninterrupted string of nothing but repeated uppercase A’s.
That’s a really good way to break chatgpt BTW. Just ask it to repeat something over and over again it will create very interesting results.
The “asking for nothing” experiment is from later in the article, where they try with ChatGPT.