The story that this 260K parameter model generated (in the screenshot of their report):

Sleepy Joe said: “Hello, Spot. Do you want to be careful with me?” Spot told Spot, “Yes, I will step back!”
Spot replied, “I lost my broken broke in my cold rock. It is okay, you can’t.” Spoon and Spot went to the top of the rock and pulled his broken rock. Spot was sad because he was not l

It’s still impressive that they got it running. I look forward to seeing if their BitNet architecture produces better results on the same hardware.