Previous posts: https://programming.dev/post/3974121 and https://programming.dev/post/3974080

Original survey link: https://forms.gle/7Bu3Tyi5fufmY8Vc8

Thanks for all the answers, here are the results for the survey in case you were wondering how you did!

Edit: People working in CS or a related field have a 9.59 avg score while the people that aren’t have a 9.61 avg.

People that have used AI image generators before got a 9.70 avg, while people that haven’t have a 9.39 avg score.

Edit 2: The data has changed slightly! Over 1,000 people have submitted results since posting this image, check the dataset to see live results. Be aware that many people saw the image and comments before submitting, so they’ve gotten spoiled on some results, which may be leading to a higher average recently: https://docs.google.com/spreadsheets/d/1MkuZG2MiGj-77PGkuCAM3Btb1_Lb4TFEx8tTZKiOoYI

  • Instigate
    2•1 year ago

    My wife and I took part in the survey as people who aren’t in programming and have never used LLM art generators before, and we scored quite poorly. I got all of the photorealistic images correct, but the painting/drawing pictures were much more difficult.

    I think a better test would be to give four real artists and five LLM art generators the same prompt, show all nine of those together in a square and you have to pick the real ones. Then we’re comparing like-for-like as opposed to trying to spot an LLM image out of the blue.

    • @[email protected]
      4•1 year ago

      For the sake of an survey you are right.

      But practically this shows how easy people are fooled nowadays, and it will only get worse in the future.