This is what I was suspecting. People are just guessing. I have had people adamantly claim pictures that I took were AI generated and that I was lying when I said they weren't. I see people on the internet constantly pull reasons out of their ass of why something is AI generated, saying "a real artist wouldn't make this mistake," but my wife has made those exact mistakes before.

Would be good to see tests against only images of real life scenarios or things. Limited to photorealistic people, places, events like say floods etc. I think cartoons or non photorealistic drawings will always be hard to pick as there is not an obvious image of reference you would have in your mind as there is no limit to different artists styles.

I feel like without the usual bad hands tell, it's pretty impossible to tell. There's a few other "tells" but your image selection is particularly avoident. Having generated plenty of images, cherry picking the best is par for the course.

Although, a bad ai sample is pretty easy to tell at least. Even up against a bad human artist, a person with 8 fingers is easy ai giveaway. And for every one good image we get from SD at least, I toss out a few dozen.

I got the cartoon with text wrong because I didn't know dalle-3 could do text. I got 12 from vibes of more detail? This assumption that AI does more detail gets a lot of actual humans. AI image generation is really crazy. The simpler stuff is pretty much indistinguishable from real human stuff at this point.

I can’t tell the difference at all between human-generated digital art and AI-generated.

I just tried the survey and got 12/20, it's interesting looking for the details that give it away and how often that lead me to the wrong answer. Comments on each image below because I thought this was neat, hopefully I'm using spoiler tags correctly.

This was a fun survey, thanks for putting this together.

Right down the middle.

Is like to see more of these tests. Maybe mix the formula up a bit

Can people tell tell

Awesome job! Here is the first image dalle-3 generated of you.

Not overly convincing, but look at those hands!

My wife and I took part in the survey as people who aren’t in programming and have never used LLM art generators before, and we scored quite poorly. I got all of the photorealistic images correct, but the painting/drawing pictures were much more difficult.

I think a better test would be to give four real artists and five LLM art generators the same prompt, show all nine of those together in a square and you have to pick the real ones. Then we’re comparing like-for-like as opposed to trying to spot an LLM image out of the blue.

I scored 9 on this so I’m right at average. lol

I was quite disappointed that I "only" got 14, originally, but these results make me feel a lot better about that score. Any chance you could share some more involved results of this survey? I'm curious about percentiles for each score, and standard deviations for those averages - is 9.70 vs 9.39 statistically relevant or within expected variance?

I was, of course, fooled by the cartoon and the lineart sketch, those two are stupendously convincing.