How confident are you in your ability to detect AI-generated text and how likely are you to read it?
I’ve noticed I’m very disenchanted with AI “slop” and I have gotten pretty confident (probably overconfident) in my ability to pick up on AI-generated content. As a result, there are things that I struggle to read, or at least read thoroughly, because I believe they are AI-generated. I’d love to hear whether or not you all are having similar experiences, if you are still engaging with the content if it is well done enough, and how you are managing it all. So how about it? Are you confident in your detection ability? Why or why not? Do you read it anyway? Why or why not?
Bonus Question: I use generative AI a lot, so I have to be careful not to have a double standard. Do you find yourself holding other content to a higher standard that you own when it comes to the size of the role AI played in its creation?
I’ve integrated Pangram to check every answer on this forum, detection rate is very good for answers over 20 words!
I tested on a set of evals that were half forum comments from before 2022 so no slop and half paragraphs from known AI generated sources, I would estimate my own accuracy is like 75-80% on this set while Pangram got 98% correct!
Personally I find Claude slop much more off putting than Gemini/Chat slop for some reason.