Fiction written by artificial intelligence is easy to detect because it struggles with complex story structure and tends to moralize in clunky ways, according to a preprint study from researchers at University of Maryland, College Park and Google DeepMind. They found that AI fiction has tells that go beyond stereotypical overuse of em-dashes and other obvious AI tropes and have more to do with the formulaic nature of the text itself.

“AI stories over-explain themes and favor tidy, single-track plots while human stories frame protagonists’ choices as more morally ambiguous and have increased temporal complexity,” the study, which looked at more than 50,000 AI-generated short stories, found. “Claude produces notably flat event escalation, GPT over-indexes on dream sequences, and Gemini defaults to external character description. We find that AI-generated stories cluster in a shared region of narrative space, while human-authored stories exhibit greater diversity. More broadly, these results suggest that differences in underlying narrative construction, not just writing style, can be used to separate human-written original works from AI-generated fiction.”

Basically, AI-generated fiction sucks and at the moment is easy to detect. The typical method of detection involves looking for stylistic markers such as an abundance of em-dashes, the overuse of the word “delve,” or an obsession with goblins, but this project tried something different. “The idea for this project came because we are hoping to eventually move past plain text detection, into some sort of space where we can separate human ideas from AI-generated ideas,” Jenna Russell, a University of Maryland researcher and one of the study’s authors, told 404 Media. Russell is also an intern at the AI-detection company Pangram.

    • nightlily@leminal.space
      link
      fedilink
      English
      arrow-up
      7
      ·
      15 days ago

      Anthropic or OpenAI should hire you as a marketer. You sure hit all their nonsense empty promises.

      The technology is fundamentally limited. It will never be „intelligent“ because it is founded on flawed premise - that language leads to intelligence and not vice versa.

      • TankovayaDiviziya
        link
        fedilink
        arrow-up
        1
        arrow-down
        8
        ·
        15 days ago

        I’m sure as hell people said the same about horse and buggy being the only mode of personal transport because cars were slow: empty promises.

        Only in Lemmy people have so much complete dismissal. Outside of Lemmy, even detractors of AI recognise the potential albeit admit the current model is overrated. Again, I’m certain the feeling of uncanny valley in Lemmy and most don’t recognise it.

        • zarkanian@sh.itjust.works
          link
          fedilink
          arrow-up
          6
          ·
          15 days ago

          To use your car analogy: what you are arguing is the equivalent of saying that a car will eventually become a horse.

          • TankovayaDiviziya
            link
            fedilink
            arrow-up
            1
            arrow-down
            5
            ·
            15 days ago

            Weird strawman that doesn’t make sense.

            Anyway, Lemmy could try to be dismissive, but time doesn’t care about personal biases.

      • TankovayaDiviziya
        link
        fedilink
        arrow-up
        2
        arrow-down
        9
        ·
        15 days ago

        It’s not that I love LLM, but its potential is there try, as you might deny. I know this is FuckAI, but i find Lemmy in general is experiencing uncanny valley and either don’t realise it or don’t want to admit it and thereby refusing its potential. That’s like saying automobiles in 1800s is a deadend technology and horse and buggy is the only way because the maximum speed of cars was 2 mph.

        Love it or hate and try as one might, AI is a Pandora’s box opened. I just wish it’s open source instead.

        • queermunist she/her@lemmy.ml
          link
          fedilink
          arrow-up
          5
          ·
          15 days ago

          LLMs need an ever increasing amount of energy and compute for diminishing returns, they all operate at a loss to generate mediocre results and can only function as long as they’re getting unlimited money from investors to burn.

          Not every technology just gets exponentially better forever. Some hit a wall, and then that’s it.

        • MartianRecon@lemmus.org
          link
          fedilink
          English
          arrow-up
          6
          arrow-down
          1
          ·
          15 days ago

          Literally tech bros said the same shit about block chain and nfts.

          Keep dreaming sweety.

          • TankovayaDiviziya
            link
            fedilink
            arrow-up
            2
            arrow-down
            8
            ·
            15 days ago

            They have nothing to do with AI.

            Again, love it or hate, denying AI is like denying cars aren’t better than horse and buggy.

            • MartianRecon@lemmus.org
              link
              fedilink
              English
              arrow-up
              6
              arrow-down
              1
              ·
              15 days ago

              What a ridiculous take.

              And yes, bringing up tech bros forcing their delusional nonsense on the general population when, time and time again the last decade you people have been catastrophically wrong just further proves that LMMs are fucking dumb and a massive waste of resources.

                  • Dpek@lemmy.zip
                    link
                    fedilink
                    English
                    arrow-up
                    1
                    ·
                    14 days ago

                    Not so sure about that

                    Decent chunck is just the greed of hopeing to use it to replace people + the “if it can do it despite its issues then imagine what it will do with people to compensate for the issues” people (so the reduce costs + inprove output people)