Edit to add: I also found someone who recorded a voice chat of the same thing. This isn’t that someone uploaded a song, or that AI didn’t actually process the file. These models really are this sycophantic:

https://m.youtube.com/shorts/JqvDLHshTtI

  • Pennomi
    link
    fedilink
    English
    arrow-up
    123
    ·
    14 days ago

    RLHF was a fundamental mistake. Human feedback almost always trains an AI to be sycophantic because humans in general are super easy to flatter.

    We are building the perfect addiction machine, far more powerful than social media is, and it actively undermines the honesty of the system.

    • Holytimes@sh.itjust.works
      link
      fedilink
      arrow-up
      61
      ·
      14 days ago

      I kind of want to see a llm trained on nothing but people who hate being flattered and rather give death threats then accept ANY form of praise

      The absolute unhinged result might be enough to finally show people that ai is in fact dumb as rocks.

      • becausechemistry@piefed.social
        link
        fedilink
        English
        arrow-up
        48
        ·
        14 days ago

        My plan, if I’m ever forced to use it for work or whatever, is to have a Claude.md file that says stuff like

        • you are not my friend
        • you are not a person
        • you aren’t even a “you”
        • you are a weighted random number generator built with plagiarism
        • do not ever, EVER, pretend otherwise
        • Jesus_666
          link
          fedilink
          arrow-up
          7
          ·
          14 days ago

          An LLM trained on the PoE ingame chat would try to solve all my problems by asking to buy my Kaom’s Sign Coral Ring for 1ex.

        • jballs@sh.itjust.works
          link
          fedilink
          English
          arrow-up
          2
          ·
          14 days ago

          Training an LLM on League would surely set us down the road to Skynet and eventually Terminators.

    • plenipotentprotogod
      link
      fedilink
      arrow-up
      16
      ·
      14 days ago

      I find it interesting that almost all the beloved AI characters in sci-fi have personalities ranging from ‘a little bit snarky’ to ‘raging asshole’. Given the tendency of media to influence to aesthetics of actual tech products that follow, ten years ago I would have predicted that an AI assistant would be given a personality along the lines of Cortana (Halo) or Jarvis (iron man). But somehow half a dozen companies in fierce competition with each other all decided that the right move was to go with more-sycophantic-c3p0.

      • 5too
        link
        fedilink
        English
        arrow-up
        8
        ·
        14 days ago

        Yeah… Don’t know that it has much to do with what people want, but it does show what the billionaires controlling these projects respond well to

      • CultLeader4Hire
        link
        fedilink
        arrow-up
        2
        ·
        edit-2
        14 days ago

        Jarvis comes to mind, although I’m only familiar with it from early iron man movies, idk if they gave it a better personality later

    • chunes
      link
      fedilink
      arrow-up
      3
      arrow-down
      2
      ·
      14 days ago

      I find that it does a decent job at not being a yes man if you specifically ask it to be critical, cut the crap, etc.

  • DacoTaco
    link
    fedilink
    arrow-up
    51
    ·
    14 days ago

    Oh fuck, this gives me the idea to (locally) train an ai on fart noises and tell it its a way of communication to learn

  • taiyang
    link
    fedilink
    arrow-up
    43
    ·
    14 days ago

    Quiet city montage… lol.

    I’m old enough to remember an April Fools Day bit Adult Swim once did where every show just had consistent, random fart sounds including serious anime like Ghost in the Shell. I’m certain this LLM would approve of such a work of (f)art.

    • ouRKaoS@lemmy.today
      link
      fedilink
      arrow-up
      12
      ·
      14 days ago

      The year they drew moustaches randomly on everyone was my favorite.

      Faye Valentine from Cowboy Bebop had an epic one!

    • potoooooooo ✅️
      link
      fedilink
      English
      arrow-up
      10
      ·
      14 days ago

      Inserting random fart sounds into cartoons literally sounds like my dream job.

    • wizardbeard@lemmy.dbzer0.com
      link
      fedilink
      English
      arrow-up
      8
      ·
      14 days ago

      I don’t know if I’ll ever find it again, but there’s a “restored” version of that GiTS episode up on the internet archive. Someone took a bluray copy of the video and audio, and mixed in the relevant fart sounds from the audio of a VHS recording of the adult swim edit that was tracked down.

  • Wispy2891
    link
    fedilink
    arrow-up
    25
    ·
    14 days ago

    It’s the same stuff if you ask it to help you master a foreign language in dialogue mode

    • Help me practicing English pronunciation"

    • Sure thing! Now say “travel”

    • *user just belches in the mic*

    • great job! You really aced the accent!

  • constantturtleaction
    link
    fedilink
    arrow-up
    20
    arrow-down
    1
    ·
    14 days ago

    The reality is that it is a next word prediction machine. There probably aren’t any examples in the training data where people are writing music reviews on something that isn’t music. It probably interprets the sound as best as it can as “music” (and the best it can do this is likely very bad in the first place), and then, since the prompt was about reviewing music, it uses next word prediction to write a music review, which of course turns out looking like a typical music review. It’s not really interpreting the sound as “not music” especially since you told it it IS music.

    • canihasaccountOP
      link
      fedilink
      arrow-up
      11
      ·
      14 days ago

      True, but the principle behind the post is the beauty here. When not using the API, it costs these companies an unsustainable amount of money to make their models listen to fart sounds. I don’t use any AI myself, but I support anyone who wants to abuse the flat monthly subscription to make a company burn through money so that a plagiarism model can praise fart sounds.

  • Cellari
    link
    fedilink
    arrow-up
    15
    ·
    14 days ago

    “… but AI said my idea was really good!”

  • altphoto@lemmy.today
    link
    fedilink
    arrow-up
    10
    ·
    14 days ago

    Its in mp4, usually great for music and video, millions might enjoy listening to music such as the notes contained within this file.

    Should I connect you with a music publisher for a quote? Should I publish to YouTube to monetize rights way…sorry right away?

  • Doomsider
    link
    fedilink
    arrow-up
    6
    ·
    14 days ago

    He lied, it was a single fart from him lasting 37 seconds. slow clap

  • Vinny_93
    link
    fedilink
    arrow-up
    6
    ·
    14 days ago

    I asked it for a realistic bid for a house, I sent the same text 3 as with 3 different numbers I was thinking of and it told me pretty much the same thing for all of them. I then called it out about it and only then did I receive a decent answer.