Barack Obama: “For elevator music, AI is going to work fine. Music like Bob Dylan or Stevie Wonder, that’s different”::Barack Obama has weighed in on AI’s impact on music creation in a new interview, saying, “For elevator music, AI is going to work fine”.

  • @rambaroo
    link
    English
    4
    edit-2
    1 year ago

    A rolling context window isn’t a real solution and will not produce works that even come close to matching the quality of human writers. That’s like having a writer who can only remember the last 100 pages they wrote.

    The tech is trained on human created data. Are you suggesting LLMs are capable of creativity and imagination? Lmao - and you try to act like I’m the one who’s full of shit.

    • @kromem
      link
      English
      -11 year ago

      That’s like having a writer who can only remember the last 100 pages they wrote.

      That’s why you pair it with RAG.

      The tech is trained on human created data. Are you suggesting LLMs are capable of creativity and imagination?

      They are trained by iterating through network configurations until there’s diminishing returns on how accurately they can complete that human created data.

      But they don’t just memorize the data. They develop the capabilities to extend it.

      So yes, they absolutely are capable of generating original content that’s not in the training set. As has been demonstrated over and over. From explaining jokes not found in the training data, solving riddles not found in it, or combining different concepts to result in a new synthesis not found in the original data.

      What do you think it’s doing? Copy/pasting or something?