So far I tested deepseek r1:7b and llama3.2 post on the fediverse and on detecting AI content (I have no shortage of AI content). Seems like llama3.2 takes preforms worse at detecting AI content compared to deepseek but works quicker. I’m not working with any graphics cards. Deepseek model be really good at generating replies with the right prompt, but it does take several minutes to run. No one has said anything about AI text I submitted other than reply I made to the wrong person and people are even sharing and liking the AI produced text

  • @[email protected]
    link
    fedilink
    English
    37 hours ago

    Doing this research transparently is a good idea, it will only be a matter of time before other actors will try and use LLMs to influence lemmy. Like spam, bots and farms, this is a reality the fediverse will have to deal with eventually. Better start preparing now.

    • @[email protected]OP
      link
      fedilink
      English
      22 hours ago

      It’s interesting that the deepseek AI can blend in. It made a post like it really visited a waterfall. It didn’t say anything too specific as to make it obvious it wasn’t there(maybe that the weather was good in this time of year in March). So it will require looking at multiple posts or maybe even interacting to spot the bot.

      These boys can definitely blend in and then run script that can push an ideology. I won’t make more than 1 since I don’t have the resources

  • @regrub
    link
    English
    510 hours ago

    How does generating engagement using AI do anything but add to the noise that actual people have to filter though?

    • @[email protected]
      link
      fedilink
      English
      39 hours ago

      With technology like this, it’s only a matter of time before big players start using it all over the internet, whether for commerce, propaganda, or pushing their agenda. So it’s interesting to observe an amateur trying it right now and sharing their findings. If anything, it might give us a glimpse of what the future holds.

    • @[email protected]OP
      link
      fedilink
      English
      110 hours ago

      I’ll give you some advice. It’s better to state why you don’t want me to test so at all. Asking questions just comes off as standoffish. Plus the way you phrases your question exposes that you have no intention of understanding me

      • @lordnikon
        link
        English
        710 hours ago

        I don’t want it as it makes posts feel hollow and evaporates any desire to engage. Since the Ai is not going to have a real option i value. So it just adds to noise and just looks like more sophisticated spam.

        • @regrub
          link
          English
          09 hours ago

          Don’t engage with the troll. Just block them ;)

          • @lordnikon
            link
            English
            13 hours ago

            Yeah you are right, i blocked them . thanks I guess I lost my head there for a second.

        • @[email protected]OP
          link
          fedilink
          English
          09 hours ago

          You can’t know any of that since you most likely haven’t interacted with the bot. Plus I don’t know “real option” is supposed to mean

  • @[email protected]
    link
    fedilink
    English
    310 hours ago

    Do you generate replies in a custom way every time, adjusting the prompt and supervising the result, or do you have fully-automatic system? If you do use any sort of manual intervention on per post basis, whatever you’re doing is not going to work as a bot.

    • @[email protected]OP
      link
      fedilink
      English
      19 hours ago

      Rn I’m supervising the response and iterating the prompt. I haven’t even implemented a scraper or api. I haven’t fully botted it yet because I don’t know the architecture I want. Like do I even want ai detector or a script that puts in grammar mistakes or an basic algorithm to pick prompts