Yep, I generally agree, but manual moderation is unfortunately not feasible at the current scale. I have plans to improve the chat situation using AI (to detect trolls), but it is not a super easy task given that AI stuff is expensive, and it has to be economically efficient (since the comments plugin does not and will never require ads to power it). Banning VPNs from chat has helped a bit I think, because it’s harder for trolls to just switch IP address when they get blocked. For image generation, I have put a lot of work into it to patch loopholes for people generating illegal things, but it’s a constant cat and mouse game, so it’ll never be 100% unless I were to completely ban NSFW, which I will not do. Still, the situation here will improve over time.
Then there’s the problem of NSFW stuff coming up on the /generators page. For that, I have implemented some automated stuff to try to prevent it, but it’s not easy, because e.g. terms like “nude” can be used in anti-prompt of image generation, so it’s easy to accidentally flag SFW as NSFW. I also try to do a bit of manual moderation where I can, but it’s not really scalable. I will try to improve the situation here, and it will certainly become a lot easier to automate as AI detection stuff becomes cheaper and more robust, but it’s not something that I’ll be able to fix properly for probably at least a few of months.
The thing that made me decide to say something was an image generator that had a style that had a combination of prompts that were really not OK. But I can’t see it on the list of recently changed generators now, so maybe you found it too?
I have some suggestions:
Maybe you could make it so that people who put generators together have to say if there generator is SFW or not?
Retire generators that are no longer managed (like if the generator owner doesn’t log in to moderate their gallery/chat)?
Could there be a “Report Generator” button maybe to make it easier for you to find the ones that you need to deal with?
We are having a discussion on how we can solve this very problem in our genratiors so it doesn’t bleed over into other genratiors https://lemmy.world/c/casual_perchance for discussion about prompts picture shares and the like :) please join us
Yep, I generally agree, but manual moderation is unfortunately not feasible at the current scale. I have plans to improve the chat situation using AI (to detect trolls), but it is not a super easy task given that AI stuff is expensive, and it has to be economically efficient (since the comments plugin does not and will never require ads to power it). Banning VPNs from chat has helped a bit I think, because it’s harder for trolls to just switch IP address when they get blocked. For image generation, I have put a lot of work into it to patch loopholes for people generating illegal things, but it’s a constant cat and mouse game, so it’ll never be 100% unless I were to completely ban NSFW, which I will not do. Still, the situation here will improve over time.
Then there’s the problem of NSFW stuff coming up on the /generators page. For that, I have implemented some automated stuff to try to prevent it, but it’s not easy, because e.g. terms like “nude” can be used in anti-prompt of image generation, so it’s easy to accidentally flag SFW as NSFW. I also try to do a bit of manual moderation where I can, but it’s not really scalable. I will try to improve the situation here, and it will certainly become a lot easier to automate as AI detection stuff becomes cheaper and more robust, but it’s not something that I’ll be able to fix properly for probably at least a few of months.
Thanks for your help.
The thing that made me decide to say something was an image generator that had a style that had a combination of prompts that were really not OK. But I can’t see it on the list of recently changed generators now, so maybe you found it too?
I have some suggestions:
We are having a discussion on how we can solve this very problem in our genratiors so it doesn’t bleed over into other genratiors https://lemmy.world/c/casual_perchance for discussion about prompts picture shares and the like :) please join us