There is a potential for proliferation of CSAM generated by AI. While the big AI generators are centralized and kept clear of most bad stuff, eventually unrestricted versions will become widespread.

We already have deepfake porn of popular actresses, which I think is already harmful. There’s also been sexually explicit deepfakes made of preteen and young teenage girls in Spain, and I think that’s the first of many similar incidents to come.

I can’t think of a way to prevent this happening without destroying major potential in AI.