Hugging Face crawls as many GitHub repositories as it can with the help of the Software Heritage Archive so as to create their Stack v2 LLM for code. And of course without consent of rights holders.

Opt-out is possible.

  • Grimy
    link
    fedilink
    arrow-up
    2
    ·
    3 days ago

    You don’t need consent. It’s better to have an open dataset, since all the big AI companies have their own private dataset anyways (which isn’t opt-out).

    So it starts I guess. Hugging face holds basically all the open source data and models, the government will start going after them now that they are getting copyright wins. It’s regulatory capture. They are doing it at the behest of big AI companies to kill the competition.