• @[email protected]
    link
    fedilink
    English
    52 months ago

    that first L stands for large. sanitizing something of this size is not hard, it’s functionally impossible.

    • Ekky
      link
      fedilink
      English
      42 months ago

      You don’t have to sanitize the weights, you have to sanitize the data you use to get the weights. Two very different things, and while I agree that sanitizing a LLM after training is close to impossible, sanitizing the data you give it is much, much easier.