• @SpaceNoodle
    link
    -26 months ago

    If it doesn’t use its training data, what’s the training data for?

    • @[email protected]
      link
      fedilink
      26 months ago

      Analysis. It uses it, but not by “matching it”. The training data is not included in the final model. No GPT can access its training data at runtime.

      Training analyzes the contents of the training data and creates a statistical model representing the likelihoods of various tokens based on a complex series of mathematical transformations that encode various attributes of the tokens making up the training data.

      3Blue1Brown has a great series on the actual math behind it, I would highly recommend educating yourself on what GPTs actually do. It’s way more interesting than simple matching.

      • @SpaceNoodle
        link
        -2
        edit-2
        6 months ago

        God forbid I use simpler language to describe what it does.

        It’s pattern matching with extra steps.

        • @[email protected]
          link
          fedilink
          06 months ago

          Simpler language is fine when it’s accurate.

          Your simplification is inaccurate and could mislead people into thinking GPTs are just advanced regex matching engines.

          They are not. They are closer to autocorrect on steroids.

          • @SpaceNoodle
            link
            16 months ago

            Autocorrect is fancy pattern matching. GPT is fancier pattern matching.

            It’s more accurate than “AI,” since there’s no actual reasoning happening.

            • @[email protected]
              link
              fedilink
              06 months ago

              I’m gonna stop responding to this asanine thread now before you continue to demean us both with your nonsense.

              • @SpaceNoodle
                link
                16 months ago

                Have fun matching patterns for the rest of the day!