• @Nalivai
    link
    English
    15 days ago

    I somehow know when it’s going to be accurate

    Are you familiar with Dunning-Kruger?

    • @bradd
      link
      English
      1
      edit-2
      5 days ago

      Sure but you can benchmark accuracy and LLMs are trained on different sets of data using different methods to improve accuracy. This isn’t something you can’t know, and I’m not claiming to know how, I’m saying that with exposure I have gained intuition, and as a result have learned to prompt better.

      Ask an LLM to write powershell vs python, it will be more accurate with python. I have learned this through exposure. I’ve used many many LLMs, most are tuned to code.

      Currently enjoying llama3.3:70b by the way, you should check it out if you haven’t.