Big day for people who use AI locally. According to benchmarks this is a big step forward to free, small LLMs.

  • @brucethemoose
    link
    English
    24 months ago

    Llama 70B is probably where its at, if you go the API route. It’s distilled from 405B, and its benchmarks are pretty close.