• @brucethemoose
    link
    English
    2
    edit-2
    1 day ago

    Depends for sure. I usually try the 32B first, but give really “hard” queries to some API model.

    • @horse_battery_staple
      link
      English
      21 day ago

      With the distilled models I have, I’ve been able to build and troubleshoot pretty complicated apps in Golang and Python. However, these distilled models are very specialized and will not do things like write me a story about a duck made out of duct tape or properly summarize articles. There are absolutely limits to my workflow and setup. But I’m pretty happy with it.