• yeehaw
    link
    fedilink
    English
    317 days ago

    This is cool, are there any decent ones that run in docker and have a web UI?

    • @[email protected]
      link
      fedilink
      English
      217 days ago

      I’ve been using open webui (search for it with those terms) to run local models in a docker container served from Llama for the last few months and I love it.