• @Kbobabob
    link
    English
    216 hours ago

    There are open-source LLMs you can run on your own computer if you have a powerful GPU.

    What defines powerful? What if you don’t have the necessary hardware?

    • @[email protected]
      link
      fedilink
      English
      214 hours ago

      You can check Hugging Face’s website for specific requirements. I will warn you that lot of home machines don’t fit the minimum requirements for a lot of models available there. There is TinyLlama and it can run on most underpowered machines, but its functionalities are very limited and it would lack a lot as an everyday AI Chatbot. You can check my other comment too for other options.