Ollama now supports AMD graphics cards · Ollama Blog
ollama.com
Ollama now supports AMD graphics cards in preview on Windows and Linux. All the features of Ollama can now be accelerated by AMD graphics cards on Ollama for Linux and Windows.

But in all fairness, it’s really llama.cpp that supports AMD.

Now looking forward to the Vulkan support!

  • @sardaukarEnglish
    7•10 months ago

    I’ve been using it with a 6800 for a few months now, all it needs is a few env vars.