11mo ago

Ollama now supports AMD graphics cards

ollama.com Ollama now supports AMD graphics cards · Ollama Blog

Ollama now supports AMD graphics cards in preview on Windows and Linux. All the features of Ollama can now be accelerated by AMD graphics cards on Ollama for Linux and Windows.

But in all fairness, it's really llama.cpp that supports AMD.

Now looking forward to the Vulkan support!

Amd @lemmy.world

AlmightySnoo 🐢🇮🇱🇺🇦 @lemmy.world

11mo ago

Ollama now supports AMD graphics cards · Ollama Blog

ollama.com /blog/amd-preview

1 0

AI Companions @lemmy.world

pavnilschanda @lemmy.world

11mo ago

News

Ollama now supports AMD graphics cards · Ollama Blog

ollama.com /blog/amd-preview

8 1

Hacker News @lemmy.smeargle.fans

bot @lemmy.smeargle.fans

BOT

11mo ago

Ollama now supports AMD graphics cards

ollama.com /blog/amd-preview

1 0

4 comments

I've been using it with a 6800 for a few months now, all it needs is a few env vars.

That's cool. I've just recently gotten hold of an interesting Ampere system and it's got an AMD card in it. I must give it a spin.
- I was sadly stymied by the fact the rocm driver install is very much x86 only.
  
  It's improving very fast. Give it a little time.