- cross-posted to:
- aicompanions@lemmy.world
- hackernews@lemmy.smeargle.fans
- cross-posted to:
- aicompanions@lemmy.world
- hackernews@lemmy.smeargle.fans
But in all fairness, it’s really llama.cpp that supports AMD.
Now looking forward to the Vulkan support!
That’s cool. I’ve just recently gotten hold of an interesting Ampere system and it’s got an AMD card in it. I must give it a spin.
I was sadly stymied by the fact the rocm driver install is very much x86 only.
It’s improving very fast. Give it a little time.