exu ,
@exu@feditown.com avatar

Llama.cpp supports OpenCL as well and performs better than rocm in my limited experience. That should work on basically any GPU.

  • All
  • Subscribed
  • Moderated
  • Favorites
  • random
  • localllama@sh.itjust.works
  • test
  • worldmews
  • mews
  • All magazines