Software > Applications and Porting
Running Ollama on PPC64LE
rheaplex:
llama.cpp with Vulkan is good on my older AMD card as long as the model fits in its VRAM and I supply the correct command line arguments (the llama.cpp wiki has good examples).
Navigation
[0] Message Index
[*] Previous page
Go to full version