1
Applications and Porting / Re: Running Ollama on PPC64LE
« on: February 19, 2025, 06:56:46 pm »
Yea I was able to get Ollama up and running following the instructions.
I didn't get very good performance though. I was getting only around 0.10 tokens/s using deepseek-r1:32b on CPU only.
I did try to get my RTX A4000 GPU to work but I couldn't get the driver to work properly. nvidia-smi just hangs and eventually gives an error message.
I didn't get very good performance though. I was getting only around 0.10 tokens/s using deepseek-r1:32b on CPU only.
I did try to get my RTX A4000 GPU to work but I couldn't get the driver to work properly. nvidia-smi just hangs and eventually gives an error message.