Software > User Zone

anyone running local LLMs?

(1/1)

power9mm:
Looking for advice on what hardware I should go with if I wanted to run a local llm on raptor hardware. Would an 8 core blackbird with a 48gb vram gpu be sufficient? or should I be considering one of the talos 2 options..? unsure how ROCm support is or if I should consider nvidia for the computer drives.

Navigation

[0] Message Index