Custom cooler mount

[ejfluhr]

>For stability testing I ran this machine hard for multi-day cycles (one of my own tools that 100% loads the CPU cores with lots of maths).

Do you know how "hot" that workload is compared to the TDP rating of the processor? 

Regards, Eric

[Woof]

I don't, but when comparing the exact same test with the IBM 3U HSF the temperatures were around 70 degrees.

I have a replacement mobo now (RCS were really helpful here) and I'm waiting on some CNC'd parts back with amends to make installing this easier. The design files are here for anyone interested:

    https://github.com/cwoffenden/talosmods/tree/main/am5-sf2-cooler

(I'll be updating this and adding docs along the way)

[ejfluhr]

Seems like you have an 18c POWER90 rated at 190W?   https://raptorcs.com/content/CP9M36/intro.html

POWER9 TDP long-term max temperature rating is 85C.  If your system runs ~70C, you have decent margin to the reliability limit.  How much is the improved cooling and how much is your workload would probably need to come from power data vs. that 190W spec.

[Woof]

Yes, I have the dual 18 core, and with the water cooling temps are around 40 degrees (same as the simpler solution from Vikings) and the machine is running silently (a quiet machine was the original aim). The same tests with a Noctua air cooler the temps are mid-50 and the fans are quiet (compared with the IBM HSF, anything is quiet).

We water cool racks of machines at work, with the big benefit being keeping the temps down keeps the clocks high and the power consumption down. With Threadrippers, for example, they run at boost clocks all the time, vs down-clocking to half the speed to stay within TDP, effectively doubling the throughput. Same with GPUs (which is where we do most of the water cooling, CPUs was just a curiosity).

Real life took over for a while but I will work on a jig to test the mounting pressure.

[ejfluhr]

>with the big benefit being keeping the temps down keeps the clocks high and the power consumption down.

If using IBM's WOF, the algorithm does not work that way.   It should boost to "the same" frequency regardless of CPU temp until it exceeds the temp limit at which point it will lower frequency to protect temperatures.  The TDP is conservative and very few workloads would exceed that.   The bigger factor affecting the temp protection mechanism is ambient temp....> 30C is more likely to throttle than < 30C.

What workload are you testing with?   I just got a Blackbird running Ubuntu and am stress testing it to see how it responds.  It's quite fun.

[Woof]

Thanks for the info, I know little about how the IBM WOF works.

The workload I'm testing with is from a graphics tool I've been working on for a while, which is interesting because I'd tuned the threading for 64C/128T Threadrippers and then started using it to compare other systems (and it's a nice workload for many cores). Send me a PM if you're interested in building it from source, I'm not ready to announce it yet so it's under wraps (GCC/Clang and CMake on most systems build out of the box).

[MPC7500]

For the Threadripper, have you tried this?
https://github.com/tud-zih-energy/FIRESTARTER

POWER9 support is planned

[Woof]

I haven't seen that but I definitely will try. A quick look at the source and I see it's handling thread affinity, a requirement for Threadrippers on Windows.

[ejfluhr]

That looks interesting but
>We therefore use highly optimized assembly routines that take the specific properties of a given processor microarchitecture into account.

Is that what is being done for
>POWER9 support is planned
??


I'm running a mersenne-prime calculator which seems to push the CPU pretty hard.  At least, it runs down near the "base" frequency of 3.2GHz (I have a 4-core CPU).

>cat mersenne.c
#include <stdio.h>
#include <stdlib.h>
#include <gmp.h>
int main(int argc, char *argv[]) {
   char *endptr;
   unsigned long int p = strtoul(argv[1],&endptr,10);
   mpz_t M, powerof2, one, two;
   mpz_init(M); mpz_init(powerof2);
   mpz_init_set_str(one,"1",10);
   mpz_init_set_str(two,"2",10);
   mpz_pow_ui(powerof2,two,p);
   mpz_sub(M,powerof2,one);
   gmp_printf("%Zd",M);
   return 0;
}


Run with:

>cat mersenne16.ksh
num=82589933
thread=0
while (( thread < 16 ))
do
   echo $thread
   echo time ./mersenne $num > M48.$thread
   time ./mersenne $num > M48.$thread &
   (( thread += 1 ))
done

[lepidotos]

I've been trying to even open the files on the github, and nothing seems to open them. FreeCAD, LibreCAD, Cura, ODA File Converter... I even tried handing them off to various print shops' quote pages and none of them could open them either. I don't think my copy is corrupt, I've redownloaded it a few times...

[MPC7500]

https://github.com/cwoffenden/CAD-projects/tree/main/am5-sf2-cooler/cad

These were created in BricsCAD (but should work just fine in AutoCAD).

[lepidotos]

I've read that already and didn't want to if I could avoid it, but finally went around to starting a trial of BricsCAD. Not even it can open it. I should also note apparently the commandline instantly crashes when I try opening it (so I can try to recover the file) so... I don't really know.
Also, the earlier file worked with all the aforementioned, it's just the repository ones that haven't.

[MPC7500]

You could open a ticket on Github as well.

[Woof]

For some reason I didn't get the forum updates, hmm.

Anyway, it's probably a Git LFS issue and the downloaded files are only the text files with the URL and metadata. It'll need a one-time LFS init of the repo.

The files to send for manufacture are the IGES files in the out directory.

[lepidotos]

Alright, good to know. What material should I get it done with?