Messages

181

Blackbird / Re: How to increase storage: another nvme/PCI or SATA

« on: September 22, 2020, 06:29:34 pm »

There are some PCIe x8 cards that accept multiple NVMe disks over OCuLink, U.2 or directly in M.2 slots

Highpoint is bringing out a PCIe 4.0 product this month:
https://highpoint-tech.com/USA_new/nvme_raid_controllers.htm

LSI tri-mode controllers, 9400-* and 9500-* look interesting but expensive.

Anything like that will help you combine multiple NVMe drives

I'd be interested to know if anybody tested any of those products already as I'm also trying to choose my storage strategy.

Whether you can use SATA drives depends on your workload.  People can only make suggestions if you describe the way you use the computer and the data you need to store.

182

Applications and Porting / Re: Riscy Slack Extras

« on: September 18, 2020, 01:09:25 pm »

Blender is in your list.  Does the Blender video preview window work for you?  In my system, the display in that window is corrupted, I created a bug report

183

Applications and Porting / Re: Building software, a bit of a newb question

« on: September 18, 2020, 07:23:57 am »

I built the backport of obs-studio from Debian bullseye so it runs on Debian buster.  I'll test it a little and then publish the package and dependencies for anybody who wants to use it

184

Operating Systems and Porting / Re: kernel config: page size 4k vs 64k

« on: September 17, 2020, 11:58:07 am »

I've found the relevant config in the Fedora kernel package and posted about the same issue in the Fedora PPC mailing list

185

Operating Systems and Porting / Re: kernel config: page size 4k vs 64k

« on: September 16, 2020, 02:17:02 am »

Today I made some tests comparing Firefox WebRTC on 64k and 4k page size

With a Logitech webcam, I found both 64k and 4k worked

With Elgato Camlink 4k, v4l2-loopback and my gstreamer script, I found it only worked on 4k.  With 64k, Firefox displayed the local monitor / self-view from the Camlink but the remote host wasn't receiving the picture.  Firefox was receiving the picture from the remote host, so this was a one-way video problem.

The gstreamer script is a very simple chroma-key example, it is not OBS but then it is less than 10 lines of code.

186

Operating Systems and Porting / Re: kernel config: page size 4k vs 64k

« on: September 15, 2020, 05:22:39 pm »

(I modified the code last night, now it builds 64k and 4k kernels as two different flavours so you can install both on the same system and choose between them in the petitboot menu, the 4k kernel file has 4k in the filename and ABI string)

Here is my patch for building a Debian kernel package with the 4k page size, like other architectures

To use it:

Code: [Select]

mkdir -p ~/ws/kernel
cd ~/ws/kernel
wget http://deb.debian.org/debian/pool/main/l/linux/linux_4.19.132.orig.tar.xz
xzcat linux_4.19.132.orig.tar.xz | tar xf -
git clone https://gitlab.com/dpocock/linux-kernel-debian
cd linux-kernel-debian
git checkout pocock/buster-ppc64el-4k
cd ../linux-4.19.132
ln -s ../linux-kernel-debian/debian .
dpkg-buildpackage -rfakeroot -i.* --no-sign -b -j`grep -c ^processor /proc/cpuinfo`
cd ..

You should find the packages *.deb in ~/ws/kernel

You can just install it with dpkg and reboot into the kernel with 4k page size

Beware: if you have a btrfs root filesystem with sectorsize=64, the kernel with 4k page size can't mount it.  If your root filesystem is ext4 it will just work.

If people are comfortable with this change then it will be a good idea to open bug reports for the kernel packaging teams in each of the relevant distributions.

187

Talos II / CPU alignment / slots not working

« on: September 15, 2020, 03:12:48 pm »

After my success with the NVIDIA card, I decided to try it in each slot

I found that it wouldn't work in slot 3, that is the middle 16x slot.

I tried removing and re-inserting it a couple of times and I inspected the slot with a torch and couldn't see any problem

Next I tried removing and re-seating CPU #2.  After doing this, the NVIDIA card in slot 3 is working.

Are there any diagnostics to confirm CPUs are correctly inserted?  Everything else I did on the CPU appeared normal, for example, I had exercised all cores and RAM without problems.

Is there any technique to follow when inserting the CPUs to avoid issues like this?

188

User Zone / Re: Working xorg.conf for nouveau driver for a NVIDIA graphics card?

« on: September 15, 2020, 03:08:13 pm »

I took this a bit further

On a positive note, Quadro K420 also worked immediately

On the other hand, when I put the system under heavy load, Nouveau crashed.  I was still able to ssh into the box, kill Xorg and start Xorg again.  This may not be a problem specific to this platform, it may be Nouveau.  amdgpu hasn't given me any similar problems when I have the system under load.

189

User Zone / Re: Working xorg.conf for nouveau driver for a NVIDIA graphics card?

« on: September 15, 2020, 01:00:01 pm »

After compiling the Debian buster kernel with a 4k page size, the Nouveau driver and Quadro K2200 immediately worked

190

General OpenPOWER Discussion / Re: News?

« on: September 15, 2020, 09:05:22 am »

I don't have an answer about the Blackbird

From my personal analysis, I feel that many people considering a Blackbird might get more advantages from a Talos II Lite, it is only about 10% more expensive but there are benefits as outlined on the comparison page here.

In particular, using more than 2 memory channels or more than 8 cores both give you significant performance benefits if that is necessary for your workload.  It can also take a GPU wider than 2 slots because there is nothing else beyond the GPU slot.

191

Operating Systems and Porting / Re: kernel config: page size 4k vs 64k

« on: September 15, 2020, 06:40:26 am »

Some emulation and virtualization tools have dependencies on page size. We had some page size issues in Firefox initially, though I think we smoked most of those out.

Maybe that is why Thunderbird is not working at all either.

Simply running a 4k kernel doesn't always fix the issues.  Sometimes it is necessary to rebuild each broken application on the host running a 4k kernel.  This is because the build scripts of some applications look at the page size during compile time and assume it will be the same for run-time and they hardcode it into the binary.

I will probably try building both the Firefox and Thunderbird packages from source on a Debian buster host running with the 4k page size.

I tried Firefox for a WebRTC call yesterday and the video was missing, I'll see if that works with the 4k page size too, with and without recompiling Firefox itself.

The two biggest concerns I heard from people about this platform are not being able to use Firefox reliably and the noise issues.  Developers are reluctant to embrace any platform that might sidetrack us from the things we are supposed to be working on.  If the noise issues can be fixed with Vikings' water cooling solution and the Firefox issues can be reined in by a 4k page size then it could make a crucial difference to the success of the platform.  It is therefore quite important to look at how to engage distributions in that solution.

192

Operating Systems and Porting / Re: kernel config: page size 4k vs 64k

« on: September 15, 2020, 06:29:43 am »

Yes, that is correct, the sectorsize parameter for a btrfs filesystem must be the same as PAGESIZE for the kernel

Therefore, btrfs filesystems created on systems with a 4k page size can only be used on systems with a 4k page size

btrfs filesystems created on systems with a 64k page size can only be used on systems with a 64k page size

193

User Zone / Re: Working xorg.conf for nouveau driver for a NVIDIA graphics card?

« on: September 14, 2020, 02:56:20 pm »

Yes, I only discovered that by chance while investigating the btrfs issues.

I compiled a kernel package with 4k page size and I have another SSD with Debian in an ext4 filesystem that should boot with 4k page size.  I'll probably try it in the next couple of days to see if it works with Nouveau and the Quadro K2200

194

Operating Systems and Porting / kernel config: page size 4k vs 64k

« on: September 14, 2020, 05:19:55 am »

Most distributions have chosen the 4k page size for their kernels on Intel architectures.

On powerpc64le, Debian (since 2014) and Fedora are using 64k

This may be good for HPC environments but troublesome for workstation users

Here are some specific observations:

Nouveau driver apparaently won't work at all on anything other than 4k

btrfs filesystems have a sectorsize that corresponds to the page size on the host where the filesystem was created.  The filesystems can't be mounted on any host with a different page size.

Example problems:

• you have a 6TB drive with btrfs from an x86 workstation, you want to move it to a Blackbird running the default Debian or Fedora kernel but it won't mount.
• you install Fedora 33 with the default kernel (64k page size) and default filesystem (btrfs from Fedora 33) and later you want to recompile your kernel for 4k.  Now you can't mount your root filesystem because mkfs was run for 64k

As Fedora is going to use btrfs by default now, btrfs volumes will be more common and users are more likely to encounter frustration from time to time.

The btrfs developers recently started a patch that allows the systems with 64k page size to read a btrfs volume with 4k sectorsize.  It only works in one direction and it is read-only.

Does anybody feel that distributions should offer different permutations of their kernel and installer based on the 4k page size?

From the perspective of workstation users, are there any other strong reasons, other than Nouveau and btrfs, for distributions to consider this?

195

General Discussion / Re: noise levels, sound dampening, tempered glass cases

« on: September 12, 2020, 03:58:08 pm »

My supplier still doesn't have the regular case (both sides dampened panels) so I took the case with dark tinted glass

As the case is so large and the case fans are big, 140mm, they can run at low speed and the overall build is very quiet when CPUs are idle

After hearing the noise levels at full load, I don't believe the dampened panel would make much difference so it is more a matter of personal preference choosing between glass or the regular panel on this case.

As there are some flashing leds on the motherboard, the glass panel might be annoying if the machine is installed in a location where somebody sleeps.