Author Topic: News?  (Read 30101 times)

pocock

  • Sr. Member
  • ****
  • Posts: 296
  • Karma: +32/-0
    • View Profile
Re: News?
« Reply #45 on: June 11, 2022, 04:49:41 pm »
I think some of this is out of Raptor's control

There is widespread discussion elsewhere about IBM wrecking things in Red Hat, CentOS and Fedora, POWER10 not being 100% open and Google has been wrecking things in Debian.  Coincidentally, IBM and Google are the two key players in OpenPOWER.  I don't want to gripe about it, only to express what it may mean for everybody who already bought in to this platform.

They had an OpenPOWER room at FOSDEM, they accepted my talk and then they canceled it, this is incredibly nasty stuff.  We go to FOSDEM every year as volunteers.  It was online this year, the Google people don't have to look the volunteers in the eye because it is all remote so they brought this dirty behavior into FOSDEM.

On a platform like POWER where there are not so many developers to begin with you can't do stuff like that.  If people see one volunteer being hurt then ten other volunteers will avoid the platform.  People don't care who is right or wrong, when they get the feeling of conflict, they decide to give it a pass or come back and look again in 12 months.  That makes it much harder for Raptor to sell to volunteer developers.

Debian has started spending a lot of money on a lawsuit recently.  I don't want to hijack this thread with details of the lawsuit, you can download the dossier if you really want to, the only thing I want to emphasize is that 17 developers resigned.  15 of those developers were removed from the keyring on 7 June.  Most of them will probably not make any statement about their resignation, most people don't like to take sides but there is a cause and effect: when conflict starts, some people quit.

This is all out of Raptor's control of course but it is a risk to the platform.

Personally, having contributed to patching packages for POWER9, I'm optimistic that lessons learnt from porting work on this platform will be easily transposed to ARM64 and RISC V.  Raptor has made the motherboards to a high standard and most people seem to agree they will last a long time, hopefully long enough for RISC V to appear on our desktops too.

Debian Developer
https://danielpocock.com

SiteAdmin

  • Administrator
  • *****
  • Posts: 41
  • Karma: +15/-0
  • RCS Staff
    • View Profile
Re: News?
« Reply #46 on: June 12, 2022, 01:31:50 am »
We would respectfully ask that the discussion here remain on topic as much as possible.  While RISC-V and ARM remain attractive from a cost perspective, we do want to remind everyone involved that all current ASIC implementations of RISC-V -- and all reasonably powerful ARM devices -- are actually more closed and require more blobs than POWER10 does.  While at least right now we won't build POWER10 systems due to the blobs resident in those CPUs and associated interface devices, it should also be apparent that current RISC-V and ARM implementations are a step even further in the wrong direction.

We believe there is a future for the POWER platform and its truly open, standardized ISA -- especially with projects like LibreSoC already underway, and internal projects (some of which are already yielding public results in the Kestrel OpenPOWER soft BMC project), we would advise against switching to blob-filled, proprietary platforms just to "hit back" at IBM.

For clarity: we do not agree with where IBM is going with the POWER platform with POWER10.  We also do not believe that IBM has the ability to restrict what can be done with the OpenPOWER ecosystem now or in the future.  They are (were) a major player, yes, but at the end of the day they are unable to call back or restrict what other companies and individuals are able to do -- and are already starting to do -- with the ISA.  The best way to keep things open in the short term, when also looking at long-term effects, would be to simply standardize the open software ecosystem on the POWER9 ISA vs. the POWER10 ISA.  At least for now, as this would further encourage the use of open chips vs. chips that require binary components, since POWER9 would remain the baseline ISA compatibility level for said new devices.

Hopefully this will spark further on-topic discussion.  We're not going anywhere, and we refuse to build and ship blob-infested hardware, so RISC-V remains a no-go for us.  Hopefully Debian will also continue to show this blob-free focus in the future, as Raptor and Debian have been fairly well aligned on this topic for many years.

...typing this from a Talos II workstation with Debian and Ungoogled Chromium installed.
« Last Edit: June 12, 2022, 02:34:57 am by SiteAdmin »

pocock

  • Sr. Member
  • ****
  • Posts: 296
  • Karma: +32/-0
    • View Profile
Re: News?
« Reply #47 on: June 12, 2022, 06:47:45 am »

Raptor has made the motherboards to a high standard and most people seem to agree they will last a long time, hopefully long enough for RISC V to appear on our desktops too.



If you look at that comment, there is nothing in it to suggest an open RISC V will arrive imminently.  In fact, given that nobody is holding their breath for open RISC V, the comment could be seen as deliberately optimistic about Talos II boards running for years to come due to their quality.


we would advise against switching to blob-filled, proprietary platforms just to "hit back" at IBM.

There was nothing in the post to suggest people "hit back" at IBM

It is just a reality check, that is all.  We can see the way people started building Alma Linux and other continuations of CentOS.  That is not to "hit back" at Red Hat or IBM, they are building that because they need it and it was the right thing to do.

Given the communities are not so big, these situations do lead to people duplicating effort (e.g. Rocky Linux) and other inefficiencies that may have been avoidable.  Rather than having 3 or 4 forks of CentOS, developers doing exactly the same thing in parallel, it would be interesting if some of that developer effort went to POWER9 porting.

Speaking as a developer, I fully respect the right of any developer, whether it is a lone volunteer or a giant company like IBM to change their direction.  It then raises the question about how other people work around that.

For example, do you see the IBM POWER9 chips continuing to be available in sufficient quantities for the Raptor ecosystem?

Do you see any other manufacturer coming along with a 100% open chip to continue from POWER9?

The best way to keep things open in the short term, when also looking at long-term effects, would be to simply standardize the open software ecosystem on the POWER9 ISA vs. the POWER10 ISA.

Could you define that?  For example, which key software products need to commit to that statement?  In practice, how many of the developers on that part of the open source ecosystem are employed by IBM / Red Hat and could that take them down a POWER10 path?

...typing this from a Talos II workstation with Debian and Ungoogled Chromium installed

Does this mean the Chromium libs are now available for building other things?  If so, I might have another look at some projects that were pending for me to port.
Debian Developer
https://danielpocock.com

SiteAdmin

  • Administrator
  • *****
  • Posts: 41
  • Karma: +15/-0
  • RCS Staff
    • View Profile
Re: News?
« Reply #48 on: June 12, 2022, 02:08:21 pm »
If you look at that comment, there is nothing in it to suggest an open RISC V will arrive imminently.  In fact, given that nobody is holding their breath for open RISC V, the comment could be seen as deliberately optimistic about Talos II boards running for years to come due to their quality.

Out main point was that the first part could be taken as RISC-V being the inevitable long-term succesor to POWER, when we're fairly certain that would not be the case, especially in the blob-free / owner-controlled sphere.  Regardless, we do appreciate the note on quality -- that's an area we've put a lot of time, effort, and resources into.

There was nothing in the post to suggest people "hit back" at IBM

It is just a reality check, that is all.  We can see the way people started building Alma Linux and other continuations of CentOS.  That is not to "hit back" at Red Hat or IBM, they are building that because they need it and it was the right thing to do.

This wasn't directed so much to you as it was to the general developer community.  We've seen some knee-jerk reactions when bad news comes out, including some people that basically just gave up and said "I'm doing x86 only, ME and vendor blobs are inevitable".

Speaking as a developer, I fully respect the right of any developer, whether it is a lone volunteer or a giant company like IBM to change their direction.  It then raises the question about how other people work around that.

Indeed.  For us, that's why we have such a stong requirement for owner control, including opening and standardization of the ISA itself.  At least this removes all of the artifical barriers that would otherwise be thrown up.  For example, Intel and AMD want to make gaming and streaming consumer systems -- they need the ME and PSP to do that, but since the ISA is not open that now steps on everyone else's rights to use the systems in other ways without effectively allowing Intel/AMD access to the data on them, because no one else can (legally) make compatible CPUs that also meet the blob-free / owner-controlled requirements.

For example, do you see the IBM POWER9 chips continuing to be available in sufficient quantities for the Raptor ecosystem?
Yes, there are many, many years worth of the CPUs available.

Do you see any other manufacturer coming along with a 100% open chip to continue from POWER9?
Short answer: yes.  Long answer: [redacted] skunkworks [redacted].

They're still planned, just delayed from COVID and the recent macroeconomic meltdown.  LibreSoC is also working in the background and contining to make progress, we're not looking at a single pathway to the required silicon here, just that all pathways produce 100% blob free ppc64le ISA 2.07+ compatible devices.

Could you define that?  For example, which key software products need to commit to that statement?  In practice, how many of the developers on that part of the open source ecosystem are employed by IBM / Red Hat and could that take them down a POWER10 path?
Great question!  We'd say just having the main binary distros (Debian, Fedora, SuSE?) ensure they keep their package archives compatible with POWER9 vs. requiring POWER10 is enough.  Then the only other group that needs to be on-board is the JIT writers -- don't use POWER10-specific instructions.  To be honest, this is going to happen naturally anyway, since no one that we know of is making POWER10 systems that are would be desktop-class or exist outside of a cloud environment, let alone open systems.  This all solely due to IBM's poor decision to close parts of the POWER10 platform, it's quite sad.

Does this mean the Chromium libs are now available for building other things?  If so, I might have another look at some projects that were pending for me to port.
Yes, we've been investing significant resources in keeping a POWER build of Chromium available, tracking upstream Debian including the security patches but also including the Ungoogled patchset.  Our thought was that since Google absolutely refuses to upstream the POWER port (our suspicion is because it is an owner controlled, blob-free platform, this would interfere with the long-term goal of mandated low-level tracking for advertising), why enable any of the Google services at all?

The patches are also fairly easy to unroll in debian/series if you did want to just build a stock Debian Chromium for POWER.  In any case, we'd love to see the base patches integrated into the official Debian builds, maybe you could help us get some traction there?

Builds are currently here:
https://quickbuild.io/~raptor-engineering-public/+archive/ubuntu/chromium/+packages

dget -x / apt-get source work against that repository.

Google's unfortunate stance on upstreaming is basically "we won't do it and we won't tell you why".

https://chromium-review.googlesource.com/c/chromium/src/+/3133001

Applying Occam's Razor against that yields a few concerning options, including the potential existence of a third party agreement that would prohibit it.  As such, the remaining patches need to be carried downstream in various distros; they're already carried downstream for Gentoo etc., see e.g. https://bugs.gentoo.org/669748 .
« Last Edit: June 12, 2022, 02:43:21 pm by SiteAdmin »

AdamJoseph

  • Newbie
  • *
  • Posts: 16
  • Karma: +3/-0
    • View Profile
Re: News?
« Reply #49 on: June 12, 2022, 08:07:21 pm »
For example, do you see the IBM POWER9 chips continuing to be available in sufficient quantities for the Raptor ecosystem?
Yes, there are many, many years worth of the CPUs available.

In this respect POWER9 is far more secure than POWER10 or any of its competitors.

Three years ago 14LPP wafers were running in New York (East Fishkill, I think, but maybe Malta) and production was starting up in Dresden as a second site.  There are probably additional sites by now; my attention has been focused elsewhere lately.  In any case, just those two locations alone are a whole lot more geopolitical security than the rest of the industry has.  14LPP isn't the same as IBM's special eDRAM-cap variant of 14nm, but it would be very unusual for it to not be running from the same sites as the less-flashy merchant foundry wafers.

Don't worry about supply of chips.  Supply of blackbird motherboards, on the other hand...


Do you see any other manufacturer coming along with a 100% open chip to continue from POWER9?
Short answer: yes.  Long answer: [redacted] skunkworks [redacted].

LibreSoC is also working in the background and contining to make progress,

I've been having a hard time finding information about their 180nm tapeout.  The chips came back almost a year ago; are any data available?  How did things turn out?  Surely there's been time for several iterations with a FIB by now...


we're not looking at a single pathway to the required silicon here, just that all pathways produce 100% blob free ppc64le ISA 2.07+ compatible devices.

Unfortunately getting the foundries to care about anything other than your organization's market cap is a gigantic obstacle these days.  Design quality and engineering talent are not taken into consideration anymore.
« Last Edit: June 12, 2022, 09:01:08 pm by AdamJoseph »

AdamJoseph

  • Newbie
  • *
  • Posts: 16
  • Karma: +3/-0
    • View Profile
Re: News?
« Reply #50 on: June 12, 2022, 08:43:54 pm »
including the potential existence of a third party agreement that would prohibit it.

I'm quite sure one exists, although less sure that it is the entire explanation for the situation.

One of the major concessions to get Hollywood to stop insisting on browser plugins (Flash and Silverlight) was the browser vendors agreeing to never allow their brands to be placed on a piece of software that didn't support EME, as a condition of receiving CDM licenses (widevine, etc).  Unfortunately User-Agent has made brands and trademarks part of protocols, but that's another story....

Anyways, this licensing condition is the reason for weird situations like:

  • Builds of Firefox that make no changes other than disabling EME being forced to use a different name.
  • Firefox suddenly and silently flag ignoring the --disable-eme flag since September 8th, 2017 -- so the only way to truly disable EME is to patch the source code like Tor-Browser does.  This gives Mozilla a toehold to claim that what you're compiling "isn't Firefox" and politely ask you to not use their trademark.
  • (I speculate) Google dragging its feet on powerpc64le.  Having to get Widevine working on powerpc64le and then maintain it is a burden for them, which is a factor in their decision.

You might have better traction asking the QT folks to integrate the patches into QTwebengine.  They support widevine but don't distribute the binary themselves, which strongly implies that they are not allowed to do so.  The only reason they wouldn't be allowed to do this is lack of a licensing agreement.  If they don't have a licensing agreement then they aren't subject to the "everywhere or nowhere" requirement.

I fear that the effort to merge the Firefox powerpc64le JIT support will hit similar nontechnical roadblocks.  I hope I'm wrong about that.
« Last Edit: June 12, 2022, 08:53:48 pm by AdamJoseph »

ClassicHasClass

  • Sr. Member
  • ****
  • Posts: 467
  • Karma: +35/-0
  • Talospace Earth Orbit
    • View Profile
    • Floodgap
Re: News?
« Reply #51 on: June 13, 2022, 07:58:02 pm »
Quote
I fear that the effort to merge the Firefox powerpc64le JIT support will hit similar nontechnical roadblocks.

I don't think so, insofar as I have unofficial OKs once I get it to a point I'm happy with it. I'm just not happy with it yet.

AdamJoseph

  • Newbie
  • *
  • Posts: 16
  • Karma: +3/-0
    • View Profile
Re: News?
« Reply #52 on: June 14, 2022, 12:20:09 am »
Quote
I fear that the effort to merge the Firefox powerpc64le JIT support will hit similar nontechnical roadblocks.

I don't think so, insofar as I have unofficial OKs once I get it to a point I'm happy with it.

Very glad to hear that!
« Last Edit: June 14, 2022, 12:28:37 am by AdamJoseph »

Borley

  • Full Member
  • ***
  • Posts: 177
  • Karma: +16/-0
    • View Profile
Re: News?
« Reply #53 on: June 14, 2022, 03:35:31 pm »
For example, do you see the IBM POWER9 chips continuing to be available in sufficient quantities for the Raptor ecosystem?
Yes, there are many, many years worth of the CPUs available.

And even if there weren't, aftermarket availability would persist. One can still find piledriver and bulldozer Opterons for socket G34 all these years later being sold out of recycling operations and private sellers. I know I've got IBM Sforza socket CPUs laying around unused right now, that could find their way to ebay in such an event. I think it's the fact that there is a specialized microcosm for both of the previous examples.

This wasn't directed so much to you as it was to the general developer community.  We've seen some knee-jerk reactions when bad news comes out, including some people that basically just gave up and said "I'm doing x86 only, ME and vendor blobs are inevitable".

I've seen that defeatist mentality in all manner of other freed technology where it's always rationalized away as "you'll never be able to 100% avoid malicious functionality so you might as well use ____. It's what everyone else is using anyway". I believe this qualifies as nirvana fallacy. Then again, I can't call myself a developer. So I have no plans to stop using my RCS board(s) unless something better comes along.

Quote
I fear that the effort to merge the Firefox powerpc64le JIT support will hit similar nontechnical roadblocks.

I don't think so, insofar as I have unofficial OKs once I get it to a point I'm happy with it. I'm just not happy with it yet.

I'm looking forward to the work getting mainlined :D


Hasturtium

  • Full Member
  • ***
  • Posts: 154
  • Karma: +10/-0
    • View Profile
Re: News?
« Reply #54 on: July 11, 2022, 12:29:51 pm »
I discussed the state of my Raptor order last week and was told they’d received a shipment of Blackbirds and would resume shipping shortly. I was even told that they would be able to ship mine out within a week, though I haven’t gotten a shipment update or tracking number yet. I really hope that info was accurate.
« Last Edit: July 11, 2022, 05:36:53 pm by Hasturtium »

r34per

  • Newbie
  • *
  • Posts: 27
  • Karma: +2/-0
    • View Profile
Re: News?
« Reply #55 on: July 12, 2022, 09:27:28 am »
That's fantastic! When did you place an order for one? Hopefully my order will be filled as well; I placed mine almost a year and a half ago
« Last Edit: July 12, 2022, 10:01:45 am by r34per »

Hasturtium

  • Full Member
  • ***
  • Posts: 154
  • Karma: +10/-0
    • View Profile
Re: News?
« Reply #56 on: July 12, 2022, 11:50:06 am »
That's fantastic! When did you place an order for one? Hopefully my order will be filled as well; I placed mine almost a year and a half ago

I placed mine in late September of last year. Cross your fingers.

edit: Got an email this evening confirming shipment, with a tracking number. What a weekend for me to go out of town... but next week I'm free to set it up!
« Last Edit: July 12, 2022, 11:11:52 pm by Hasturtium »

ClassicHasClass

  • Sr. Member
  • ****
  • Posts: 467
  • Karma: +35/-0
  • Talospace Earth Orbit
    • View Profile
    • Floodgap
Re: News?
« Reply #57 on: July 13, 2022, 12:28:02 am »
Excellent!

Corvidae

  • Newbie
  • *
  • Posts: 25
  • Karma: +11/-0
    • View Profile
Re: News?
« Reply #58 on: July 13, 2022, 01:07:56 pm »
Going on a bit over 2 years since I ordered my Blackbird, haven't heard anything yet. Hopefully they didn't forget about me  :'(

Glad others are finally getting theirs though!

Borley

  • Full Member
  • ***
  • Posts: 177
  • Karma: +16/-0
    • View Profile
Re: News?
« Reply #59 on: July 14, 2022, 06:53:49 pm »
I placed mine in late September of last year. Cross your fingers.

edit: Got an email this evening confirming shipment, with a tracking number. What a weekend for me to go out of town... but next week I'm free to set it up!

That's great to hear! I hope all goes well. It sounds like the Free Software Foundation might be eyeing some Blackbirds too.