ios builds failing (nov 9)

[Dave Dyer]

My last successful build was at 13:39

back at 20:30, now builds are failing.  The only available clue is that
the error logs of failed builds all end with

Parsing: /var/folders/zh/kb_4hqhn4kg1h0r5dp_6htcm0000gn/T/build5253339589298551336xxx/classes/zertz/common/zChip.class
Parsing: /var/folders/zh/kb_4hqhn4kg1h0r5dp_6htcm0000gn/T/build5253339589298551336xxx/classes/zertz/common/ZertzGameViewer$1.class
Parsing: /var/folders/zh/kb_4hqhn4kg1h0r5dp_6htcm0000gn/T/build5253339589298551336xxx/classes/zertz/common/ZertzGameViewer.class
Parsing: /var/folders/zh/kb_4hqhn4kg1h0r5dp_6htcm0000gn/T/build5253339589298551336xxx/classes/zertz/jdk11/GameViewer.class
Rewrite /var/folders/zh/kb_4hqhn4kg1h0r5dp_6htcm0000gn/T/build5253339589298551336xxx/dist/Develop-src/cn1_globals.h with 1 changes
outputDirectory is: /var/folders/zh/kb_4hqhn4kg1h0r5dp_6htcm0000gn/T/build5253339589298551336xxx/dist/Develop-src

which corresponds to the switchover to saving the output source file.

Now, the plot thickens.  As I started composing this message, I also started
another build, intending to wait until it also failed to hit send.   This
turned out to be unnecessary, since the third build magically came back from the
dead and became a successful build.  See the attached screen shot.

[Shai Almog]

Thanks for the issue you submitted. I'm not sure if we'll push it for 3.8 or right after the release. I have another issue I'd like to address in the release so we'll need to see.

[Dave Dyer]

Here's another instance in this pattern.  If you look at the start times, you can see that the "successful" build is out of sequence.
It was previously labeled as a failed build.

[Shai Almog]

I think this issue relates to core architecture of the build servers. It's something we'd like to update moving forward but it's kind of like changing a planes engine mid flight... So it's a bit hard to justify the effort technically when we have so many ongoing tasks and so few resources.

[Dave Dyer]

I am still ahead of the game if I have to build 2 or 3 times, compared to the single build time a year ago.