Round 12 ETA: Soon (see updates in thread)

[Brian Hauer]

We are setting the following as goals for Round 12.  As in all previous rounds, these dates should be considered likely to change.

• Monday, February 1: Last day for addition or change pull requests.  PRs will additions or major changes after this date will be deferred until the following round.
• Monday, February 8: First Round 12 preview available.
• Monday, February 15: Second Round 12 preview available.
• Monday, February 22: Round 12 final.
  

Thanks for all of the contributions!

[Brian Hauer]

Peak has alerted us that they need to replace our existing servers with new servers that should be available by roughly mid-February.  We have asked that the new servers match the specifications of the existing ones so that data aligns well with previous rounds, but if that is not possible, we will note the changes.  Peak very generously provides the servers free of cost to this project!

With this in mind, here is a revised tentative schedule that pushes the dates out by about two weeks:

• Monday, February 15: Last day for addition or change pull requests.  PRs will additions or major changes after this date will be deferred until the following round.
• Monday, February 22: First Round 12 preview available.
• Monday, February 29: Second Round 12 preview available.
• Monday, March 7: Round 12 final.

Additional delays will be necessary if the replacement servers cannot be made available by mid-February.

[Ludovic Gasc]

Hi,

Thanks a lot for this extra time :-)

Have a nice day.

--

Ludovic Gasc (GMLudo)

http://www.gmludo.eu/

--
You received this message because you are subscribed to the Google Groups "framework-benchmarks" group.
To unsubscribe from this group and stop receiving emails from it, send an email to framework-benchm...@googlegroups.com.
Visit this group at https://groups.google.com/group/framework-benchmarks.
For more options, visit https://groups.google.com/d/optout.

[Fredrik Widlund]

Hi,

Are we on schedule?

Kind regards,

Fredrik Widlund

[Brian Hauer]

Due to circumstances outside of our control, we will no longer be able to use Peak hardware for ongoing rounds.  I will create a separate thread to discuss this further.

With respect to Round 12 specifically, we believe we can capture one last set of data from the Peak environment and are doing so presently.  Due to the hardware environment being decommissioned, we may do something a bit unconventional and just release Round 12 with that data as the final Round 12 results.  It will not be possible to conduct preview cycles within the Peak environment.  But any alternative would need to wait until a new physical environment can be created.  I'd rather march forward to Round 13.

I'll update this thread to indicate that the ETA is presently unknown, but assuming things go according to this plan, Round 12 could be complete soon.

[Nick Kasvosve]

Any update on round 12? Cannot wait to see results'

[Brian Hauer]

We have data collected from the Peak servers that we believe is suitable for this modestly "rushed" conclusion for Round 12.  We will be deploying the raw results to GitHub soon and will post the results on the usual web site shortly thereafter.

As of this writing, we plan to skip EC2 testing for Round 12.

[Fabio T.]

Hi, I've noticed that many PRs (including mines about Comsat servers) haven't been included even though they respected the deadlines (mainly, Feb 15 for change PRs). Is that due to HW decommissioning rush?

Thanks,
-- Fabio