Intel i9-9900K compilation times

[Matt Fysh]

I'm looking to put together a build box for compiling Chromium, and found these benchmarks that use the chromium build: https://www.anandtech.com/bench/CPU-2019/2224

The fairly inexpensive Intel i9-9900K has a compile time of around 53 minutes for a fresh compile. Anyone know if this is correct? Is there a way for me to verify the results before making the purchase?

[Peter Kasting]

I don't know, but I do know no really recent CPUs (eg Ryzen 3000 series) are on that table. When I built my machine recently I ended up going with a 3950x and 64 GB RAM, and it compiles fairly quickly (full build in 15 or so minutes iirc).

PK

On Thu, Feb 6, 2020, 6:49 PM Matt Fysh <matt...@gmail.com> wrote:

I'm looking to put together a build box for compiling Chromium, and found these benchmarks that use the chromium build: https://www.anandtech.com/bench/CPU-2019/2224

The fairly inexpensive Intel i9-9900K has a compile time of around 53 minutes for a fresh compile. Anyone know if this is correct? Is there a way for me to verify the results before making the purchase?

--
--
Chromium Developers mailing list: chromi...@chromium.org
View archives, change email options, or unsubscribe:
http://groups.google.com/a/chromium.org/group/chromium-dev
---
You received this message because you are subscribed to the Google Groups "Chromium-dev" group.
To unsubscribe from this group and stop receiving emails from it, send an email to chromium-dev...@chromium.org.
To view this discussion on the web visit https://groups.google.com/a/chromium.org/d/msgid/chromium-dev/9436ad68-02f0-46ea-a820-8c6fe02e2f53%40chromium.org.

[Matt Fysh]

Here's the machine I'm thinking of building: https://pcpartpicker.com/list/jLFXJb

Any feedback welcome :)

[Erik Chen]

Disclaimer: I'm no hardware expert, so take anything I say with a grain of salt.

Non-goma compile speed is dominated by: sufficient RAM to avoid swap [32GB should be good], # cores * speed, and disk RW speed. 

Your stats seem good on that front.

Some random asides:

* A typical chromium checkout w/ full build output + maximum debug symbols is around 150GB, IIRC. Depending on how many chromium checkouts you want [I often have several], 500GB may be a bit tight.

* May want to check the # of RAM-channels your motherboard has -- I think it may be 2 (?), so you may be better off with 2 16GB sticks.

* You don't need a dedicated GPU for chrome development, unless you're testing GPU-specific stuff.

* I've personally had issues with insufficient power on GPU-heavy workloads [games], and tend to go with an over-specced power supply. 

--

--
Chromium Developers mailing list: chromi...@chromium.org
View archives, change email options, or unsubscribe:
http://groups.google.com/a/chromium.org/group/chromium-dev
---
You received this message because you are subscribed to the Google Groups "Chromium-dev" group.
To unsubscribe from this group and stop receiving emails from it, send an email to chromium-dev...@chromium.org.

To view this discussion on the web visit https://groups.google.com/a/chromium.org/d/msgid/chromium-dev/6a93d03b-cf84-450b-8a66-b6d0002307a9%40chromium.org.

[Peter Kasting]

On Fri, Feb 7, 2020 at 4:05 PM Erik Chen <erik...@chromium.org> wrote:

Non-goma compile speed is dominated by: sufficient RAM to avoid swap [32GB should be good], # cores * speed, and disk RW speed.

Tangent: necessary RAM probably scales with the number of parallel jobs, which is normally autoset based on the number of cores; on my 3950x (which has 16 physical/32 virtual cores), I fully use all 64 GB RAM that I have during heavy linking near the end of the build.  But I don't think my swap usage goes very high, so I think 64 is "about right" for me.  If the scaling is linear, then "32 GB should be good" would be correct for an 8 core machine.

PK

[Sunny Sachanandani]

I'd imagine that build performance would scale quite differently for component builds vs static builds, the former scaling well with increasing number of cores and the latter being bound by linking (which is not as parallel IIUC).  I couldn't find anything about the GN args Anandtech used in their comparison so it's hard to conclude which CPU to get.  Plus it's not clear if the build times were recorded on the same revision (or at least nearish revisions) so that could affect build times too.

--

--
Chromium Developers mailing list: chromi...@chromium.org
View archives, change email options, or unsubscribe:
http://groups.google.com/a/chromium.org/group/chromium-dev
---
You received this message because you are subscribed to the Google Groups "Chromium-dev" group.
To unsubscribe from this group and stop receiving emails from it, send an email to chromium-dev...@chromium.org.

To view this discussion on the web visit https://groups.google.com/a/chromium.org/d/msgid/chromium-dev/CAAHOzFDVHi_DPOvFyo48ZpthrfqzhW1ptf-WzQ_%2BBxdJBbvjZw%40mail.gmail.com.

[Tommy C. Li]

Fun task -- if I were doing this, I would probably get something like:

 - Ryzen 3900x (I just looked up this: https://www.cpubenchmark.net/compare/AMD-Ryzen-9-3900X-vs-Intel-Core-i9-9900K/3493vs3334)

 - 64GB of ram (Two pairs of 16GB sticks => 64GB)

 - At least 1TB of SSD space

I think you can do that within your budget.

On Friday, February 7, 2020 at 5:05:00 PM UTC-8, Sunny Sachanandani wrote:

I'd imagine that build performance would scale quite differently for component builds vs static builds, the former scaling well with increasing number of cores and the latter being bound by linking (which is not as parallel IIUC).  I couldn't find anything about the GN args Anandtech used in their comparison so it's hard to conclude which CPU to get.  Plus it's not clear if the build times were recorded on the same revision (or at least nearish revisions) so that could affect build times too.

On Fri, Feb 7, 2020 at 4:10 PM Peter Kasting <pkas...@chromium.org> wrote:

On Fri, Feb 7, 2020 at 4:05 PM Erik Chen <erik...@chromium.org> wrote:

Non-goma compile speed is dominated by: sufficient RAM to avoid swap [32GB should be good], # cores * speed, and disk RW speed.

Tangent: necessary RAM probably scales with the number of parallel jobs, which is normally autoset based on the number of cores; on my 3950x (which has 16 physical/32 virtual cores), I fully use all 64 GB RAM that I have during heavy linking near the end of the build.  But I don't think my swap usage goes very high, so I think 64 is "about right" for me.  If the scaling is linear, then "32 GB should be good" would be correct for an 8 core machine.

PK

--
--
Chromium Developers mailing list: chromi...@chromium.org
View archives, change email options, or unsubscribe:
http://groups.google.com/a/chromium.org/group/chromium-dev
---
You received this message because you are subscribed to the Google Groups "Chromium-dev" group.

To unsubscribe from this group and stop receiving emails from it, send an email to chromium-dev+unsubscribe@chromium.org.

[Nico Weber]

We adjust the number of max parallel link jobs depending on the amount of memory, so hopefully it always comes in a bit under swap. So if you have a ton of cores but not a ton of ram, we'll use fewer link jobs. So 32 GB should be fine.

 

PK

--
--
Chromium Developers mailing list: chromi...@chromium.org
View archives, change email options, or unsubscribe:
http://groups.google.com/a/chromium.org/group/chromium-dev
---
You received this message because you are subscribed to the Google Groups "Chromium-dev" group.
To unsubscribe from this group and stop receiving emails from it, send an email to chromium-dev...@chromium.org.

To view this discussion on the web visit https://groups.google.com/a/chromium.org/d/msgid/chromium-dev/CAAHOzFDVHi_DPOvFyo48ZpthrfqzhW1ptf-WzQ_%2BBxdJBbvjZw%40mail.gmail.com.

[Brian Sheedy]

You may want to consider swapping the CPU for a Ryzen 9 3900X - I believe its per-core performance is marginally lower than Intel's offerings, but you're getting an extra 4 cores for about the same price, which will be quite useful for compiling.

[matcheydj]

if you're just building chromium i would get a different video card, like https://www.cpumedics.com/dell-gjd61-nvidia-tesla-k20-5gb-gddr5-pci-e-gpu-accelerator/?_vsrefdom=adwords&msclkid=2fec06ff051b1c528e5458bf20691e6c&utm_source=bing&utm_medium=cpc&utm_campaign=Shopping%20%7C%20All%20Products&utm_term=1101012322168&utm_content=ECI%20-%20Initial%20Product%20Ads%20Ad%20Group << one that is built for drafting and precision, not triangles and gaming. tesla 5gb can be bought cheaper.

[matcheydj]

also maybe consider a 750-850+w power supply, esp if not using battery backup/solar power strip.

[Shih-Chin Yang]

Hi,

I tried building Chromium last month. Instead of building locally on my computer, I built it on AWS EC2, 16 CPUs, 32GB memory for a few us dollars . That was much better for me.

Best,

Shih-Chin

--

--
Chromium Developers mailing list: chromi...@chromium.org
View archives, change email options, or unsubscribe:
http://groups.google.com/a/chromium.org/group/chromium-dev
---
You received this message because you are subscribed to the Google Groups "Chromium-dev" group.

To unsubscribe from this group and stop receiving emails from it, send an email to chromium-dev+unsubscribe@chromium.org.
To view this discussion on the web visit https://groups.google.com/a/chromium.org/d/msgid/chromium-dev/6a93d03b-cf84-450b-8a66-b6d0002307a9%40chromium.org.

[Matt Fysh]

Thanks all – here's the finished build:

PCPartPicker Part List: https://au.pcpartpicker.com/list/FpnQK4

CPU: AMD Ryzen 9 3900X 3.8 GHz 12-Core Processor

Motherboard: Gigabyte X570 GAMING X ATX AM4 Motherboard

Memory: G.Skill Ripjaws V Series 32 GB (2 x 16 GB) DDR4-3200 Memory

Storage: Samsung 970 Evo Plus 1 TB M.2-2280 NVME Solid State Drive

Video Card: Gigabyte GeForce GTX 1650 SUPER 4 GB WINDFORCE OC Video Card

Case: Corsair 275Q ATX Mid Tower Case

Power Supply: EVGA SuperNOVA G3 550 W 80+ Gold Certified Fully Modular ATX Power Supply

On Friday, February 7, 2020 at 1:49:30 PM UTC+11, Matt Fysh wrote:

[Peter Kasting]

On Sun, Feb 16, 2020 at 6:49 PM Matt Fysh <matt...@gmail.com> wrote:

Thanks all – here's the finished build:

PCPartPicker Part List: https://au.pcpartpicker.com/list/FpnQK4

CPU: AMD Ryzen 9 3900X 3.8 GHz 12-Core Processor

Motherboard: Gigabyte X570 GAMING X ATX AM4 Motherboard

Memory: G.Skill Ripjaws V Series 32 GB (2 x 16 GB) DDR4-3200 Memory

Storage: Samsung 970 Evo Plus 1 TB M.2-2280 NVME Solid State Drive

Video Card: Gigabyte GeForce GTX 1650 SUPER 4 GB WINDFORCE OC Video Card

Case: Corsair 275Q ATX Mid Tower Case

Power Supply: EVGA SuperNOVA G3 550 W 80+ Gold Certified Fully Modular ATX Power Supply

I think you'll be happy with it :)

PK

[matcheydj]

looks great! you can fit about 4 wine bottles in the case if you have that type of cooling system - homemade systems are fine for that psu, i have an open case system with plants in the room and oil lamps, etc. you should be able to connect up to four 4K displays as well. good luck.

note:

https://www.nvidia.com/en-us/drivers/unix/ 

https://developer.amd.com/amd-ryzentm-master-monitoring-sdk/ 

https://www.archlinux.org/packages/extra/x86_64/colord/ - for issues, starting point;

Oo.,

--

--
Chromium Developers mailing list: chromi...@chromium.org
View archives, change email options, or unsubscribe:
http://groups.google.com/a/chromium.org/group/chromium-dev
---

You received this message because you are subscribed to a topic in the Google Groups "Chromium-dev" group.
To unsubscribe from this topic, visit https://groups.google.com/a/chromium.org/d/topic/chromium-dev/tGj3mTGllqQ/unsubscribe.
To unsubscribe from this group and all its topics, send an email to chromium-dev...@chromium.org.
To view this discussion on the web visit https://groups.google.com/a/chromium.org/d/msgid/chromium-dev/CAAHOzFC3eVoJXOqPa56eJEC9vSDNCyM9bSHDqSvuCOfhVMwFAw%40mail.gmail.com.

--

David Matchey

[Lei Zhang]

I noticed GamersNexus has a more modern Chromium compile benchmark,
though it is not obvious what exact version they are testing.
https://www.gamersnexus.net/guides/3577-cpu-test-methodology-unveil-for-2020-compile-gaming-more

On Thu, Feb 6, 2020 at 6:50 PM Matt Fysh <matt...@gmail.com> wrote:
>
> I'm looking to put together a build box for compiling Chromium, and found these benchmarks that use the chromium build: https://www.anandtech.com/bench/CPU-2019/2224
>
> The fairly inexpensive Intel i9-9900K has a compile time of around 53 minutes for a fresh compile. Anyone know if this is correct? Is there a way for me to verify the results before making the purchase?
>

> --
> --
> Chromium Developers mailing list: chromi...@chromium.org
> View archives, change email options, or unsubscribe:
> http://groups.google.com/a/chromium.org/group/chromium-dev
> ---

> You received this message because you are subscribed to the Google Groups "Chromium-dev" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to chromium-dev...@chromium.org.
> To view this discussion on the web visit https://groups.google.com/a/chromium.org/d/msgid/chromium-dev/9436ad68-02f0-46ea-a820-8c6fe02e2f53%40chromium.org.

[奚诚 杨]

Should be true. I'm using 20C40T*2，about 27mins.

Antonidas Yang

[奚诚 杨]

BTW, i9-9900K needs 87.9mins according to the chart.

Antonidas Yang