How to distribute the Android build process over several physical servers

[praveenm mulimani]

Dear All,

Is it possible to distribute the Android build process over several physical servers  to further reduce the build time? Has
anyone (Google?) done this and can they give any advice as to how they automated the process?

As Kit Kat build is taking lot of time for Quad core Processors..

if you are using any build  tools or cluster environment let me know.

Thanks in Advance.

Regards
Praveen

[Javier Jardón]

On 18 February 2014 06:34, praveenm mulimani <praveen....@gmail.com> wrote:
> Dear All,

Hello Praveenm,

> Is it possible to distribute the Android build process over several physical
> servers to further reduce the build time? Has
> anyone (Google?) done this and can they give any advice as to how they
> automated the process?

You can use distcc [1] to distribute the load between several machines

Regards

[1] https://code.google.com/p/distcc/

--
Javier Jardón Cabezas

[Alexey Vesnin]

Hello Praveenm and greetings from Russia! What exact problems/timing issues do you have for building android on quad-core machine? We're using a quad core one too and we experience no problems with it's timings. Please describe your problem more precise, I'll be glad to help you!

Cheers,

Alexey Vesnin

вторник, 18 февраля 2014 г., 10:34:13 UTC+4 пользователь praveenm mulimani написал:

[Rone]

Dear all,

I am facing the same problem: the build time is too much with my i7 (16 G Ram). My employer doesn't want to invest in a workstation with two Xeons E5.

Build take at least an hour I want a solution to reduce this time....   By cons, I have 10 PC (i7) for a cluster.

distcc allows sources to compile c / c + + (45/50% AOSP) but what solution it currently does for java files?

Regards,

Rone

[Alexey Vesnin]

Hi Rone! AOSP on this configuration should be an hour : based on my practice. And I think rhat disk subsystem organization is your weak spot. Please tell me your configuration details

воскресенье, 2 марта 2014 г., 10:04:04 UTC+4 пользователь Rone написал:

[Rone]

Indeed, the build takes an hour with ccache fixed at 50G. 

When I do multiple builds on the same day one hour is too much with my workstation. Add 16 GB of ram, it can reduce this time?

regards

Rone

[Atte Peltomaki]

On Mon, Feb 24, 2014 at 07:42:14PM +0100, Javier Jardón wrote:
> On 18 February 2014 06:34, praveenm mulimani <praveen....@gmail.com> wrote:
>
> > Is it possible to distribute the Android build process over several physical
> > servers to further reduce the build time? Has
> > anyone (Google?) done this and can they give any advice as to how they
> > automated the process?
>
> You can use distcc [1] to distribute the load between several machines

A few years ago I implemented USE_DISTCC flag for this and patched
distcc to better support Android build system. Unfortunately, it turned
out that bulk of Android build is spent compiling Java apps and
performance gains from distcc were insignificant, below 10% even under
supposedly ideal conditions.

Since the concept didn't pay off as I hoped, I never published the build
system changes. If someone wants to revisit this subject, let me know
and I can dig out the patches and notes I wrote back then.

--
Atte Peltomäki
NVIDIA Corporation
nvpublic

[宋宋俊慶]

Hi, Could you share the build environment patch for me?
I am interesting and try compile android source code with cluster.

Thank you.

Atte於 2014年3月5日星期三UTC+8下午9時55分40秒寫道：

[Rex Tener]

Yes, it would be great to have those patches.  I build for an android device that is mostly native code.

Thanks,

--

Rex

--
--
You received this message because you are subscribed to the "Android Building" mailing list.
To post to this group, send email to android-...@googlegroups.com
To unsubscribe from this group, send email to
android-buildi...@googlegroups.com
For more options, visit this group at
http://groups.google.com/group/android-building?hl=en

---
You received this message because you are subscribed to the Google Groups "Android Building" group.
To unsubscribe from this group and stop receiving emails from it, send an email to android-buildi...@googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

[5245...@qq.com]

hello , i want to use this patch too, would you share with me ?

Thanks

在 2014年8月13日星期三UTC+8上午12时20分08秒，Rex Tener写道：