[Cruisecontrolrb-users] multiple builders, why do they keep stopping.

11 views
Skip to first unread message

Nick.A...@generaldynamics.uk.com

unread,
Apr 15, 2011, 11:47:10 AM4/15/11
to cruisecont...@rubyforge.org
Hi All.
 
We've been using CCRB, v 1.4.0, on a project for nearly a year now and have found it pretty stable however recently we've had some issues.
 
The project is cross platform so there are multiple builders monitoring the same subversion path.
 
When there are just 2 builders this works fine.
We've recently introduced a new platform so have added another project which monitors the same subversion path. This has caused some stability issues.
Every so often, seems like every 2 or 3 builds one of the builders will die for no apparent reason. The dashboard indicates the builder is stopped and the log doesn't seem to say anything. It seems random which builder will die out of the 3 that are running.
 
Has anyone seen anything like this or have any ideas how I can get them to be stable again.
 
Switching the builds in to serial rather than parallel isn't an option as each build can take up to half an hour, some times longer.
Any ideas gratefully received.
 
Thanks.
Nick.
 
 

Nick Adamson
Software Engineer

Advanced Projects and Technologies  
 
General Dynamics United Kingdom Limited
Bryn Brithdir, Oakdale Business Park, Blackwood, South Wales, NP12 4AA

Telephone: +44 (0) 1495 236467  
Email: nick.a...@generaldynamics.uk.com
Website:
www.generaldynamics.uk.com      

Please consider the environment before printing this email

 

 


This email and any files attached are intended for the addressee and may contain information of a confidential nature. If you are not the intended recipient, be aware that this email was sent to you in error and you should not disclose, distribute, print, copy or make other use of this email or its attachments. Such actions, in fact, may be unlawful. In compliance with the various Regulations and Acts, General Dynamics United Kingdom Limited reserves the right to monitor (and examine for viruses) all emails and email attachments, both inbound and outbound. Email communications and their attachments may not be secure or error- or virus-free and the company does not accept liability or responsibility for such matters or the consequences thereof. General Dynamics United Kingdom Limited, Registered Office: 21 Holborn Viaduct, London EC1A 2DY. Registered in England and Wales No: 1911653.

Signature.bmp

Alexey Verkhovsky

unread,
Apr 15, 2011, 12:32:47 PM4/15/11
to cruisecont...@rubyforge.org
Does builder log say anything about the cause of death?

_______________________________________________
Cruisecontrolrb-users mailing list
Cruisecont...@rubyforge.org
http://rubyforge.org/mailman/listinfo/cruisecontrolrb-users




--
Alexey Verkhovsky
http://alex-verkhovsky.blogspot.com/
CruiseControl.rb [http://cruisecontrolrb.thoughtworks.com]

Signature.bmp

Nick.A...@generaldynamics.uk.com

unread,
Apr 18, 2011, 4:53:53 AM4/18/11
to cruisecont...@rubyforge.org
Hi Alexey.

Nothing useful as far as I can tell.
On Friday before I left work I restarted the project builder, with in 2
hours it had gone down again. Here's the log.
Sorry, its only at info, I'll restart CCRB with trace logging in a
minute to see if that gives us any more info.

[info] [2011-04-15 16:42:58] Builder for project 'ATIS-Vsap' started
[info] [2011-04-15 16:43:01] New revision 4323 detected
[info] [2011-04-15 16:43:15] Build 4323 started
[info] [2011-04-15 17:11:46] Build 4323 finished SUCCESSFULLY
Sent mail:
Date: Fri, 15 Apr 2011 17:11:46 +0100 From:
nor...@generaldynamics.uk.com To: nick.a...@generaldynamics.uk.com
Subject: [CruiseControl] ATIS-Vsap build 4323 fixed Mime-Version: 1.0
Content-Type: text/plain; charset=utf-8 The build has been fixed.

CHANGES
-------
New revision 4323 detected
Revision 4323 committed by pwhite on 2011-04-15 14:33:58
***** content of email removed as there's nothing useful. *****

[info] [2011-04-15 17:12:46] Builder for project 'ATIS-Vsap' exited

That's it folks!
I looked in the production log and there was nothing useful.

Will forward on the trace logs when it happens again.

Nick Adamson
Software Engineer

General Dynamics United Kingdom Limited
Bryn Brithdir, Oakdale Business Park, Blackwood, South Wales, NP12 4AA
Telephone: +44 (0)1495 23 6467

Email: Nick.A...@generaldynamics.uk.com
Website: www.generaldynamics.uk.com
To help reduce waste paper, please only print this email if you really
need to.

General Dynamics United Kingdom
Limited<http://gdonline/new/Communications/img/Signature/Signature.bmp>

Bryn Brithdir, Oakdale Business Park, Blackwood, South Wales,
NP12 4AA

Telephone: +44 (0) 1495 236467
Email: nick.a...@generaldynamics.uk.com

<mailto:nick.a...@generaldynamics.uk.com>
Website: www.generaldynamics.uk.com
<http://www.generaldynamics.uk.com/>

Nick.A...@generaldynamics.uk.com

unread,
Apr 21, 2011, 11:02:23 AM4/21/11
to cruisecont...@rubyforge.org
Hi All.

Interestingly enough regarding the below issue.
When the servers running at trace all the builders stay up. I've not had
any die on me since I switched it to trace on Monday.

Thanks.
Nick.


Nick Adamson
Software Engineer

General Dynamics United Kingdom Limited
Bryn Brithdir, Oakdale Business Park, Blackwood, South Wales, NP12 4AA

Telephone: +44 (0)1495 23 6467
Email: Nick.A...@generaldynamics.uk.com
Website: www.generaldynamics.uk.com
To help reduce waste paper, please only print this email if you really
need to.


-----Original Message-----
From: cruisecontrolr...@rubyforge.org
[mailto:cruisecontrolr...@rubyforge.org] On Behalf Of Alexey
Verkhovsky
Sent: 15 April 2011 17:33
To: cruisecont...@rubyforge.org
Subject: Re: [Cruisecontrolrb-users] multiple builders,why do they keep
stopping.

General Dynamics United Kingdom
Limited<http://gdonline/new/Communications/img/Signature/Signature.bmp>

Bryn Brithdir, Oakdale Business Park, Blackwood, South Wales,
NP12 4AA

Telephone: +44 (0) 1495 236467
Email: nick.a...@generaldynamics.uk.com

Nick.A...@generaldynamics.uk.com

unread,
May 3, 2011, 8:25:59 AM5/3/11
to cruisecont...@rubyforge.org
Hi All.

2 of the 3 builders have gone down again.
I'm logging at trace however there is nothing useful.
On both builders that died a build completes and the following 2 lines
are seen:
[debug] [2011-04-27 16:23:48] Sleeping
[info] [2011-04-27 16:23:48] Builder for project 'ATIS-Vsap' exited

Any further ideas?

Thanks.
Nick.


Nick Adamson
Software Engineer

General Dynamics United Kingdom Limited
Bryn Brithdir, Oakdale Business Park, Blackwood, South Wales, NP12 4AA

Telephone: +44 (0)1495 23 6467
Email: Nick.A...@generaldynamics.uk.com
Website: www.generaldynamics.uk.com
To help reduce waste paper, please only print this email if you really
need to.


-----Original Message-----
From: cruisecontrolr...@rubyforge.org
[mailto:cruisecontrolr...@rubyforge.org] On Behalf Of Alexey
Verkhovsky
Sent: 15 April 2011 17:33
To: cruisecont...@rubyforge.org
Subject: Re: [Cruisecontrolrb-users] multiple builders,why do they keep
stopping.

General Dynamics United Kingdom
Limited<http://gdonline/new/Communications/img/Signature/Signature.bmp>

Bryn Brithdir, Oakdale Business Park, Blackwood, South Wales,
NP12 4AA

Telephone: +44 (0) 1495 236467
Email: nick.a...@generaldynamics.uk.com

Nick.A...@generaldynamics.uk.com

unread,
May 11, 2011, 3:40:57 AM5/11/11
to Nick.A...@generaldynamics.uk.com, cruisecont...@rubyforge.org
Hi All.

Sorry to post again but the issues described below are still happening,
if anything the builders seam to stop more often.

Does anyone have any ideas?

Thanks.
Nick.


Nick Adamson
Software Engineer

General Dynamics United Kingdom Limited
Bryn Brithdir, Oakdale Business Park, Blackwood, South Wales, NP12 4AA

Telephone: +44 (0)1495 23 6467
Email: Nick.A...@generaldynamics.uk.com
Website: www.generaldynamics.uk.com
To help reduce waste paper, please only print this email if you really
need to.


-----Original Message-----
From: Nick Adamson
Sent: 03 May 2011 13:26
To: 'cruisecont...@rubyforge.org'
Subject: RE: [Cruisecontrolrb-users] multiple builders,why do they keep
stopping.

Hi All.

2 of the 3 builders have gone down again.
I'm logging at trace however there is nothing useful.
On both builders that died a build completes and the following 2 lines
are seen:
[debug] [2011-04-27 16:23:48] Sleeping
[info] [2011-04-27 16:23:48] Builder for project 'ATIS-Vsap' exited

Any further ideas?

Thanks.
Nick.


Nick Adamson
Software Engineer

General Dynamics United Kingdom Limited
Bryn Brithdir, Oakdale Business Park, Blackwood, South Wales, NP12 4AA

Telephone: +44 (0)1495 23 6467
Email: Nick.A...@generaldynamics.uk.com
Website: www.generaldynamics.uk.com
To help reduce waste paper, please only print this email if you really
need to.


-----Original Message-----
From: cruisecontrolr...@rubyforge.org
[mailto:cruisecontrolr...@rubyforge.org] On Behalf Of Alexey
Verkhovsky
Sent: 15 April 2011 17:33
To: cruisecont...@rubyforge.org
Subject: Re: [Cruisecontrolrb-users] multiple builders,why do they keep
stopping.

General Dynamics United Kingdom
Limited<http://gdonline/new/Communications/img/Signature/Signature.bmp>

Bryn Brithdir, Oakdale Business Park, Blackwood, South Wales,
NP12 4AA

Telephone: +44 (0) 1495 236467
Email: nick.a...@generaldynamics.uk.com

Reply all
Reply to author
Forward
0 new messages