Account Options

  1. Sign in
The old Google Groups will be going away soon, but your browser is incompatible with the new version.
Google Groups Home
« Groups Home
Message from discussion Unit Profiling?

Received: by 10.150.191.10 with SMTP id o10mr3404126ybf.9.1244248146260;
        Fri, 05 Jun 2009 17:29:06 -0700 (PDT)
Return-Path: <marc.es...@gmail.com>
Received: from mail-gx0-f229.google.com (mail-gx0-f229.google.com [209.85.217.229])
        by gmr-mx.google.com with ESMTP id 16si143287gxk.1.2009.06.05.17.29.06;
        Fri, 05 Jun 2009 17:29:06 -0700 (PDT)
Received-SPF: pass (google.com: domain of marc.es...@gmail.com designates 209.85.217.229 as permitted sender) client-ip=209.85.217.229;
Authentication-Results: gmr-mx.google.com; spf=pass (google.com: domain of marc.es...@gmail.com designates 209.85.217.229 as permitted sender) smtp.mail=marc.es...@gmail.com
Received: by gxk13 with SMTP id 13so4018687gxk.11
        for <mxunit@googlegroups.com>; Fri, 05 Jun 2009 17:29:06 -0700 (PDT)
Mime-Version: 1.0
Content-Type: multipart/alternative;
	boundary="0016361e7d94c31d73046ba3185f"
In-Reply-To: <afe663af0906051534h3deb2948o43ad81adb37aa3ef@mail.gmail.com>
Received: by 10.90.92.16 with SMTP id p16mr3649322agb.7.1244248146120; Fri, 05 
	Jun 2009 17:29:06 -0700 (PDT)
Message-ID: <0016361e7d94c31d84046ba31862@google.com>
Date: Sat, 06 Jun 2009 00:29:06 +0000
Subject: Re: Re: [mxunit:1294] Re: Unit Profiling?
From: marc.es...@gmail.com
To: mxunit@googlegroups.com

--0016361e7d94c31d73046ba3185f
Content-Type: text/plain; charset=ISO-8859-1

Hey Randy,

I updated the blog post here  
http://blog.mxunit.org/2009/06/continuous-integration-with-hudson-cf.html  
to show what the time trend graph looks like. I suspect that once you get  
it set up and running steady, the graph will even out and then be more  
meaningful as a tool because if things are going wrong, it'll creep up.

marc

On Jun 5, 2009 6:34pm, Marc Esher <marc.es...@gmail.com> wrote:
> here's my quickie answer on hudson then i gotta split for a while:

> hudson has extremely low overhead. You could literally install tomcat

> on a box, drop hudson into it, schedule tests, and the only blip you'd

> get would be whenever it ran your tests. I have it running on my

> laptop all the time and I never notice it. At work, I'm about to

> install it on one of our old "we're gonna pitch this box if noone

> wants to use it" machines and I'm fully confident that it'll be fine.



> in my case -- and it sounds like yours -- it's definitely not this

> monolithic monster thing that's fetching sources from a thousand

> different subversion repositories around the globe, compiling for an

> hour, and running millions of tests. Rather, it's just an app that's

> gonna make http calls to your tests and record the results. You could

> probably run it on your desktop, and firefox will take up more memory

> than hudson would most of the time.



> Definitely don't be afraid of it in terms of server-hoggishness. It's no  
> pig.



> On Fri, Jun 5, 2009 at 6:20 PM, RandyZoram...@gmail.com> wrote:

> >

> > Very good questions and points.

> >

> > To start, I'll describe the position that I am in. Right now I am

> > starting work on a new project and trying to start off on the right

> > foot and get all the automation and build processes setup from the get-

> > go. As far as a team goes, I am working with a few people on the

> > project but most of the time it will be me doing most of the

> > programming. I would really like to have a CI server setup, atm I

> > don't know if that is going to be financially feasible to have running

> > all the time, can you setup hudson locally or be setup on an EC2

> > instance and just started and stopped when I want to use it? I don't

> > know how well hudson would do with being started and stopped.

> >

> > I would be interested in the general unit testing times to look for

> > trends, but for some of the core code it would be nice to see it when

> > functions are run thousands of times, but I don't really know if that

> > would be worth the effort, or if I should just rely on the overall

> > tests.

> >

> > So, really I would like to have a CI server for when things get

> > larger, then it will just be part of the process, and not have to be

> > rigged later on to a larger project.

> >

> > Randy

> >

> > On Jun 5, 4:50 pm, Marc Esher marc.es...@gmail.com> wrote:

> >> Randy,

> >> Do you want to see the global view of trending for all your tests

> >> over time? you can easily get that from the main hudson screen. Though

> >> I see now that I didn't put any screenshots up about that. I have a

> >> post in the works -- probably the one i should've started with -- on

> >> "why the hell would you even need this stuff?", which will cover my

> >> own motivation for investigating hudson, and in fact it started with

> >> time trending!

> >>

> >> but i'm not so much concerned about 'does test 1 take longer today

> >> than it took yesterday'. I'm concerned about "are all my tests

> >> progressively taking longer to run", which would indicate some

> >> problem. then i could presumably drill down into the tests to get at

> >> that information. yes, you get the total time tests take when you dig

> >> into the test results.

> >>

> >> i'm not sure what other stuff is out there yet for getting

> >> more/better/easier-to-read information with respect to time trending

> >> in Hudson, but I'll definitely be digging into that b/c it's important

> >> to me. I do know that continuous integration servers generally have a

> >> mechanism for causing builds to fail when build times spike, but i

> >> haven't implemented that in hudson yet so I don't know how it's done.

> >>

> >> I'm curious: are you working alone, or on a team? I think for me,

> >> this would influence whether I went down the CI route or whether I

> >> just rolled my own test result app.

> >>

> >> marc

> > 
> >

> >


--0016361e7d94c31d73046ba3185f
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

Hey Randy,<br /><br />I updated the blog post here http://blog.mxunit.org/2=
009/06/continuous-integration-with-hudson-cf.html to show what the time tre=
nd graph looks like. I suspect that once you get it set up and running stea=
dy, the graph will even out and then be more meaningful as a tool because i=
f things are going wrong, it&#39;ll creep up.<br /><br />marc<br /><br />On=
 Jun 5, 2009 6:34pm, Marc Esher &lt;marc.es...@gmail.com&gt; wrote:<br />&g=
t; here&#39;s my quickie answer on hudson then i gotta split for a while:<b=
r />&gt; <br />&gt; hudson has extremely low overhead. You could literally =
install tomcat<br />&gt; <br />&gt; on a box, drop hudson into it, schedule=
 tests, and the only blip you&#39;d<br />&gt; <br />&gt; get would be whene=
ver it ran your =A0tests. I have it running on my<br />&gt; <br />&gt; lapt=
op all the time and I never notice it. =A0At work, I&#39;m about to<br />&g=
t; <br />&gt; install it on one of our old &quot;we&#39;re gonna pitch this=
 box if noone<br />&gt; <br />&gt; wants to use it&quot; machines and I&#39=
;m fully confident that it&#39;ll be fine.<br />&gt; <br />&gt; <br />&gt; =
<br />&gt; in my case -- and it sounds like yours -- it&#39;s definitely no=
t this<br />&gt; <br />&gt; monolithic monster thing that&#39;s fetching so=
urces from a thousand<br />&gt; <br />&gt; different subversion repositorie=
s around the globe, compiling for an<br />&gt; <br />&gt; hour, and running=
 millions of tests. Rather, it&#39;s just an app that&#39;s<br />&gt; <br /=
>&gt; gonna make http calls to your tests and record the results. =A0You co=
uld<br />&gt; <br />&gt; probably run it on your desktop, and firefox will =
take up more memory<br />&gt; <br />&gt; than hudson would most of the time=
.<br />&gt; <br />&gt; <br />&gt; <br />&gt; Definitely don&#39;t be afraid=
 of it in terms of server-hoggishness. It&#39;s no pig.<br />&gt; <br />&gt=
; <br />&gt; <br />&gt; On Fri, Jun 5, 2009 at 6:20 PM, RandyZoramite@gmail=
.com&gt; wrote:<br />&gt; <br />&gt; &gt;<br />&gt; <br />&gt; &gt; Very go=
od questions and points.<br />&gt; <br />&gt; &gt;<br />&gt; <br />&gt; &gt=
; To start, I&#39;ll describe the position that I am in. Right now I am<br =
/>&gt; <br />&gt; &gt; starting work on a new project and trying to start o=
ff on the right<br />&gt; <br />&gt; &gt; foot and get all the automation a=
nd build processes setup from the get-<br />&gt; <br />&gt; &gt; go. As far=
 as a team goes, I am working with a few people on the<br />&gt; <br />&gt;=
 &gt; project but most of the time it will be me doing most of the<br />&gt=
; <br />&gt; &gt; programming. I would really like to have a CI server setu=
p, atm I<br />&gt; <br />&gt; &gt; don&#39;t know if that is going to be fi=
nancially feasible to have running<br />&gt; <br />&gt; &gt; all the time, =
can you setup hudson locally or be setup on an EC2<br />&gt; <br />&gt; &gt=
; instance and just started and stopped when I want to use it? I don&#39;t<=
br />&gt; <br />&gt; &gt; know how well hudson would do with being started =
and stopped.<br />&gt; <br />&gt; &gt;<br />&gt; <br />&gt; &gt; I would be=
 interested in the general unit testing times to look for<br />&gt; <br />&=
gt; &gt; trends, but for some of the core code it would be nice to see it w=
hen<br />&gt; <br />&gt; &gt; functions are run thousands of times, but I d=
on&#39;t really know if that<br />&gt; <br />&gt; &gt; would be worth the e=
ffort, or if I should just rely on the overall<br />&gt; <br />&gt; &gt; te=
sts.<br />&gt; <br />&gt; &gt;<br />&gt; <br />&gt; &gt; So, really I would=
 like to have a CI server for when things get<br />&gt; <br />&gt; &gt; lar=
ger, then it will just be part of the process, and not have to be<br />&gt;=
 <br />&gt; &gt; rigged later on to a larger project.<br />&gt; <br />&gt; =
&gt;<br />&gt; <br />&gt; &gt; Randy<br />&gt; <br />&gt; &gt;<br />&gt; <b=
r />&gt; &gt; On Jun 5, 4:50=A0pm, Marc Esher marc.es...@gmail.com&gt; wrot=
e:<br />&gt; <br />&gt; &gt;&gt; Randy,<br />&gt; <br />&gt; &gt;&gt; =A0 D=
o you want to see the global view of trending for all your tests<br />&gt; =
<br />&gt; &gt;&gt; over time? you can easily get that from the main hudson=
 screen. Though<br />&gt; <br />&gt; &gt;&gt; I see now that I didn&#39;t p=
ut any screenshots up about that. I have a<br />&gt; <br />&gt; &gt;&gt; po=
st in the works -- probably the one i should&#39;ve started with -- on<br /=
>&gt; <br />&gt; &gt;&gt; &quot;why the hell would you even need this stuff=
?&quot;, which will cover my<br />&gt; <br />&gt; &gt;&gt; own motivation f=
or investigating hudson, and in fact it started with<br />&gt; <br />&gt; &=
gt;&gt; time trending!<br />&gt; <br />&gt; &gt;&gt;<br />&gt; <br />&gt; &=
gt;&gt; =A0 but i&#39;m not so much concerned about &#39;does test 1 take l=
onger today<br />&gt; <br />&gt; &gt;&gt; than it took yesterday&#39;. I&#3=
9;m concerned about &quot;are all my tests<br />&gt; <br />&gt; &gt;&gt; pr=
ogressively taking longer to run&quot;, which would indicate some<br />&gt;=
 <br />&gt; &gt;&gt; problem. then i could presumably drill down into the t=
ests to get at<br />&gt; <br />&gt; &gt;&gt; that information. yes, you get=
 the total time tests take when you dig<br />&gt; <br />&gt; &gt;&gt; into =
the test results.<br />&gt; <br />&gt; &gt;&gt;<br />&gt; <br />&gt; &gt;&g=
t; =A0 i&#39;m not sure what other stuff is out there yet for getting<br />=
&gt; <br />&gt; &gt;&gt; more/better/easier-to-read information with respec=
t to time trending<br />&gt; <br />&gt; &gt;&gt; in Hudson, but I&#39;ll de=
finitely be digging into that b/c it&#39;s important<br />&gt; <br />&gt; &=
gt;&gt; to me. I do know that continuous integration servers generally have=
 a<br />&gt; <br />&gt; &gt;&gt; mechanism for causing builds to fail when =
build times spike, but i<br />&gt; <br />&gt; &gt;&gt; haven&#39;t implemen=
ted that in hudson yet so I don&#39;t know how it&#39;s done.<br />&gt; <br=
 />&gt; &gt;&gt;<br />&gt; <br />&gt; &gt;&gt; I&#39;m curious: are you wor=
king alone, or on a team? =A0I think for me,<br />&gt; <br />&gt; &gt;&gt; =
this would influence whether I went down the CI route or whether I<br />&gt=
; <br />&gt; &gt;&gt; just rolled my own test result app.<br />&gt; <br />&=
gt; &gt;&gt;<br />&gt; <br />&gt; &gt;&gt; marc<br />&gt; <br />&gt; &gt; <=
br />&gt; <br />&gt; &gt;<br />&gt; <br />&gt; &gt;<br />&gt;
--0016361e7d94c31d73046ba3185f--