Received: by 10.142.135.15 with SMTP id i15mr926050wfd.31.1298920503814;
        Mon, 28 Feb 2011 11:15:03 -0800 (PST)
X-BeenThere: silverstripe-dev@googlegroups.com
Received: by 10.142.97.18 with SMTP id u18ls3878260wfb.2.p; Mon, 28 Feb 2011
 11:15:02 -0800 (PST)
MIME-Version: 1.0
Received: by 10.142.50.7 with SMTP id x7mr465943wfx.39.1298920502556; Mon, 28
 Feb 2011 11:15:02 -0800 (PST)
Received: by v11g2000prb.googlegroups.com with HTTP; Mon, 28 Feb 2011 11:15:02
 -0800 (PST)
Date: Mon, 28 Feb 2011 11:15:02 -0800 (PST)
In-Reply-To: <a460b5c6-cc6c-45e3-8939-f08f4e7f476b@z31g2000vbs.googlegroups.com>
X-IP: 27.252.22.152
References: <F9BAA08F-9147-4AC1-89F4-31B36BCEE7FB@silverstripe.com>
 <ca7369cb-3527-49a2-8afa-3f07b7b0bc5d@m7g2000vbq.googlegroups.com>
 <F1B0D288-B29A-4796-9CD6-E0297E81501F@silverstripe.com> <a460b5c6-cc6c-45e3-8939-f08f4e7f476b@z31g2000vbs.googlegroups.com>
User-Agent: G2/1.0
X-HTTP-UserAgent: Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US)
 AppleWebKit/534.13 (KHTML, like Gecko) Chrome/9.0.597.98 Safari/534.13,gzip(gfe)
Message-ID: <ddd1b0a1-e8d7-4913-be21-a97fc52f5ed3@v11g2000prb.googlegroups.com>
Subject: Re: SS3: Anybody keen to compare framework performance?
From: Hamish Campbell <hn.campb...@gmail.com>
To: SilverStripe Core Development <silverstripe-dev@googlegroups.com>
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

On Mar 1, 4:31=A0am, xeraa <p.xe...@gmail.com> wrote:
> 1) I'd question the use of the published benchmark results. <<The
> "Product" Application>> test for <<real world>> applications was done
> with:
> # No page/template cache
> # No database access
> # No session
> # No output escaping
> That doesn't sound like my world...

I was thinking that as well. It looks like a routing and control test
more than anything related to real world bottlenecks. The criteria
appear to most of the important areas for potential optimization that
a framework can apply. I mean, who cares if frame X has half the no-
template build time vs. Y if Y is 10x faster with the template cache.
Y will win every time in a real world installation.

And no database access?

I think it would be more useful to set some benchmarks against:

1. Common database operation IO times
2. Template cache execution
3. Controller routing
4. Template build times
...

A benchmarking module would be a useful addition, although I don't
know if Dawn already provides some of this functionality.

>
> 2) I was thinking about doing something similar after finishing my
> current "project", however I'd focus on SilverStripe only. I'd think a
> fair comparison is hardly possible, both because of personal favorites
> and because very few people will know half a dozen frameworks / CMS
> equally well.
> My approach would rather be, how much speed can SilverStripe offer -
> based on different use cases (10 pages vs 1000,...) and technologies
> (does it make a difference to use PostgreSQL rather than MySQL,...).
> But more on that hopefully in a month or so...
>
> On 27 Feb., 20:49, Ingo Schommer <i...@silverstripe.com> wrote:
>
>
>
>
>
>
>
> > Mirko: Awesome, let us know if you need any help with
> > implementing the specific app examples in SilverStripe.
>
> > Hamish: As with any benchmark, you have to take it with a grain of salt=
.
> > If you read through the links provided, they're going through great
> > lengths to make the tests objective and reproducible.
> > SilverStripe 2.4 vs. 3.0 is a different kettle of fish, but worth testi=
ng as well.
>
> > On 28/02/2011, at 12:11 AM, Mirko Sassetti wrote:
>
> > > I can do that, if you give me some days.
> > > ok?
>
> > > Mirko.
>
> > > On 24 Feb, 22:18, Ingo Schommer <i...@silverstripe.com> wrote:
> > >> I've just discovered a github project to compare PHP frameworks:http=
s://github.com/fabpot/framework-benchs
> > >> Created by Fabien Potencier, core dev for Symfony 2:http://symfony-r=
eloaded.org/fast
>
> > >> I don't expect us to come out too well in this comparison,
> > >> but it'll help us focus our performance efforts for SilverStripe 3.
>
> > >> Anybody keen to extend this with a SilverStripe example,
> > >> book an EC2 instance for a couple of hours, run the tests, and publi=
sh the results?
>
> > >> Ingo
>
> > >> ---
> > >> Ingo Schommer | Senior Developer
> > >> SilverStripehttp://silverstripe.com
> > >> i...@silverstripe.com
>
> > >> Phone: +64 4 978 7330 x 42
> > >> Skype: chillu23
>
> > > --
> > > You received this message because you are subscribed to the Google Gr=
oups "SilverStripe Core Development" group.
> > > To post to this group, send email to silverstripe-...@googlegroups.co=
m.
> > > To unsubscribe from this group, send email to silverstripe-dev+unsubs=
cribe@googlegroups.com.
> > > For more options, visit this group athttp://groups.google.com/group/s=
ilverstripe-dev?hl=3Den.
>
> > ---
> > Ingo Schommer | Senior Developer
> > SilverStripehttp://silverstripe.com
> > i...@silverstripe.com
>
> > Phone: +64 4 978 7330 x 42