Difference between Baseline testing and benchmark testing?

[pedda swamy]

Hi,

colud any one please explain what is the Difference between Baseline testing and benchmark testing?

Regards,
Pedda

[cbrzana]

Baselining is the process of running a set of tests to capture
performance information so that you have a point of reference when
future changes are made to the application/infrastructure. An example
would be you run baseline test of an application, collect and analyze
results, and then modify several indexes on a SQL Server database and
run the same test again, using the previous results to determine
whether or not the new results were better, worse, or about the same.

Benchmarking is the process of comparing your system performance
against an industry standard that is endorsed by some other
organization.

[Deepak Gupta]

Can you please clarify one doubt,

Is it okay for a baseline test running for >1 user or the baseline test necessarily have to be for 1user load only?

 

rdgs,

Deepak

[hiranmaya]

Initial baseline test is done with normal user loads of the system. So
the user load should be the load expected on the production system.
Whenever there is a code change, configuration change, database
optimization, etc, the performance test should be run again with the
same scenario and same number of vusers and the performance counters
should be compared with the baseline test results to check performance
degradation / improvement.

However, if any new transactions are to be added to the scenario or
expected user load is increased, a new baseline test should be
performed and the future tests should be compared against this test.

Regards,
Hiranmaya.

On Jan 23, 11:19 am, Deepak Gupta <deepakc...@gmail.com> wrote:
> Can you please clarify one doubt,
> Is it okay for a baseline test running for >1 user or the baseline test
> necessarily have to be for 1user load only?
>
> rdgs,
> Deepak
>

[Deepak Gupta]

Thanks for clarification Hiranmaya,

please let me know if this can be concluded from the above discussion-

that - Baseline test can be a pre-requisite for performance test.

 

regards,

Deepak Gupta

[Roland Jefferson JR]

Deepak,
I would suggest you baseline the system with 5 users for each of your
scripts at a minimum, to know that this is the best present
performance ata baseline or minimal load volume with the current build
and configuration.

Hope this helps,

Roland