Performance Analysis report on Mobicents JAIN SLEE 1.2.1.GA*_12th Nov'08

14 views
Skip to first unread message

Sheik Badhusha

unread,
Nov 12, 2008, 12:24:39 AM11/12/08
to mobicents-public
Hi All,
I have tried load test on Mobicents Server using SIPp as a Load
generator. Mobicents responds for the generated load by the SIPp in
the following call rates [10calls/sec, 50calls/sec, and 100calls/sec],
but on analysis it was found that the average calls generated by the
SIPp is < 50% of call rate set to run the flow.

On Load generating measure, when SIPp is tuned to generate more than
80% calls per second the Mobicents average response was poor.

Summary on Report:
------------------------------
---------------------------------------------------------------------------------------------------------------------------------
Call Limit Calls/Sec Caller Callee Successfull
Calls
CallsCreated Calls Received
---------------------------------------------------------------------------------------------------------------------------------
Default 100 51307 51307 50990 - Caller
50891 - Callee

4000000 100 576498 105831 198 - Caller
30 - Callee
---------------------------------------------------------------------------------------------------------------------------------

Verify the reports, scripts used and let me know whether any update
need to be performed with the machine configuration or scripts to
achieve good performance.......

I have attached a file named "PerformanceAnalysis_Report12thNov08.zip"
under the following URL,

http://mobicents-public.googlegroups.com/web/PerformanceAnalysis_Report12thNov08.zip

While extracting this zip, it will have the following files,

1.Report [Report on MobicentsLoadTest.xls] - which comprises the
detailed report about the load test, performed with different call
rates.
2.Scenario Files [Scenario Files.zip] - which comprises of scenario
files used
i. Note: If you need to run the scripts, update the target
user IPs in the corresponding csv files
3.Logs [Logs.zip] - which comprises of final screen with call
statistics of UAC1&2 in the scenario where the performance issue
occurs


System Configuration used to deploy Mobicents
Processor: Pentium 4 - 2.40GHz
RAM: 1GB
HDD: 40GB
Virtual Memory: Set as “System managed size”
Operating System: Windows XP Prof. SP2
Package used: Mobicents JAIN SLEE 1.2.1.GA*

Load Test Scenario
1.UAC1 Sends INVITE
2.UAC2 Accepts the INVITE and Sends BYE
Here,
UAC1 - Caller
UAC2 – Callee


Regards,
Sheik Badhusha

Eduardo Martins

unread,
Nov 12, 2008, 4:18:03 AM11/12/08
to mobicent...@googlegroups.com
What JAIN SLEE application did you use? Also, did you changed log4j configuration to set all loggers with level WARN, which is essential for a good performance?

Sheik Badhusha

unread,
Nov 13, 2008, 2:27:10 AM11/13/08
to mobicents-public
Hi Martins,
I used the following versions for deploying the Mobicents Server,

Package used: Mobicents JAIN SLEE 1.2.1.GA*
JAIN SLEE Version: JAIN SLEE 1.2.1.GA
Example Used: call-controller2 and its dependent example, RAs
[Package downloaded URL:
http://sourceforge.net/project/showfiles.php?group_id=102670&package_id=287659&release_id=633066].

Coming about log4j configuration, I have tried with following,
1. Disabled Console logs and updating the other logger levels to
“WARN”
2. Disabled all loggers

Result:
I found slight variations in successful call rate, but there is no
huge difference between the call rates I specified in the previous
post.

Regards,
Sheik Badhusha


On Nov 12, 2:18 pm, "Eduardo Martins" <emmart...@gmail.com> wrote:
> What JAIN SLEE application did you use? Also, did you changed log4j
> configuration to set all loggers with level WARN, which is essential for a
> good performance?
>
> >http://mobicents-public.googlegroups.com/web/PerformanceAnalysis_Repo...

Bartosz Baranowski

unread,
Nov 13, 2008, 3:08:27 AM11/13/08
to mobicent...@googlegroups.com
Can we get Our hands on error files?
--
Bartosz Baranowski
JBoss R & D
==================================
Word of criticism meant to improve is always step forward.

Eduardo Martins

unread,
Nov 13, 2008, 4:27:38 AM11/13/08
to mobicent...@googlegroups.com
The call controller example, being just a functionality example, and mixing a lot of components, is not really optimized for performance, thus those numbers seems appropriate to me. If you want to try clean call setup numbers use the sip-loadtest-* (or sip11-loadtest-* for sip11 ra) examples.

Sheik Badhusha

unread,
Nov 13, 2008, 4:41:15 AM11/13/08
to mobicents-public
Hi Bartosz,

Here is have pasted the error messages copied from the SIPp error log
file captured on caller side,

Errors messages from the error log,
---------------------------------------------------
sipp: The following events occured:
2008-11-13 12:13:03:062 1226558583.062500: Aborting call on unexpected
message for Call-Id '296-...@200.201.202.177': while expecting
'100' (index 1), received 'SIP/2.0 503 Service unavailable
Via: SIP/2.0/UDP 200.201.202.177:5062;branch=z9hG4bK-2708-296-0
From: <sip:sh...@nist.gov>;tag=296-INV-UAC
To: <sip:san...@nist.gov>
Call-ID: 296-...@200.201.202.177
CSeq: 1 INVITE
Server:
org.mobicents.slee.sip.ra.SipResourceAdapter_200.201.202.179_5060
Retry-After: 8
Content-Length: 0

'.
2008-11-13 12:13:05:046 1226558585.046500: Dead call
296-...@200.201.202.177 (aborted at index 1), received 'SIP/2.0 100
Trying
Via: SIP/2.0/UDP 200.201.202.177:5062;branch=z9hG4bK-2708-296-0
From: <sip:sh...@nist.gov>;tag=296-INV-UAC
To: <sip:san...@nist.gov>
Call-ID: 296-...@200.201.202.177
CSeq: 1 INVITE
Content-Length: 0

'.
2008-11-13 12:13:12:374 1226558592.374500: Aborting call on unexpected
message for Call-Id '987-...@200.201.202.177': while expecting
'180' (index 2), received 'SIP/2.0 503 Service unavailable
Via: SIP/2.0/UDP 200.201.202.177:5062;branch=z9hG4bK-2708-987-0
From: <sip:sh...@nist.gov>;tag=987-INV-UAC
To: <sip:san...@nist.gov>
Call-ID: 987-...@200.201.202.177
CSeq: 1 INVITE
Server:
org.mobicents.slee.sip.ra.SipResourceAdapter_200.201.202.179_5060
Retry-After: 7
Content-Length: 0

'.
2008-11-13 12:13:28:062 1226558608.062500: Aborting call on UDP
retransmission timeout for Call-ID '112-...@200.201.202.177'.

2008-11-13 12:13:31:249 1226558611.249500: Aborting call on unexpected
message for Call-Id '3064...@200.201.202.177': while expecting
'100' (index 1), received 'SIP/2.0 503 Service unavailable
Via: SIP/2.0/UDP 200.201.202.177:5062;branch=z9hG4bK-2708-3064-0
From: <sip:sh...@nist.gov>;tag=3064-INV-UAC
To: <sip:san...@nist.gov>
Call-ID: 3064...@200.201.202.177
CSeq: 1 INVITE
Server:
org.mobicents.slee.sip.ra.SipResourceAdapter_200.201.202.179_5060
Retry-After: 5
Content-Length: 0


Regards,
Sheik Badhusha

Sheik Badhusha

unread,
Nov 13, 2008, 5:14:13 AM11/13/08
to mobicents-public
Hi Martins,
I don’t find any binary named sip-loadtest-* (or) sip11-loadtest-*
under the examples folder that I have downloaded. Where will I get
those examples binaries?
Can you please help me to get those binaries, and I need to know how
it works?

Regards,
Sheik Badhusha


On Nov 13, 2:27 pm, "Eduardo Martins" <emmart...@gmail.com> wrote:
> The call controller example, being just a functionality example, and mixing
> a lot of components, is not really optimized for performance, thus those
> numbers seems appropriate to me. If you want to try clean call setup numbers
> use the sip-loadtest-* (or sip11-loadtest-* for sip11 ra) examples.
>
> On Thu, Nov 13, 2008 at 7:27 AM, Sheik Badhusha <sheikwo...@gmail.com>wrote:
>
>
>
> > Hi Martins,
> > I used the following versions for deploying the Mobicents Server,
>
> > Package used: Mobicents JAIN SLEE 1.2.1.GA*
> >                 JAIN SLEE Version:      JAIN SLEE 1.2.1.GA
> >                Example Used: call-controller2 and its dependent example,
> > RAs
> > [Package downloaded URL:
>
> >http://sourceforge.net/project/showfiles.php?group_id=102670&package_...

Eduardo Martins

unread,
Nov 13, 2008, 5:24:32 AM11/13/08
to mobicent...@googlegroups.com

Sheik Badhusha

unread,
Nov 13, 2008, 5:39:27 AM11/13/08
to mobicents-public
I have deployed Mobicents JAIN SLEE 1.2.1 GA* server from the
binaries. Can you give me the steps to build the required example
alone from the source?

On Nov 13, 3:24 pm, "Eduardo Martins" <emmart...@gmail.com> wrote:
> Here ->http://groups.google.com/group/mobicents-public/web/mobicents-load-te...

Bartosz Baranowski

unread,
Nov 13, 2008, 5:46:46 AM11/13/08
to mobicent...@googlegroups.com
This JSIP stack response. If we send error it contains message content exaplining error condition. It means its out of resources/memory and wasnt able to obtain transaction from it internal data structures or couldnt create one.

Eduardo Martins

unread,
Nov 13, 2008, 6:48:42 AM11/13/08
to mobicent...@googlegroups.com

Sheik Badhusha

unread,
Nov 13, 2008, 7:25:37 AM11/13/08
to mobicents-public
I have deployed Mobicents JAIN SLEE 1.2.1 GA* server from the binaries
not from the sources. Building from sources is a time consuming one.
Is there any possibility to get sip-loadtest-* (or) sip11-loadtest-*
jars, i will directly throw it in deploy directory. It will reduce my
task time


On Nov 13, 4:48 pm, "Eduardo Martins" <emmart...@gmail.com> wrote:
> http://groups.google.com/group/mobicents-public/web/quick-start-guide...

Eduardo Martins

unread,
Nov 13, 2008, 10:03:28 AM11/13/08
to mobicent...@googlegroups.com
There are no binaries built for those examples, all you have to do is install Maven 2.0.9+, checkout the directory of the example you want (svn checkout http://mobicents.googlecode.com/svn/tags/mobicents-jainslee-1.2.1.GA/examples/sip-loadtest-with-dialogs mobicents-jainslee-example-sip-loadtest-with-dialogs) and do mvn install -Djboss.home=path_to_jboss_4.2.2.GA_dir_of_mobicents

Sheik Badhusha

unread,
Nov 14, 2008, 4:16:31 AM11/14/08
to mobicents-public
Steps I have followed,
1. Made JBOSS up with SIP11 RA
2. Installed “apache-maven-2.0.9” and Set JBOSS_HOME environment
variable pointing to the Root folder of JBOSS
3. Checked out the directory of “sip11-loadtest-without-dialogs”
example from the following URL
http://mobicents.googlecode.com/svn/tags/mobicents-jainslee-server-1.2.1.GA/examples/sip11-loadtest-without-dialogs/
using the tool “TortoiseSVN”
4. Tried mvn install and got the following error
Error Message:

D:\Mobicents121\examples\Src\sip11-loadtest-without-dialogs>mvn
install -Djboss.home=d:\Mobicents121\jboss-4.2
.2.GA\
[INFO] Scanning for projects...
Downloading: http://repo1.maven.org/maven2/org/mobicents/mobicents-jainslee-server/1.2.1.GA/mobicents-jainslee
-server-1.2.1.GA.pom
[INFO]
------------------------------------------------------------------------
[ERROR] FATAL ERROR
[INFO]
------------------------------------------------------------------------
[INFO] Error building POM (may not be this project's POM).

Project ID: org.mobicents.examples:sip11-loadtest-without-dialogs-
parent:pom:null
Reason: Cannot find parent: org.mobicents:mobicents-jainslee-server
for project: org.mobicents.examples:sip11-
loadtest-without-dialogs-parent:pom:null for project
org.mobicents.examples:sip11-loadtest-without-dialogs-par
ent:pom:null

[INFO]
------------------------------------------------------------------------
[INFO] Trace
org.apache.maven.reactor.MavenExecutionException: Cannot find parent:
org.mobicents:mobicents-jainslee-server
for project: org.mobicents.examples:sip11-loadtest-without-dialogs-
parent:pom:null for project org.mobicents.e
xamples:sip11-loadtest-without-dialogs-parent:pom:null
at org.apache.maven.DefaultMaven.getProjects(DefaultMaven.java:
378)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:
292)
at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:
129)
at org.apache.maven.cli.MavenCli.main(MavenCli.java:287)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke
(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke
(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.codehaus.classworlds.Launcher.launchEnhanced
(Launcher.java:315)
at org.codehaus.classworlds.Launcher.launch(Launcher.java:255)
at org.codehaus.classworlds.Launcher.mainWithExitCode
(Launcher.java:430)
at org.codehaus.classworlds.Launcher.main(Launcher.java:375)
Caused by: org.apache.maven.project.ProjectBuildingException: Cannot
find parent: org.mobicents:mobicents-jain
slee-server for project: org.mobicents.examples:sip11-loadtest-without-
dialogs-parent:pom:null for project org
.mobicents.examples:sip11-loadtest-without-dialogs-parent:pom:null
at
org.apache.maven.project.DefaultMavenProjectBuilder.assembleLineage
(DefaultMavenProjectBuilder.java
:1370)
at
org.apache.maven.project.DefaultMavenProjectBuilder.buildInternal
(DefaultMavenProjectBuilder.java:8
21)
at
org.apache.maven.project.DefaultMavenProjectBuilder.buildFromSourceFileInternal
(DefaultMavenProject
Builder.java:506)
at org.apache.maven.project.DefaultMavenProjectBuilder.build
(DefaultMavenProjectBuilder.java:198)
at org.apache.maven.DefaultMaven.getProject(DefaultMaven.java:
583)
at org.apache.maven.DefaultMaven.collectProjects
(DefaultMaven.java:461)
at org.apache.maven.DefaultMaven.getProjects(DefaultMaven.java:
365)
... 11 more
Caused by: org.apache.maven.project.ProjectBuildingException: POM
'org.mobicents:mobicents-jainslee-server' no
t found in repository: Unable to download the artifact from any
repository
org.mobicents:mobicents-jainslee-server:pom:1.2.1.GA
from the specified remote repositories:
central (http://repo1.maven.org/maven2)
for project org.mobicents:mobicents-jainslee-server
at
org.apache.maven.project.DefaultMavenProjectBuilder.findModelFromRepository
(DefaultMavenProjectBuil
der.java:603)
at
org.apache.maven.project.DefaultMavenProjectBuilder.assembleLineage
(DefaultMavenProjectBuilder.java
:1366)
... 17 more
Caused by:
org.apache.maven.artifact.resolver.ArtifactNotFoundException: Unable
to download the artifact from
any repository
org.mobicents:mobicents-jainslee-server:pom:1.2.1.GA
from the specified remote repositories:
central (http://repo1.maven.org/maven2)
at
org.apache.maven.artifact.resolver.DefaultArtifactResolver.resolve
(DefaultArtifactResolver.java:212
)
at
org.apache.maven.artifact.resolver.DefaultArtifactResolver.resolve
(DefaultArtifactResolver.java:74)
at
org.apache.maven.project.DefaultMavenProjectBuilder.findModelFromRepository
(DefaultMavenProjectBuil
der.java:556)
... 18 more
Caused by: org.apache.maven.wagon.ResourceDoesNotExistException:
Unable to download the artifact from any repo
sitory
at
org.apache.maven.artifact.manager.DefaultWagonManager.getArtifact
(DefaultWagonManager.java:331)
at
org.apache.maven.artifact.resolver.DefaultArtifactResolver.resolve
(DefaultArtifactResolver.java:200
)
... 20 more
[INFO]
------------------------------------------------------------------------
[INFO] Total time: 1 second
[INFO] Finished at: Fri Nov 14 12:57:16 IST 2008
[INFO] Final Memory: 1M/4M
[INFO]
------------------------------------------------------------------------


Note:
JSLEE, SIP11 RAs are deployed using Binaries

Regards,
Sheik Badhusha

On Nov 13, 8:03 pm, "Eduardo Martins" <emmart...@gmail.com> wrote:
> There are no binaries built for those examples, all you have to do is
> install Maven 2.0.9+, checkout the directory of the example you want (svn
> checkout *http*://
Reply all
Reply to author
Forward
0 new messages