video chat load testing

[Lordb_]

Hi all,

Do any one have experience on video chat application performance
testing using loadrunner or any other tool.

i searched on net also and i found very rare information. it will be
helpful if someone provide some links or experience on it.

Gaurav!

[Mark Tomlinson]

Back with simple RTSP or MMS we used to be able to stop & start a stream of video - but that was broadcasting streams, not exactly interactive video chat.

What I can tell you is that most video streaming is governed by network throughput mechanisms like QoS - so you can reliably take a single-user footprint of network utilization and arithmetically calculate the maximum streams on the network.

The server side of the equation is a bit different - depending on the heap/memory required to proxy the live chatting sessions.  This requires multiple users to test properly.  But I must admit - the video content doesn't need to be unique.  Just take a measurement of the resource utilization with 1 session (2 clients) and then 2 sessions, 4 sessions...up to 10 - and take an arithmetic calculation of the estimated maximum sessions.

Other techniques would be to drive with a GUI Virtual User or QuickTest Professional.

-mt

--
You received this message because you are subscribed to the Google "LoadRunner" group.
To post to this group, send email to LR-Loa...@googlegroups.com
To unsubscribe from this group, send email to
LR-LoadRunne...@googlegroups.com
For more options, visit this group at
http://groups.google.com/group/LR-LoadRunner?hl=en

--

Mark Tomlinson | Performance Engineering Consultant | +1.775.773.8780 | ma...@careytomlinson.org  | mtomlins.blogspot.com | @mtomlins

[Gaurav Mishra]

thanks MT for ur input.

let me dig up a bit and i will surly use input provided by you in my project.

recently i saw a tool named wowza which is majorly recommonded for this purpose,but still i am inclined to do it using Loadrunner.

LR also have real media and windows media streaming related protocols. i dnt have there licence so dnt know aout there effects.

[Gaurav Mishra]

High Level Ideas

This is just a laundry list of items.

Features

• Reactive Video Chat
  • 1 way video (customer sees agent, agent does not see customer)
    • with 2 way text and 2 way audio
  • 2 way video
    • with 2 way text and 2 way audio
• Speech to text conversion for transcripts
• Embedding video and audio links in transcripts
• Escalation from chatbot to video chat
• Escalation from WSS to video chat
• Ability to switch from text chat to audio chat / video chat
  • Customer or agent should be able to make the switch
• Proactive Video Chat
  • Offer type to include Video Chat
• Video Chat with Multibrowse
• Access to Knowledge Base from the customer console during Video Chat
• Ability to store the audio and video content
• Assignment of Video Chats similar to the assignment of Text Chats
• Devices support for audio and video (customer and agent)
• Computer
• Mobile

Technology

 

• Current V10 chat infrastructure (XMPP) with some extensions
• Explore partnership with third party vendors
• Leverage popular audio / video clients already present on desktops / devices
  • Flash, Skype, Facebook, Google Chat, Yahoo Messenger, Vivox, etc.
• Explore HTML 5 video and H.264 streaming

 

 

I hope this information may help to guide me in right direction ???

[James Pulley]

Diagram the flows.   You  very likely have a direct peer to peer situation on the streaming which turns into more of a network test.    On the account side you likely have a central server for account registration and setup which is completely out of the picture when the streaming starts.   So then your challenge is to represent the peer to peer streaming after the account setup and registration actions take place.

 

Become very competent with a protocol analyzer and the visual studio DLL-built virtual users.   You will need a path to include protocols which LoadRunner does not normally include.

 

‘Pulley

 

From: lr-loa...@googlegroups.com [mailto:lr-loa...@googlegroups.com] On Behalf Of Gaurav Mishra
Sent: Monday, May 07, 2012 6:55 AM
To: lr-loa...@googlegroups.com
Subject: Re: video chat load testing

 

High Level Ideas

This is just a laundry list of items.

Features

• Reactive Video Chat

• 1 way video (customer sees agent, agent does not see customer)

• with 2 way text and 2 way audio

• 2 way video

• with 2 way text and 2 way audio

·         Speech to text conversion for transcripts

·         Embedding video and audio links in transcripts

·         Escalation from chatbot to video chat

·         Escalation from WSS to video chat

·         Ability to switch from text chat to audio chat / video chat

o    Customer or agent should be able to make the switch

·         Proactive Video Chat

o    Offer type to include Video Chat

·         Video Chat with Multibrowse

·         Access to Knowledge Base from the customer console during Video Chat

·         Ability to store the audio and video content

·         Assignment of Video Chats similar to the assignment of Text Chats

·         Devices support for audio and video (customer and agent)

o    Computer

o    Mobile

Technology

 

• Current V10 chat infrastructure (XMPP) with some extensions
• Explore partnership with third party vendors
• Leverage popular audio / video clients already present on desktops / devices

• Flash, Skype, Facebook, Google Chat, Yahoo Messenger, Vivox, etc.

• Explore HTML 5 video and H.264 streaming

 

 

I hope this information may help to guide me in right direction ???

--

[Gaurav Mishra]

James,

 

I found out about wowza load testing tool, and after studying this i came on a conclusion to use a combination of LR and wowza.

 

what if I sumalate registration and all through LR and parallel simalate media server using wowza. I think it can help to atlest semulate real time load.

 

any comments ???

[Gaurav Mishra]

I have a good news and bad news ..........

 

good news is that i have manage to simulate streaming part. bad news it the rest of the part means peer to peer text chat application.

 

in a chat application, there are two said, let say chater 1 and chater 2.

 

both have there own login information saperatly.

 

both should be online at the same time.

 

ch1 will ping and after that ch2 will ping accordingly.

 

if i made 2 scripts for ch1 and ch2 sapratly then their dependency can me managed by VTS server only, i guess.

 

other way is to make 1 script for both of them ............ not likly looking fessible.

 

comments pls!

 

Gaurav!

[Vivek]

Are you ultimately looking to simulate the streaming part at server level and measure it's performance?. If so I think you'd be better off with one of those in-house benchmark tools that comes with buying an enterprise media server, similar to Flash RTMP that ships with wowza which can help simulate thousands of  video streaming flash player connections in a single server and benchmark it's performance.

On the other hand you're looking at a protocol analyzer (something which works more than http level traffic) to capture the session traffic triggered from a chat client. At the end you'll have a consistent pattern/template of the recorded traffic established between the client and server for over a period of time. This could be of high help for you to construct and simulate a similar chat session from the client level.

--

[Gaurav Mishra]

Thanks vivek,

 

That was a real help. adding few point to it .......

 

in chat server is having a two way connection to two diff user at the same time. if we are using LR for this purpose then there would be two diff script which have dependecy to each other.

 

so one have to use some server to manage it. options are VTS, STAF, or use MYSQL.

 

when one of user send msg table will update when table will update then only 2nd user will through msg. till now this is what i thought. still in implementation of it.

 

any advise will be a grt appriciation and most most welcome.

 

Gaurav!