WebRTC Quality Measurement

[Gavin Fitzgerald]

Hey,
Just curious what methods people are using to measure the experience quality of webrtc video + audio connections?

I'm looking at these from the stats:

• Jitter
• Client Received FPS
• Packet Loss
• qualityLimitationReason (outbound)
• qualityLimitationResolutionChanges  (outbound)
• networkType
  

but I'm presuming others have already broken this ground and it mightn't make sense to make false assumptions.

Any help appreciated :)

[arun...@gmail.com]

Trying to find answer for the same question

[Artiom Khachaturian]

For audio I use MOS estimation based on this description: https://www.pingman.com/kb/article/how-is-mos-calculated-in-pingplotter-pro-50.html

[Artiom Khachaturian]

For video I maybe suggested to compare of metrics for original (captured) video frames with sent/received video frames, almost all this info is available via WebRTC stats:

original - googFrameHeightInput/googFrameWidthInput/googFrameRateInput

transmitted - googFrameHeightSent/googFrameWidthSent/googFrameRateSent (outbound) & googFrameHeightReceived/googFrameWidthReceived/googFrameRateReceived (inbound)

[Pratim Mallick]

Hi Artiom Khanchaturian

Does the above description of MOS estimation work for you in webrtc? 

[bdrtc]

For quality measurement， maybe include online report & offline tests

• Online report:

Your client report their stall duration(media receiver end) stats periodically during call to your backend system, your system calculates

the stall rate of audio and video with stall duration/ total time  x 100%, then you can get stall rate of every call

and guide your qos optimization.

1. For audio stall duration stats,  

  You can use  concealedSamples and totalSamplesReceived stats in rtcinboundrtpstreamstats of webrtc-stats(this is a w3c draft),  then audio stall rate is:

concealedSamples/totalSamplesReceived x 100%

2. For video stall rate,

You can use totalFreezesDuration stats in rtcinboundrtpstreamstats（added to getStats recently) , then video stall rate is:

totalFreezeDuration/ (total call time) x 100%

 

• For offline test:

You may use tools to calculate video QP, and audio mos to measure quality.

--

---
You received this message because you are subscribed to the Google Groups "discuss-webrtc" group.
To unsubscribe from this group and stop receiving emails from it, send an email to discuss-webrt...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/discuss-webrtc/8f383590-a36f-4790-93ee-5691b654dde7n%40googlegroups.com.

[Artiom Khachaturian]

Hi Pratim Mallick

I'm made QOS estimation based on this [https://repozitorij.unizg.hr/islandora/object/fer:7397/datastream/PDF/download] doctoral thesis, and seemsl like it works as expected