Re: Firebug + Net Export + WebDriver does not export all the requests

1,743 views
Skip to first unread message

Jan Honza Odvarko

unread,
Oct 1, 2012, 6:15:40 AM10/1/12
to Firebug
On Sep 28, 12:35 pm, Tarun Kumar <tkum...@gmail.com> wrote:
> I followedhttp://www.softwareishard.com/blog/firebug/automate-page-load-perform...
> to capture n/w traffic and all went well.
> But I am facing one issue with respect to data which is exported from net
> panel. For one operation on page only 26 requests are exported to har file
> and not all the requests.
Is the page accessible online?
Can we somehow try to repro the problem on our machines?

Honza

> I gave more than 1 minute wait period but yet see only 26 requests in the
> exported har file. While in the net export panel of browser I can see all
> the request during test run. Did I miss any setting?
>
> Thanks in advance
> Tarun K

Jan Honza Odvarko

unread,
Oct 3, 2012, 10:55:00 AM10/3/12
to Firebug
I have fixed one netExport related issue that could solve the problem
see: http://code.google.com/p/fbug/issues/detail?id=5925

There is also fresh new release: NetExport 0.9b2
https://getfirebug.com/releases/netexport/netExport-0.9b2.xpi

Does it solve the problem?
Honza

Tarun Kumar

unread,
Oct 4, 2012, 11:53:24 PM10/4/12
to fir...@googlegroups.com
Thanks for response Jan,

I found that the issue is because of ajax operation. I increased the time out limit << profile.setPreference(domain + "netexport.pageLoadedTimeout", "120000");>> and got to see all requests being logged in har file. 

Jan Honza Odvarko

unread,
Oct 5, 2012, 2:09:44 AM10/5/12
to fir...@googlegroups.com
Thanks for the update!
Honza

Jan Honza Odvarko

unread,
Oct 17, 2012, 7:46:12 AM10/17/12
to Firebug
On Oct 17, 1:32 pm, Vinay <vinayku...@goorulearning.org> wrote:
> Hi.. i followed same procedure.. once i got the HAR file. second time when
> i am executing i am not able to get the HAR file in the specified path..
> can u plz help me out??
We need detailed steps about what to do to see the problem.
Can you provide it + a test page?

Honza
Message has been deleted

Vinay

unread,
Oct 17, 2012, 7:57:37 AM10/17/12
to fir...@googlegroups.com

the same example which is in http://www.softwareishard.com/blog/firebug/automate-page-load-performance-testing-with-firebug-and-selenium/
i had followed by changing firebug and netexport versions and the path where HAR files to be generated..

Jan Honza Odvarko

unread,
Oct 17, 2012, 8:15:04 AM10/17/12
to Firebug
On Oct 17, 1:57 pm, Vinay <vinayku...@goorulearning.org> wrote:
> the same example which is inhttp://www.softwareishard.com/blog/firebug/automate-page-load-perform...
> i had followed by changing firebug and netexport versions and the path
> where HAR files to be generated..
And what page did you use for your test?
Or does the problem appear with any page?
Can I test it with google.com?
Honza

Vinay

unread,
Oct 17, 2012, 8:21:53 AM10/17/12
to fir...@googlegroups.com
The same page which is in example.Also,tried with google.com. Page is getting opened and closing with out any errors in console.
But,in the specified path HAR file is not getting generated

Vinay

unread,
Oct 18, 2012, 12:24:58 AM10/18/12
to fir...@googlegroups.com
Hi. .

I could not trace out where is the mistake.. the page is getting opened and closed. But,in the specified path the HAR file is not generated.
Kindly,help me to achieve this. .

Thanks,
Vinay

Vinay

unread,
Oct 18, 2012, 7:57:14 AM10/18/12
to fir...@googlegroups.com
Hi..

Finally i achieved the task.. i have something to get clarified.. only for one page load the HAR files is generated.
Suppose if i am giving multiple selenium commands will i be able to get the response time for all the pages????

Thanks,
Vinay

Jan Honza Odvarko

unread,
Oct 18, 2012, 8:54:38 AM10/18/12
to Firebug
On Oct 18, 1:57 pm, Vinay <vinayku...@goorulearning.org> wrote:
> Hi..
>
> Finally i achieved the task..
Sounds great, what was the problem?

> i have something to get clarified.. only for
> one page load the HAR files is generated.
> Suppose if i am giving multiple selenium commands will i be able to get the
> response time for all the pages????
Yes, this should work.

You just need to use the driver to open new page.

Honza

Jan Honza Odvarko

unread,
Jan 29, 2013, 11:22:29 AM1/29/13
to Firebug
On Jan 29, 12:59 am, gsounda...@gmail.com wrote:
> Hi Jan,
>
> I need to capture all the request through Net export using Java. For
> approx. 15 minutes, my page will be triggering data and I need to capture
> all of them. Number of request could be more than 400. After Auto export
> when I read HAR file it does not have all 400 request, it has 200 request
> approx. But when I export it manually I see all 400 request. I tried
> increasing pageloaded timeout but still there was no change.
>
> I'm using Firefox 10, Firebug 1.9.2, Netexpot 1.9.2

Does it help if you use latest versions?
Firefox 18, Firebug 1.11.1 and NetExport Netexpot 0.9b3

Btw. Netexpot 1.9.2, doesn't exist

Also, is there any way I can repro the problem on my machine?

Honza


>
> Soundar

gsoun...@gmail.com

unread,
Jan 29, 2013, 11:59:38 AM1/29/13
to fir...@googlegroups.com
I'll try upgrading my version to the latest and let you know. I'm using Netexpot 0.9b2, my bad.

Repro steps: Goto cnbc.com and play the video which is in the top right corner. Different events will be triggered until the video completes playing. I need to capture those events.

Soundar

gsoun...@gmail.com

unread,
Jan 29, 2013, 6:42:18 PM1/29/13
to fir...@googlegroups.com
I upgraded and tried but still no change in results.

Firefox 16 (Selenium isn't working with Firefox 16), Firebug 1.10 and Netexpot 0.9b3 

Soundar

Jan Honza Odvarko

unread,
Jan 30, 2013, 6:03:29 AM1/30/13
to Firebug
On Jan 30, 12:42 am, gsounda...@gmail.com wrote:
> I upgraded and tried but still no change in results.
I can reproduce the problem with cnbc.com

Please create a new report here:
http://code.google.com/p/fbug/issues/list

And provide some instructions how to reproduce the problem
so, it isn't forgotten here in the noise.

I'll take a look at it. The problem is that the netExport
exports content of the Net panel too soon, I guess.

Honza

Jan Honza Odvarko

unread,
Jan 31, 2013, 9:33:44 AM1/31/13
to Firebug
Was the problem reported?
(please cross post the issue number here so, I don't miss it)

Honza

gsoun...@gmail.com

unread,
Jan 31, 2013, 10:44:35 AM1/31/13
to fir...@googlegroups.com

Alok Nayak

unread,
Mar 7, 2013, 2:31:57 PM3/7/13
to fir...@googlegroups.com
just found out from the documnetation in code
All requests  are collected in an internal array and removed when proper response is received.  As soon as the requests list is empty again, the object waits for specified  amount of time (see: extensions.firebug.netexport.pageLoadedTimeout) and if no request  is made during this period the page is declared to be loaded.

On Friday, March 8, 2013 12:33:04 AM UTC+5:30, Alok Nayak wrote:
Just out of curiosity, I am wondering, how can setting "pageloadedtimeout" ,solved your problem? given I am assuming that "pageloadedtimeout" is same as webdriver wait "pageloadtimeout" (that is netexport waits for page to load within timeout before exporting to file) and
also assuming that the page you requested will be "loaded" first then ajax operation would have happened.
So this should work only if ajax operation is happening before page load and setting "pageloadedtimeout" allowed ajax operation to happen, which is confusing.

neetha bhushan

unread,
Sep 24, 2015, 4:52:38 AM9/24/15
to Firebug
Hi,
Im not able to export all the requests, total request are 45 but only 20 request are getting exported in har file,
im using Selenium IDE. can u pls help.

thanks
neetha.

Jan Honza Odvarko

unread,
Sep 24, 2015, 10:47:56 AM9/24/15
to Firebug
On Thursday, September 24, 2015 at 10:52:38 AM UTC+2, neetha bhushan wrote:
Hi,
Im not able to export all the requests, total request are 45 but only 20 request are getting exported in har file,
im using Selenium IDE. can u pls help.

Does this the following test page work for you?
http://janodvarko.cz/har/tests/har-export-trigger/har-export-api.html
Can you see HAR log in the Console panel if you press the "HAR Export" button.

The main question, are you able to reproduce the problem *without* Selenium?

Honza


Reply all
Reply to author
Forward
0 new messages