Page Source vs. Active Page

[Craig J]

I have a situation where I need to scrape the page_source for information.  I'm finding that the active rendered page isn't equivalent to the page source.  For example, I can successfully find an element but the same element won't show up in the page source.  Any tips or tricks to make sure I get all actively rendered items in the browser? 

[Chris Merrill]

I would inject some javascript into the page to inspect the DOM and
pull out what I need. We use this method to capture key snippets
of the DOM for inspection.

The DOM is guaranteed to reflect the page, as rendered, at that instant.
The page source is only guaranteed to reflect the source that was returned
from the server.



--
------------------------------------------------------------------------ -
Chris Merrill | Web Performance, Inc.
ch...@webperformance.com | http://webperformance.com
919-433-1762 | 919-845-7601

Web Performance: Website Load Testing Software & Services
------------------------------------------------------------------------ -