Search entire website's source for specific code

[Sarla Scherlis]

I am looking for a way to view an entire website's source with the goal of locating code contained there. For right now, I can only view each page's source individually, and this method is extremely time-consuming with so many pages. Is there a method within DevTools that will allow me to search what I'm looking for through all of the website's source code?

[PhistucK]

Not using the Developer Tools.

The closest you can get is pressing Control + Shift + F in the Developer Tools. That will bring up the global search which searches across all of the HTML, CSS and JavaScript files that are used on the current tab (including frames/iFrames).

☆PhistucK

On Wed, Jun 24, 2020 at 2:02 AM Sarla Scherlis <scherl...@gmail.com> wrote:

I am looking for a way to view an entire website's source with the goal of locating code contained there. For right now, I can only view each page's source individually, and this method is extremely time-consuming with so many pages. Is there a method within DevTools that will allow me to search what I'm looking for through all of the website's source code?

--
You received this message because you are subscribed to the Google Groups "Chrome DevTools" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-chrome-develo...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-chrome-developer-tools/4ee28a01-f930-4457-8d6d-1035eb83d28do%40googlegroups.com.

[Sarla Scherlis]

Thank you for the response. I know this is a Google forum, but would you happen to know of other methods that might allow me to do something like this?

On Tuesday, June 23, 2020 at 6:11:34 PM UTC-5, PhistucK wrote:

Not using the Developer Tools.

The closest you can get is pressing Control + Shift + F in the Developer Tools. That will bring up the global search which searches across all of the HTML, CSS and JavaScript files that are used on the current tab (including frames/iFrames).

☆PhistucK

On Wed, Jun 24, 2020 at 2:02 AM Sarla Scherlis <scherl...@gmail.com> wrote:

I am looking for a way to view an entire website's source with the goal of locating code contained there. For right now, I can only view each page's source individually, and this method is extremely time-consuming with so many pages. Is there a method within DevTools that will allow me to search what I'm looking for through all of the website's source code?

--
You received this message because you are subscribed to the Google Groups "Chrome DevTools" group.

To unsubscribe from this group and stop receiving emails from it, send an email to google-chrome-developer-tools+unsub...@googlegroups.com.

[herb munson]

Notepad++ will look through a (sub-)set of files/folders, though there are probably more sophisticated solutions 🤔😷

Herb Munson

Ballard WA

Sent from the awful Google gmail client (terrible editor) over T-MOBILE's sketchy network

On Tue, Jun 23, 2020, 4:02 PM Sarla Scherlis <scherl...@gmail.com> wrote:

I am looking for a way to view an entire website's source with the goal of locating code contained there. For right now, I can only view each page's source individually, and this method is extremely time-consuming with so many pages. Is there a method within DevTools that will allow me to search what I'm looking for through all of the website's source code?

--

You received this message because you are subscribed to the Google Groups "Chrome DevTools" group.

To unsubscribe from this group and stop receiving emails from it, send an email to google-chrome-develo...@googlegroups.com.

[guest271314]

One option is to navigate to Network tab, right click on an entry, select Save all as HAR with content, open .har file in text editor or at a Chromium, then press Ctrl F.

[Sarla Scherlis]

I do not see any entries. What does this method do?

[guest271314]

Open DevTools => Network => Select All => Refresh page (if necessary) => See "Name Status Type Initiator Size" => Right click => Select "Save all as HAR with content" 

which should prompt for download of a .har file, see https://developer.mozilla.org/en-US/docs/Mozilla/Add-ons/WebExtensions/API/devtools.network/getHAR , http://www.softwareishard.com/blog/har-12-spec/#log

[Sarla Scherlis]

I tried that method, and it seems to be more of a diagnostic method, but I'm unable to do what I'm thinking of. Is it possible to see the source code for the entire website without going through each page and looking at it individually?

[guest271314]

> Is it possible to see the source code for the entire website without going through each page and looking at it individually?

Am not sure what you mean. To see the entire source code necessitates inclusion of each page individually. The .har file should contain all of the content within the request. An excerpt from the .har file from this page

"content": {

            "size": 436,

            "mimeType": "text/html",

            "text": "<!DOCTYPE html>\n<html>\n<head>\n<title></title>\n<meta http-equiv=\"X-UA-Compatible\" content=\"IE=edge\" />\n<script type=\"text/javascript\" nonce=\"DKntdgzNk+XiWGzIrAjqDQ==\">\n  window['startup'] = function() {\n    googleapis.server.init();\n  };\n</script>\n<script type=\"text/javascript\"\n  src=\"https://apis.google.com/js/googleapis.proxy.js?onload=startup\" async\n  defer nonce=\"DKntdgzNk+XiWGzIrAjqDQ==\"></script>\n</head>\n<body>\n</body>\n</html>\n"

          }

[PhistucK]

Not with the Developer Tools. There are web scraping applications/libraries/scripts but even they only download everything they find using links and maybe simple form submissions.

There is no way to get everything a website holds if it does not expose it in a relatively straightforward way.

☆PhistucK

--

You received this message because you are subscribed to the Google Groups "Chrome DevTools" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-chrome-develo...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/google-chrome-developer-tools/6e1fb608-80d6-4b79-a792-e3b9d69f932eo%40googlegroups.com.

[scherl...@gmail.com]

Well, this response for an earlier similar question is what sparked my curiosity on this topic: "It is only going to search what sources it knows about. By default, the DevTools only knows about the code of any given page it is on. You may use the Workspaces feature to reveal the entire site's source code to the DevTools and it should then look over everything." It seems as though Workspaces is no longer being maintained and wanted to see what options I had now to search through the source code of an entire website.

[PhistucK]

I think workspaces are maintained, but they only help if the website is yours (you have the source code), in which case, any file searching utility would also work (except for dynamic parts that are part of the loaded page in the browser).

☆PhistucK

--

You received this message because you are subscribed to the Google Groups "Chrome DevTools" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-chrome-develo...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/google-chrome-developer-tools/0e5d911f-2129-4c86-b336-929f30d594aen%40googlegroups.com.

[scherl...@gmail.com]

Noted. Would a full static website change anything?

[PhistucK]

If you own it, it is easier (Notepad++ or any other file content search would work). If you do not own it, it does not change a lot.

☆PhistucK

To view this discussion on the web visit https://groups.google.com/d/msgid/google-chrome-developer-tools/813525fe-3eb4-4327-b4bb-20224c653f14n%40googlegroups.com.

[scherl...@gmail.com]

Since the website in question here is too large to be downloaded offline and I do not own it, what do you recommend I do?

[PhistucK]

No recommendation and out of scope for this group, sorry.

☆PhistucK

To view this discussion on the web visit https://groups.google.com/d/msgid/google-chrome-developer-tools/2e79ed24-9247-4da8-8f42-77ec215861dfn%40googlegroups.com.