Crawling an HTML File

34 views
Skip to first unread message

rjone...@gmail.com

unread,
Jun 21, 2023, 9:47:12 AM6/21/23
to Abot Web Crawler
What would I override/extend if I wanted to crawl an html text file instead of a website?

Sparklyn Services

unread,
May 10, 2024, 3:49:42 PM5/10/24
to Abot Web Crawler
Instead of using HTTP requests to handle file input, you would usually override or enhance parts of a web crawling framework or library to crawl an HTML text file. If you would like a general sketch of what you would need to extend or modify, reach out to us at sparklyn.com.ng
Reply all
Reply to author
Forward
0 new messages