How to implement the decision maker function in abot web crawler.

33 views
Skip to first unread message

agarwal....@gmail.com

unread,
Jun 12, 2020, 12:33:56 AM6/12/20
to Abot Web Crawler
I am working on project where before crawling a page i need to check whether should a crawl this page or not. i have tried using the shouldcrawlpagedecisionmaker and does not get the right way to implement that.

can someone please help to get it correct.
Displaying image.png
Reply all
Reply to author
Forward
0 new messages