Crawl Anchor Tag Links with Href attribute as "#"

26 views
Skip to first unread message

Ridhima Shukla

unread,
Jul 22, 2020, 2:24:19 AM7/22/20
to Abot Web Crawler
Hi,

Can we Crawl Anchor tags with href attribute "#" with AbotX.

Thanks
Ridhima

sjdi...@gmail.com

unread,
Aug 30, 2020, 10:46:40 AM8/30/20
to Ridhima Shukla, Abot Web Crawler
There is a config value that can switch that on and off (off by default)...

        /// <summary>
        /// Whether or not url named anchors or hashbangs are considered part of the url. If false, they will be ignored. If true, they will be considered part of the url.
        /// </summary>
        public bool IsRespectUrlNamedAnchorOrHashbangEnabled { get; set; }

--
You received this message because you are subscribed to the Google Groups "Abot Web Crawler" group.
To unsubscribe from this group and stop receiving emails from it, send an email to abot-web-crawl...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/abot-web-crawler/3d4a7a4c-e91c-44ec-8699-3514fbad4cddn%40googlegroups.com.
Reply all
Reply to author
Forward
0 new messages