how to crawl the page need to login

[caihu...@gmail.com]

Hi sjdirect,
I have a question about Abot. Can I crawl the page which need to login? Now, I've try to crawl the page but get the less info from the html body, some content need to login to be showed. Could you please give me some help?

Best regards,
Caihua

[sjdi...@gmail.com]

Search this forum for "login" and the first result is this.

--
You received this message because you are subscribed to the Google Groups "Abot Web Crawler" group.
To unsubscribe from this group and stop receiving emails from it, send an email to abot-web-crawler+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[gcot...@gmail.com]

On Friday, September 15, 2017 at 10:36:36 AM UTC-4, sjdirect wrote:
> Search this forum for "login" and the first result is this.
>
>
> On Fri, Sep 15, 2017 at 1:30 AM, <caihu...@gmail.com> wrote:
> Hi sjdirect,
>
> I have a question about Abot. Can I crawl the page which need to login? Now, I've try to crawl the page but get the less info from the html body, some content need to login to be showed. Could you please give me some help?
>
>
>
> Best regards,
>
> Caihua
>
>
>
> --
>
> You received this message because you are subscribed to the Google Groups "Abot Web Crawler" group.
>

> To unsubscribe from this group and stop receiving emails from it, send an email to abot-web-crawl...@googlegroups.com.

>
> For more options, visit https://groups.google.com/d/optout.

so does editing

<authorization
isAlwaysLogin="false"
loginUser=""
loginPassword="" />

to true and to have the username and password work only for specific types of logins?