where can i config the program to ignore robots.txt?

819 views
Skip to first unread message

li

unread,
Sep 24, 2011, 8:52:44 PM9/24/11
to VisualWget Help
i can't find the option to config... help!!!

Khomsan Phongphisansakun

unread,
Sep 25, 2011, 2:02:04 AM9/25/11
to VisualWget Help
Hi li,

Please try searching this group with a word "robot".
Basically you use the --execute command.
Then put robots=off as a command.

Best Regards,
Khomsan
Reply all
Reply to author
Forward
0 new messages