[Dillo-dev] Downloading user agent

[Andreas Kemnade]

Hi,

I am thinking about the User-Agent which is sent during downloads.
Some sites block wget, probably because they do not want to learn
robots.txt and do not like a tool doing massdownloads.

So if you use dillo to download from such sites, you get a 403
forbidden.
If wget would use dillo as user-agent (can be set via a parameter) in
such cases, there would be no problem and it is not really wrong.

Regards,
Andreas


_______________________________________________
Dillo-dev mailing list
Dill...@dillo.org
http://lists.dillo.org/cgi-bin/mailman/listinfo/dillo-dev