Control Bandwidth Usage

[Gustavo Arjones]

Hi all,
My server is running quite well. Thanks guys!

As it's working so fine, it started to overuse my internet bandwidth - I've contracted 2Mbps and it's consuming 2.1Mbps right now and keep rising.

What kind config can I do to slow down crawler in order to avoid over usage?

Thanks a lot!
Gustavo Arjones

[Jorge Handl]

Gustavo, I'm glad to hear that you are successfully using Hounder. 

There is no direct way to cap the bandwidth usage, but you can indirectly affect it by changing the number of threads used by the Nutch fetcher (edit the "fetcher.threads.fetch" parameter in the nutch-site.xml file).

Let me know if that helped.

- Jorge