Does crawler.request_delay only come into effect if crawler.monitor_delay_type=fixed?

Hi Mr. Cook.

The way I read it is that it is possible to increase the delay by using the crawler.request_delay configuration even in dynamic mode but the delay is not guaranteed. i.e. Depending on the response, Funnelback will adapt to delay value slightly to make the most of the available resources .

If you want to ensure that the delay is “always” a fixed amount, you will need to set crawler.monitor_delay_type to fixed.

In my experience, I have not had any problems with simply setting the crawler.request_delay slightly higher for sites which a little less performant or sensitive.

Hope this helps.

Thanks,

~Gioan