Crawler - Ignore meta refresh redirects

Developers Gathering & indexing
1

Hello,

I am attempting to crawl an intranet site - but am finding that almost all the content pages are being redirected with the M = Meta Refresh (HTML) Redirect reason.

There is a meta refresh tag <meta http-equiv=“refresh” content="3600; url=homepage> on each page.

Is there an simple way I can tell the crawler to ignore this type of redirect?

Cheers,

Karen

2

Hi Karen,

Sadly, I don’t think Funnelback currently supports any mechanism to ignore redirects. My suggestion would be to ask the content owners to change it at the source.

Hope that helps.

Thanks

~Gioan