401 Unauthorised when crawl starts

heroneast 2022-06-13 10:33:29 UTC #1

Hi there,

I'm currently having a little trouble finding what the issue could be. I've got a collection for our intranet site which requires windows authentication.

If I logon to the server with the account which is in the http_user and http_password parameter in the collection I can view the site directly via the browser.

However when I run the crawl on the collection I see the following in following in the 'url_error.log' - E http://intranet/Services/ [401 Unauthorized] [2022:06:13:11:23:45].

I've turned off windows authetication on the application to ensure it works without and it runs without authetication enabled. Had anyone experienced something similair? Is there any parameters in the collection I need to ensure are assigned?

Thanks!

plevan 2022-06-13 23:06:38 UTC #2

Hi,

http_user and http_password are for site that use HTTP Basic authentication. If you're using windows authentication you can probably use the crawler's NTLM authentication to access the site as a specific user.

(15.24 instructions are below)
https://docs.squiz.net/funnelback/archive/15.24/collections/collection-types/web/crawling_password_protected_sites.html

heroneast 2022-06-14 13:16:42 UTC #3

Hi,

Thanks very much for this, this has been the answer i was looking for.

Kind regards!