You can't use an exclude pattern for a page you need to crawl through.
Take a look at the following article - you should ideally specify robots meta tags in your page content, or failing that use the kill configuration to remove the files from the search index after indexing.
