Create local collection - Source directory

[gavin1211]

Hi

 

When creating a new local collection using funnelback.  How do you create a Source directory using the funnelback interface?

 

attached screenshot of error.

 

Thanks,

Gavin
Screen Shot 2015-07-17 at 14.06.04.png (391 KB)

[gordongrace]

Hi Gavin -

 

What you've encountered there is something of a Catch-22:  you're telling Funnelback to use a data folder that doesn't yet exist, and that will only exist once you've created a collection.

 

The quickest way to address the issue:

1. Populate all the other fields in the 'New Collection' screen as per your screenshot except for the 'Source Directory' value


2. Set the 'Source Directory' value to a folder that does already exist (e.g. /opt/funnelback/conf)


3. Uncheck the 'Update collection immediately' box.


4. Click 'Create'


5. Funnelback will create a new collection and the associated folder structure.  The folder at /opt/funnelback/data/courses-test/offline/data will exist after this process concludes).


6. From the Admin UI, Click Admin > Edit Collection Settings


7. Change the 'Source Directory' from '/opt/funnelback/conf' to '/opt/funnelback/data/courses-test/offline/data'


8. Save changes

Now you'll have a collection that's using a collection-specific folder that exists to look for it's data source.  Placing data in that folder isn't something that the Admin UI supports (SSH access is assumed here), so you'll need to perform that task from the command line before attempting to update your collection.

[gavin1211]

Hi Gordon

 

Thanks for explaining that so well, I now have the local collection setup.

 

I did not use SSH, but I tried to place data into the web resources directory,  /opt/funnelback/conf/courses-test/_default_preview/web/, using a Pre-gather curl command to save an xml file.

 

This gave an error on update of the collection, which I didn't quite understand:

 

MESSAGE: Error: Error running "/opt/funnelback/linbin/ActivePerl/bin/perl-static /opt/funnelback/bin/index.pl /opt/funnelback/conf/ulster-dev-env/collection.cfg".

 

I then changed the pre-gather curl command to save to this directory /opt/funnelback/data/courses-test/offline/data/, the collection updated successfully.

 

Thanks,

Gavin

[gavin1211]

Just realised to use the web resource directory I needed to set this in the collection.cfg

 

data_root=$SEARCH_HOME/conf/$COLLECTION_NAME/_default_preview/web/

 

Not setting this may have been the cause of the error:

 

MESSAGE: Error: Error running "/opt/funnelback/linbin/ActivePerl/bin/perl-static /opt/funnelback/bin/index.pl /opt/funnelback/conf/ulster-dev-env/collection.cfg".

[gordongrace]