Is it possible to loop through multiple urls dynamically and curl them on the pr_idex_command of a local collection?

Here is our current command, we manually add the url's as more pages appear. I have added some line breaks between the curl commands here.

pre_index_command=

curl --retry 5 --retry-delay 1 --retry-max-time 600 -Lm600 https://www.ulster.ac.uk/tester/_web_services/phds-xml/_nocache?result_40001_result_page=1 -o $SEARCH_HOME/conf/$COLLECTION_NAME/_default_preview/web/opps2.xml;

curl --retry 5 --retry-delay 1 --retry-max-time 600 -Lm600 https://www.ulster.ac.uk/tester/_web_services/phds-xml/_nocache?result_40001_result_page=2 -o $SEARCH_HOME/conf/$COLLECTION_NAME/_default_preview/web/opps2.xml;

etc...

There are up to 12 pages now, becoming hard to manually update.

  • created

    Dec '19
  • last reply

    Dec '19
  • 1

    reply

  • 3.6k

    views

  • 2

    users

  • 3

    links