How do I schedule a sitemap to run automatically?

Use the Schedule tab in Web Scraper Cloud to run a sitemap automatically on selected days or at recurring intervals.

Create a schedule

1. Open the sitemap in Web Scraper Cloud.
2. Open the Schedule tab.
3. Select the scheduler time zone.
4. Choose the schedule type and configure the timing.
5. Configure the Driver, Request interval, Page load delay, Proxy, and Priority.
6. Save the schedule.

Schedule types

• Daily: run on selected weekdays at a specific time.
• Interval: run repeatedly using a minutes or hours interval.
• Custom Cron expression: create a recurring schedule that cannot be represented by the Daily or Interval options.

All schedule timing uses the scheduler time zone you select.

Test the configuration first

Before scheduling regular jobs, validate the same driver, proxy, request interval, and page load delay with a Test scrape or normal Cloud job.

What if the previous scheduled job is still running?

If the next scheduled time arrives while the previous scheduled job for the same sitemap is still running, the next run waits until the previous one finishes. It then starts when a parallel task is available.

This means setting an interval shorter than the sitemap's normal run time will not make the sitemap run more frequently.

See the Scheduler documentation for more information.