How do I test a Cloud scrape before running the full job?
Use Test scrape to validate a sitemap and its Cloud settings before starting a full scraping job.
Run a Test scrape
- Open the sitemap in Web Scraper Cloud.
- Open the Scrape tab.
- Configure the driver, proxy, request interval, page load delay, and other settings you want to test.
- Select Test scrape.
- Review the returned records and page outcomes before starting the full job.
Does Test scrape use URL credits?
No. A Test scrape does not consume URL credits.
It processes up to 500 links. The limit is based on links processed, not on the number of records returned. A processed link counts toward the limit even if it produces no data.
What should I check?
Use the test result to confirm:
- The expected fields and records are returned.
- The selected driver works with the website.
- The proxy configuration provides access to the target pages.
- The request interval and page load delay are appropriate.
- Pagination, scrolling, clicks, and other navigation behave as expected.
Once the test result is correct, return to the Scrape tab and select Scrape to start the full job.
See the Run a Cloud scraping job documentation for more information.