How does Proxy work?
When Proxy is enabled for a scraping job:
- The IP address of the scraper will be rotated at an interval
- The scraper will automatically rotate its IP address when a page containing CAPTCHA or a page containing elements that signal that the access is denied due to the scraper being blocked is encountered.
- Any pages marked as 'Failed' or 'Empty', will be retried at the end of the scraping job using a different IP address.