What IP address is my scraping job using when 'No Proxy' option is used?
When Proxy is not enabled for a scraping job
The scraper will be using an IP address selected from a limited pool of Web Scrapers own IP addresses. When this configuration is used, please note:
- The IP address of the scraper will not be rotated at an interval
- When the 'No Proxy' option is used, the scraper exclusively will be using the United States as its location
- As the IP pool is limited, depending on the target site as well as the volume of data you are extracting, prolonged data extraction using our IP pool may result in the IP addresses being blocked, thus your scraping job will no longer be able to access the site with the configuration 'No Proxy'.
When possible, we recommend using Proxy, as this will improve the accuracy of the data you are extracting as well as decrease the probability of the scraping job running into an issue with the target site blocking the access to it.