Can I connect Web Scraper to an external platform?

Web Scraper does not provide a direct integration with n8n or other platforms that are not listed as supported integrations.

However, you can build a custom connection if the external platform can make HTTP requests to the Web Scraper Cloud API and receive webhooks.

Example: connecting through n8n

n8n can be connected through its generic HTTP Request and Webhook nodes.

  1. Use an HTTP Request node to start the scraping job through the Web Scraper Cloud API.
  2. Configure an n8n Webhook node and add its URL as a webhook endpoint in Web Scraper Cloud.
  3. When the scraping job reaches a final status, Web Scraper Cloud sends the webhook notification.
  4. Use the returned scrapingjob_id  in another API request to download the scraped data.
  5. Continue processing the data in your n8n workflow.

This is a custom API workflow, not a native Web Scraper integration with n8n.

Other platforms

A similar setup may be possible with another platform if it supports both:

  • Making authenticated HTTP requests to a REST API.
  • Receiving HTTP webhook notifications.

Web Scraper cannot guarantee compatibility with every third-party platform. Check that platform's API and webhook capabilities before building the workflow.

Important: webhooks do not contain the scraped dataset

The Web Scraper webhook contains scraping-job information, including scrapingjob_id . It does not contain the scraped records themselves.

Your workflow must make a follow-up request to the Web Scraper Cloud API to retrieve the data.

Use a supported Data Export destination when possible

If you only need the completed dataset delivered automatically, using one of Web Scraper Cloud's supported Data Export destinations may be simpler than building a custom API integration.

See the Web Scraper Cloud API documentation and Webhook documentation for API details.

Did this answer your question? Thanks for the feedback There was a problem submitting your feedback. Please try again later.

Still need help? Contact Us Contact Us