How do I create my first sitemap?

A sitemap tells Web Scraper where to start, how to navigate the website, and which data to extract.

Before you begin

  1. Install the Web Scraper browser extension.
  2. Open the website you want to scrape.

Choose how to create your sitemap

AI Sitemap Wizard

Use the AI Sitemap Wizard for common scraping workflows, especially websites that display repeated items such as products, properties, jobs, or directory records.

  1. Open the page where you want scraping to begin.
  2. Click the Web Scraper icon in the browser toolbar.
  3. Start the AI Sitemap Wizard.
  4. Review the detected items and navigation, then finish the sitemap.

See the AI Sitemap Wizard documentation for detailed instructions.

Advanced Sitemap Builder

Use the Advanced Sitemap Builder when you need more control over navigation, selector relationships, or extraction settings.

  1. Open browser Developer Tools on the website you want to scrape.
  2. Select the Web Scraper tab.
  3. Select Create sitemap.
  4. Enter a sitemap name and start URL.
  5. Add the navigation and data selectors required for the website.

See the Advanced Sitemap Builder documentation for detailed instructions.

What should I use for my first sitemap?

For a straightforward listing page, start with the AI Sitemap Wizard. Use the Advanced Sitemap Builder when the website requires custom navigation, clicks, or manual control over the selector tree.

For the complete workflow, see the Scrape a website documentation.

Did this answer your question? Thanks for the feedback There was a problem submitting your feedback. Please try again later.

Still need help? Contact Us Contact Us