How do I use Website Log-In / State setup?

Website Log-In / State setup runs a sequence of actions before normal sitemap extraction when a required page state is not already present.

Typical uses include signing in, setting a location or currency, opening a required page, or completing another preliminary interaction before scraping begins.

Set the trigger condition

1. Enable Website Log-In / State setup.
2. Configure Perform when not found selector.
3. Select an element that proves the required state already exists, such as a signed-in account label, selected location, or other state-specific element.
4. Use Element Preview to verify that the selector matches when the required state is present.

If the selector matches one or more elements, the setup is skipped. If it matches zero elements, the configured action sequence runs.

Add the required actions

Website Log-In / State setup supports:

• Open URL: open a specific page before continuing.
• Click: click a matching button, link, tab, or other element.
• Text Input: enter non-sensitive text into a matching field.
• Password Input: enter a password.

Only add an Open URL action when the remaining actions cannot run from the current page.

Use it for more than login

Website Log-In / State setup can also be used to:

• Set a location
• Select a language or currency
• Open a required page
• Submit a search or complete another preliminary interaction

Test the setup in Cloud

Run a Cloud Test scrape and confirm that the expected page state is reached before extraction starts.

If a required input, button, link, or other element cannot be found, the affected page is recorded as a Failed page. Use the job's Inspect view to compare the returned page with the expected state.

Password values synced or imported into Cloud are encrypted. They cannot be exported and appear blank in exported sitemap definitions.

See the Website State Setup documentation for more information.