Skip to content

Documentation

Visual Mapper

The mapper helps inspect a page and find the elements from which values should be extracted. A server-side browser opens the page, making it possible to work with sites that prevent frame embedding or run JavaScript.

How to use it

  1. Open the mapper from a site page and enter the page you want to inspect.
  2. Wait for its content, images, and dynamic blocks to load.
  3. Close region, cookie, or confirmation dialogs if they cover the product.
  4. Select an element and make sure the selector points to the value, rather than a shared container or neighboring text.
  5. Check it on another product page, including one where the value is missing.

Scrolling and clicks are sent to the server-side browser. Delays depend on the source and network; several quick clicks may reach a page that has already changed. Let one action finish before repeating it.

What the mapper does not discover automatically

Selecting one element does not describe traversal of all categories, pagination, or product variants. Add these steps to your collection algorithm after inspecting an individual page. Check that product pages are available without personal authorization and that the source terms allow your intended collection.

Running a server-side browser consumes compute resources. Keeping a page open and performing actions are different things; see the limits section for details.