Documentation

Getting started with Crawle

From account setup to your first monitored client site.

Add website wizard

ONBOARDING · verified domain · client tags · URL budget

Add website

Verify the domain and allocate budget before the first crawl

0 / 3 steps

Setup checklist

3 steps to first crawl

EssentialsDomain, project name, and URL budget
ScopeDiscovery crawl from the sitemap
AccessRegion, robots policy, and user agent

Essentials

Domain, project name, client context, and URL budget

Domain

https://demo-shop.comChecking…

Verifying ownership through Google Search Console…

Project name

Demo Shop

Client

Northwind Retail

Your crawl is starting!

Verified

Discovering URLs from the sitemap — first results within a few minutes.

Scope: Discovery
Region: Europe
URL budget: 0

URLs discovered5,400

The actual onboarding wizard verifies the domain, assigns client and tag context, and allocates URL budget before the first crawl starts.

1. Accept your invite

Crawle accounts are created through an invitation — a team invite or an access invitation sent to your email address.

Use the invite link sent to your email address.
Complete email verification if prompted.
Use Google sign-in or email/password depending on your account setup.

2. Choose the right workspace

Workspaces keep client portfolios, URL capacity, reports, and team access separate.

Use the workspace switcher for multi-client accounts.
Use client groups and tags to filter large portfolios.
Only owners can manage billing and workspace capacity.

3. Add your first site

After ownership verification, Crawle starts crawling and the site appears in dashboards, alerts, exports, and reports.

Connect Google Search Console when available.
Use DNS or meta verification when GSC access is not available.
Set crawl settings and notification defaults before large rollouts.

Related features

Continuous monitoring

Put these docs to work on a real client site.

Set up continuous monitoring across your client portfolio.

Start monitoring