List URLs

GET/v1/api/sites/{site_id}/urls

List URLs for a site with bounded pagination.

Scope: urls:read
Token: API key or OAuth access token
Role: Any workspace member
MCP tool: search_urls; What scopes, tokens and roles mean →

Request

curl "https://api.crawle.io/v1/api/sites/11111111-1111-1111-1111-111111111111/urls" \
  -H "Authorization: Bearer $CRAWLE_API_KEY"

const response = await fetch("https://api.crawle.io/v1/api/sites/11111111-1111-1111-1111-111111111111/urls", {
  headers: {
    Authorization: `Bearer ${process.env.CRAWLE_API_KEY}`,
  },
});
const data = await response.json();

import os

import requests

response = requests.request(
    "GET",
    "https://api.crawle.io/v1/api/sites/11111111-1111-1111-1111-111111111111/urls",
    headers={
        "Authorization": f"Bearer {os.environ['CRAWLE_API_KEY']}",
    },
)
data = response.json()

$CRAWLE_API_KEY: is an API key from Settings › API keys.

Response 200: a JSON object. Its fields are not described in the API contract yet, so no example is shown.

Parameters

site_idpath · string (uuid)required
pagequery · integer: at least 1 · default 1
page_sizequery · integer: 1–100 · default 50
statusquery · string or null
favoritequery · boolean or null
searchquery · string or null
sort_byquery · string: default "importance_score"
sort_orderquery · string: default "desc"
includequery · string: default "latest_crawl,link_counts"

Pages with page and a page size.

Response 200

Returns a JSON object. Its fields are not described in the API contract yet.

Errors

401
When
Missing, invalid, or expired token.
403
When
The token has none of the accepted scopes (urls:read).
422
When
The request did not match the schema. detail lists each problem.
429
When
Rate limited. Wait for Retry-After seconds.

List URLs: errors
Status	When
401	Missing, invalid, or expired token.
403	The token has none of the accepted scopes (`urls:read`).
422	The request did not match the schema. `detail` lists each problem.
429	Rate limited. Wait for `Retry-After` seconds.

All errors and what to do →

Generated from the API contract at 7e7039b0b, synced October 30, 2026.