0
+38%kept out of the queue
Documentation
Parameter traps and suppressed URLs
Review parameter explosion warnings and suppress low-value URL patterns safely.
Parameter trap manager
Crawl rules
Suppress parameter traps, keep folders, save crawl budget
0%
+12%of monthly URL budget
0
exclusion patterns
0
+100%this crawl
Crawl exclusion rules4
Robots-style patterns that keep matching URLs out of the crawl queue.
*?sort=Auto-addedContainsCrawle added this internal exclusion rule after detecting a parameter crawl trap. Your robots.txt was not changed.
0 matched*?utm_*ContainsCampaign tracking parameters — no unique content.
0 matched/calendar/*PrefixInfinite calendar pagination.
0 matched*.pdf$SuffixBinary downloads excluded from the link graph.
0 matched
Suppressed URLs
Stored URLs currently excluded from crawling — purge to reclaim URL budget.
7,183+71%
URLs held back across 4 active rules. Active rules keep future matching URLs out of the queue.
- Parameter trap4,821
- Tracking params1,290
- Pagination760
- Binary files312
| Category | Value | Share |
|---|---|---|
| Parameter trap | 4,821 | 67.1% |
| Tracking params | 1,290 | 18% |
| Pagination | 760 | 10.6% |
| Binary files | 312 | 4.3% |
- Parameter trap
- Tracking params
- Pagination
- Binary files
Parameter traps
Parameter traps happen when a site exposes many low-value URL variants through filters, sorting, tracking, or repeated query parameters.
- Crawle should flag parameter variants, not ordinary folder paths.
- Review examples before suppressing a rule.
- Suppression rules should target the parameter pattern that creates crawl noise.
Suppressed URLs
Suppressed URLs stay visible as a state but are removed from crawl pressure.
- Use suppression for URLs that should not be crawled again.
- Purge suppressed URLs only when you intentionally want to delete them from the workspace.
- Keep important URL patterns unsuppressed even if they are large.
Continuous monitoring
Put these docs to work on a real client site.
Set up continuous monitoring across your client portfolio.