Skip to content
The Madison Avenue Field GuideA field guide to marketing & advertising, by Brandon Mina

GlossarySEO & ContentCrawl Budget

SEO & Content

Crawl Budget

The number of URLs a search engine will crawl on a site in a given period, shaped by server capacity and how much Google wants to crawl.

By Brandon MinaCEO, BrandPilot AIUpdated November 2026

Short answer

Crawl budget is the number of URLs a search engine will crawl on a site in a given period, shaped by server capacity and how much the search engine wants to crawl. It mainly matters for very large or frequently updated sites. Wasting it on duplicate, parameter or low-value URLs can delay discovery of important pages.