Glossary/SEO & Content/Crawl Budget
SEO & Content
Crawl Budget
The number of URLs a search engine will crawl on a site in a given period, shaped by server capacity and how much Google wants to crawl.
By Brandon Mina·CEO, BrandPilot AI·Updated November 2026
Short answer
Crawl budget is the number of URLs a search engine will crawl on a site in a given period, shaped by server capacity and how much the search engine wants to crawl. It mainly matters for very large or frequently updated sites. Wasting it on duplicate, parameter or low-value URLs can delay discovery of important pages.