Pay Per Crawl

A Cloudflare feature launched in 2025 that lets site owners charge verified AI crawlers a set fee per page, block them, or allow free access.

By Brandon MinaCEO, BrandPilot AIUpdated November 2026

Short answer

Pay Per Crawl is a Cloudflare feature launched in 2025 that lets website owners charge verified AI crawlers a set fee per page accessed. Site owners can alternatively block crawlers or allow free access. It gives publishers a way to monetize AI access to their content instead of choosing only between allowing and blocking.