Training Crawler vs. Retrieval Crawler

Short answer

Training crawler versus retrieval crawler describes the split between bots that collect web content to train AI models and bots that fetch content to answer and cite queries in real time. Publishers often treat them differently, blocking training crawlers while allowing retrieval crawlers that can send visibility, citations, and referral traffic.