openai
Tuesday, November 10, 2026 11:00 AM
Which OpenAI crawlers should you allow?
What GPTBot, OAI-SearchBot, ChatGPT-User, and OAI-AdsBot do with your content. Decide which to allow.
Before deciding which OpenAI crawlers to block check what each one is doing. According to OpenAI's documentation GPTBot is the one that gathers the training data.