AI bots
OAI-SearchBot: what it is, its IP ranges, and how to block it
OAI-SearchBot is OpenAI's crawler for AI search and answers.
| Vendor | OpenAI |
|---|---|
| What it is for | AI search and answers |
| In its User-Agent | OAI-SearchBot |
| Its vendor's address list | https://openai.com/searchbot.json |
| IP ranges | 39 |
It reads a page for an AI's search or for a person who asked an assistant, and can bring visitors. Bot Protection lets it through by default; you can block it.
How to verify it
Any bot can write OAI-SearchBot in its User-Agent. A request is OAI-SearchBot only when its address is in OpenAI's published list below: check the address, not the name.
How to block it
With robots.txt, you ask it to stay out:
User-agent: OAI-SearchBot Disallow: /
robots.txt is a request, not a block, and it cannot tell the real crawler from a bot wearing its name. Bot Protection verifies OAI-SearchBot by its address on every request and answers it as you choose on the Set-up page, per kind or for OAI-SearchBot alone; a bot that only wears the name is judged like any other bot.
Its IP ranges
From OpenAI's own list, downloaded again every day.
IPv4
104.210.140.128/28 13.66.216.176/28 135.234.64.0/24 172.182.193.224/28 172.182.193.80/28 172.182.194.144/28 172.182.194.32/28 172.182.195.48/28 172.182.209.208/28 172.182.211.192/28 172.182.213.192/28 172.182.224.0/28 172.203.190.112/28 172.203.190.128/28 172.203.190.80/28 20.14.99.96/28 20.168.18.32/28 20.169.6.224/28 20.169.7.48/28 20.169.77.0/25 20.171.123.64/28 20.171.53.224/28 20.25.151.224/28 20.42.10.176/28 23.102.145.48/28 4.227.36.0/25 40.67.175.0/25 40.90.214.16/28 51.8.102.0/24 74.7.175.128/25 74.7.228.0/25 74.7.228.128/25 74.7.229.0/25 74.7.229.128/25 74.7.230.0/25 74.7.241.128/25 74.7.242.128/25 74.7.243.0/25 74.7.244.0/25