User-Agent List
The User-Agent strings Chrome, Edge, Firefox and Safari send today, and those of Googlebot, GPTBot, ClaudeBot and other crawlers, with their robots.txt tokens.
Checked on November 6, 2026. Crawler details come from each operator's own documentation.
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/157.0.0.0 Safari/537.36Windows 11 also sends "Windows NT 10.0". Only the major version changes; the rest of the number is fixed at 0.
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/157.0.0.0 Safari/537.36The macOS version is fixed at 10_15_7, and Apple silicon Macs also say Intel.
Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/157.0.0.0 Safari/537.36Mozilla/5.0 (X11; CrOS x86_64 14541.0.0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/157.0.0.0 Safari/537.36The ChromeOS version is fixed at 14541.0.0.
Mozilla/5.0 (Linux; Android 10; K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/157.0.0.0 Mobile Safari/537.36The Android version and device model are fixed at "Android 10; K".
Mozilla/5.0 (Linux; Android 10; K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/157.0.0.0 Safari/537.36The only difference from a phone is the missing "Mobile" token.
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/157.0.0.0 Safari/537.36 Edg/157.0.0.0The Chrome string with "Edg/" appended (not the "Edge/" of legacy Edge).
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/157.0.0.0 Safari/537.36 Edg/157.0.0.0Mozilla/5.0 (Linux; Android 10; K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/157.0.0.0 Mobile Safari/537.36 EdgA/157.0.0.0The Android app says "EdgA/" and the iPhone and iPad app says "EdgiOS/".
Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:159.0) Gecko/20100101 Firefox/159.0On desktop, "Gecko/20100101" is a fixed string.
Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:159.0) Gecko/20100101 Firefox/159.0macOS 11 and later are reported as "10.15", and Apple silicon Macs as Intel.
Mozilla/5.0 (X11; Linux x86_64; rv:159.0) Gecko/20100101 Firefox/159.0Mozilla/5.0 (Android 16; Mobile; rv:159.0) Gecko/159.0 Firefox/159.0Unlike Chrome, it sends the real Android version (16 in this example). There is no device model.
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/27.0 Safari/605.1.15The number after "Version/" is the Safari version. The macOS version is fixed at 10_15_7.
Mozilla/5.0 (iPhone; CPU iPhone OS 18_7 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/27.0 Mobile/15E148 Safari/604.1Since iOS 26, Safari reports the iOS version as a fixed 18.x value. The real iOS version matches the number after "Version/".
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/27.0 Safari/605.1.15Safari on iPad sends the same string as a Mac by default, so the string alone cannot tell them apart.
Googlebot SmartphoneGoogleSearch engine
Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/W.X.Y.Z Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)Placeholders such as "W.X.Y.Z" stand for the browser (Chrome or Edge) version used in real requests.
- robots.txt token
Googlebot- robots.txt
- Obeys
- Verify a real request
- Reverse-resolve the address: the name should end in googlebot.com and resolve forward to the same address. IP address list ↗
Google says most Googlebot requests use the smartphone crawler. It shares its robots.txt token with the desktop crawler, so robots.txt cannot target only one of them.
Official documentation ↗Googlebot DesktopGoogleSearch engine
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/W.X.Y.Z Safari/537.36Placeholders such as "W.X.Y.Z" stand for the browser (Chrome or Edge) version used in real requests.
- robots.txt token
Googlebot- robots.txt
- Obeys
- Verify a real request
- Reverse-resolve the address: the name should end in googlebot.com and resolve forward to the same address. IP address list ↗
Googlebot-ImageGoogleSearch engine
Googlebot-Image/1.0- robots.txt token
Googlebot-ImageGooglebot- robots.txt
- Obeys
- Verify a real request
- Reverse-resolve the address: the name should end in googlebot.com and resolve forward to the same address. IP address list ↗
Used for Google Images and similar features. It has two tokens, and a rule naming either one applies, so Googlebot rules cover it too.
Official documentation ↗Googlebot-VideoGoogleSearch engine
Googlebot-Video/1.0- robots.txt token
Googlebot-VideoGooglebot- robots.txt
- Obeys
- Verify a real request
- Reverse-resolve the address: the name should end in googlebot.com and resolve forward to the same address. IP address list ↗
Googlebot-NewsGoogleSearch engine
No User-Agent of its own; it is only a robots.txt token.
- robots.txt token
Googlebot-NewsGooglebot- robots.txt
- Obeys
There is no separate User-Agent; crawling uses the Googlebot strings. The token affects Google News (news.google.com and the app), not the News tab in Search.
Official documentation ↗Storebot-GoogleGoogleSearch engine
Mozilla/5.0 (X11; Linux x86_64; Storebot-Google/1.0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/W.X.Y.Z Safari/537.36Mozilla/5.0 (Linux; Android 8.0; Pixel 2 Build/OPD3.170816.012; Storebot-Google/1.0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/W.X.Y.Z Mobile Safari/537.36Placeholders such as "W.X.Y.Z" stand for the browser (Chrome or Edge) version used in real requests.
- robots.txt token
Storebot-Google- robots.txt
- Obeys
- Verify a real request
- Reverse-resolve the address: the name should end in googlebot.com and resolve forward to the same address. IP address list ↗
Used for Google Shopping. Googlebot rules do not cover it; name it explicitly.
Official documentation ↗Google-InspectionToolGoogleSearch engine
Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/W.X.Y.Z Mobile Safari/537.36 (compatible; Google-InspectionTool/1.0)Placeholders such as "W.X.Y.Z" stand for the browser (Chrome or Edge) version used in real requests.
- robots.txt token
Google-InspectionToolGooglebot- robots.txt
- Obeys
- Verify a real request
- Reverse-resolve the address: the name should end in googlebot.com and resolve forward to the same address. IP address list ↗
Used by Search Console's URL Inspection and the Rich Results Test; it has no effect on Google Search.
Official documentation ↗BingbotMicrosoftSearch engine
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm) Chrome/W.X.Y.Z Safari/537.36Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/W.X.Y.Z Mobile Safari/537.36 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)Placeholders such as "W.X.Y.Z" stand for the browser (Chrome or Edge) version used in real requests.
- robots.txt token
Bingbot- robots.txt
- Obeys
- Verify a real request
- Reverse-resolve the address: the name should end in search.msn.com and resolve forward to the same address. Bing's Verify Bingbot tool also checks it. IP address list ↗
W.X.Y.Z is replaced by the latest Microsoft Edge version. The UA spells it in lowercase, "bingbot". The official example uses an unusual space or bracket character; it is shown here with the ordinary one.
Official documentation ↗ApplebotAppleSearch engine
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/17.4 Safari/605.1.15 (Applebot/0.1; +http://www.apple.com/go/applebot)Mozilla/5.0 (iPhone; CPU iPhone OS 17_4_1 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/17.4.1 Mobile/15E148 Safari/604.1 (Applebot/0.1; +http://www.apple.com/go/applebot)- robots.txt token
Applebot- robots.txt
- Obeys
- Verify a real request
- Reverse-resolve the address: the name should end in applebot.apple.com and resolve forward to the same address. IP address list ↗
Powers search in Spotlight, Siri and Safari. These are Apple's examples; the browser part is updated from time to time. If robots.txt names Googlebot but not Applebot, Applebot follows the Googlebot rules.
Official documentation ↗DuckDuckBotDuckDuckGoSearch engine
DuckDuckBot/1.1; (+http://duckduckgo.com/duckduckbot.html)- robots.txt token
DuckDuckBot- robots.txt
- Obeys
- Verify a real request
- IP address list ↗
YandexBotYandexSearch engine
Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)- robots.txt token
YandexBotYandex- robots.txt
- Obeys
- Verify a real request
- Reverse-resolve the address: the name should end in yandex.ru, yandex.net or yandex.com and resolve forward to the same address. Yandex publishes no IP list.
"User-agent: YandexBot" applies only to the main crawler; "User-agent: Yandex" applies to all Yandex robots.
Official documentation ↗BaiduspiderBaiduSearch engine
Mozilla/5.0 (Linux;u;Android 4.2.2;zh-cn;) AppleWebKit/534.46 (KHTML,like Gecko) Version/5.1 Mobile Safari/10600.6.3 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)- robots.txt token
Baiduspider- robots.txt
- Obeys
- Verify a real request
- Reverse-resolve the address: the name should end in baidu.com or baidu.jp and resolve forward to the same address.
The official example uses an unusual space or bracket character; it is shown here with the ordinary one.
Official documentation ↗Yahoo! SlurpYahooSearch engine
Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)- robots.txt token
Slurp- robots.txt
- Obeys
Yahoo's crawler, used for parts of Yahoo Search and to collect partner content for Yahoo News, Finance and Sports.
Official documentation ↗GPTBotOpenAIAI training
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; GPTBot/1.4; +https://openai.com/gptbot- robots.txt token
GPTBot- robots.txt
- Obeys
- Verify a real request
- IP address list ↗
A disallow means the content should not be used to train generative AI foundation models. If OAI-SearchBot is also allowed, one crawl may serve both.
Official documentation ↗ClaudeBotAnthropicAI training
The full User-Agent is not officially published.
- robots.txt token
ClaudeBot- robots.txt
- Obeys
- Verify a real request
- IP address list ↗
Collects content that may contribute to model training. Anthropic documents only the robots.txt token, not the full User-Agent. The IP list is shared by all of Anthropic's bots. The older names anthropic-ai and Claude-Web are not in the current documentation.
Official documentation ↗Google-ExtendedGoogleAI training
No User-Agent of its own; it is only a robots.txt token.
- robots.txt token
Google-Extended- robots.txt
- Obeys
It does not crawl. The token controls whether pages Google has crawled may be used to train Gemini and for grounding in Gemini Apps and Vertex AI. Blocking it does not affect inclusion or ranking in Google Search.
Official documentation ↗Applebot-ExtendedAppleAI training
No User-Agent of its own; it is only a robots.txt token.
- robots.txt token
Applebot-Extended- robots.txt
- Obeys
It does not crawl. The token controls whether data Applebot collected may train Apple's generative foundation models. Blocking it does not remove pages from Apple's search results.
Official documentation ↗Meta-ExternalAgentMetaAI training
meta-externalagent/1.1- robots.txt token
meta-externalagent- robots.txt
- Obeys
Meta describes its use as training foundation AI models or improving products by indexing content directly. The official string has a relative path in its bracketed URL, which may change, so only the name and version are shown.
Official documentation ↗AmazonbotAmazonAI training
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1) Chrome/W.X.Y.Z Safari/537.36Placeholders such as "W.X.Y.Z" stand for the browser (Chrome or Edge) version used in real requests.
- robots.txt token
Amazonbot- robots.txt
- Obeys
- Verify a real request
- IP address list ↗
Used to improve Amazon products and services, and may be used to train Amazon AI models. It does not support Crawl-delay.
Official documentation ↗MistralAI-TrainingMistral AIAI training
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; MistralAI-Training/1.0; +https://docs.mistral.ai/robots)- robots.txt token
MistralAI-Training- robots.txt
- Obeys
Builds training datasets for Mistral models; it is not used for search or live answers. No IP list is published.
Official documentation ↗OAI-SearchBotOpenAIAI search
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36; compatible; OAI-SearchBot/1.4; +https://openai.com/searchbotMozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36; compatible; OAI-SearchBot/1.4; robots.txt; +https://openai.com/searchbot- robots.txt token
OAI-SearchBot- robots.txt
- Obeys
- Verify a real request
- IP address list ↗
Sites that opt out are not shown in ChatGPT search answers, though they can still appear as navigational links. Changes take about 24 hours to apply.
Official documentation ↗Claude-SearchBotAnthropicAI search
The full User-Agent is not officially published.
- robots.txt token
Claude-SearchBot- robots.txt
- Obeys
- Verify a real request
- IP address list ↗
Indexes content to improve search results for Claude users; blocking it may reduce visibility there. Anthropic documents only the robots.txt token, not the full User-Agent. The IP list is shared by all of Anthropic's bots.
Official documentation ↗PerplexityBotPerplexityAI search
Mozilla/5.0 (compatible; PerplexityBot/1.0; +https://perplexity.ai/perplexitybot)- robots.txt token
PerplexityBot- robots.txt
- Obeys
- Verify a real request
- IP address list ↗
Surfaces and links sites in Perplexity search results; Perplexity says it is not used to crawl content for AI foundation models.
Official documentation ↗Meta-WebIndexerMetaAI search
meta-webindexer/1.1- robots.txt token
Meta-WebIndexer- robots.txt
- Obeys
Meta says allowing it helps Meta AI cite and link to your content. The official string has a relative path in its bracketed URL, which may change, so only the name and version are shown.
Official documentation ↗Amzn-SearchBotAmazonAI search
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amzn-SearchBot/0.1) Chrome/W.X.Y.Z Safari/537.36Placeholders such as "W.X.Y.Z" stand for the browser (Chrome or Edge) version used in real requests.
- robots.txt token
Amzn-SearchBot- robots.txt
- Obeys
- Verify a real request
- IP address list ↗
Used for search in Amazon products such as Alexa; not used for generative AI training.
Official documentation ↗DuckAssistBotDuckDuckGoAI search
DuckAssistBot/1.2; (+http://duckduckgo.com/duckassistbot.html)- robots.txt token
DuckAssistBot- robots.txt
- Obeys
- Verify a real request
- IP address list ↗
Fetches pages for DuckDuckGo's AI-assisted answers, which cite sources; DuckDuckGo says the data is not used to train AI models. Opting out does not affect organic rankings.
Official documentation ↗MistralAI-IndexMistral AIAI search
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; MistralAI-Index/1.0; +https://docs.mistral.ai/robots)- robots.txt token
MistralAI-Index- robots.txt
- Obeys
- Verify a real request
- IP address list ↗
Indexes pages for Mistral's search; Mistral says it is not used for generative AI training of any kind.
Official documentation ↗YouBotYou.comAI search
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; YouBot/1.0; +https://docs.you.com/youbot; env:prod) Chrome/X.X.X.X Safari/537.36Placeholders such as "W.X.Y.Z" stand for the browser (Chrome or Edge) version used in real requests.
- robots.txt token
YouBot- robots.txt
- Obeys
- Verify a real request
- Reverse-resolve the address: the name should end in search.you.com.
The crawler behind the You.com search engine.
Official documentation ↗YandexAdditionalYandexAI search
No User-Agent of its own; it is only a robots.txt token.
- robots.txt token
YandexAdditionalYandexAdditionalBot- robots.txt
- Obeys
Controls whether pages may be used in Yandex AI answers. It makes no indexing requests itself and applies to pages the main crawler has indexed.
Official documentation ↗ChatGPT-UserOpenAIAI user request
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; ChatGPT-User/1.0; +https://openai.com/bot- robots.txt token
ChatGPT-User- robots.txt
- May not obey
- Verify a real request
- IP address list ↗
Visits pages for user actions in ChatGPT and custom GPTs. Because these actions are initiated by a user, OpenAI says robots.txt rules may not apply.
Official documentation ↗Claude-UserAnthropicAI user request
The full User-Agent is not officially published.
- robots.txt token
Claude-User- robots.txt
- Obeys
- Verify a real request
- IP address list ↗
Fetches pages when users ask Claude questions. Anthropic says its bots honor robots.txt, and disabling Claude-User stops retrieval in response to user queries. Anthropic documents only the robots.txt token, not the full User-Agent. The IP list is shared by all of Anthropic's bots.
Official documentation ↗Claude-AgentAnthropicAI user request
Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko; compatible; Claude-Agent/1.0) Chrome/154.0.0.0 Safari/537.36- robots.txt token
- Not documented
- robots.txt
- Not documented
- Verify a real request
- IP address list ↗
A real browser on Anthropic's infrastructure, driven by a Claude agent on a user's behalf. No robots.txt token is documented; Anthropic leaves allowing or blocking it to the User-Agent and IP address.
Official documentation ↗Perplexity-UserPerplexityAI user request
Mozilla/5.0 (compatible; Perplexity-User/1.0; +https://perplexity.ai/perplexity-user)- robots.txt token
Perplexity-User- robots.txt
- Does not obey
- Verify a real request
- IP address list ↗
Visits pages when users ask Perplexity a question. Since a user requested the fetch, Perplexity says it generally ignores robots.txt rules.
Official documentation ↗Meta-ExternalFetcherMetaAI user request
meta-externalfetcher/1.1- robots.txt token
meta-externalfetcher- robots.txt
- May not obey
Fetches individual links at a user's request and supports agentic AI features. Meta says it may bypass robots.txt rules. The official string has a relative path in its bracketed URL, which may change, so only the name and version are shown.
Official documentation ↗Amzn-UserAmazonAI user request
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amzn-User/0.1) Chrome/W.X.Y.Z Safari/537.36Placeholders such as "W.X.Y.Z" stand for the browser (Chrome or Edge) version used in real requests.
- robots.txt token
Amzn-User- robots.txt
- May not obey
- Verify a real request
- IP address list ↗
Fetches live information for user actions such as Alexa queries; not used for generative AI training. Because a user can initiate it, it may not follow all robots.txt directives.
Official documentation ↗MistralAI-UserMistral AIAI user request
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; MistralAI-User/1.0; +https://docs.mistral.ai/robots)- robots.txt token
MistralAI-User- robots.txt
- Obeys
- Verify a real request
- IP address list ↗
Visits a page when a user asks Mistral's assistant to, and links it as a source. It is not used for automatic crawling or AI training.
Official documentation ↗Google-AgentGoogleAI user request
Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/W.X.Y.Z Mobile Safari/537.36 (compatible; Google-Agent; +https://developers.google.com/crawling/docs/crawlers-fetchers/google-agent)Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko; compatible; Google-Agent; +https://developers.google.com/crawling/docs/crawlers-fetchers/google-agent) Chrome/W.X.Y.Z Safari/537.36Placeholders such as "W.X.Y.Z" stand for the browser (Chrome or Edge) version used in real requests.
- robots.txt token
- Not documented
- robots.txt
- Does not obey
- Verify a real request
- Reverse-resolve the address: the name should end in googleusercontent.com or google.com and resolve forward to the same address. IP address list ↗
Added in March 2026: used by agents on Google's infrastructure that navigate sites on a user's request. As a user-triggered fetcher it generally ignores robots.txt and has no token.
Official documentation ↗Google-GeminiNotebookGoogleAI user request
Mozilla/5.0 (Linux; Android 10; K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/138.0.0.0 Mobile Safari/537.36 (compatible; Google-GeminiNotebook; +https://developers.google.com/crawling/docs/crawlers-fetchers/google-gemininotebook)Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/137.0.0.0 Safari/537.36 (compatible; Google-GeminiNotebook; +https://developers.google.com/crawling/docs/crawlers-fetchers/google-gemininotebook)- robots.txt token
- Not documented
- robots.txt
- Does not obey
- Verify a real request
- Reverse-resolve the address: the name should end in googleusercontent.com or google.com and resolve forward to the same address.
Fetches URLs that users add as sources in Gemini Notebook. Renamed from Google-NotebookLM in July 2026. As a user-triggered fetcher it generally ignores robots.txt.
Official documentation ↗CCBotCommon CrawlPublic dataset
CCBot/2.0 (https://commoncrawl.org/faq/)- robots.txt token
CCBot- robots.txt
- Obeys
- Verify a real request
- Reverse-resolve the address: the name should end in crawl.commoncrawl.org. Common Crawl warns that some crawlers falsely claim to be CCBot. IP address list ↗
Builds a non-profit open dataset. Common Crawl does not call it an AI training crawler, but the data is used in large language model work, so the robots.txt Generator puts it in the training group.
Official documentation ↗AdsBot-GoogleGoogleAds
AdsBot-Google (+http://www.google.com/adsbot.html)- robots.txt token
AdsBot-Google- robots.txt
- Obeys only rules that name it
- Verify a real request
- Reverse-resolve the address: the name should end in google.com (rate-limited-proxy-….google.com) and resolve forward to the same address. IP address list ↗
Checks the quality of Google Ads landing pages. It ignores "User-agent: *", so it must be named to be restricted.
Official documentation ↗AdsBot-Google-MobileGoogleAds
Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/W.X.Y.Z Mobile Safari/537.36 (compatible; AdsBot-Google-Mobile; +http://www.google.com/mobile/adsbot.html)Placeholders such as "W.X.Y.Z" stand for the browser (Chrome or Edge) version used in real requests.
- robots.txt token
AdsBot-Google-Mobile- robots.txt
- Obeys only rules that name it
- Verify a real request
- Reverse-resolve the address: the name should end in google.com (rate-limited-proxy-….google.com) and resolve forward to the same address. IP address list ↗
Mediapartners-GoogleGoogleAds
(Various mobile device types) (compatible; Mediapartners-Google/2.1; +http://www.google.com/bot.html)- robots.txt token
Mediapartners-Google- robots.txt
- Obeys only rules that name it
- Verify a real request
- Reverse-resolve the address: the name should end in google.com (rate-limited-proxy-….google.com) and resolve forward to the same address. IP address list ↗
Visits sites that show AdSense and other Google ads to choose relevant ads. It ignores "User-agent: *", so it must be named to be restricted, which makes the ads less relevant.
Official documentation ↗AdIdxBotMicrosoftAds
Mozilla/5.0 (iPhone; CPU iPhone OS 7_0 like Mac OS X) AppleWebKit/537.51.1 (KHTML, like Gecko) Version/7.0 Mobile/11A465 Safari/9537.53 (compatible; adidxbot/2.0; +http://www.bing.com/bingbot.htm)Mozilla/5.0 (Windows Phone 8.1; ARM; Trident/7.0; Touch; rv:11.0; IEMobile/11.0; NOKIA; Lumia 530) like Gecko (compatible; adidxbot/2.0; +http://www.bing.com/bingbot.htm)- robots.txt token
- Not documented
- robots.txt
- Not documented
- Verify a real request
- Reverse-resolve the address: the name should end in search.msn.com and resolve forward to the same address. Bing's Verify Bingbot tool also checks it. IP address list ↗
Crawls Bing Ads ads and follows them to their websites for quality control.
Official documentation ↗OAI-AdsBotOpenAIAds
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; OAI-AdsBot/1.0; +https://openai.com/adsbot- robots.txt token
- Not documented
- robots.txt
- Not documented
- Verify a real request
- IP address list ↗
Checks only the landing pages submitted as ads on ChatGPT; the data is not used for training.
Official documentation ↗Meta-ExternalAdsMetaAds
meta-externalads/1.1- robots.txt token
meta-externalads- robots.txt
- Obeys
Crawls to improve advertising and other business products and services. The official string has a relative path in its bracketed URL, which may change, so only the name and version are shown.
Official documentation ↗AhrefsBotAhrefsSEO tool
Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/)- robots.txt token
AhrefsBot- robots.txt
- Obeys
- Verify a real request
- Reverse-resolve the address: the name should end in ahrefs.com or ahrefs.net. IP address list ↗
Powers the Ahrefs database and the Yep search engine.
Official documentation ↗AhrefsSiteAuditAhrefsSEO tool
Mozilla/5.0 (Linux; Android 13) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/151.0.7922.173 Mobile Safari/537.36 (compatible; AhrefsSiteAudit/6.1; +http://ahrefs.com/robot/site-audit)- robots.txt token
AhrefsSiteAudit- robots.txt
- Obeys
- Verify a real request
- Reverse-resolve the address: the name should end in ahrefs.com or ahrefs.net. IP address list ↗
Powers Ahrefs Site Audit. Verified owners can let it ignore robots.txt on their own sites.
Official documentation ↗SemrushBotSemrushSEO tool
The full User-Agent is not officially published.
- robots.txt token
SemrushBot- robots.txt
- Obeys
Covers Semrush's backlink data; other Semrush tools use separate tokens such as SiteAuditBot and SemrushBot-BA. Semrush advises against blocking by IP because it uses no consecutive ranges.
Official documentation ↗MJ12botMajesticSEO tool
The full User-Agent is not officially published.
- robots.txt token
MJ12bot- robots.txt
- Obeys
Feeds Majestic's backlink index. It is a distributed crawler with no fixed IP addresses.
Official documentation ↗DotBotMozSEO tool
The full User-Agent is not officially published.
- robots.txt token
dotbot- robots.txt
- Obeys
Gathers data for the Moz Link Index behind Link Explorer. Moz's site-audit crawler is a separate bot, rogerbot.
Official documentation ↗facebookexternalhitMetaLink preview
facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)facebookexternalhit/1.1- robots.txt token
facebookexternalhit- robots.txt
- May not obey
Builds previews of pages shared on Facebook, Instagram or Messenger. Open Graph tags must be within the first 1 MB. It may bypass robots.txt during security or integrity checks.
Official documentation ↗TwitterbotXLink preview
- robots.txt token
Twitterbot- robots.txt
- Obeys
Builds cards for pages shared on X. Blocking a page means no card; blocking an image means no thumbnail. X has removed this documentation, so the details come from an archived copy of the official page.
Official documentation ↗MicrosoftPreviewMicrosoftLink preview
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; MicrosoftPreview/2.0; +https://aka.ms/MicrosoftPreview) Chrome/W.X.Y.Z Safari/537.36Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/W.X.Y.Z Mobile Safari/537.36 (compatible; MicrosoftPreview/2.0; +https://aka.ms/MicrosoftPreview)Placeholders such as "W.X.Y.Z" stand for the browser (Chrome or Edge) version used in real requests.
- robots.txt token
- Not documented
- robots.txt
- Not documented
- Verify a real request
- Reverse-resolve the address: the name should end in search.msn.com and resolve forward to the same address. Bing's Verify Bingbot tool also checks it. IP address list ↗
Generates page snapshots for Microsoft products. The official example uses an unusual space or bracket character; it is shown here with the ordinary one.
Official documentation ↗Slackbot-LinkExpandingSlackLink preview
Slackbot-LinkExpanding 1.0 (+https://api.slack.com/robots)- robots.txt token
- Not documented
- robots.txt
- Does not obey
Unfurls links posted in Slack. Slack does not honor robots.txt; ask Slack to stop fetching your site instead.
Official documentation ↗DiscordbotDiscordLink preview
- robots.txt token
- Not documented
- robots.txt
- Not documented
- Verify a real request
- IP address list ↗
Fetches only when a link is shared, with no continuous crawling. Discord says to match "Discordbot" anywhere in the string, because other parts may change.
Official documentation ↗WhatsAppMetaLink preview
- robots.txt token
- Not documented
- robots.txt
- Not documented
Fetches the page on the sender's behalf; Open Graph tags must be in the <head> within the first 300 KB. The trailing A, I or N means Android, iOS or web.
Official documentation ↗GoogleOther-ImageGoogleOther
GoogleOther-Image/1.0- robots.txt token
GoogleOther-ImageGoogleOther- robots.txt
- Obeys
- Verify a real request
- Reverse-resolve the address: the name should end in googlebot.com and resolve forward to the same address. IP address list ↗
GoogleOther-VideoGoogleOther
GoogleOther-Video/1.0- robots.txt token
GoogleOther-VideoGoogleOther- robots.txt
- Obeys
- Verify a real request
- Reverse-resolve the address: the name should end in googlebot.com and resolve forward to the same address. IP address list ↗
GoogleOtherGoogleOther
Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/W.X.Y.Z Mobile Safari/537.36 (compatible; GoogleOther)Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; GoogleOther) Chrome/W.X.Y.Z Safari/537.36Placeholders such as "W.X.Y.Z" stand for the browser (Chrome or Edge) version used in real requests.
- robots.txt token
GoogleOther- robots.txt
- Obeys
- Verify a real request
- Reverse-resolve the address: the name should end in googlebot.com and resolve forward to the same address. IP address list ↗
A generic crawler that Google product teams use, for example for internal research and development. It does not affect any specific product.
Official documentation ↗Google-CloudVertexBotGoogleOther
- robots.txt token
Google-CloudVertexBotGooglebot- robots.txt
- Obeys
- Verify a real request
- Reverse-resolve the address: the name should end in googlebot.com and resolve forward to the same address. IP address list ↗
Crawls at a site owner's request to build Vertex AI Agents. It has no effect on Google Search.
Official documentation ↗Google-SafetyGoogleOther
Google-Safety- robots.txt token
- Not documented
- robots.txt
- Does not obey
- Verify a real request
- Reverse-resolve the address: the name should end in google.com (rate-limited-proxy-….google.com) and resolve forward to the same address. IP address list ↗
Abuse-specific crawling, such as malware discovery for links posted on Google properties. It ignores robots.txt.
Official documentation ↗SlackbotSlackOther
Slackbot 1.0 (+https://api.slack.com/robots)- robots.txt token
- Not documented
- robots.txt
- Does not obey
Used for any Slack request not covered by its other robots, such as API calls for integrations. Slack does not honor robots.txt.
Official documentation ↗BytespiderByteDanceOther
The full User-Agent is not officially published.
- robots.txt token
Bytespider- robots.txt
- Not documented
No official ByteDance documentation was found, so neither the string nor the purpose is given. The robots.txt Generator puts it in the training group, following common practice.
A reference list of the User-Agent strings that current browsers send, and of the crawlers that visit websites: search engines, AI companies, SEO tools and link previews. For each crawler it gives the robots.txt token, whether it obeys robots.txt and how to verify that a request really comes from it, taken from the operator's own documentation.
User-Agent List: Features
How to use the list
Type part of a name, company or string into the search box to filter the list, or use the buttons to show one kind at a time. Copy puts a string on the clipboard, and Parse opens it in the User-Agent Parser so you can see how it is identified. It is meant for the two everyday jobs: choosing a string to test a site with, and working out what an unfamiliar entry in an access log is.
Browser strings are partly frozen
Current browsers send fixed values in place of some real ones, to reduce fingerprinting. Chrome and Edge report only their major version, with the rest of the number set to zero, and on Android they report every device as "Android 10; K", so the model cannot be read from the string. On macOS, Chrome, Edge and Safari say 10_15_7 and Firefox says 10.15 whatever the real version, and Apple silicon Macs still say Intel. Windows 11 reports Windows NT 10.0. Since iOS 26, Safari reports the iOS version as a fixed 18.x value and carries the real version in the Version token instead.
Kinds of crawler and robots.txt
Search engine crawlers collect pages for search results. AI crawlers come in three kinds: training crawlers such as GPTBot, ClaudeBot and Amazonbot; AI search indexers such as OAI-SearchBot, Claude-SearchBot and PerplexityBot; and fetchers that retrieve a page when a user asks an assistant to, such as ChatGPT-User, Claude-User and Perplexity-User. Common Crawl's CCBot builds a public dataset that is also used in AI research, so it is often treated like a training crawler. To block one, put its robots.txt token in a User-agent line. Some, such as Google-Extended and Applebot-Extended, have no User-Agent of their own and exist only as robots.txt tokens. The robots.txt Generator builds the rules for you.
Verifying a real crawler
Anyone can send any User-Agent, so a request claiming to be Googlebot may not be. Google, Bing, OpenAI and others publish a way to check: a reverse DNS lookup of the requesting address, a list of the IP ranges their crawlers use, or both. Each entry shows the method its operator documents. A request that fails the check will not be stopped by robots.txt; block it at the server or firewall.
When the list was checked
The browser versions and crawler details were checked against official sources on November 6, 2026. Browsers raise their major version every few weeks, and crawlers are added and renamed, so confirm anything important through each entry's link to the official documentation.
User-Agent List: FAQ
What is the iPhone User-Agent?
Safari on iPhone sends a string of the form Mozilla/5.0 (iPhone; CPU iPhone OS 18_7 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/27.0 Mobile/15E148 Safari/604.1. Since iOS 26 the OS part is a fixed 18.x value, so read the real iOS version from the number after Version/. Chrome on iPhone includes CriOS/, Firefox includes FxiOS/ and Edge includes EdgiOS/.
Why does Chrome on Android not show the device model?
Chrome's User-Agent reduction fixes the Android version and model at "Android 10; K", so a Pixel on Android 14 and a Galaxy on Android 16 send the same string. Sites that need the model or version must request User-Agent Client Hints such as Sec-CH-UA-Model and Sec-CH-UA-Platform-Version.
Is the Windows 11 string different from Windows 10?
No. Windows 11 also reports Windows NT 10.0, so the string cannot tell them apart. In Chrome and Edge, the Sec-CH-UA-Platform-Version client hint can.
What is the Googlebot User-Agent?
Googlebot has a smartphone crawler and a desktop crawler, and both include Googlebot/2.1. The smartphone one presents itself as Chrome on an Android device; Google's documentation writes the Chrome version as W.X.Y.Z, and real requests carry the version of Chrome that Googlebot currently uses. There are also purpose-specific names such as Googlebot-Image.
What is the Google-Extended User-Agent?
There is none. Google-Extended does not crawl; it is a robots.txt token that controls whether pages Google has crawled may be used to train Gemini models and for grounding in Gemini Apps and Vertex AI. Google states that blocking it does not affect a site's inclusion or ranking in Google Search. Applebot-Extended works the same way for Apple.
How do I block all AI crawlers at once?
The Block AI training and Block AI search too presets in the robots.txt Generator produce rules for the main AI crawlers in this list. Fetchers acting on a user's request may not apply robots.txt, and some, such as Google-Agent and Claude-Agent, have no robots.txt token at all, so to be certain, block them at the server or CDN by User-Agent or address range.
How can I view my site with a different User-Agent?
In Chrome, open DevTools and set a custom User agent in the Network conditions panel. On the command line, pass the string to curl with -A. The Copy button in this list gives you the exact string to use.
How do I identify a string that is not listed?
Paste it into the User-Agent Parser, which identifies the browser, operating system, device and whether it is a bot. Names containing bot, crawler or spider are detected even when they are not in this list.
How to Use User-Agent List
-
Find a string
Type part of a name, company or string, or use the buttons to show browsers, AI crawlers and so on.
-
Copy or parse it
Copy puts the string on the clipboard; Parse opens it in the User-Agent Parser to see how it is identified.
-
Use the token in robots.txt
To block a crawler, write its robots.txt token in a User-agent line, or use the presets in the robots.txt Generator.
Category Network