Skip to main content

User-Agent List

The User-Agent strings Chrome, Edge, Firefox and Safari send today, and those of Googlebot, GPTBot, ClaudeBot and other crawlers, with their robots.txt tokens.

User-Agent List
79 results

Checked on November 6, 2026. Crawler details come from each operator's own documentation.

Browsers
ChromeWindows
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/157.0.0.0 Safari/537.36
Parse

Windows 11 also sends "Windows NT 10.0". Only the major version changes; the rest of the number is fixed at 0.

ChromemacOS
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/157.0.0.0 Safari/537.36
Parse

The macOS version is fixed at 10_15_7, and Apple silicon Macs also say Intel.

ChromeLinux
Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/157.0.0.0 Safari/537.36
Parse
ChromeChromeOS
Mozilla/5.0 (X11; CrOS x86_64 14541.0.0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/157.0.0.0 Safari/537.36
Parse

The ChromeOS version is fixed at 14541.0.0.

ChromeAndroid (phone)
Mozilla/5.0 (Linux; Android 10; K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/157.0.0.0 Mobile Safari/537.36
Parse

The Android version and device model are fixed at "Android 10; K".

ChromeAndroid (tablet)
Mozilla/5.0 (Linux; Android 10; K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/157.0.0.0 Safari/537.36
Parse

The only difference from a phone is the missing "Mobile" token.

Microsoft EdgeWindows
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/157.0.0.0 Safari/537.36 Edg/157.0.0.0
Parse

The Chrome string with "Edg/" appended (not the "Edge/" of legacy Edge).

Microsoft EdgemacOS
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/157.0.0.0 Safari/537.36 Edg/157.0.0.0
Parse
Microsoft EdgeAndroid
Mozilla/5.0 (Linux; Android 10; K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/157.0.0.0 Mobile Safari/537.36 EdgA/157.0.0.0
Parse

The Android app says "EdgA/" and the iPhone and iPad app says "EdgiOS/".

FirefoxWindows
Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:159.0) Gecko/20100101 Firefox/159.0
Parse

On desktop, "Gecko/20100101" is a fixed string.

FirefoxmacOS
Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:159.0) Gecko/20100101 Firefox/159.0
Parse

macOS 11 and later are reported as "10.15", and Apple silicon Macs as Intel.

FirefoxLinux
Mozilla/5.0 (X11; Linux x86_64; rv:159.0) Gecko/20100101 Firefox/159.0
Parse
FirefoxAndroid
Mozilla/5.0 (Android 16; Mobile; rv:159.0) Gecko/159.0 Firefox/159.0
Parse

Unlike Chrome, it sends the real Android version (16 in this example). There is no device model.

SafarimacOS
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/27.0 Safari/605.1.15
Parse

The number after "Version/" is the Safari version. The macOS version is fixed at 10_15_7.

SafariiPhone
Mozilla/5.0 (iPhone; CPU iPhone OS 18_7 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/27.0 Mobile/15E148 Safari/604.1
Parse

Since iOS 26, Safari reports the iOS version as a fixed 18.x value. The real iOS version matches the number after "Version/".

SafariiPad (default setting)
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/27.0 Safari/605.1.15
Parse

Safari on iPad sends the same string as a Mac by default, so the string alone cannot tell them apart.

Crawlers and bots
Googlebot SmartphoneGoogleSearch engine
Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/W.X.Y.Z Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
Parse

Placeholders such as "W.X.Y.Z" stand for the browser (Chrome or Edge) version used in real requests.

robots.txt token
Googlebot
robots.txt
Obeys
Verify a real request
Reverse-resolve the address: the name should end in googlebot.com and resolve forward to the same address. IP address list ↗

Google says most Googlebot requests use the smartphone crawler. It shares its robots.txt token with the desktop crawler, so robots.txt cannot target only one of them.

Official documentation ↗
Googlebot DesktopGoogleSearch engine
DesktopMozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/W.X.Y.Z Safari/537.36
Parse
Desktop (used rarely)Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
Parse
Desktop (used rarely)Googlebot/2.1 (+http://www.google.com/bot.html)
Parse

Placeholders such as "W.X.Y.Z" stand for the browser (Chrome or Edge) version used in real requests.

robots.txt token
Googlebot
robots.txt
Obeys
Verify a real request
Reverse-resolve the address: the name should end in googlebot.com and resolve forward to the same address. IP address list ↗
Official documentation ↗
Googlebot-ImageGoogleSearch engine
Googlebot-Image/1.0
Parse
robots.txt token
Googlebot-ImageGooglebot
robots.txt
Obeys
Verify a real request
Reverse-resolve the address: the name should end in googlebot.com and resolve forward to the same address. IP address list ↗

Used for Google Images and similar features. It has two tokens, and a rule naming either one applies, so Googlebot rules cover it too.

Official documentation ↗
Googlebot-VideoGoogleSearch engine
Googlebot-Video/1.0
Parse
robots.txt token
Googlebot-VideoGooglebot
robots.txt
Obeys
Verify a real request
Reverse-resolve the address: the name should end in googlebot.com and resolve forward to the same address. IP address list ↗
Official documentation ↗
Googlebot-NewsGoogleSearch engine

No User-Agent of its own; it is only a robots.txt token.

robots.txt token
Googlebot-NewsGooglebot
robots.txt
Obeys

There is no separate User-Agent; crawling uses the Googlebot strings. The token affects Google News (news.google.com and the app), not the News tab in Search.

Official documentation ↗
Storebot-GoogleGoogleSearch engine
DesktopMozilla/5.0 (X11; Linux x86_64; Storebot-Google/1.0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/W.X.Y.Z Safari/537.36
Parse
SmartphoneMozilla/5.0 (Linux; Android 8.0; Pixel 2 Build/OPD3.170816.012; Storebot-Google/1.0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/W.X.Y.Z Mobile Safari/537.36
Parse

Placeholders such as "W.X.Y.Z" stand for the browser (Chrome or Edge) version used in real requests.

robots.txt token
Storebot-Google
robots.txt
Obeys
Verify a real request
Reverse-resolve the address: the name should end in googlebot.com and resolve forward to the same address. IP address list ↗

Used for Google Shopping. Googlebot rules do not cover it; name it explicitly.

Official documentation ↗
Google-InspectionToolGoogleSearch engine
DesktopMozilla/5.0 (compatible; Google-InspectionTool/1.0)
Parse
SmartphoneMozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/W.X.Y.Z Mobile Safari/537.36 (compatible; Google-InspectionTool/1.0)
Parse

Placeholders such as "W.X.Y.Z" stand for the browser (Chrome or Edge) version used in real requests.

robots.txt token
Google-InspectionToolGooglebot
robots.txt
Obeys
Verify a real request
Reverse-resolve the address: the name should end in googlebot.com and resolve forward to the same address. IP address list ↗

Used by Search Console's URL Inspection and the Rich Results Test; it has no effect on Google Search.

Official documentation ↗
BingbotMicrosoftSearch engine
DesktopMozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm) Chrome/W.X.Y.Z Safari/537.36
Parse
Desktop (short form)Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)
Parse
SmartphoneMozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/W.X.Y.Z Mobile Safari/537.36 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)
Parse

Placeholders such as "W.X.Y.Z" stand for the browser (Chrome or Edge) version used in real requests.

robots.txt token
Bingbot
robots.txt
Obeys
Verify a real request
Reverse-resolve the address: the name should end in search.msn.com and resolve forward to the same address. Bing's Verify Bingbot tool also checks it. IP address list ↗

W.X.Y.Z is replaced by the latest Microsoft Edge version. The UA spells it in lowercase, "bingbot". The official example uses an unusual space or bracket character; it is shown here with the ordinary one.

Official documentation ↗
ApplebotAppleSearch engine
DesktopMozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/17.4 Safari/605.1.15 (Applebot/0.1; +http://www.apple.com/go/applebot)
Parse
SmartphoneMozilla/5.0 (iPhone; CPU iPhone OS 17_4_1 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/17.4.1 Mobile/15E148 Safari/604.1 (Applebot/0.1; +http://www.apple.com/go/applebot)
Parse
robots.txt token
Applebot
robots.txt
Obeys
Verify a real request
Reverse-resolve the address: the name should end in applebot.apple.com and resolve forward to the same address. IP address list ↗

Powers search in Spotlight, Siri and Safari. These are Apple's examples; the browser part is updated from time to time. If robots.txt names Googlebot but not Applebot, Applebot follows the Googlebot rules.

Official documentation ↗
DuckDuckBotDuckDuckGoSearch engine
DuckDuckBot/1.1; (+http://duckduckgo.com/duckduckbot.html)
Parse
robots.txt token
DuckDuckBot
robots.txt
Obeys
Verify a real request
IP address list ↗
Official documentation ↗
YandexBotYandexSearch engine
Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)
Parse
robots.txt token
YandexBotYandex
robots.txt
Obeys
Verify a real request
Reverse-resolve the address: the name should end in yandex.ru, yandex.net or yandex.com and resolve forward to the same address. Yandex publishes no IP list.

"User-agent: YandexBot" applies only to the main crawler; "User-agent: Yandex" applies to all Yandex robots.

Official documentation ↗
BaiduspiderBaiduSearch engine
DesktopMozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)
Parse
SmartphoneMozilla/5.0 (Linux;u;Android 4.2.2;zh-cn;) AppleWebKit/534.46 (KHTML,like Gecko) Version/5.1 Mobile Safari/10600.6.3 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)
Parse
robots.txt token
Baiduspider
robots.txt
Obeys
Verify a real request
Reverse-resolve the address: the name should end in baidu.com or baidu.jp and resolve forward to the same address.

The official example uses an unusual space or bracket character; it is shown here with the ordinary one.

Official documentation ↗
Yahoo! SlurpYahooSearch engine
Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)
Parse
robots.txt token
Slurp
robots.txt
Obeys

Yahoo's crawler, used for parts of Yahoo Search and to collect partner content for Yahoo News, Finance and Sports.

Official documentation ↗
GPTBotOpenAIAI training
Example (the version may change)Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; GPTBot/1.4; +https://openai.com/gptbot
Parse
robots.txt token
GPTBot
robots.txt
Obeys
Verify a real request
IP address list ↗

A disallow means the content should not be used to train generative AI foundation models. If OAI-SearchBot is also allowed, one crawl may serve both.

Official documentation ↗
ClaudeBotAnthropicAI training

The full User-Agent is not officially published.

robots.txt token
ClaudeBot
robots.txt
Obeys
Verify a real request
IP address list ↗

Collects content that may contribute to model training. Anthropic documents only the robots.txt token, not the full User-Agent. The IP list is shared by all of Anthropic's bots. The older names anthropic-ai and Claude-Web are not in the current documentation.

Official documentation ↗
Google-ExtendedGoogleAI training

No User-Agent of its own; it is only a robots.txt token.

robots.txt token
Google-Extended
robots.txt
Obeys

It does not crawl. The token controls whether pages Google has crawled may be used to train Gemini and for grounding in Gemini Apps and Vertex AI. Blocking it does not affect inclusion or ranking in Google Search.

Official documentation ↗
Applebot-ExtendedAppleAI training

No User-Agent of its own; it is only a robots.txt token.

robots.txt token
Applebot-Extended
robots.txt
Obeys

It does not crawl. The token controls whether data Applebot collected may train Apple's generative foundation models. Blocking it does not remove pages from Apple's search results.

Official documentation ↗
Meta-ExternalAgentMetaAI training
meta-externalagent/1.1
Parse
robots.txt token
meta-externalagent
robots.txt
Obeys

Meta describes its use as training foundation AI models or improving products by indexing content directly. The official string has a relative path in its bracketed URL, which may change, so only the name and version are shown.

Official documentation ↗
AmazonbotAmazonAI training
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1) Chrome/W.X.Y.Z Safari/537.36
Parse

Placeholders such as "W.X.Y.Z" stand for the browser (Chrome or Edge) version used in real requests.

robots.txt token
Amazonbot
robots.txt
Obeys
Verify a real request
IP address list ↗

Used to improve Amazon products and services, and may be used to train Amazon AI models. It does not support Crawl-delay.

Official documentation ↗
MistralAI-TrainingMistral AIAI training
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; MistralAI-Training/1.0; +https://docs.mistral.ai/robots)
Parse
robots.txt token
MistralAI-Training
robots.txt
Obeys

Builds training datasets for Mistral models; it is not used for search or live answers. No IP list is published.

Official documentation ↗
OAI-SearchBotOpenAIAI search
Example (the version may change)Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36; compatible; OAI-SearchBot/1.4; +https://openai.com/searchbot
Parse
When fetching robots.txtMozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36; compatible; OAI-SearchBot/1.4; robots.txt; +https://openai.com/searchbot
Parse
robots.txt token
OAI-SearchBot
robots.txt
Obeys
Verify a real request
IP address list ↗

Sites that opt out are not shown in ChatGPT search answers, though they can still appear as navigational links. Changes take about 24 hours to apply.

Official documentation ↗
Claude-SearchBotAnthropicAI search

The full User-Agent is not officially published.

robots.txt token
Claude-SearchBot
robots.txt
Obeys
Verify a real request
IP address list ↗

Indexes content to improve search results for Claude users; blocking it may reduce visibility there. Anthropic documents only the robots.txt token, not the full User-Agent. The IP list is shared by all of Anthropic's bots.

Official documentation ↗
PerplexityBotPerplexityAI search
Example (the version may change)Mozilla/5.0 (compatible; PerplexityBot/1.0; +https://perplexity.ai/perplexitybot)
Parse
robots.txt token
PerplexityBot
robots.txt
Obeys
Verify a real request
IP address list ↗

Surfaces and links sites in Perplexity search results; Perplexity says it is not used to crawl content for AI foundation models.

Official documentation ↗
Meta-WebIndexerMetaAI search
meta-webindexer/1.1
Parse
robots.txt token
Meta-WebIndexer
robots.txt
Obeys

Meta says allowing it helps Meta AI cite and link to your content. The official string has a relative path in its bracketed URL, which may change, so only the name and version are shown.

Official documentation ↗
Amzn-SearchBotAmazonAI search
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amzn-SearchBot/0.1) Chrome/W.X.Y.Z Safari/537.36
Parse

Placeholders such as "W.X.Y.Z" stand for the browser (Chrome or Edge) version used in real requests.

robots.txt token
Amzn-SearchBot
robots.txt
Obeys
Verify a real request
IP address list ↗

Used for search in Amazon products such as Alexa; not used for generative AI training.

Official documentation ↗
DuckAssistBotDuckDuckGoAI search
DuckAssistBot/1.2; (+http://duckduckgo.com/duckassistbot.html)
Parse
robots.txt token
DuckAssistBot
robots.txt
Obeys
Verify a real request
IP address list ↗

Fetches pages for DuckDuckGo's AI-assisted answers, which cite sources; DuckDuckGo says the data is not used to train AI models. Opting out does not affect organic rankings.

Official documentation ↗
MistralAI-IndexMistral AIAI search
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; MistralAI-Index/1.0; +https://docs.mistral.ai/robots)
Parse
robots.txt token
MistralAI-Index
robots.txt
Obeys
Verify a real request
IP address list ↗

Indexes pages for Mistral's search; Mistral says it is not used for generative AI training of any kind.

Official documentation ↗
YouBotYou.comAI search
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; YouBot/1.0; +https://docs.you.com/youbot; env:prod) Chrome/X.X.X.X Safari/537.36
Parse

Placeholders such as "W.X.Y.Z" stand for the browser (Chrome or Edge) version used in real requests.

robots.txt token
YouBot
robots.txt
Obeys
Verify a real request
Reverse-resolve the address: the name should end in search.you.com.

The crawler behind the You.com search engine.

Official documentation ↗
YandexAdditionalYandexAI search

No User-Agent of its own; it is only a robots.txt token.

robots.txt token
YandexAdditionalYandexAdditionalBot
robots.txt
Obeys

Controls whether pages may be used in Yandex AI answers. It makes no indexing requests itself and applies to pages the main crawler has indexed.

Official documentation ↗
ChatGPT-UserOpenAIAI user request
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; ChatGPT-User/1.0; +https://openai.com/bot
Parse
robots.txt token
ChatGPT-User
robots.txt
May not obey
Verify a real request
IP address list ↗

Visits pages for user actions in ChatGPT and custom GPTs. Because these actions are initiated by a user, OpenAI says robots.txt rules may not apply.

Official documentation ↗
Claude-UserAnthropicAI user request

The full User-Agent is not officially published.

robots.txt token
Claude-User
robots.txt
Obeys
Verify a real request
IP address list ↗

Fetches pages when users ask Claude questions. Anthropic says its bots honor robots.txt, and disabling Claude-User stops retrieval in response to user queries. Anthropic documents only the robots.txt token, not the full User-Agent. The IP list is shared by all of Anthropic's bots.

Official documentation ↗
Claude-AgentAnthropicAI user request
Example (the version may change)Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko; compatible; Claude-Agent/1.0) Chrome/154.0.0.0 Safari/537.36
Parse
robots.txt token
Not documented
robots.txt
Not documented
Verify a real request
IP address list ↗

A real browser on Anthropic's infrastructure, driven by a Claude agent on a user's behalf. No robots.txt token is documented; Anthropic leaves allowing or blocking it to the User-Agent and IP address.

Official documentation ↗
Perplexity-UserPerplexityAI user request
Example (the version may change)Mozilla/5.0 (compatible; Perplexity-User/1.0; +https://perplexity.ai/perplexity-user)
Parse
robots.txt token
Perplexity-User
robots.txt
Does not obey
Verify a real request
IP address list ↗

Visits pages when users ask Perplexity a question. Since a user requested the fetch, Perplexity says it generally ignores robots.txt rules.

Official documentation ↗
Meta-ExternalFetcherMetaAI user request
meta-externalfetcher/1.1
Parse
robots.txt token
meta-externalfetcher
robots.txt
May not obey

Fetches individual links at a user's request and supports agentic AI features. Meta says it may bypass robots.txt rules. The official string has a relative path in its bracketed URL, which may change, so only the name and version are shown.

Official documentation ↗
Amzn-UserAmazonAI user request
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amzn-User/0.1) Chrome/W.X.Y.Z Safari/537.36
Parse

Placeholders such as "W.X.Y.Z" stand for the browser (Chrome or Edge) version used in real requests.

robots.txt token
Amzn-User
robots.txt
May not obey
Verify a real request
IP address list ↗

Fetches live information for user actions such as Alexa queries; not used for generative AI training. Because a user can initiate it, it may not follow all robots.txt directives.

Official documentation ↗
MistralAI-UserMistral AIAI user request
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; MistralAI-User/1.0; +https://docs.mistral.ai/robots)
Parse
robots.txt token
MistralAI-User
robots.txt
Obeys
Verify a real request
IP address list ↗

Visits a page when a user asks Mistral's assistant to, and links it as a source. It is not used for automatic crawling or AI training.

Official documentation ↗
Google-AgentGoogleAI user request
SmartphoneMozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/W.X.Y.Z Mobile Safari/537.36 (compatible; Google-Agent; +https://developers.google.com/crawling/docs/crawlers-fetchers/google-agent)
Parse
DesktopMozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko; compatible; Google-Agent; +https://developers.google.com/crawling/docs/crawlers-fetchers/google-agent) Chrome/W.X.Y.Z Safari/537.36
Parse

Placeholders such as "W.X.Y.Z" stand for the browser (Chrome or Edge) version used in real requests.

robots.txt token
Not documented
robots.txt
Does not obey
Verify a real request
Reverse-resolve the address: the name should end in googleusercontent.com or google.com and resolve forward to the same address. IP address list ↗

Added in March 2026: used by agents on Google's infrastructure that navigate sites on a user's request. As a user-triggered fetcher it generally ignores robots.txt and has no token.

Official documentation ↗
Google-GeminiNotebookGoogleAI user request
SmartphoneMozilla/5.0 (Linux; Android 10; K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/138.0.0.0 Mobile Safari/537.36 (compatible; Google-GeminiNotebook; +https://developers.google.com/crawling/docs/crawlers-fetchers/google-gemininotebook)
Parse
DesktopMozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/137.0.0.0 Safari/537.36 (compatible; Google-GeminiNotebook; +https://developers.google.com/crawling/docs/crawlers-fetchers/google-gemininotebook)
Parse
robots.txt token
Not documented
robots.txt
Does not obey
Verify a real request
Reverse-resolve the address: the name should end in googleusercontent.com or google.com and resolve forward to the same address.

Fetches URLs that users add as sources in Gemini Notebook. Renamed from Google-NotebookLM in July 2026. As a user-triggered fetcher it generally ignores robots.txt.

Official documentation ↗
CCBotCommon CrawlPublic dataset
CCBot/2.0 (https://commoncrawl.org/faq/)
Parse
robots.txt token
CCBot
robots.txt
Obeys
Verify a real request
Reverse-resolve the address: the name should end in crawl.commoncrawl.org. Common Crawl warns that some crawlers falsely claim to be CCBot. IP address list ↗

Builds a non-profit open dataset. Common Crawl does not call it an AI training crawler, but the data is used in large language model work, so the robots.txt Generator puts it in the training group.

Official documentation ↗
AdsBot-GoogleGoogleAds
AdsBot-Google (+http://www.google.com/adsbot.html)
Parse
robots.txt token
AdsBot-Google
robots.txt
Obeys only rules that name it
Verify a real request
Reverse-resolve the address: the name should end in google.com (rate-limited-proxy-….google.com) and resolve forward to the same address. IP address list ↗

Checks the quality of Google Ads landing pages. It ignores "User-agent: *", so it must be named to be restricted.

Official documentation ↗
AdsBot-Google-MobileGoogleAds
Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/W.X.Y.Z Mobile Safari/537.36 (compatible; AdsBot-Google-Mobile; +http://www.google.com/mobile/adsbot.html)
Parse

Placeholders such as "W.X.Y.Z" stand for the browser (Chrome or Edge) version used in real requests.

robots.txt token
AdsBot-Google-Mobile
robots.txt
Obeys only rules that name it
Verify a real request
Reverse-resolve the address: the name should end in google.com (rate-limited-proxy-….google.com) and resolve forward to the same address. IP address list ↗
Official documentation ↗
Mediapartners-GoogleGoogleAds
DesktopMediapartners-Google
Parse
Smartphone (the start varies by device)(Various mobile device types) (compatible; Mediapartners-Google/2.1; +http://www.google.com/bot.html)
Parse
robots.txt token
Mediapartners-Google
robots.txt
Obeys only rules that name it
Verify a real request
Reverse-resolve the address: the name should end in google.com (rate-limited-proxy-….google.com) and resolve forward to the same address. IP address list ↗

Visits sites that show AdSense and other Google ads to choose relevant ads. It ignores "User-agent: *", so it must be named to be restricted, which makes the ads less relevant.

Official documentation ↗
AdIdxBotMicrosoftAds
DesktopMozilla/5.0 (compatible; adidxbot/2.0; +http://www.bing.com/bingbot.htm)
Parse
iPhoneMozilla/5.0 (iPhone; CPU iPhone OS 7_0 like Mac OS X) AppleWebKit/537.51.1 (KHTML, like Gecko) Version/7.0 Mobile/11A465 Safari/9537.53 (compatible; adidxbot/2.0; +http://www.bing.com/bingbot.htm)
Parse
Windows PhoneMozilla/5.0 (Windows Phone 8.1; ARM; Trident/7.0; Touch; rv:11.0; IEMobile/11.0; NOKIA; Lumia 530) like Gecko (compatible; adidxbot/2.0; +http://www.bing.com/bingbot.htm)
Parse
robots.txt token
Not documented
robots.txt
Not documented
Verify a real request
Reverse-resolve the address: the name should end in search.msn.com and resolve forward to the same address. Bing's Verify Bingbot tool also checks it. IP address list ↗

Crawls Bing Ads ads and follows them to their websites for quality control.

Official documentation ↗
OAI-AdsBotOpenAIAds
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; OAI-AdsBot/1.0; +https://openai.com/adsbot
Parse
robots.txt token
Not documented
robots.txt
Not documented
Verify a real request
IP address list ↗

Checks only the landing pages submitted as ads on ChatGPT; the data is not used for training.

Official documentation ↗
Meta-ExternalAdsMetaAds
meta-externalads/1.1
Parse
robots.txt token
meta-externalads
robots.txt
Obeys

Crawls to improve advertising and other business products and services. The official string has a relative path in its bracketed URL, which may change, so only the name and version are shown.

Official documentation ↗
AhrefsBotAhrefsSEO tool
Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/)
Parse
robots.txt token
AhrefsBot
robots.txt
Obeys
Verify a real request
Reverse-resolve the address: the name should end in ahrefs.com or ahrefs.net. IP address list ↗

Powers the Ahrefs database and the Yep search engine.

Official documentation ↗
AhrefsSiteAuditAhrefsSEO tool
DesktopMozilla/5.0 (compatible; AhrefsSiteAudit/6.1; +http://ahrefs.com/robot/site-audit)
Parse
Smartphone (the Chrome version changes)Mozilla/5.0 (Linux; Android 13) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/151.0.7922.173 Mobile Safari/537.36 (compatible; AhrefsSiteAudit/6.1; +http://ahrefs.com/robot/site-audit)
Parse
robots.txt token
AhrefsSiteAudit
robots.txt
Obeys
Verify a real request
Reverse-resolve the address: the name should end in ahrefs.com or ahrefs.net. IP address list ↗

Powers Ahrefs Site Audit. Verified owners can let it ignore robots.txt on their own sites.

Official documentation ↗
SemrushBotSemrushSEO tool

The full User-Agent is not officially published.

robots.txt token
SemrushBot
robots.txt
Obeys

Covers Semrush's backlink data; other Semrush tools use separate tokens such as SiteAuditBot and SemrushBot-BA. Semrush advises against blocking by IP because it uses no consecutive ranges.

Official documentation ↗
MJ12botMajesticSEO tool

The full User-Agent is not officially published.

robots.txt token
MJ12bot
robots.txt
Obeys

Feeds Majestic's backlink index. It is a distributed crawler with no fixed IP addresses.

Official documentation ↗
DotBotMozSEO tool

The full User-Agent is not officially published.

robots.txt token
dotbot
robots.txt
Obeys

Gathers data for the Moz Link Index behind Link Explorer. Moz's site-audit crawler is a separate bot, rogerbot.

Official documentation ↗
facebookexternalhitMetaLink preview
facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)
Parse
facebookexternalhit/1.1
Parse
robots.txt token
facebookexternalhit
robots.txt
May not obey

Builds previews of pages shared on Facebook, Instagram or Messenger. Open Graph tags must be within the first 1 MB. It may bypass robots.txt during security or integrity checks.

Official documentation ↗
TwitterbotXLink preview
Name and version (part of the UA)Twitterbot/1.0
Parse
robots.txt token
Twitterbot
robots.txt
Obeys

Builds cards for pages shared on X. Blocking a page means no card; blocking an image means no thumbnail. X has removed this documentation, so the details come from an archived copy of the official page.

Official documentation ↗
MicrosoftPreviewMicrosoftLink preview
DesktopMozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; MicrosoftPreview/2.0; +https://aka.ms/MicrosoftPreview) Chrome/W.X.Y.Z Safari/537.36
Parse
SmartphoneMozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/W.X.Y.Z Mobile Safari/537.36 (compatible; MicrosoftPreview/2.0; +https://aka.ms/MicrosoftPreview)
Parse

Placeholders such as "W.X.Y.Z" stand for the browser (Chrome or Edge) version used in real requests.

robots.txt token
Not documented
robots.txt
Not documented
Verify a real request
Reverse-resolve the address: the name should end in search.msn.com and resolve forward to the same address. Bing's Verify Bingbot tool also checks it. IP address list ↗

Generates page snapshots for Microsoft products. The official example uses an unusual space or bracket character; it is shown here with the ordinary one.

Official documentation ↗
Slackbot-LinkExpandingSlackLink preview
Slackbot-LinkExpanding 1.0 (+https://api.slack.com/robots)
Parse
robots.txt token
Not documented
robots.txt
Does not obey

Unfurls links posted in Slack. Slack does not honor robots.txt; ask Slack to stop fetching your site instead.

Official documentation ↗
DiscordbotDiscordLink preview
Page fetchMozilla/5.0 (compatible; Discordbot/2.0; +https://discordapp.com)
Parse
Component-embed JSON fetchDiscordbot/2.0
Parse
robots.txt token
Not documented
robots.txt
Not documented
Verify a real request
IP address list ↗

Fetches only when a link is shared, with no continuous crawling. Discord says to match "Discordbot" anywhere in the string, because other parts may change.

Official documentation ↗
WhatsAppMetaLink preview
Android exampleWhatsApp/2.22.20.72 A
Parse
iOS exampleWhatsApp/2.22.19.78 I
Parse
Web exampleWhatsApp/2.2236.3 N
Parse
robots.txt token
Not documented
robots.txt
Not documented

Fetches the page on the sender's behalf; Open Graph tags must be in the <head> within the first 300 KB. The trailing A, I or N means Android, iOS or web.

Official documentation ↗
GoogleOther-ImageGoogleOther
GoogleOther-Image/1.0
Parse
robots.txt token
GoogleOther-ImageGoogleOther
robots.txt
Obeys
Verify a real request
Reverse-resolve the address: the name should end in googlebot.com and resolve forward to the same address. IP address list ↗
Official documentation ↗
GoogleOther-VideoGoogleOther
GoogleOther-Video/1.0
Parse
robots.txt token
GoogleOther-VideoGoogleOther
robots.txt
Obeys
Verify a real request
Reverse-resolve the address: the name should end in googlebot.com and resolve forward to the same address. IP address list ↗
Official documentation ↗
GoogleOtherGoogleOther
SmartphoneMozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/W.X.Y.Z Mobile Safari/537.36 (compatible; GoogleOther)
Parse
DesktopMozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; GoogleOther) Chrome/W.X.Y.Z Safari/537.36
Parse

Placeholders such as "W.X.Y.Z" stand for the browser (Chrome or Edge) version used in real requests.

robots.txt token
GoogleOther
robots.txt
Obeys
Verify a real request
Reverse-resolve the address: the name should end in googlebot.com and resolve forward to the same address. IP address list ↗

A generic crawler that Google product teams use, for example for internal research and development. It does not affect any specific product.

Official documentation ↗
Google-CloudVertexBotGoogleOther
Substring of the UA (no full string published)Google-CloudVertexBot
Parse
robots.txt token
Google-CloudVertexBotGooglebot
robots.txt
Obeys
Verify a real request
Reverse-resolve the address: the name should end in googlebot.com and resolve forward to the same address. IP address list ↗

Crawls at a site owner's request to build Vertex AI Agents. It has no effect on Google Search.

Official documentation ↗
Google-SafetyGoogleOther
Google-Safety
Parse
robots.txt token
Not documented
robots.txt
Does not obey
Verify a real request
Reverse-resolve the address: the name should end in google.com (rate-limited-proxy-….google.com) and resolve forward to the same address. IP address list ↗

Abuse-specific crawling, such as malware discovery for links posted on Google properties. It ignores robots.txt.

Official documentation ↗
SlackbotSlackOther
Slackbot 1.0 (+https://api.slack.com/robots)
Parse
robots.txt token
Not documented
robots.txt
Does not obey

Used for any Slack request not covered by its other robots, such as API calls for integrations. Slack does not honor robots.txt.

Official documentation ↗
BytespiderByteDanceOther

The full User-Agent is not officially published.

robots.txt token
Bytespider
robots.txt
Not documented

No official ByteDance documentation was found, so neither the string nor the purpose is given. The robots.txt Generator puts it in the training group, following common practice.

A reference list of the User-Agent strings that current browsers send, and of the crawlers that visit websites: search engines, AI companies, SEO tools and link previews. For each crawler it gives the robots.txt token, whether it obeys robots.txt and how to verify that a request really comes from it, taken from the operator's own documentation.

User-Agent List: Features

How to use the list

Type part of a name, company or string into the search box to filter the list, or use the buttons to show one kind at a time. Copy puts a string on the clipboard, and Parse opens it in the User-Agent Parser so you can see how it is identified. It is meant for the two everyday jobs: choosing a string to test a site with, and working out what an unfamiliar entry in an access log is.

Browser strings are partly frozen

Current browsers send fixed values in place of some real ones, to reduce fingerprinting. Chrome and Edge report only their major version, with the rest of the number set to zero, and on Android they report every device as "Android 10; K", so the model cannot be read from the string. On macOS, Chrome, Edge and Safari say 10_15_7 and Firefox says 10.15 whatever the real version, and Apple silicon Macs still say Intel. Windows 11 reports Windows NT 10.0. Since iOS 26, Safari reports the iOS version as a fixed 18.x value and carries the real version in the Version token instead.

Kinds of crawler and robots.txt

Search engine crawlers collect pages for search results. AI crawlers come in three kinds: training crawlers such as GPTBot, ClaudeBot and Amazonbot; AI search indexers such as OAI-SearchBot, Claude-SearchBot and PerplexityBot; and fetchers that retrieve a page when a user asks an assistant to, such as ChatGPT-User, Claude-User and Perplexity-User. Common Crawl's CCBot builds a public dataset that is also used in AI research, so it is often treated like a training crawler. To block one, put its robots.txt token in a User-agent line. Some, such as Google-Extended and Applebot-Extended, have no User-Agent of their own and exist only as robots.txt tokens. The robots.txt Generator builds the rules for you.

Verifying a real crawler

Anyone can send any User-Agent, so a request claiming to be Googlebot may not be. Google, Bing, OpenAI and others publish a way to check: a reverse DNS lookup of the requesting address, a list of the IP ranges their crawlers use, or both. Each entry shows the method its operator documents. A request that fails the check will not be stopped by robots.txt; block it at the server or firewall.

When the list was checked

The browser versions and crawler details were checked against official sources on November 6, 2026. Browsers raise their major version every few weeks, and crawlers are added and renamed, so confirm anything important through each entry's link to the official documentation.

User-Agent List: FAQ

What is the iPhone User-Agent?

Safari on iPhone sends a string of the form Mozilla/5.0 (iPhone; CPU iPhone OS 18_7 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/27.0 Mobile/15E148 Safari/604.1. Since iOS 26 the OS part is a fixed 18.x value, so read the real iOS version from the number after Version/. Chrome on iPhone includes CriOS/, Firefox includes FxiOS/ and Edge includes EdgiOS/.

Why does Chrome on Android not show the device model?

Chrome's User-Agent reduction fixes the Android version and model at "Android 10; K", so a Pixel on Android 14 and a Galaxy on Android 16 send the same string. Sites that need the model or version must request User-Agent Client Hints such as Sec-CH-UA-Model and Sec-CH-UA-Platform-Version.

Is the Windows 11 string different from Windows 10?

No. Windows 11 also reports Windows NT 10.0, so the string cannot tell them apart. In Chrome and Edge, the Sec-CH-UA-Platform-Version client hint can.

What is the Googlebot User-Agent?

Googlebot has a smartphone crawler and a desktop crawler, and both include Googlebot/2.1. The smartphone one presents itself as Chrome on an Android device; Google's documentation writes the Chrome version as W.X.Y.Z, and real requests carry the version of Chrome that Googlebot currently uses. There are also purpose-specific names such as Googlebot-Image.

What is the Google-Extended User-Agent?

There is none. Google-Extended does not crawl; it is a robots.txt token that controls whether pages Google has crawled may be used to train Gemini models and for grounding in Gemini Apps and Vertex AI. Google states that blocking it does not affect a site's inclusion or ranking in Google Search. Applebot-Extended works the same way for Apple.

How do I block all AI crawlers at once?

The Block AI training and Block AI search too presets in the robots.txt Generator produce rules for the main AI crawlers in this list. Fetchers acting on a user's request may not apply robots.txt, and some, such as Google-Agent and Claude-Agent, have no robots.txt token at all, so to be certain, block them at the server or CDN by User-Agent or address range.

How can I view my site with a different User-Agent?

In Chrome, open DevTools and set a custom User agent in the Network conditions panel. On the command line, pass the string to curl with -A. The Copy button in this list gives you the exact string to use.

How do I identify a string that is not listed?

Paste it into the User-Agent Parser, which identifies the browser, operating system, device and whether it is a bot. Names containing bot, crawler or spider are detected even when they are not in this list.

How to Use User-Agent List

  1. Find a string

    Type part of a name, company or string, or use the buttons to show browsers, AI crawlers and so on.

  2. Copy or parse it

    Copy puts the string on the clipboard; Parse opens it in the User-Agent Parser to see how it is identified.

  3. Use the token in robots.txt

    To block a crawler, write its robots.txt token in a User-agent line, or use the presets in the robots.txt Generator.

Category Network