User Agent List

VPN

  • No logs
  • Kill Switch
  • 6 devices
  • Monthly price: $4.92

Visit nordvpn.com

List of User Agents – WhatIsMyBrowser Developers

Software:
Facebook App (21, 546, 101)
Instagram (21, 282, 289)
Android WebView (14, 303, 767)
Chrome (10, 041, 037)
Opera (2, 327, 502)
Yandex Browser (1, 734, 419)
Internet Explorer (1, 728, 192)
Outlook (1, 492, 779)
UC Browser (1, 269, 752)
Browse all Software Names
Operating Systems:
Android (63, 221, 506)
iOS (17, 078, 327)
Windows (5, 722, 058)
Linux (463, 909)
Mac OS X (335, 430)
macOS (301, 964)
Symbian (97, 324)
Fire OS (73, 324)
Chrome OS (66, 439)
Browse all Operating Systems
Operating Platforms:
Apple iPhone 7 (1, 379, 481)
Apple iPhone (1, 346, 308)
Motorola Moto G (1, 298, 584)
Redmi (1, 274, 388)
Lenovo (1, 192, 698)
Apple iPhone 6s (1, 080, 631)
Apple iPhone 8 (969, 673)
Apple iPhone 7 Plus (958, 341)
Apple iPhone 8 Plus (897, 962)
Browse all Operating Platforms
Software Types:
In-App Browser (61, 050, 855)
Web Browser (24, 053, 106)
Application (1, 688, 361)
Crawler (1, 233, 877)
Media Player (188, 339)
Analyser (28, 960)
Software Library (18, 428)
Bot (11, 273)
Download Helper (2, 331)
Browse all Software Types
Hardware Types:
Phone (38, 859, 423)
Mobile (37, 747, 435)
Computer (6, 113, 446)
Tablet (4, 912, 240)
Server (1, 292, 896)
TV (90, 881)
E-Book Reader (74, 753)
Music Player (63, 160)
watch (6, 932)
Browse all Hardware Types
Layout Engines:
WebKit (54, 781, 955)
Blink (26, 608, 794)
Trident (3, 418, 820)
Gecko (677, 438)
Presto (414, 499)
EdgeHTML (204, 753)
NetFront (33, 345)
Goanna (5, 574)
KHTML (3, 816)
Browse all Layout Engine Names
Search user agents via the API
Instead of trawling through the huge listing for the types of user agents you need, use the Database Search Interface to query the API instead of having to download and load the huge database dump. Sign up for a Pro or Enterprise account to get started.
You can perform detailed user agent searches, including refining by software/browser name and version, operating system name and version, software type (browser, bot, app etc), hardware type and so on. You can easily find groups of user agents that match your search criteria.
Use the API to decode user agents
If you need to integrate the user agent parser directly into your website or system then it’s very simple to use the API. It’s free to use, and has paid tiers for more access and better features. This lets you identify the browser, OS and device your users have. Find out more.
Download the whole database
If you want to get a copy of the database of 92, 558, 295 user agents you can download it very easily. This will let you do things like advanced filtering and searching, identify trends in user agents, perform statistical analysis and other interesting applications. Find out more.
List of User Agent strings - DeviceAtlas

HTTP Rotating & Static

  • 200 thousand IPs
  • Locations: US, EU
  • Monthly price: from $39
  • 1 day moneyback guarantee

Visit stormproxies.com

List of User Agent strings – DeviceAtlas

The User-Agent (UA) string is contained in the HTTP headers and is intended to identify devices requesting online content. The User-Agent tells the server what the visiting device is (among many other things) and this information can be used to determine what content to return. Of course this requires using a device detection solution which translates UAs into understandable software and hardware information.
User-Agent list for different device types
There are millions of User-Agent combinations given that UAs change with the software and hardware. For example, a Chrome browser on an iPhone 6 will introduce itself using a different UA than a Safari browser on the same phone.
Every device type, including phones, tablets, desktops, may come with its own UA that makes it possible to detect this device for any purpose. Interestingly bots and crawlers also come with their unique UAs.
Here is a list of example User-Agents for different device types that can be detected. If you’d like to learn more on these devices, just copy and paste the UAs to our User-Agent testing tool. You’ll see all the properties of a detected device.
Android User Agents
iPhone User Agents
MS Windows User Agents
Tablet User Agents
Desktop User Agents
Set Top Box User Agents
Games Console User Agents
Bots and Crawlers User Agents
E-Readers User Agents
Android Mobile User Agents
Samsung Galaxy S9
Mozilla/5. 0 (Linux; Android 8. 0. 0; SM-G960F Build/R16NW) AppleWebKit/537. 36 (KHTML, like Gecko) Chrome/62. 3202. 84 Mobile Safari/537. 36
Samsung Galaxy S8
Mozilla/5. 0 (Linux; Android 7. 0; SM-G892A Build/NRD90M; wv) AppleWebKit/537. 36 (KHTML, like Gecko) Version/4. 0 Chrome/60. 3112. 107 Mobile Safari/537. 36
Samsung Galaxy S7
Mozilla/5. 0; SM-G930VC Build/NRD90M; wv) AppleWebKit/537. 0 Chrome/58. 3029. 83 Mobile Safari/537. 36
Samsung Galaxy S7 Edge
Mozilla/5. 0 (Linux; Android 6. 1; SM-G935S Build/MMB29K; wv) AppleWebKit/537. 0 Chrome/55. 2883. 91 Mobile Safari/537. 36
Samsung Galaxy S6
Mozilla/5. 1; SM-G920V Build/MMB29K) AppleWebKit/537. 36 (KHTML, like Gecko) Chrome/52. 2743. 98 Mobile Safari/537. 36
Samsung Galaxy S6 Edge Plus
Mozilla/5. 0 (Linux; Android 5. 1. 1; SM-G928X Build/LMY47X) AppleWebKit/537. 36 (KHTML, like Gecko) Chrome/47. 2526. 36
Nexus 6P
Mozilla/5. 1; Nexus 6P Build/MMB29P) AppleWebKit/537. 36
Sony Xperia XZ
Mozilla/5. 1; G8231 Build/41. 2. A. 219; wv) AppleWebKit/537. 0 Chrome/59. 3071. 125 Mobile Safari/537. 36
Sony Xperia Z5
Mozilla/5. 1; E6653 Build/32. 253) AppleWebKit/537. 36
HTC One X10
Mozilla/5. 0; HTC One X10 Build/MRA58K; wv) AppleWebKit/537. 0 Chrome/61. 3163. 36
HTC One M9
Mozilla/5. 0; HTC One M9 Build/MRA58K) AppleWebKit/537. 3
If you’re wondering which devices are most common where you are, read our list of the world’s most popular Android devices.
Below are examples of User Agent strings used by the most popular iPhone devices. As Apple do not pass much info through the User Agent, version numbers don’t allow us differentiate between iPhone models.
However, with DeviceAtlas client-side, you can classify these user agents to return correct device model.
The Complete Guide To User Agents.
Download our free e-book on User Agents to learn:
What is a User Agent?
How do you parse them?
What can you do with them?
Download the Free Guide
For more on how to detect exact iPhone 8/8 Plus and iPhone X models, read our guides on How To Detect iPhone 8/X and how to detect the latest iPhones – the XR, XS and XS Max.
Apple iPhone XR (Safari)
Mozilla/5. 0 (iPhone; CPU iPhone OS 12_0 like Mac OS X) AppleWebKit/605. 15 (KHTML, like Gecko) Version/12. 0 Mobile/15E148 Safari/604. 1
Apple iPhone XS (Chrome)
Mozilla/5. 15 (KHTML, like Gecko) CriOS/69. 3497. 105 Mobile/15E148 Safari/605. 1
Apple iPhone XS Max (Firefox)
Mozilla/5. 15 (KHTML, like Gecko) FxiOS/13. 2b11866 Mobile/16A366 Safari/605. 15
Apple iPhone X
Mozilla/5. 0 (iPhone; CPU iPhone OS 11_0 like Mac OS X) AppleWebKit/604. 38 (KHTML, like Gecko) Version/11. 0 Mobile/15A372 Safari/604. 1
Apple iPhone 8
Mozilla/5. 34 (KHTML, like Gecko) Version/11. 0 Mobile/15A5341f Safari/604. 1
Apple iPhone 8 Plus
Mozilla/5. 0 Mobile/15A5370a Safari/604. 1
Apple iPhone 7
Mozilla/5. 0 (iPhone9, 3; U; CPU iPhone OS 10_0_1 like Mac OS X) AppleWebKit/602. 50 (KHTML, like Gecko) Version/10. 0 Mobile/14A403 Safari/602. 1
Apple iPhone 7 Plus
Mozilla/5. 0 (iPhone9, 4; U; CPU iPhone OS 10_0_1 like Mac OS X) AppleWebKit/602. 1
Apple iPhone 6
Mozilla/5. 0 (Apple-iPhone7C2/1202. 466; U; CPU like Mac OS X; en) AppleWebKit/420+ (KHTML, like Gecko) Version/3. 0 Mobile/1A543 Safari/419. 3
MS Windows Phone User Agents
Microsoft Lumia 650
Mozilla/5. 0 (Windows Phone 10. 0; Android 6. 1; Microsoft; RM-1152) AppleWebKit/537. 116 Mobile Safari/537. 36 Edge/15. 15254
Microsoft Lumia 550
Mozilla/5. 0; Android 4. 1; Microsoft; RM-1127_16056) AppleWebKit/537. 36(KHTML, like Gecko) Chrome/42. 2311. 135 Mobile Safari/537. 36 Edge/12. 10536
Microsoft Lumia 950
Mozilla/5. 1; Microsoft; Lumia 950) AppleWebKit/537. 36 (KHTML, like Gecko) Chrome/46. 2486. 0 Mobile Safari/537. 36 Edge/13. 1058
Google Pixel C
Mozilla/5. 0; Pixel C Build/NRD90M; wv) AppleWebKit/537. 0 Chrome/52. 98 Safari/537. 36
Sony Xperia Z4 Tablet
Mozilla/5. 1; SGP771 Build/32. 253; wv) AppleWebKit/537. 36
Nvidia Shield Tablet K1
Mozilla/5. 1; SHIELD Tablet K1 Build/MRA58K; wv) AppleWebKit/537. 91 Safari/537. 36
Samsung Galaxy Tab S3
Mozilla/5. 0; SM-T827R4 Build/NRD90M) AppleWebKit/537. 36 (KHTML, like Gecko) Chrome/60. 116 Safari/537. 36
Samsung Galaxy Tab A
Mozilla/5. 2; SAMSUNG SM-T550 Build/LRX22G) AppleWebKit/537. 36 (KHTML, like Gecko) SamsungBrowser/3. 3 Chrome/38. 2125. 102 Safari/537. 36
Amazon Kindle Fire HDX 7
Mozilla/5. 0 (Linux; Android 4. 4. 3; KFTHWI Build/KTU84M) AppleWebKit/537. 36 (KHTML, like Gecko) Silk/47. 79 like Chrome/47. 80 Safari/537. 36
LG G Pad 7. 0
Mozilla/5. 2; LG-V410/V41020c Build/LRX22G) AppleWebKit/537. 0 Chrome/34. 1847. 118 Safari/537. 36
If you’re looking for a list of mobile browser user-agents, we’ve got them too – List Of Mobile Browser User-Agent Strings.
Windows 10-based PC using Edge browser
Mozilla/5. 0 (Windows NT 10. 0; Win64; x64) AppleWebKit/537. 36 (KHTML, like Gecko) Chrome/42. 135 Safari/537. 246
Chrome OS-based laptop using Chrome browser (Chromebook)
Mozilla/5. 0 (X11; CrOS x86_64 8172. 45. 0) AppleWebKit/537. 36 (KHTML, like Gecko) Chrome/51. 2704. 64 Safari/537. 36
Mac OS X-based computer using a Safari browser
Mozilla/5. 0 (Macintosh; Intel Mac OS X 10_11_2) AppleWebKit/601. 3. 9 (KHTML, like Gecko) Version/9. 2 Safari/601. 9
Windows 7-based PC using a Chrome browser
Mozilla/5. 0 (Windows NT 6. 1; WOW64) AppleWebKit/537. 111 Safari/537. 36
Linux-based PC using a Firefox browser
Mozilla/5. 0 (X11; Ubuntu; Linux x86_64; rv:15. 0) Gecko/20100101 Firefox/15. 1
Bring device intelligence to your web applications in minutes.
For the web, native apps and mobile operator environments.
Compare options and pricing
Set Top Boxes User Agents
Chromecast
Mozilla/5. 0 (CrKey armv7l 1. 5. 16041) AppleWebKit/537. 36 (KHTML, like Gecko) Chrome/31. 1650. 0 Safari/537. 36
Roku Ultra
Roku4640X/DVP-7. 70 (297. 70E04154A)
Minix NEO X5
Mozilla/5. 0 (Linux; U; Android 4. 2; he-il; NEO-X5-116A Build/JDQ39) AppleWebKit/534. 30 (KHTML, like Gecko) Version/4. 0 Safari/534. 30
Amazon 4K Fire TV
Mozilla/5. 1; AFTS Build/LMY47O) AppleWebKit/537. 0 Chrome/41. 99900. 2250. 0242 Safari/537. 36
Google Nexus Player
Dalvik/2. 0 (Linux; U; Android 6. 1; Nexus Player Build/MMB29T)
Apple TV 5th Gen 4K
AppleTV6, 2/11. 1
Apple TV 4th Gen
AppleTV5, 3/9. 1
Game Consoles User Agents
Nintendo Wii U
Mozilla/5. 0 (Nintendo WiiU) AppleWebKit/536. 30 (KHTML, like Gecko) NX/3. 12 NintendoBrowser/
Xbox One S
Mozilla/5. 0; Win64; x64; XBOX_ONE_ED) AppleWebKit/537. 79 Safari/537. 36 Edge/14. 14393
Xbox One
Mozilla/5. 1; Xbox; Xbox One) AppleWebKit/537. 10586
Playstation 4
Mozilla/5. 0 (PlayStation 4 3. 11) AppleWebKit/537. 73 (KHTML, like Gecko)
Playstation Vita
Mozilla/5. 0 (PlayStation Vita 3. 61) AppleWebKit/537. 73 (KHTML, like Gecko) Silk/3. 2
Nintendo 3DS
Mozilla/5. 0 (Nintendo 3DS; U;; en) Version/1.
We’ve compiled a more in-depth list of User-Agent strings of the most active web crawlers and bots.
Google bot
Mozilla/5. 0 (compatible; Googlebot/2. 1; +)
Bing bot
Mozilla/5. 0 (compatible; bingbot/2. 0; +)
Yahoo! bot
Mozilla/5. 0 (compatible; Yahoo! Slurp;)
E Readers User Agents
Amazon Kindle 4
Mozilla/5. 0 (X11; U; Linux armv7l like Android; en-us) AppleWebKit/531. 2+ (KHTML, like Gecko) Version/5. 0 Safari/533. 2+ Kindle/3. 0+
Amazon Kindle 3
Mozilla/5. 0 (Linux; U; en-US) AppleWebKit/528. 5+ (KHTML, like Gecko, Safari/528. 5+) Version/4. 0 Kindle/3. 0 (screen 600×800; rotate)
Learn more about User-Agents
If you’re looking for more information on User-Agents, be sure to read these posts on the DeviceAtlas blog:
How User-Agent parsing works and how it can be used
List of Mobile Browser User Agents
User-Agent string Analysis
Building device databases with User-Agent strings
How to switch UA in your desktop browser
Get Instant access to a DeviceAtlas Cloud trial
DeviceAtlas Cloud offer a great way to start detecting mobile device traffic to your site:
Optimize website content for mobile, tablet, and other devices
Boost website loading time and minimize page weight
Handle traffic from any device as you want
Get started with a DeviceAtlas Cloud trial today.
Get started
Web Crawlers and User Agents - Top 10 Most Popular - KeyCDN

Web Crawlers and User Agents – Top 10 Most Popular – KeyCDN

By Brian JacksonUpdated on June 6, 2017
When it comes to the world wide web there are both bad bots and good bots. The bad bots you definitely want to avoid as these consume your CDN bandwidth, take up server resources, and steal your content. Good bots (also known as web crawlers) on the other hand, should be handled with care as they are a vital part of getting your content to index with search engines such as Google, Bing, and Yahoo. Read more below about some of the top 10 web crawlers and user agents to ensure you are handling them crawlersWeb crawlers, also known as web spiders or internet bots, are programs that browse the web in an automated manner for the purpose of indexing content. Crawlers can look at all sorts of data such as content, links on a page, broken links, sitemaps, and HTML code engines like Google, Bing, and Yahoo use crawlers to properly index downloaded pages so that users can find them faster and more efficiently when they are searching. Without web crawlers, there would be nothing to tell them that your website has new and fresh content. Sitemaps also can play a part in that process. So web crawlers, for the most part, are a good thing. However there are also issues sometimes when it comes to scheduling and load as a crawler might be constantly polling your site. And this is where a file comes into play. This file can help control the crawl traffic and ensure that it doesn’t overwhelm your crawlers identify themselves to a web server by using the User-Agent request header in an HTTP request, and each crawler has their own unique identifier. Most of the time you will need to examine your web server referrer logs to view web crawler placing a file at the root of your web server you can define rules for web crawlers, such as allow or disallow certain assets from being crawled. Web crawlers must follow the rules defined in this file. You can apply generic rules which apply to all bots or get more granular and specify their specific User-Agent string. Example 1This example instructs all Search engine robots to not index any of the website’s content. This is defined by disallowing the root / of your *
Disallow: /
Example 2This example achieves the opposite of the previous one. In this case, the instructions are still applied to all user agents, however there is nothing defined within the Disallow instruction, meaning that everything can be *
Disallow:
To see more examples make sure to check out our in-depth post on how to use a 10 web crawlers and botsThere are hundreds of web crawlers and bots scouring the internet but below is a list of 10 popular web crawlers and bots that we have been collected based on ones that we see on a regular basis within our web server logs. 1. GoogleBotGooglebot is obviously one of the most popular web crawlers on the internet today as it is used to index content for Google’s search engine. Patrick Sexton wrote a great article about what a Googlebot is and how it pertains to your website indexing. One great thing about Google’s web crawler is that they give us a lot of tools and control over the
Full User-Agent stringMozilla/5. 0 (compatible; Googlebot/2. 1; +)
Googlebot example in robots. txtThis example displays a little more granularity pertaining to the instructions defined. Here, the instructions are only relevant to Googlebot. More specifically, it is telling Google not to index a specific page (/no-index/) Googlebot
Disallow: /no-index/
Besides Google’s web search crawler, they actually have 9 additional web crawlers:Web crawlerUser-Agent stringGooglebot NewsGooglebot-NewsGooglebot ImagesGooglebot-Image/1. 0Googlebot VideoGooglebot-Video/1. 0Google Mobile (featured phone)SAMSUNG-SGH-E250/1. 0 Profile/MIDP-2. 0 Configuration/CLDC-1. 1 owser/6. 2. 3. c. 101 (GUI) MMP/2. 0 (compatible; Googlebot-Mobile/2. 1; +)Google SmartphoneMozilla/5. 0 (Linux; Android 6. 0. 1; Nexus 5X Build/MMB29P) AppleWebKit/537. 36 (KHTML, like Gecko) Chrome/41. 2272. 96 Mobile Safari/537. 36 (compatible; Googlebot/2. 1; +)Google Mobile Adsense(compatible; Mediapartners-Google/2. 1; +)Google AdsenseMediapartners-GoogleGoogle AdsBot (PPC landing page quality)AdsBot-Google (+)Google app crawler (fetch resources for mobile)AdsBot-Google-Mobile-AppsYou can use the Fetch tool in Google Search Console to test how Google crawls or renders a URL on your site. See whether Googlebot can access a page on your site, how it renders the page, and whether any page resources (such as images or scripts) are blocked to can also see the Googlebot crawl stats per day, the amount of kilobytes downloaded, and time spent downloading a Googlebot documentation. BingbotBingbot is a web crawler deployed by Microsoft in 2010 to supply information to their Bing search engine. This is the replacement of what used to be the MSN
Full User-Agent stringMozilla/5. 0 (compatible; Bingbot/2. 0; +)
Bing also has a very similar tool as Google, called Fetch as Bingbot, within Bing Webmaster Tools. Fetch As Bingbot allows you to request a page be crawled and shown to you as our crawler would see it. You will see the page code as Bingbot would see it, helping you to understand if they are seeing your page as you Bingbot documentation. Slurp BotYahoo Search results come from the Yahoo web crawler Slurp and Bing’s web crawler, as a lot of Yahoo is now powered by Bing. Sites should allow Yahoo Slurp access in order to appear in Yahoo Mobile Search ditionally, Slurp does the following:Collects content from partner sites for inclusion within sites like Yahoo News, Yahoo Finance and Yahoo cesses pages from sites across the Web to confirm accuracy and improve Yahoo’s personalized content for our
Full User-Agent stringMozilla/5. 0 (compatible; Yahoo! Slurp;)
See Slurp documentation. 4. DuckDuckBotDuckDuckBot is the Web crawler for DuckDuckGo, a search engine that has become quite popular lately as it is known for privacy and not tracking you. It now handles over 12 million queries per day. DuckDuckGo gets its results from over four hundred sources. These include hundreds of vertical sources delivering niche Instant Answers, DuckDuckBot (their crawler) and crowd-sourced sites (Wikipedia). They also have more traditional links in the search results, which they source from Yahoo!, Yandex and
Full User-Agent stringDuckDuckBot/1. 0; (+)
It respects WWW::RobotRules and originates from these IP addresses:72. 94. 249. 3472. 3572. 3672. 3772. 385. BaiduspiderBaiduspider is the official name of the Chinese Baidu search engine’s web crawling spider. It crawls web pages and returns updates to the Baidu index. Baidu is the leading Chinese search engine that takes an 80% share of the overall search engine market of China
Full User-Agent stringMozilla/5. 0 (compatible; Baiduspider/2. 0; +)
Besides Baidu’s web search crawler, they actually have 6 additional web crawlers:Web crawlerUser-Agent stringImage SearchBaiduspider-imageVideo SearchBaiduspider-videoNews SearchBaiduspider-newsBaidu wishlistsBaiduspider-favoBaidu UnionBaiduspider-cproBusiness SearchBaiduspider-adsOther search pagesBaiduspiderSee Baidu documentation. 6. Yandex BotYandexBot is the web crawler to one of the largest Russian search engines, Yandex. According to LiveInternet, for the three months ended December 31, 2015, they generated 57. 3% of all search traffic in
Full User-Agent stringMozilla/5. 0 (compatible; YandexBot/3. 0; +)
There are many different User-Agent strings that the YandexBot can show up as in your server logs. See the full list of Yandex robots and Yandex documentation. 7. Sogou SpiderSogou Spider is the web crawler for, a leading Chinese search engine that was launched in 2004. As of April 2016 it has a rank of 103 in Alexa’s internet The Sogou web spider does not respect the robots exclusion standard, and is therefore banned from many websites because of excessive Pic Spider/3. 0()
Sogou head spider/3. 0()
Sogou web spider/4. 0(+)
Sogou Orion spider/3. 0()
Sogou-Test-Spider/4. 0 (compatible; MSIE 5. 5; Windows 98)
8. ExabotExabot is a web crawler for Exalead, which is a search engine based out of France. It was founded in 2000 and now has more than 16 billion pages currently (compatible; Konqueror/3. 5; Linux) KHTML/3. 5. 5 (like Gecko) (Exabot-Thumbnails)
Mozilla/5. 0 (compatible; Exabot/3. 0; +)
See Exabot documentation. 9. Facebook external hitFacebook allows its users to send links to interesting web content to other Facebook users. Part of how this works on the Facebook system involves the temporary display of certain images or details related to the web content, such as the title of the webpage or the embed tag of a video. The Facebook system retrieves this information only after a user provides a of their main crawling bots is Facebot, which is designed to help improve advertising
facebookexternalhit/1. 0 (+)
facebookexternalhit/1. 1 (+)
See Facebot documentation. 10. Alexa crawleria_archiver is the web crawler for Amazon’s Alexa internet rankings. As you probably know they collect information to show rankings for both local and international
Full User-Agent stringia_archiver (+;)
See Ia_archiver botsAs we mentioned above most of those are actually good web crawlers. You generally don’t want to block Google or Bing from indexing your site unless you have a good reason. But what about the thousands of bad bots? KeyCDN released a new feature back in February 2016 that you can enable in your dashboard called Block Bad Bots. KeyCDN uses a comprehensive list of known bad bots and blocks them based on their User-Agent a new Zone is added the Block Bad Bots feature is set to disabled. This setting can be set to enabled instead if you want bad bots to automatically be resourcesPerhaps you are seeing some user-agent strings in your logs that have you concerned. Here are a couple of good resources in which you can lookup popular bad bots, crawlers, and Caio Almeida also has a pretty good list on his crawler-user-agents GitHub mmaryThere are hundreds of different web crawlers out there but hopefully you are now familiar with couple of the more popular ones. Again you want to be careful when blocking any of these as they could cause indexing issues. It is always good to check your web server logs to see how often they are actually crawling your we miss any important ones? If so please let us know below and we will add them.

Frequently Asked Questions about user agent list

What is the best User-Agent?

Slurp Bot. … DuckDuckBot. … Baiduspider. … Yandex Bot. … Sogou Spider. … Exabot. … 9. Facebook external hit. Facebook allows its users to send links to interesting web content to other Facebook users. … Alexa crawler. ia_archiver is the web crawler for Amazon’s Alexa internet rankings.More items…•Jun 6, 2017

What is User-Agent example?

User-Agent list for different device types. There are millions of User-Agent combinations given that UAs change with the software and hardware. For example, a Chrome browser on an iPhone 6 will introduce itself using a different UA than a Safari browser on the same phone.Oct 23, 2018

What are the most common user agents?

Web Browser User AgentsUser agentSoftwarePopularityMozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; .NET CLR 1.1.4322)Internet Explorer 6Very commonMozilla/5.0 (iPhone; CPU iPhone OS 11_4_1 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/11.0 Mobile/15E148 Safari/604.1Safari 11Very common48 more rows

Leave a Reply

Your email address will not be published. Required fields are marked *