Robots |
1 | 543 | 16.03 | ltx71 - (http://ltx71.com/) |
2 | 488 | 14.40 | compatible Mozilla/5.0 |
3 | 338 | 9.98 | bingbot/2.0 |
4 | 330 | 9.74 | DotBot/1.1 |
5 | 256 | 7.56 | BLEXBot/1.0 |
6 | 220 | 6.49 | YandexBot/3.0 |
7 | 194 | 5.73 | SeznamBot/3.2 |
8 | 161 | 4.75 | Googlebot/2.1 |
9 | 109 | 3.22 | Sogou web spider/4.0(+http://www.sogou.c... |
10 | 95 | 2.80 | Yahoo! Slurp |
11 | 74 | 2.18 | MJ12bot/v1.4.5 |
12 | 67 | 1.98 | MJ12bot/v1.4.7 |
13 | 52 | 1.53 | robots |
14 | 46 | 1.36 | Twitterbot/1.0 |
15 | 45 | 1.33 | coccocbot-web/1.0 |
16 | 37 | 1.09 | ia_archiver |
17 | 32 | 0.94 | Linux x86_64 |
18 | 31 | 0.91 | AhrefsBot/5.1 |
19 | 18 | 0.53 | SemrushBot/1.1~bl |
20 | 18 | 0.53 | Yeti/1.1 |
21 | 17 | 0.50 | TurnitinBot (https://turnitin.com/robot/... |
22 | 17 | 0.50 | Googlebot/2.1 (+http://www.google.com/bo... |
23 | 15 | 0.44 | OrangeBot/2.0 |
24 | 13 | 0.38 | MSIE 8.0 |
25 | 12 | 0.35 | MJ12bot/v1.4.6 |
26 | 12 | 0.35 | - |
27 | 11 | 0.32 | psbot/0.1 (+http://www.picsearch.com/bot... |
28 | 10 | 0.30 | Exabot/3.0 |
29 | 9 | 0.27 | DeuSu/5.0.2 |
30 | 8 | 0.24 | coccocbot-image/1.0 |
31 | 7 | 0.21 | voltron |
32 | 6 | 0.18 | oBot/2.3.1 |
33 | 6 | 0.18 | Windows NT 6.1? |
34 | 6 | 0.18 | Screaming Frog SEO Spider/6.2 |
35 | 6 | 0.18 | doczz_net download bot, see http://doczz... |
36 | 6 | 0.18 | SalesIntelligent (+https://www.salesinte... |
37 | 6 | 0.18 | SEOkicks-Robot |
38 | 5 | 0.15 | yoozBot-2.2 |
39 | 5 | 0.15 | archive.org_bot |
40 | 4 | 0.12 | MSIE 9.0 |
41 | 3 | 0.09 | spbot/5.0.3 |
42 | 3 | 0.09 | mj12bot |
43 | 3 | 0.09 | linkdexbot/2.2 |
44 | 3 | 0.09 | kazbtbot/0.1 |
45 | 3 | 0.09 | rogerbot |
46 | 2 | 0.06 | SafeDNSBot (https://www.safedns.com/sear... |
47 | 2 | 0.06 | MSIE 6.0 |
48 | 2 | 0.06 | Scrapy/1.0.3.post1+g83a06ed (+http://scr... |
49 | 2 | 0.06 | Firefox/3.6 |
50 | 2 | 0.06 | Firefox/1.0 |
51 | 2 | 0.06 | Firefox/3.6b1 |
52 | 2 | 0.06 | Firefox/2.0.0.6 |
53 | 1 | 0.03 | compatible Mozilla/4.0 |
54 | 1 | 0.03 | linkdexbot/2.0 |
55 | 1 | 0.03 | PagesInventory (robot http://www.pagesin... |
56 | 1 | 0.03 | NextGenSearchBot 1 (for information visi... |
57 | 1 | 0.03 | SiteExplorer/1.1b |
58 | 1 | 0.03 | SemanticScholarBot/1.0 (+http://s2.allen... |
59 | 1 | 0.03 | vebidoobot |
60 | 1 | 0.03 | Googlebot (gocrawl v0.4) |
61 | 1 | 0.03 | Dataprovider |
62 | 1 | 0.03 | BlackBerry9000/4.6.0.167 Profile/MIDP-2.... |
63 | 1 | 0.03 | studylib download bot, see http://studyl... |
64 | 1 | 0.03 | DomainStatsBot/1.0 (http://domainstats.i... |
65 | 1 | 0.03 | Gigabot/1.0 |
66 | 1 | 0.03 | Aboundex/0.3 (http://www.aboundex.com/cr... |
67 | 1 | 0.03 | BLEXBotTest/1.0 |
68 | 1 | 0.03 | Sonic/1.0 |
69 | 1 | 0.03 | MSIE 5.01 |
70 | 1 | 0.03 | SMTBot/1.0 |
71 | 1 | 0.03 | LinkChecker/7.5 (+http://linkchecker.sou... |
72 | 1 | 0.03 | NetSeer crawler/2.0 |
73 | 1 | 0.03 | VeriCiteCrawler/Nutch-1.9 |
74 | 1 | 0.03 | SurdotlyBot/1.0 |
75 | 1 | 0.03 | WBSearchBot/1.1 |
76 | 1 | 0.03 | nutch-1.4/Nutch-1.4 |