Robots |
1 | 1417 | 29.23 | DotBot/1.1 |
2 | 1098 | 22.65 | ltx71 - (http://ltx71.com/) |
3 | 521 | 10.75 | compatible Mozilla/5.0 |
4 | 238 | 4.91 | Sogou web spider/4.0(+http://www.sogou.c... |
5 | 213 | 4.39 | MJ12bot/v1.4.7 |
6 | 202 | 4.17 | YandexBot/3.0 |
7 | 195 | 4.02 | Googlebot/2.1 |
8 | 185 | 3.82 | bingbot/2.0 |
9 | 180 | 3.71 | SeznamBot/3.2 |
10 | 74 | 1.53 | Yahoo! Slurp |
11 | 57 | 1.18 | yoozBot-2.2 |
12 | 55 | 1.13 | coccocbot-web/1.0 |
13 | 43 | 0.89 | robots |
14 | 32 | 0.66 | AhrefsBot/5.2 |
15 | 25 | 0.52 | Twitterbot/1.0 |
16 | 24 | 0.50 | ia_archiver |
17 | 23 | 0.47 | DeuSu/5.0.2 |
18 | 21 | 0.43 | Linux x86_64 |
19 | 20 | 0.41 | Daum/4.1 |
20 | 19 | 0.39 | MSIE 8.0 |
21 | 16 | 0.33 | Googlebot/2.1 (+http://www.google.com/bo... |
22 | 14 | 0.29 | SemrushBot/1.2~bl |
23 | 13 | 0.27 | MSIE 9.0 |
24 | 11 | 0.23 | Exabot/3.0 |
25 | 11 | 0.23 | Scrapy/1.0.3.post1+g83a06ed (+http://scr... |
26 | 10 | 0.21 | coccocbot-image/1.0 |
27 | 10 | 0.21 | - |
28 | 10 | 0.21 | archive.org_bot |
29 | 8 | 0.17 | OrangeBot/2.0 |
30 | 8 | 0.17 | MJ12bot/v1.4.8 |
31 | 6 | 0.12 | TurnitinBot (https://turnitin.com/robot/... |
32 | 5 | 0.10 | psbot/0.1 (+http://www.picsearch.com/bot... |
33 | 5 | 0.10 | Uptimebot/1.0 |
34 | 5 | 0.10 | Steeler/3.5 |
35 | 4 | 0.08 | oBot/2.3.1 |
36 | 4 | 0.08 | kazbtbot/0.1 |
37 | 4 | 0.08 | GigablastOpenSource/1.0 |
38 | 3 | 0.06 | spbot/5.0.3 |
39 | 3 | 0.06 | Windows NT 6.1? |
40 | 3 | 0.06 | linkdexbot/2.0 |
41 | 3 | 0.06 | SafeDNSBot (https://www.safedns.com/sear... |
42 | 3 | 0.06 | CSS Certificate Spider (http://www.css-s... |
43 | 3 | 0.06 | linkdexbot/2.2 |
44 | 3 | 0.06 | Firefox/3.6 |
45 | 3 | 0.06 | Docoloc |
46 | 3 | 0.06 | GarlikCrawler/1.2 (http://garlik.com/, c... |
47 | 2 | 0.04 | MSIE 10.0 |
48 | 2 | 0.04 | Yeti/1.1 |
49 | 2 | 0.04 | Googlebot (gocrawl v0.4) |
50 | 2 | 0.04 | MSIE 6.0 |
51 | 2 | 0.04 | ZoomBot/Nutch-1.12-SNAPSHOT |
52 | 2 | 0.04 | SEOkicks-Robot |
53 | 2 | 0.04 | CCBot/2.0 (http://commoncrawl.org/faq/) |
54 | 2 | 0.04 | Firefox/2.0.0.6 |
55 | 1 | 0.02 | SiteExplorer/1.1b |
56 | 1 | 0.02 | Cliqzbot/1.0 |
57 | 1 | 0.02 | nutch-1.4/Nutch-1.4 |
58 | 1 | 0.02 | nutch-spider-2.2.1/Nutch-1.12-SNAPSHOT |
59 | 1 | 0.02 | panscient.com |
60 | 1 | 0.02 | DomainStatsBot/1.0 (http://domainstats.i... |
61 | 1 | 0.02 | Aboundex/0.3 (http://www.aboundex.com/cr... |
62 | 1 | 0.02 | voltron |
63 | 1 | 0.02 | izsearch.com |
64 | 1 | 0.02 | GrapeshotCrawler/2.0 |
65 | 1 | 0.02 | MSIE 5.01 |
66 | 1 | 0.02 | Python-urllib/2.7 (+http://example.com/c... |
67 | 1 | 0.02 | NetSeer crawler/2.0 |
68 | 1 | 0.02 | AddThis.com (http://support.addthis.com/... |
69 | 1 | 0.02 | SalesIntelligent (+https://www.salesinte... |
70 | 1 | 0.02 | Pu_iN Crawler (+http://semanticjuice.com... |
71 | 1 | 0.02 | Nmap Scripting Engine |
72 | 1 | 0.02 | SurdotlyBot/1.0 |