Robots |
1 | 1923 | 32.38 | DotBot/1.1 |
2 | 988 | 16.64 | compatible Mozilla/5.0 |
3 | 659 | 11.10 | YandexBot/3.0 |
4 | 534 | 8.99 | MJ12bot/v1.4.8 |
5 | 332 | 5.59 | bingbot/2.0 |
6 | 219 | 3.69 | Googlebot/2.1 |
7 | 172 | 2.90 | Sogou web spider/4.0(+http://www.sogou.c... |
8 | 149 | 2.51 | SeznamBot/3.2 |
9 | 109 | 1.84 | AhrefsBot/5.2 |
10 | 104 | 1.75 | coccocbot-web/1.0 |
11 | 99 | 1.67 | MauiBot (crawler.feedback+wc@gmail.com) |
12 | 76 | 1.28 | Linux x86_64 |
13 | 68 | 1.15 | TurnitinBot (https://turnitin.com/robot/... |
14 | 54 | 0.91 | Cliqzbot/2.0 |
15 | 51 | 0.86 | MJ12bot/v1.4.7 |
16 | 48 | 0.81 | robots |
17 | 42 | 0.71 | The Knowledge AI |
18 | 41 | 0.69 | SemrushBot/2~bl |
19 | 37 | 0.62 | ltx71 - (http://ltx71.com/) |
20 | 34 | 0.57 | Googlebot/2.1 (+http://www.google.com/bo... |
21 | 24 | 0.40 | Jersey/2.6 (HttpUrlConnection 1.8.0_152) |
22 | 24 | 0.40 | coccocbot-image/1.0 |
23 | 22 | 0.37 | Yahoo! Slurp |
24 | 19 | 0.32 | Twitterbot/1.0 |
25 | 12 | 0.20 | oBot/2.3.1 |
26 | 12 | 0.20 | - |
27 | 12 | 0.20 | Go-http-client/1.1 |
28 | 7 | 0.12 | Windows NT 6.1? |
29 | 6 | 0.10 | linkdexbot/2.0 |
30 | 6 | 0.10 | Steeler/3.5 |
31 | 6 | 0.10 | linkdexbot/2.2 |
32 | 4 | 0.07 | yoozBot-2.2 |
33 | 4 | 0.07 | 1S/1S-1.0 (http://www.example.com/) |
34 | 4 | 0.07 | Yeti/1.1 |
35 | 4 | 0.07 | SnowHaze Search/1.0 support@snowhaze.com |
36 | 4 | 0.07 | Firefox/3.6 |
37 | 4 | 0.07 | GarlikCrawler/1.2 (http://garlik.com/, c... |
38 | 3 | 0.05 | Y!J-BRW/1.0 (https://www.yahoo-help.jp/a... |
39 | 3 | 0.05 | Daum/4.1 |
40 | 2 | 0.03 | spbot/5.0.3 |
41 | 2 | 0.03 | istellabot/t.1.13 |
42 | 2 | 0.03 | netEstate NE Crawler (+http://www.websit... |
43 | 2 | 0.03 | SafeDNSBot (https://www.safedns.com/sear... |
44 | 2 | 0.03 | Contacts-Crawler/0.2 (+http://www.scrapi... |
45 | 2 | 0.03 | YisouSpider |
46 | 2 | 0.03 | uCrawler/1.0 |
47 | 2 | 0.03 | archive.org_bot |
48 | 2 | 0.03 | CCBot/2.0 (http://commoncrawl.org/faq/) |
49 | 1 | 0.02 | Plukkie/1.6 |