Robots |
1 | 431 | 20.29 | \"Mozilla/5.0 |
2 | 343 | 16.15 | Ezooms/1.0 |
3 | 265 | 12.48 | bingbot/2.0 |
4 | 244 | 11.49 | compatible Mozilla/5.0 |
5 | 163 | 7.67 | Googlebot/2.1 |
6 | 126 | 5.93 | panscient.com |
7 | 80 | 3.77 | MJ12bot/v1.4.3 |
8 | 68 | 3.20 | YandexBot/3.0 |
9 | 65 | 3.06 | Baiduspider/2.0 |
10 | 40 | 1.88 | Blekkobot |
11 | 32 | 1.51 | Baiduspider+(+http://www.baidu.com/searc... |
12 | 21 | 0.99 | Sosospider+(+http://help.soso.com/webspi... |
13 | 18 | 0.85 | SeznamBot/3.0 (+http://fulltext.sblog.cz... |
14 | 18 | 0.85 | Googlebot/2.1 (+http://www.google.com/bo... |
15 | 18 | 0.85 | AhrefsBot/3.0 |
16 | 14 | 0.66 | Exabot/3.0 |
17 | 13 | 0.61 | discobot/2.0 |
18 | 12 | 0.56 | SISTRIX Crawler |
19 | 11 | 0.52 | - |
20 | 11 | 0.52 | AcoonBot/4.11.0 |
21 | 10 | 0.47 | EventGuruBot/1.0 |
22 | 9 | 0.42 | MJ12bot/v1.4.2 |
23 | 8 | 0.38 | ia_archiver(OS-Wayback) |
24 | 8 | 0.38 | compatible Mozilla/4.0 |
25 | 8 | 0.38 | MSIE 6.0 |
26 | 7 | 0.33 | msnbot/2.0b (+http://search.msn.com/msnb... |
27 | 7 | 0.33 | AcoonBot/4.10.7 |
28 | 5 | 0.24 | OpenindexDeepSpider/Nutch-1.5-dev |
29 | 5 | 0.24 | SEOENGWorldBot/1.0 (+http://www.seoengin... |
30 | 5 | 0.24 | YoudaoBot/1.0 |
31 | 5 | 0.24 | MSIE 8.0 |
32 | 4 | 0.19 | findlinks/2.6 (+http://wortschatz.uni-le... |
33 | 4 | 0.19 | Wada.vn Vietnamese Search/2.1 |
34 | 4 | 0.19 | findlinks/2.0.2 (+http://wortschatz.uni-... |
35 | 4 | 0.19 | Aghaven/Nutch-1.2 (www.aghaven.com) |
36 | 3 | 0.14 | findlinks/2.5 (+http://wortschatz.uni-le... |
37 | 3 | 0.14 | AcoonBot/4.10.8 |
38 | 2 | 0.09 | oBot/2.3.1 |
39 | 2 | 0.09 | Ubuntu/10.04 |
40 | 2 | 0.09 | Yahoo! Slurp |
41 | 2 | 0.09 | Sogou web spider/4.0(+http://www.sogou.c... |
42 | 2 | 0.09 | linkdex.com/v2.0 |
43 | 2 | 0.09 | coruscan/Nutch-1.4 |
44 | 2 | 0.09 | WBSearchBot/1.1 |
45 | 2 | 0.09 | Hailoobot/1.2 |
46 | 2 | 0.09 | AhrefsBot/2.0 |
47 | 1 | 0.05 | thumbshots-de-bot (+http://www.thumbshot... |
48 | 1 | 0.05 | Firefox/3.6.8 |
49 | 1 | 0.05 | CrawlFire - you can disable this Robot: ... |
50 | 1 | 0.05 | BlackBerry9630/5.0.0.732 Profile/MIDP-2.... |
51 | 1 | 0.05 | spbot/3.0 |
52 | 1 | 0.05 | MSIE 5.01 |
53 | 1 | 0.05 | MLBot (www.metadatalabs.com/mlbot) |
54 | 1 | 0.05 | CCBot/1.0 (+http://www.commoncrawl.org/b... |
55 | 1 | 0.05 | Content Crawler |
56 | 1 | 0.05 | Goldfire Server |
57 | 1 | 0.05 | ichiro/3.0 (http://help.goo.ne.jp/door/c... |
58 | 1 | 0.05 | aiHitBot/1.1 |
59 | 1 | 0.05 | nutch-1.4/Nutch-1.4 |
60 | 1 | 0.05 | Aboundex/0.2 (http://www.aboundex.com/cr... |