Robots |
1 | 194 | 16.55 | python-requests/2.2.1 CPython/2.7.3 Linu... |
2 | 184 | 15.70 | MJ12bot/v1.4.5 |
3 | 141 | 12.03 | compatible Mozilla/5.0 |
4 | 127 | 10.84 | bingbot/2.0 |
5 | 124 | 10.58 | Googlebot/2.1 |
6 | 69 | 5.89 | Linux x86_64 |
7 | 55 | 4.69 | DotBot/1.1 |
8 | 40 | 3.41 | YandexBot/3.0 |
9 | 37 | 3.16 | robots |
10 | 28 | 2.39 | Yahoo! Slurp |
11 | 23 | 1.96 | msnbot/2.0b (+http://search.msn.com/msnb... |
12 | 22 | 1.88 | coccoc/1.0 |
13 | 18 | 1.54 | Sogou web spider/4.0(+http://www.sogou.c... |
14 | 11 | 0.94 | AhrefsBot/5.0 |
15 | 9 | 0.77 | LSSRocketCrawler/1.0 LightspeedSystems |
16 | 8 | 0.68 | MSIE 8.0 |
17 | 7 | 0.60 | Exabot/3.0 |
18 | 6 | 0.51 | spbot/4.4.2 |
19 | 5 | 0.43 | SeznamBot/3.2 |
20 | 5 | 0.43 | voltron |
21 | 5 | 0.43 | Wada.vn Vietnamese Search |
22 | 5 | 0.43 | Y!J-ASR/0.1 crawler (http://www.yahoo-he... |
23 | 4 | 0.34 | OrangeBot/2.0 |
24 | 4 | 0.34 | MojeekBot/0.6 |
25 | 3 | 0.26 | Steeler/3.5 |
26 | 3 | 0.26 | MSIE 9.0 |
27 | 3 | 0.26 | - |
28 | 3 | 0.26 | Firefox/2.0.0.6 |
29 | 2 | 0.17 | Wotbox/2.01 (+http://www.wotbox.com/bot/... |
30 | 2 | 0.17 | ScoutJet |
31 | 2 | 0.17 | SemrushBot/0.99~bl |
32 | 2 | 0.17 | NextGenSearchBot 1 (for information visi... |
33 | 2 | 0.17 | panscient.com |
34 | 2 | 0.17 | aiHitBot/2.9 |
35 | 2 | 0.17 | MegaIndex.ru/2.0 |
36 | 2 | 0.17 | meanpathbot/1.0 |
37 | 2 | 0.17 | Riddler (http://riddler.io/about) |
38 | 2 | 0.17 | GigablastOpenSource/1.0 |
39 | 1 | 0.09 | fujilabolx6 Spider/Nutch-1.10 |
40 | 1 | 0.09 | NalezenCzBot/1.0 (http://www.nalezen.cz/... |
41 | 1 | 0.09 | MSIE 6.0 |
42 | 1 | 0.09 | archive.org_bot |
43 | 1 | 0.09 | MSIE 5.01 |
44 | 1 | 0.09 | HTTrack 3.0x |
45 | 1 | 0.09 | ltx71 - (http://ltx71.com/) |
46 | 1 | 0.09 | Python-urllib/2.7 (+http://ella.juls.sav... |
47 | 1 | 0.09 | SEOkicks-Robot |