Skip to content

Instantly share code, notes, and snippets.

@Koc
Last active August 29, 2015 14:26
Show Gist options
  • Save Koc/91164641becfe4161cfd to your computer and use it in GitHub Desktop.
Save Koc/91164641becfe4161cfd to your computer and use it in GitHub Desktop.
metalloprokat@metalloprokat1:/data/www/metalloprokat.ru$ sudo cat /var/log/apache2/metalloprokat.ru-access.log | cut -d " " -f 1 | sort | uniq -c | sort -g -r | head -50
[sudo] password for metalloprokat:
5583374 10.1.142.101 10.1.142.101
58697 130.193.48.24 spider-130-193-48-24.yandex.com
58246 37.140.141.49 spider-37-140-141-49.yandex.com
57944 5.255.253.105 spider-5-255-253-105.yandex.com
57170 5.255.253.191 spider-5-255-253-191.yandex.com
55781 95.108.158.184 spider-95-108-158-184.yandex.com
51520 5.255.253.153 spider-5-255-253-153.yandex.com
43014 66.249.64.126 crawl-66-249-64-126.googlebot.com
42762 66.249.64.121 crawl-66-249-64-121.googlebot.com
42575 66.249.64.2 crawl-66-249-64-2.googlebot.com
33315 68.180.230.37 b115425.yse.yahoo.net
32186 188.226.86.162 188.226.86.162-FTTB.planeta.tc
31712 68.180.229.162 b115308.yse.yahoo.net
30575 130.193.48.11 spider-130-193-48-11.yandex.com
29853 66.249.64.97 crawl-66-249-64-97.googlebot.com
29698 5.45.254.226 spider-5-45-254-226.yandex.com
27145 95.167.189.79 spider-95-167-189-79.sputnik.ru
26229 68.180.229.123 b115323.yse.yahoo.net
22614 68.180.228.33 b110035.yse.yahoo.net
21632 66.249.64.15 crawl-66-249-64-15.googlebot.com
21048 66.249.64.20 crawl-66-249-64-20.googlebot.com
20477 95.108.158.146 spider-95-108-158-146.yandex.com
20053 68.180.230.177 b110333.yse.yahoo.net
18747 66.249.64.87 crawl-66-249-64-87.googlebot.com
17941 66.249.64.92 crawl-66-249-64-92.googlebot.com
16665 66.249.64.10 crawl-66-249-64-10.googlebot.com
14758 68.180.229.115 b115331.yse.yahoo.net
12684 66.249.64.107 crawl-66-249-64-107.googlebot.com
12657 5.45.254.227 spider-5-45-254-227.yandex.com
12575 66.249.64.102 crawl-66-249-64-102.googlebot.com
11335 68.180.229.124 b115322.yse.yahoo.net
10184 95.167.189.90 spider-95-167-189-90.sputnik.ru
9591 46.161.41.34 46.161.41.34
9226 37.140.141.39 spider-37-140-141-39.yandex.com
8037 66.249.64.110 crawl-66-249-64-110.googlebot.com
7794 66.249.64.115 crawl-66-249-64-115.googlebot.com
7225 66.249.64.206 crawl-66-249-64-206.googlebot.com
7136 66.249.64.211 crawl-66-249-64-211.googlebot.com
7117 5.45.254.225 spider-5-45-254-225.yandex.com
6041 66.249.64.241 crawl-66-249-64-241.googlebot.com
6029 217.69.133.169 octopus1.p.mail.ru
5753 66.249.64.120 crawl-66-249-64-120.googlebot.com
5680 66.249.64.246 crawl-66-249-64-246.googlebot.com
5673 157.55.39.79 msnbot-157-55-39-79.search.msn.com
5412 66.249.64.29 crawl-66-249-64-29.googlebot.com
5401 66.249.64.19 crawl-66-249-64-19.googlebot.com
5310 66.249.64.24 crawl-66-249-64-24.googlebot.com
5301 66.249.64.27 crawl-66-249-64-27.googlebot.com
5191 66.249.64.249 crawl-66-249-64-249.googlebot.com
4820 157.55.39.238 msnbot-157-55-39-238.search.msn.com
4749 66.249.64.213 crawl-66-249-64-213.googlebot.com
4488 66.249.64.212 crawl-66-249-64-212.googlebot.com
4435 68.180.230.51 b115411.yse.yahoo.net
4384 95.108.158.145 spider-95-108-158-145.yandex.com
4251 66.249.64.128 crawl-66-249-64-128.googlebot.com
4174 66.249.64.32 crawl-66-249-64-32.googlebot.com
4128 66.249.64.216 crawl-66-249-64-216.googlebot.com
4002 148.251.236.167 static.167.236.251.148.clients.your-server.de
3974 207.46.13.146 msnbot-207-46-13-146.search.msn.com
3957 66.249.64.22 crawl-66-249-64-22.googlebot.com
3909 68.180.229.242 b115452.yse.yahoo.net
3870 66.249.64.52 crawl-66-249-64-52.googlebot.com
3756 68.180.228.226 b110140.yse.yahoo.net
3739 66.249.64.217 crawl-66-249-64-217.googlebot.com
3702 68.180.228.49 b110022.yse.yahoo.net
3697 66.249.64.251 crawl-66-249-64-251.googlebot.com
3684 66.249.64.101 crawl-66-249-64-101.googlebot.com
3656 66.249.64.96 crawl-66-249-64-96.googlebot.com
3601 88.198.180.41 static.88-198-180-41.clients.your-server.de
3591 66.249.64.103 crawl-66-249-64-103.googlebot.com
3588 66.249.64.238 crawl-66-249-64-238.googlebot.com
3586 66.249.64.108 crawl-66-249-64-108.googlebot.com
3464 66.249.64.254 crawl-66-249-64-254.googlebot.com
3412 66.249.64.207 crawl-66-249-64-207.googlebot.com
3409 66.249.64.140 crawl-66-249-64-140.googlebot.com
3378 66.249.64.203 crawl-66-249-64-203.googlebot.com
3357 66.249.64.25 crawl-66-249-64-25.googlebot.com
3350 66.249.64.91 crawl-66-249-64-91.googlebot.com
3323 66.249.64.208 crawl-66-249-64-208.googlebot.com
3317 66.249.64.193 crawl-66-249-64-193.googlebot.com
3315 66.249.64.201 crawl-66-249-64-201.googlebot.com
3314 66.249.64.167 crawl-66-249-64-167.googlebot.com
3205 66.249.64.198 crawl-66-249-64-198.googlebot.com
3197 66.249.64.81 crawl-66-249-64-81.googlebot.com
3183 66.249.64.144 crawl-66-249-64-144.googlebot.com
3124 66.249.64.188 crawl-66-249-64-188.googlebot.com
3103 66.249.64.47 crawl-66-249-64-47.googlebot.com
3064 68.180.229.28 b110164.yse.yahoo.net
3060 66.249.64.229 crawl-66-249-64-229.googlebot.com
3040 66.249.64.169 crawl-66-249-64-169.googlebot.com
3027 66.249.64.70 crawl-66-249-64-70.googlebot.com
3026 66.249.64.113 crawl-66-249-64-113.googlebot.com
2990 66.249.64.71 crawl-66-249-64-71.googlebot.com
2984 66.249.64.145 crawl-66-249-64-145.googlebot.com
2974 66.249.64.174 crawl-66-249-64-174.googlebot.com
2934 66.249.64.33 crawl-66-249-64-33.googlebot.com
2862 68.180.229.221 b115473.yse.yahoo.net
2849 66.249.64.136 crawl-66-249-64-136.googlebot.com
2833 66.249.64.237 crawl-66-249-64-237.googlebot.com
2819 66.249.64.247 crawl-66-249-64-247.googlebot.com
2799 66.249.64.239 crawl-66-249-64-239.googlebot.com
2773 66.249.64.187 crawl-66-249-64-187.googlebot.com
2766 66.249.64.242 crawl-66-249-64-242.googlebot.com
2734 66.249.64.248 crawl-66-249-64-248.googlebot.com
2716 68.180.228.37 b110009.yse.yahoo.net
2707 68.180.228.250 b110134.yse.yahoo.net
2687 157.55.39.181 msnbot-157-55-39-181.search.msn.com
2675 66.249.64.243 crawl-66-249-64-243.googlebot.com
2663 66.249.64.197 crawl-66-249-64-197.googlebot.com
2650 66.249.64.172 crawl-66-249-64-172.googlebot.com
2646 66.249.64.162 crawl-66-249-64-162.googlebot.com
2644 66.249.64.21 crawl-66-249-64-21.googlebot.com
2639 66.249.64.244 crawl-66-249-64-244.googlebot.com
2622 66.249.64.26 crawl-66-249-64-26.googlebot.com
2622 66.249.64.236 crawl-66-249-64-236.googlebot.com
2619 157.55.39.180 msnbot-157-55-39-180.search.msn.com
2603 66.249.64.61 crawl-66-249-64-61.googlebot.com
2591 66.249.64.219 crawl-66-249-64-219.googlebot.com
2590 66.249.64.164 crawl-66-249-64-164.googlebot.com
2589 66.249.64.134 crawl-66-249-64-134.googlebot.com
2563 66.249.64.31 crawl-66-249-64-31.googlebot.com
2563 66.249.64.143 crawl-66-249-64-143.googlebot.com
2557 66.249.64.240 crawl-66-249-64-240.googlebot.com
2550 66.249.64.68 crawl-66-249-64-68.googlebot.com
2547 66.249.64.95 crawl-66-249-64-95.googlebot.com
2543 66.249.64.76 crawl-66-249-64-76.googlebot.com
2526 66.249.64.250 crawl-66-249-64-250.googlebot.com
2503 66.249.64.75 crawl-66-249-64-75.googlebot.com
2496 66.249.64.63 crawl-66-249-64-63.googlebot.com
2483 66.249.64.90 crawl-66-249-64-90.googlebot.com
2482 66.249.64.245 crawl-66-249-64-245.googlebot.com
2479 66.249.64.85 crawl-66-249-64-85.googlebot.com
2474 66.249.64.4 crawl-66-249-64-4.googlebot.com
2444 68.180.230.186 b110324.yse.yahoo.net
2444 68.180.229.218 b115476.yse.yahoo.net
2437 66.249.64.218 crawl-66-249-64-218.googlebot.com
2421 66.249.64.223 crawl-66-249-64-223.googlebot.com
2401 66.249.64.58 crawl-66-249-64-58.googlebot.com
2397 66.249.64.35 crawl-66-249-64-35.googlebot.com
2378 66.249.64.40 crawl-66-249-64-40.googlebot.com
2363 66.249.64.148 crawl-66-249-64-148.googlebot.com
2351 66.249.64.38 crawl-66-249-64-38.googlebot.com
2351 66.249.64.179 crawl-66-249-64-179.googlebot.com
2347 66.249.64.222 crawl-66-249-64-222.googlebot.com
2344 66.249.64.224 crawl-66-249-64-224.googlebot.com
2331 66.249.64.105 crawl-66-249-64-105.googlebot.com
2254 66.249.64.45 crawl-66-249-64-45.googlebot.com
2252 66.249.64.28 crawl-66-249-64-28.googlebot.com
2240 66.249.64.192 crawl-66-249-64-192.googlebot.com
2188 68.180.229.98 b115348.yse.yahoo.net
2169 66.249.64.138 crawl-66-249-64-138.googlebot.com
2139 68.180.229.92 b115354.yse.yahoo.net
2139 66.249.64.57 crawl-66-249-64-57.googlebot.com
2131 66.249.64.202 crawl-66-249-64-202.googlebot.com
2070 66.249.64.106 crawl-66-249-64-106.googlebot.com
2065 66.249.64.55 crawl-66-249-64-55.googlebot.com
2019 68.180.228.38 b110028.yse.yahoo.net
2006 79.134.201.234 79-134-201-234.obit.ru
2003 66.249.64.50 crawl-66-249-64-50.googlebot.com
2003 144.76.27.118 static.118.27.76.144.clients.your-server.de
1984 68.180.229.113 b115333.yse.yahoo.net
1936 66.249.64.11 crawl-66-249-64-11.googlebot.com
1935 68.180.229.230 b115464.yse.yahoo.net
1906 66.249.64.159 crawl-66-249-64-159.googlebot.com
1894 68.180.229.106 b115340.yse.yahoo.net
1872 66.249.64.228 crawl-66-249-64-228.googlebot.com
1866 68.180.228.28 b110020.yse.yahoo.net
1858 66.249.64.150 crawl-66-249-64-150.googlebot.com
1846 66.249.64.154 crawl-66-249-64-154.googlebot.com
1845 66.249.64.65 crawl-66-249-64-65.googlebot.com
1835 66.249.64.9 crawl-66-249-64-9.googlebot.com
1828 66.249.64.86 crawl-66-249-64-86.googlebot.com
1781 66.249.64.17 crawl-66-249-64-17.googlebot.com
1754 92.36.46.229 cdma-92-36-46-229.msk.skylink.ru
1730 66.249.64.42 crawl-66-249-64-42.googlebot.com
1718 66.249.64.66 crawl-66-249-64-66.googlebot.com
1706 66.249.64.37 crawl-66-249-64-37.googlebot.com
1689 66.249.64.83 crawl-66-249-64-83.googlebot.com
1631 66.249.64.111 crawl-66-249-64-111.googlebot.com
1617 66.249.64.116 crawl-66-249-64-116.googlebot.com
1594 66.249.64.182 crawl-66-249-64-182.googlebot.com
1566 68.180.230.104 b115382.yse.yahoo.net
1539 66.249.64.98 crawl-66-249-64-98.googlebot.com
1534 95.108.158.144 spider-95-108-158-144.yandex.com
1522 68.180.229.216 b115478.yse.yahoo.net
1521 66.249.64.60 crawl-66-249-64-60.googlebot.com
1499 68.180.230.109 b115377.yse.yahoo.net
1498 68.180.228.90 b110045.yse.yahoo.net
1497 66.249.64.77 crawl-66-249-64-77.googlebot.com
1495 66.249.64.39 crawl-66-249-64-39.googlebot.com
1490 212.24.35.116 web1.1adm.ru
1482 157.55.39.116 msnbot-157-55-39-116.search.msn.com
1477 68.180.228.102 b110075.yse.yahoo.net
1472 66.249.64.177 crawl-66-249-64-177.googlebot.com
1454 66.249.64.8 crawl-66-249-64-8.googlebot.com
1447 66.249.64.74 crawl-66-249-64-74.googlebot.com
1424 136.243.1.5 web3.1adm.ru
1422 66.249.64.139 crawl-66-249-64-139.googlebot.com
1408 78.46.174.55 static.55.174.46.78.clients.your-server.de
1404 68.180.230.230 b115504.yse.yahoo.net
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment