Skip to content

Instantly share code, notes, and snippets.

@dlangille

dlangille/0 - sample data

Last active January 11, 2024 00:55
Show Gist options
  • Save dlangille/e011da1b2bd6b50cb91ee08597c5f3f5 to your computer and use it in GitHub Desktop.
Save dlangille/e011da1b2bd6b50cb91ee08597c5f3f5 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
0 - sample data
47.76.35.19 - - [09/Jan/2024:00:00:02 +0000] "GET /commit.php?files=yes&message_id=200809240908.m8O98gWf053619%40repoman.freebsd.org HTTP/1.1" 200 4156 "-" "Mozilla/5.0 (Windows NT 6.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/61.0.2013.169 Safari/537.36"
47.76.35.19 - - [09/Jan/2024:00:00:02 +0000] "HEAD /commit.php?category=graphics&files=yes&message_id=201502211511.t1LFBrkF003830%40svn.freebsd.org&port=gthumb HTTP/1.1" 301 0 "-" "Mozilla/5.0 (Windows NT 6.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/61.0.2975.4 Safari/537.36"
47.76.35.19 - - [09/Jan/2024:00:00:03 +0000] "HEAD /commit.php?category=x11-toolkits&files=yes&message_id=200412132012.iBDKCF3f073228%40repoman.freebsd.org&port=qt33 HTTP/1.1" 301 0 "-" "Mozilla/5.0 (Windows NT 6.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/61.0.3405.157 Safari/537.36"
47.76.35.19 - - [09/Jan/2024:00:00:03 +0000] "HEAD /search.php?method=match&query=databases%2Fpecl-cassandra&stype=depends_all HTTP/1.1" 301 0 "-" "Mozilla/5.0 (Windows NT 6.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/62.0.3231.150 Safari/537.36"
47.76.35.19 - - [09/Jan/2024:00:00:03 +0000] "HEAD /commit.php?category=databases&files=yes&message_id=200204291333.g3TDXwC76245%40freefall.freebsd.org&port=zodb HTTP/1.1" 301 0 "-" "Mozilla/5.0 (Windows NT 6.3; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.2715.39 Safari/537.36"
47.76.35.19 - - [09/Jan/2024:00:00:04 +0000] "HEAD /commit.php?category=databases&files=yes&message_id=200204291333.g3TDXwC76245%40freefall.freebsd.org&port=zodb HTTP/1.1" 200 0 "-" "Mozilla/5.0 (Windows NT 6.3; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.2715.39 Safari/537.36"
47.76.35.19 - - [09/Jan/2024:00:00:04 +0000] "HEAD /search.php?method=match&query=databases%2Fpecl-cassandra&stype=depends_all HTTP/1.1" 200 0 "-" "Mozilla/5.0 (Windows NT 6.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/62.0.3231.150 Safari/537.36"
47.76.35.19 - - [09/Jan/2024:00:00:04 +0000] "GET /commit.php?category=databases&files=yes&message_id=200204291333.g3TDXwC76245%40freefall.freebsd.org&port=zodb HTTP/1.1" 301 169 "-" "Mozilla/5.0 (Windows NT 6.3; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.2715.39 Safari/537.36"
47.76.35.19 - - [09/Jan/2024:00:00:04 +0000] "GET /search.php?method=match&query=databases%2Fpecl-cassandra&stype=depends_all HTTP/1.1" 301 169 "-" "Mozilla/5.0 (Windows NT 6.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/62.0.3231.150 Safari/537.36"
47.76.35.19 - - [09/Jan/2024:00:00:04 +0000] "HEAD /commit.php?category=graphics&files=yes&message_id=201502211511.t1LFBrkF003830%40svn.freebsd.org&port=gthumb HTTP/1.1" 200 0 "-" "Mozilla/5.0 (Windows NT 6.0; Win64; x64) AppleWebKit/537.36[0:54 aws-1-nginx01 dan /var/log/nginx] %
47.76.35.19 - - [09/Jan/2024:21:09:02 +0000] "GET /commit.php?category=sysutils&files=yes&message_id=ea7123695aad83707eba8adaf42b29dac7f296e4&port=gigolo HTTP/1.1" 200 53894 "-" "Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/75.0.3856.17 Safari/537.36"
47.76.35.19 - - [09/Jan/2024:21:09:02 +0000] "HEAD /commit.php?category=sysutils&files=yes&message_id=201205220850.q4M8op4j024318%40repoman.freebsd.org&port=p5-File-Next HTTP/1.1" 301 0 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.2100.88 Safari/537.36"
47.76.35.19 - - [09/Jan/2024:21:09:02 +0000] "HEAD /commit.php?category=devel&files=yes&message_id=201309201713.r8KHDlD5071784%40svn.freebsd.org&port=pecl-shape HTTP/1.1" 200 0 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/61.0.3580.39 Safari/537.36"
47.76.35.19 - - [09/Jan/2024:21:09:02 +0000] "HEAD /commit.php?category=hebrew&files=yes&message_id=201509232106.t8NL6DOQ041651%40repo.freebsd.org&port=libreoffice HTTP/1.1" 200 0 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/60.0.2801.153 Safari/537.36"
47.76.35.19 - - [09/Jan/2024:21:09:02 +0000] "GET /commit.php?category=devel&files=yes&message_id=201309201713.r8KHDlD5071784%40svn.freebsd.org&port=pecl-shape HTTP/1.1" 301 169 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/61.0.3580.39 Safari/537.36"
47.76.35.19 - - [09/Jan/2024:21:09:02 +0000] "GET /commit.php?category=hebrew&files=yes&message_id=201509232106.t8NL6DOQ041651%40repo.freebsd.org&port=libreoffice HTTP/1.1" 301 169 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/60.0.2801.153 Safari/537.36"
47.76.35.19 - - [09/Jan/2024:21:09:03 +0000] "GET /commit.php?category=hebrew&files=yes&message_id=201509232106.t8NL6DOQ041651%40repo.freebsd.org&port=libreoffice HTTP/1.1" 200 12958 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/60.0.2801.153 Safari/537.36"
47.76.35.19 - - [09/Jan/2024:21:09:03 +0000] "GET /commit.php?category=devel&files=yes&message_id=305f148f482daf30dcf728039d03d019f88344eb&port=py-murmurhash HTTP/1.1" 200 25664 "-" "Mozilla/5.0 (Windows NT 6.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/71.0.3782.4 Safari/537.36"
47.76.35.19 - - [09/Jan/2024:21:09:04 +0000] "GET /commit.php?category=devel&files=yes&message_id=201309201713.r8KHDlD5071784%40svn.freebsd.org&port=pecl-shape HTTP/1.1" 200 25373 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/61.0.3580.39 Safari/537.36"
47.76.35.19 - - [09/Jan/2024:21:09:04 +0000] "GET /search.php?method=match&query=japanese%2Fruby-uconv&stype=depends_all HTTP/1.1" 200 7062 "-" "Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/68.0.2833.40 Safari/537.36"
Raw
1 - grep
[15:43 aws-1-nginx01 dan /var/log/nginx] % sudo grep -E '^47.76.35.19' freshports.org-access.log.0| grep -o '/[0-9][0-9][0-9][0-9]:[0-9][0-9]:[0-9]' | uniq -c
2647 /2024:00:0
1897 /2024:00:1
2157 /2024:00:2
2590 /2024:00:3
2373 /2024:00:4
2575 /2024:00:5
2427 /2024:01:0
2172 /2024:01:1
2307 /2024:01:2
2758 /2024:01:3
1599 /2024:01:4
2437 /2024:01:5
2522 /2024:02:0
2652 /2024:02:1
2355 /2024:02:2
2434 /2024:02:3
2535 /2024:02:4
1386 /2024:02:5
2451 /2024:03:0
2275 /2024:03:1
2527 /2024:03:2
2192 /2024:03:3
2939 /2024:03:4
2727 /2024:03:5
2986 /2024:04:0
2458 /2024:04:1
2063 /2024:04:2
2291 /2024:04:3
2896 /2024:04:4
2541 /2024:04:5
2471 /2024:05:0
2449 /2024:05:1
2364 /2024:05:2
2092 /2024:05:3
2333 /2024:05:4
3292 /2024:05:5
2972 /2024:06:0
2328 /2024:06:1
1911 /2024:06:2
2296 /2024:06:3
2793 /2024:06:4
3328 /2024:06:5
3613 /2024:07:0
3527 /2024:07:1
3779 /2024:07:2
3862 /2024:07:3
3890 /2024:07:4
3586 /2024:07:5
3326 /2024:08:0
3090 /2024:08:1
3904 /2024:08:2
3862 /2024:08:3
4242 /2024:08:4
4085 /2024:08:5
4152 /2024:09:0
4173 /2024:09:1
4135 /2024:09:2
4073 /2024:09:3
4052 /2024:09:4
3839 /2024:09:5
4041 /2024:10:0
4035 /2024:10:1
3957 /2024:10:2
3952 /2024:10:3
4022 /2024:10:4
4022 /2024:10:5
2481 /2024:11:0
3999 /2024:11:1
3909 /2024:11:2
3947 /2024:11:3
4086 /2024:11:4
4175 /2024:11:5
4128 /2024:12:0
4110 /2024:12:1
4075 /2024:12:2
4034 /2024:12:3
4198 /2024:12:4
4325 /2024:12:5
4271 /2024:13:0
4112 /2024:13:1
4017 /2024:13:2
4111 /2024:13:3
4117 /2024:13:4
4193 /2024:13:5
4149 /2024:14:0
4123 /2024:14:1
4022 /2024:14:2
4065 /2024:14:3
4113 /2024:14:4
4275 /2024:14:5
4270 /2024:15:0
4258 /2024:15:1
4069 /2024:15:2
4072 /2024:15:3
4149 /2024:15:4
2566 /2024:15:5
4102 /2024:16:0
4081 /2024:16:1
3919 /2024:16:2
4067 /2024:16:3
4123 /2024:16:4
3981 /2024:16:5
3993 /2024:17:0
4103 /2024:17:1
4029 /2024:17:2
4050 /2024:17:3
3966 /2024:17:4
4045 /2024:17:5
4238 /2024:18:0
4276 /2024:18:1
4105 /2024:18:2
4018 /2024:18:3
4166 /2024:18:4
4091 /2024:18:5
4245 /2024:19:0
4245 /2024:19:1
3977 /2024:19:2
4008 /2024:19:3
4162 /2024:19:4
4124 /2024:19:5
3941 /2024:20:0
4210 /2024:20:1
4081 /2024:20:2
4083 /2024:20:3
4159 /2024:20:4
3997 /2024:20:5
3914 /2024:21:0
Raw
2 - awk
This from https://bsd.network/web/@ed1conf/111732990677643585
[19:35 aws-1-nginx01 dan /var/log/nginx] % sudo awk -vIP=47.76.35.19 '$1 == IP {k=substr($4, 2, 16) '0'; if (k == oldk) ++i; else {print oldk, i; i=1} oldk=k}END {print oldk, i}' freshports.org-access.log.0
09/Jan/2024:00:00 2647
09/Jan/2024:00:10 1897
09/Jan/2024:00:20 2157
09/Jan/2024:00:30 2590
09/Jan/2024:00:40 2373
09/Jan/2024:00:50 2575
09/Jan/2024:01:00 2427
09/Jan/2024:01:10 2172
09/Jan/2024:01:20 2307
09/Jan/2024:01:30 2758
09/Jan/2024:01:40 1599
09/Jan/2024:01:50 2437
09/Jan/2024:02:00 2522
09/Jan/2024:02:10 2652
09/Jan/2024:02:20 2355
09/Jan/2024:02:30 2434
09/Jan/2024:02:40 2535
09/Jan/2024:02:50 1386
09/Jan/2024:03:00 2451
09/Jan/2024:03:10 2275
09/Jan/2024:03:20 2527
09/Jan/2024:03:30 2192
09/Jan/2024:03:40 2939
09/Jan/2024:03:50 2727
09/Jan/2024:04:00 2986
09/Jan/2024:04:10 2458
09/Jan/2024:04:20 2063
09/Jan/2024:04:30 2291
09/Jan/2024:04:40 2896
09/Jan/2024:04:50 2541
09/Jan/2024:05:00 2471
09/Jan/2024:05:10 2449
09/Jan/2024:05:20 2364
09/Jan/2024:05:30 2092
09/Jan/2024:05:40 2333
09/Jan/2024:05:50 3292
09/Jan/2024:06:00 2972
09/Jan/2024:06:10 2328
09/Jan/2024:06:20 1911
09/Jan/2024:06:30 2296
09/Jan/2024:06:40 2793
09/Jan/2024:06:50 3328
09/Jan/2024:07:00 3613
09/Jan/2024:07:10 3527
09/Jan/2024:07:20 3779
09/Jan/2024:07:30 3862
09/Jan/2024:07:40 3890
09/Jan/2024:07:50 3586
09/Jan/2024:08:00 3326
09/Jan/2024:08:10 3090
09/Jan/2024:08:20 3904
09/Jan/2024:08:30 3862
09/Jan/2024:08:40 4242
09/Jan/2024:08:50 4085
09/Jan/2024:09:00 4152
09/Jan/2024:09:10 4173
09/Jan/2024:09:20 4135
09/Jan/2024:09:30 4073
09/Jan/2024:09:40 4052
09/Jan/2024:09:50 3839
09/Jan/2024:10:00 4041
09/Jan/2024:10:10 4035
09/Jan/2024:10:20 3957
09/Jan/2024:10:30 3952
09/Jan/2024:10:40 4022
09/Jan/2024:10:50 4022
09/Jan/2024:11:00 2481
09/Jan/2024:11:10 3999
09/Jan/2024:11:20 3909
09/Jan/2024:11:30 3947
09/Jan/2024:11:40 4086
09/Jan/2024:11:50 4175
09/Jan/2024:12:00 4128
09/Jan/2024:12:10 4110
09/Jan/2024:12:20 4075
09/Jan/2024:12:30 4034
09/Jan/2024:12:40 4198
09/Jan/2024:12:50 4325
09/Jan/2024:13:00 4271
09/Jan/2024:13:10 4112
09/Jan/2024:13:20 4017
09/Jan/2024:13:30 4111
09/Jan/2024:13:40 4117
09/Jan/2024:13:50 4193
09/Jan/2024:14:00 4149
09/Jan/2024:14:10 4123
09/Jan/2024:14:20 4022
09/Jan/2024:14:30 4065
09/Jan/2024:14:40 4113
09/Jan/2024:14:50 4275
09/Jan/2024:15:00 4270
09/Jan/2024:15:10 4258
09/Jan/2024:15:20 4069
09/Jan/2024:15:30 4072
09/Jan/2024:15:40 4149
09/Jan/2024:15:50 2566
09/Jan/2024:16:00 4102
09/Jan/2024:16:10 4081
09/Jan/2024:16:20 3919
09/Jan/2024:16:30 4067
09/Jan/2024:16:40 4123
09/Jan/2024:16:50 3981
09/Jan/2024:17:00 3993
09/Jan/2024:17:10 4103
09/Jan/2024:17:20 4029
09/Jan/2024:17:30 4050
09/Jan/2024:17:40 3966
09/Jan/2024:17:50 4045
09/Jan/2024:18:00 4238
09/Jan/2024:18:10 4276
09/Jan/2024:18:20 4105
09/Jan/2024:18:30 4018
09/Jan/2024:18:40 4166
09/Jan/2024:18:50 4091
09/Jan/2024:19:00 4245
09/Jan/2024:19:10 4245
09/Jan/2024:19:20 3977
09/Jan/2024:19:30 4008
09/Jan/2024:19:40 4162
09/Jan/2024:19:50 4124
09/Jan/2024:20:00 3941
09/Jan/2024:20:10 4210
09/Jan/2024:20:20 4081
09/Jan/2024:20:30 4083
09/Jan/2024:20:40 4159
09/Jan/2024:20:50 3997
09/Jan/2024:21:00 3914
Raw
3 -
From https://twitter.com/ConsultingCso/status/1745225555044376781
[23:56 aws-1-nginx01 dan /var/log/nginx] % sudo grep '47.76.35.19' freshports.org-access.log.0 | \
awk '{print $4}' | \
cut -d: -f1,2,3 | \
sed -E 's/:[0-5][0-9]/:00/' | \
sort | \
uniq -c
7731 [09/Jan/2024:00:00
7739 [09/Jan/2024:00:01
7899 [09/Jan/2024:00:02
7977 [09/Jan/2024:00:03
8010 [09/Jan/2024:00:04
7572 [09/Jan/2024:00:05
7494 [09/Jan/2024:00:06
7591 [09/Jan/2024:00:07
7784 [09/Jan/2024:00:08
7543 [09/Jan/2024:00:09
7507 [09/Jan/2024:00:10
7393 [09/Jan/2024:00:11
7590 [09/Jan/2024:00:12
7377 [09/Jan/2024:00:13
7353 [09/Jan/2024:00:14
7435 [09/Jan/2024:00:15
7073 [09/Jan/2024:00:16
6775 [09/Jan/2024:00:17
6997 [09/Jan/2024:00:18
7073 [09/Jan/2024:00:19
6835 [09/Jan/2024:00:20
7026 [09/Jan/2024:00:21
7348 [09/Jan/2024:00:22
7139 [09/Jan/2024:00:23
7342 [09/Jan/2024:00:24
7352 [09/Jan/2024:00:25
7140 [09/Jan/2024:00:26
7093 [09/Jan/2024:00:27
7318 [09/Jan/2024:00:28
7069 [09/Jan/2024:00:29
7167 [09/Jan/2024:00:30
7127 [09/Jan/2024:00:31
7196 [09/Jan/2024:00:32
7185 [09/Jan/2024:00:33
7238 [09/Jan/2024:00:34
7340 [09/Jan/2024:00:35
7142 [09/Jan/2024:00:36
7515 [09/Jan/2024:00:37
7541 [09/Jan/2024:00:38
7406 [09/Jan/2024:00:39
7457 [09/Jan/2024:00:40
7542 [09/Jan/2024:00:41
7439 [09/Jan/2024:00:42
7506 [09/Jan/2024:00:43
7708 [09/Jan/2024:00:44
7366 [09/Jan/2024:00:45
7395 [09/Jan/2024:00:46
7237 [09/Jan/2024:00:47
7700 [09/Jan/2024:00:48
7563 [09/Jan/2024:00:49
7413 [09/Jan/2024:00:50
7417 [09/Jan/2024:00:51
7688 [09/Jan/2024:00:52
7268 [09/Jan/2024:00:53
7152 [09/Jan/2024:00:54
7323 [09/Jan/2024:00:55
7210 [09/Jan/2024:00:56
7225 [09/Jan/2024:00:57
7385 [09/Jan/2024:00:58
7509 [09/Jan/2024:00:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment