without_head.txt

要看我 麻煩到變更紀錄內看

太長ㄌ

wow.md

log格式

BulUnIs-M:docker_log buluni$ tail -n 10 dbabdbd77ef4b99f3f0b35edb285b26198295c79a35e06b69082ee11f9f8ed1b-json.log 
{"log":"192.168.240.3 - 1105103222 [03/Jul/2019:03:31:06 +0800] \"GET /v2/ap/semester HTTP/1.1\" 200 613 \"-\" \"Dart/2.3 (dart:io)\"\n","stream":"stdout","time":"2019-07-02T19:31:06.340403907Z"}
{"log":"192.168.240.3 - 1105103222 [03/Jul/2019:03:31:06 +0800] \"GET /v2/ap/users/coursetables/107/2 HTTP/1.1\" 200 856 \"-\" \"Dart/2.3 (dart:io)\"\n","stream":"stdout","time":"2019-07-02T19:31:06.857401081Z"}
{"log":"192.168.240.3 - 1105103222 [03/Jul/2019:03:31:08 +0800] \"GET /v2/ap/semester HTTP/1.1\" 200 613 \"-\" \"Dart/2.3 (dart:io)\"\n","stream":"stdout","time":"2019-07-02T19:31:08.466776038Z"}
{"log":"192.168.240.3 - 1105103222 [03/Jul/2019:03:31:08 +0800] \"GET /v2/ap/users/scores/107/2 HTTP/1.1\" 200 495 \"-\" \"Dart/2.3 (dart:io)\"\n","stream":"stdout","time":"2019-07-02T19:31:08.683723712Z"}
{"log":"192.168.240.3 - 1105103222 [03/Jul/2019:03:31:18 +0800] \"GET /v2/ap/users/scores/107/2 HTTP/1.1\" 200 495 \"-\" \"Dart/2.3 (dart:io)\"\n","stream":"stdout","time":"2019-07-02T19:31:18.35773261Z"}
{"log":"192.168.240.3 - 1105103222 [03/Jul/2019:03:31:20 +0800] \"GET /v2/ap/users/scores/107/1 HTTP/1.1\" 200 588 \"-\" \"Dart/2.3 (dart:io)\"\n","stream":"stdout","time":"2019-07-02T19:31:20.716932289Z"}
{"log":"192.168.240.3 - 1105103222 [03/Jul/2019:03:31:23 +0800] \"GET /v2/ap/users/scores/107/2 HTTP/1.1\" 200 495 \"-\" \"Dart/2.3 (dart:io)\"\n","stream":"stdout","time":"2019-07-02T19:31:23.337063111Z"}
{"log":"192.168.240.3 - 1105103222 [03/Jul/2019:03:31:35 +0800] \"GET /v2/ap/users/scores/107/1 HTTP/1.1\" 200 588 \"-\" \"Dart/2.3 (dart:io)\"\n","stream":"stdout","time":"2019-07-02T19:31:35.318326282Z"}
{"log":"192.168.240.3 - 1105103222 [03/Jul/2019:03:31:39 +0800] \"GET /v2/ap/users/scores/107/2 HTTP/1.1\" 200 495 \"-\" \"Dart/2.3 (dart:io)\"\n","stream":"stdout","time":"2019-07-02T19:31:39.486978615Z"}
{"log":"192.168.240.3 - C107110232 [03/Jul/2019:03:33:32 +0800] \"GET /v2/ap/users/scores/107/2 HTTP/1.1\" 200 542 \"-\" \"Dart/2.3 (dart:io)\"\n","stream":"stdout","time":"2019-07-02T19:33:32.206312134Z"}

(學號不遮了 也不算敏感資料吧 log時間有確定無誤)

basic_auth 帳密塞header了 沒發現半個POST在檔案中

大致尋找10000筆中沒有發現會跟GET重疊到的東西

so ..

grep 'GET'

總筆數

$ cat dbabdbd77ef4b99f3f0b35edb285b26198295c79a35e06b69082ee11f9f8ed1b-json.log | grep 'GET' | wc -l

   59023

$ cat dbabdbd77ef4b99f3f0b35edb285b26198295c79a35e06b69082ee11f9f8ed1b-json.log  | grep 'GET' | awk '{print $4}' | uniq -c | sort -rn | head

awk 抓時間 uniq集合一下 sort排序一下 head看頭

$cat dbabdbd77ef4b99f3f0b35edb285b26198295c79a35e06b69082ee11f9f8ed1b-json.log  | grep 'GET' | awk '{print $4}' | uniq -c | sort -rn | head 
  23 [02/Jul/2019:17:55:09
  23 [01/Jul/2019:23:17:44
  20 [02/Jul/2019:04:43:03
  20 [01/Jul/2019:15:28:11
  20 [01/Jul/2019:12:47:42
  19 [03/Jul/2019:00:30:38
  19 [02/Jul/2019:00:32:08
  18 [03/Jul/2019:00:32:13
  18 [02/Jul/2019:18:18:55
  18 [02/Jul/2019:04:44:37

這裡也來了一份不head的，但太長了 丟在另一個檔案上

表格

request/sec	time
23	[02/Jul/2019:17:55:09
23	[01/Jul/2019:23:17:44
20	[02/Jul/2019:04:43:03
20	[01/Jul/2019:15:28:11
20	[01/Jul/2019:12:47:42
19	[03/Jul/2019:00:30:38
19	[02/Jul/2019:00:32:08
18	[03/Jul/2019:00:32:13
18	[02/Jul/2019:18:18:55

補充說明 開始記錄時間約在: [01/Jul/2019:12:04:33 +0800]