Skip to content

Instantly share code, notes, and snippets.

@jpmckinney
Last active August 29, 2015 13:58
Show Gist options
  • Save jpmckinney/9995555 to your computer and use it in GitHub Desktop.
Save jpmckinney/9995555 to your computer and use it in GitHub Desktop.
HTTP methods:
5 CONNECT
10 PUT
47 PROPFIND
1962 POST
97097 null
97115 OPTIONS
102141 HEAD
2901012 GET
Successful HTTP methods:
203 206 GET
8498 200 OPTIONS
101223 200 HEAD
2585289 200 GET
HTTP statuses:
4 504
151 null
203 403
307 502
658 500
689 499
730 503
1560 206
1805 302
2009 408
52897 304
85733 404
88570 405
98611 400
168413 301
2697060 200
28% 404s by robots, etc.
68% 404s on endpoint (>50 requests)
50 /postcodes/T1W0H5/?sets=alberta-electoral-districts
52 /postcodes/59715
54 /postcodes/V3B8G3/?sets=british-columbia-electoral-districts
54 /postcodes/T4B3V7/?sets=alberta-electoral-districts
54 /postcodes/59860
54 /postcodes/V5L0A9/?sets=british-columbia-electoral-districts
54 /postcodes/V3G6T2/?sets=british-columbia-electoral-districts
54 /postcodes/V2Y3V9/?sets=british-columbia-electoral-districts
55 /postcodes/V8X1I2/?sets=british-columbia-electoral-districts
55 /postcodes/V1L1F7/?sets=british-columbia-electoral-districts
56 /postcodes/V3Y3J6/?sets=british-columbia-electoral-districts
59 /postcodes/V9Z9H6/?sets=british-columbia-electoral-districts
60 /postcodes/V2K9X9/?sets=british-columbia-electoral-districts
61 /postcodes/?pretty=1
61 /postcodes/V9V4N1/?sets=british-columbia-electoral-districts
61 /postcodes/V0W3A5/?sets=british-columbia-electoral-districts
62 /postcodes/V0R7X1/?sets=british-columbia-electoral-districts
62 /postcodes/V0E1S1/?sets=british-columbia-electoral-districts
62 /postcodes/V1H3W1/?sets=british-columbia-electoral-districts
62 /postcodes/V0J6K2/?sets=british-columbia-electoral-districts
64 /postcodes/?sets=toronto-wards
65 /postcodes/V0E1W1/?sets=british-columbia-electoral-districts
65 /postcodes/T6W2A2/?sets=alberta-electoral-districts
66 /postcodes/V5Y7L3/?sets=british-columbia-electoral-districts
66 /postcodes/V1M7W3/?sets=british-columbia-electoral-districts
66 /postcodes/V6E7S7/?sets=british-columbia-electoral-districts
66 /representatives//?limit=300
66 /postcodes/V4G1R4/?sets=british-columbia-electoral-districts
66 /postcodes/V0J1T9/?sets=british-columbia-electoral-districts
70 /postcodes/V0H1T4/
71 /postcodes/D5D6D5/
71 /postcodes/V1L7C8/?sets=british-columbia-electoral-districts
71 /postcodes/VON2E0/?sets=british-columbia-electoral-districts
72 /postcodes/V0N1T2/?sets=british-columbia-electoral-districts
75 /postcodes/V0R2Z5/?sets=british-columbia-electoral-districts
75 /postcodes/V6R5Z5/?sets=british-columbia-electoral-districts
75 /postcodes/V0R2Z2/?sets=british-columbia-electoral-districts
75 /postcodes/V0R2Z1/?sets=british-columbia-electoral-districts
75 /postcodes/V0R2Z4/?sets=british-columbia-electoral-districts
75 /postcodes/V5X6H3/?sets=british-columbia-electoral-districts
75 /postcodes/V6J1R5/?sets=british-columbia-electoral-districts
75 /boundaries/?touches=ontario-electoral-districts/66&limit=40
78 /postcodes/59802
79 /postcodes/V7G9N4/?sets=british-columbia-electoral-districts
79 /postcodes/V7M7N7/?sets=british-columbia-electoral-districts
80 /postcodes/59601
83 /postcodes/T0B3M2/?sets=alberta-electoral-districts
96 /postcodes/59911
116 /postcodes/59801
123 /postcodes/59912
123 /postcodes/V8B1G0/?sets=british-columbia-electoral-districts
136 /postcodes/
159 /postcodes/V0G2G1/?sets=british-columbia-electoral-districts
250 /boundaries//simple_shape
250 /postcodes/59937
267 /postcodes/V0G2G2/?sets=british-columbia-electoral-districts
405 /postcodes/59901
431 /boundaries/?touches=ottawa-wards/7
459 /boundaries/?touches=ontario-electoral-districts/66
1233 /boundaries/?touches=ottawa-wards/7&limit=300
1513 /boundaries/?touches=ontario-electoral-districts/66&limit=300
2152 /postcodes//
5% 404s on other paths (>20 requests)
20 /apple-touch-icon-precomposed.png
21 /setlang//https://groups.google.com/forum
21 /api/https://github.com/ncadou/pyrepresent
21 /demo/https://github.com/opennorth/jquery-findyourrep-ca
21 /https://oss.maxcdn.com/libs/respond.js/1.4.2/respond.min.js
21 /https://oss.maxcdn.com/libs/html5shiv/3.7.0/html5shiv.js
21 /api/https://github.com/opennorth/govkit-ca
21 //postcodes//
21 /api/https://drupal.org/project/civinorth
21 /api/https://drupal.org/project/represent
22 /api/+++++++++++++++++++++++++++++++++++++++++++++++Result:+no+post+sending+forms+are+found;
22 /https://netdna.bootstrapcdn.com/bootstrap/3.1.1/js/bootstrap.min.js
22 /https://github.com/sprice/represent
23 /api/https://github.com/opennorth/represent-canada-data
23 /https://github.com/opennorth/govkit-ca
23 /api/https://github.com/sprice/represent
23 /https://github.com/opennorth/represent-canada-data
24 /https://groups.google.com/forum
24 /https://github.com/opennorth/represent-canada
24 /https://github.com/ncadou/pyrepresent
25 /https://drupal.org/project/represent
28 /government/(
28 /api/(
28 /data/(
28 /(
28 /demo/(
28 /static/js/),this.$menu.html(b),this},next:function(b){var c=this.$menu.find(
30 //postcodes/K/
31 /static/js/).html(c.highlighter(d)),b[0]}),b.first().addClass(
31 /static/js/).html(formatJSON($(
32 /api/trackback/
33 /government/mailto:[email protected]
33 /data/mailto:[email protected]
39 /api/mailto:[email protected]
40 /demo/mailto:[email protected]
44 /mailto:[email protected]
50 //images/stories/explore.gif
72 //maps.google.com
74 //ajax.googleapis.com
83 /user
245 /info/whitelist.pac
Potentially abusive IPs (many 404 postcodes) (>400):
402 69.167.170.74
451 64.69.70.50
465 192.234.196.229
652 70.31.41.109
657 75.157.149.14
874 67.213.65.87
1027 67.213.65.91
1144 72.55.179.16
1585 192.234.196.230
2168 76.74.128.20
3355 68.232.64.242
5274 174.118.11.89
6569 199.83.240.54
8135 162.213.251.136
13825 209.15.213.69
Traffic by IP (>1000 requests):
1031 72.22.74.51
1058 134.117.249.38
1086 184.69.30.6
1146 207.58.129.221
1230 24.212.247.106
1316 192.197.82.205
1334 67.68.160.158
1379 66.207.222.14
1382 54.205.219.255
1416 174.93.162.38
1420 206.177.43.77
1459 135.23.71.93
1576 209.97.213.81
1726 108.59.11.71
1971 192.145.239.5
2045 198.84.195.49
2048 75.98.193.186
2162 162.243.92.231
2299 199.168.222.18
2304 207.34.205.171
2400 107.6.25.170
2478 99.237.40.34
2544 66.199.190.14
2738 107.6.25.183
2885 184.149.180.162
3078 162.243.96.91
3085 209.97.193.146
3355 216.8.176.167
3399 64.69.70.50
3422 192.99.19.154
3441 199.58.85.90
3478 198.57.247.239
3666 209.167.115.5
4142 173.32.215.68
4204 24.203.176.236
4805 198.58.124.36
4993 162.243.97.177
5383 184.69.140.29
5419 174.118.11.89
7446 24.212.135.194
8097 75.157.149.14
8124 64.179.216.242
8197 50.87.144.68
8898 206.47.115.146
10194 72.55.179.16
10801 69.167.170.74
12529 216.70.92.199
13301 99.240.252.113
15353 74.121.197.103
19316 23.233.111.74
24805 199.83.240.54
25045 75.98.196.143
26855 192.234.196.232
27359 69.165.202.100
27704 209.15.213.70
28633 192.234.196.229
41386 76.74.128.20
44220 67.213.65.87
48304 173.236.140.35
52837 67.224.85.251
68213 67.213.65.91
70544 192.234.196.230
71761 162.213.251.136
113971 69.64.61.63
216645 209.15.213.69
337006 70.31.41.109
609769 68.232.64.242
Traffic by referrer (>20 requests):
20 organize.notankers.ca
21 www.nipost.org
22 foodgrainsbank.tacticahosting.com
22 semalt.com
22 opendatasummit.ca
22 api.twitter.com
23 gis.stackexchange.com
24 sites.google.com
25 semalt.semalt.com
26 www.safeschoolsalberta.ca
27 www.google.co.uk
27 fcmdemo-cstreetdev.nationbuilder.com
27 seiuhealthcare.nationbuilder.com
28 api.openparliament.ca
28 gsa.site
31 www.LocalVote2014.ca
33 www.cunation.ca
36 salishseaspillmap.org
37 openparliament.ca
40 www1.toronto.ca
41 www.actioncdifficile.com
43 nordouvert.ca
43 fairforcanada.ca
43 www.seiuhealthcare.ca
45 webcache.googleusercontent.com
49 foodgrainsbank.local.dev
50 sk.parentalconsent.ca
52 represent.poplus.org
56 www.kerrywall.com
58 doctorsandpatientsdev.oma.org
59 chrishuntweb.com
59 cstreettools-cstreetdev.nationbuilder.com
67 omarmir.github.io
72 dl.dropboxusercontent.com
76 10.80.80.187
85 imaginecanada
91 sauvonsnossoinsdesante.ca
94 www.salishseaspillmap.org
99 www.bing.com
103 www.supportontariodoctors.com.ws7.korax.net
104 www.artsalliance.sk.ca
105 translate.googleusercontent.com
112 www.everycandidate.org
114 blog.opennorth.ca
129 fiddle.jshell.net
129 fb.sebastienlegare.com
132 thealbertaway.com
133 www.openhousens.ca
155 opennorth.github.io
156 actioncdifficile.nationbuilder.com
159 www.opennorth.ca
178 www.faircancercare.ca
178 127.0.0.1
187 www.ontariosdoctors.com
206 www.tritag.ca
222 www.macaissejytiens.ca
233 wonderlust
255 upstreamfull-josho.nationbuilder.com
264 t.co
288 www.oma.org
305 lab.nowdesign.ca
358 www.cleanprosperity.ca
367 localhost
372 www.imaginecanada.ca
409 jessiewill.com
453 weneedalaw.ca
492 www.google.com
512 www.citizenshipcounts.ca
522 www.fairnessforworkers.ca
569 www.devienscitoyen.ca
616 opennorth.ca
678 omatest.oma.org
881 citizenbridge.org
886 everycandidate.org
1080 singallofus.ca
1178 bccyclingcoalition.nationbuilder.com
1245
1371 tritag.ca
1473 citizenshipcounts.ca
1623 highwaysafety-bccyclingcoalition.nationbuilder.com
1655 www.google.ca
3494 saveourhealthcare.ca
3666 mycumatters.ca
5758 cunation.ca
6242 www.bccc.bc.ca
8157 cunation.ictinusdesign.com
9131 safeschoolsalberta.ca
9767 www.positionprimer.ca
14699 www.localvote2014.ca
15692 positionprimer.ca
28702 election.thetyee.ca
160625 represent.opennorth.ca
2094890 null
Traffic by user agent (>100 requests):
102 Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10) AppleWebKit/600.1.8 (KHTML, like Gecko) QuickLook/5.0
104 ZooOn/1.0 CFNetwork/672.1.13 Darwin/14.0.0
104 Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10) AppleWebKit/600.1.22 (KHTML, like Gecko) QuickLook/5.0
115 ZooOn/1.0 CFNetwork/672.0.8 Darwin/14.0.0
125 python-requests/2.3.0 CPython/3.4.1 Linux/3.8.11-ec2
130 Mozilla/5.0 (X11; U; Linux x86_64; en-US) AppleWebKit/533.3 (KHTML, like Gecko) Qt/4.7.1 Safari/533.3
139 Mozilla/5.0 (compatible; SiteExplorer/1.0b; +http://siteexplorer.info/)
155 PHP/5.2.17
156 python-requests/2.3.0 CPython/3.3.5 Darwin/13.4.0
156 panscient.com
158 Java1.4.0_01
161 Nutch12/Nutch-1.2
165 Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/534.34 (KHTML, like Gecko) Qt/4.8.4 Safari/534.34
166 Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.21 (KHTML, like Gecko) imgsizer Safari/537.21
170 fog/1.20.0
178 python-requests/1.2.3 CPython/2.7.3 Linux/3.2.0-24-virtual
197 python-requests/2.2.1 CPython/3.4.0 Darwin/13.1.0
211 Java/1.7.0_05
216 Mozilla/5.0 (Unknown; Linux x86_64) AppleWebKit/534.34 (KHTML, like Gecko) PhantomJS/1.9.2 Safari/534.34
219 Java/1.6.0_07
226 Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/534+ (KHTML, like Gecko) BingPreview/1.0b
232 Java/1.8.0_25
245 Java/1.6.0_24
248 facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)
276 ZooOn/1.0 CFNetwork/672.1.13 Darwin/13.1.0
290 Java/1.7.0_21
352 Java/1.7.0_55
356 python-requests/1.2.3 CPython/2.7.5 Darwin/13.3.0
368 ZooOn/1.0 CFNetwork/672.0.8 Darwin/13.1.0
410 python-requests/2.3.0 CPython/2.7.5+ Linux/3.11.0-18-generic
470 Java/1.7.0_60
494 Java/1.7.0_25
503 Opera
568 python-requests/1.0.0 CPython/2.7.4 Linux/3.8.11-ec2
800 Java/1.6.0_04
801 Java/1.7.0_45
980 python-requests/1.2.3 CPython/2.7.5 Darwin/13.2.0
1029 node-superagent/0.18.2
1081 ZooOn/1.0 CFNetwork/672.0.8 Darwin/13.0.0
1141 WordPress/3.9.2; http://www.inclusivecan.ca
1239 Faraday v0.8.9
1255 NativeHost
1382 python-requests/2.5.0 CPython/2.7.5 Linux/2.6.32-504.3.3.el6.x86_64
1419 python-requests/2.5.0 CPython/2.7.3 Darwin/13.4.0
1424 python-requests/2.4.3 CPython/3.4.1 Darwin/13.4.0
1678 Faraday v0.8.8
1816 BlackBerry
1872 Java/1.7.0_51
2232 python-requests/1.2.3 CPython/2.7.5 Darwin/13.1.0
3195 Java/1.6.0_65
4282 WordPress/3.4.2; http://democracywatch.ca
4989 Curl Request
5034 Python-urllib/1.17
5167 python-requests/0.12.1
5977 Apache-HttpClient/4.3.2 (java 1.5)
6480 Mojolicious (Perl)
6704 Java/1.4.1_04
7672 Java/1.7.0_67
9277 python-requests/1.2.3 CPython/2.7.1 Darwin/11.4.2
11307 Android
14211 Ruby
22856 Faraday v0.9.0
30098 Safari
30926 Drupal (+http://drupal.org/)
31064 IOS
43939 PHP/5.3.27
52854 Firefox
114047 Python-urllib/2.7
127793 Internet Explorer
140944 Chrome
337179 python-requests/2.5.0 CPython/3.4.2 Windows/7
662361 R (3.1.0 x86_64-w64-mingw32 x86_64 mingw32)
674333 -
Requests: 2384047
Min per day: 1
Max per day: 88196
Mean: 6496
Median: 2868
Stddev: 12646
Popular endpoints:
678 elections
1022 candidates
20454 representative-sets
32989 boundary-sets
224729 representatives
473105 boundaries
1456153 postcodes
Popular sets (>300 requests):
300 guelph-wards
314 saint-jerome-districts
323 wood-buffalo-wards
324 clarington-wards
333 cote-saint-luc-districts
337 gatineau-districts
337 wellesley-wards
341 montreal-boroughs
353 chatham-kent-wards
364 quebec-assemblee-nationale
365 westmount-districts
380 saguenay-districts
383 sainte-anne-de-bellevue-districts
397 dollard-des-ormeaux-districts
401 sherbrooke-districts
404 senneville-districts
408 quebec-districts
500 federal-electoral-districts-next-election
502 windsor-wards
522 newmarket-wards
534 summerside-wards
537 new-brunswick-electoral-districts
539 vaughan-wards
541 prince-edward-island-electoral-districts
542 pickering-wards
543 oakville-wards
548 woolwich-wards
551 greater-sudbury-wards
557 richmond-hill-wards
558 kirkland-districts
559 stratford-wards
559 kawartha-lakes-wards
560 milton-wards
562 strathcona-county-wards
563 wilmot-wards
564 saint-jean-sur-richelieu-districts
565 thunder-bay-wards
566 cape-breton-districts
566 edmonton-wards
569 moncton-wards
574 saskatoon-wards
576 peterborough-wards
576 saskatchewan-electoral-districts
577 haldimand-county-wards
580 dorval-districts
585 pointe-claire-districts
585 grande-prairie-county-no-1-divisions
587 burlington-wards
591 halifax-districts
592 north-dumfries-wards
594 fredericton-wards
597 sherbrooke-boroughs
598 charlottetown-wards
599 hamilton-wards
608 brossard-districts
610 kingston-districts
611 st-catharines-wards
613 regina-wards
614 london-wards
615 winnipeg-wards
617 newfoundland-and-labrador-electoral-districts
630 manitoba-electoral-districts
631 waterloo-wards
635 beaconsfield-districts
642 brantford-wards
663 cambridge-wards
668 sault-ste-marie-wards
672 ajax-wards
735 kitchener-wards
830 calgary-wards
929 st-johns-wards
958 ottawa-wards
1296 alberta-electoral-districts
1399 nova-scotia-electoral-districts
1473 census-divisions
2038 caledon-wards
2394 ontario-legislature
2519 toronto-wards
3341 bc-legislature
3742 mississauga-wards
4070 ontario-electoral-districts
4089 brampton-wards
34312 house-of-commons
34757 quebec-electoral-districts
45269 federal-electoral-districts
45896 british-columbia-electoral-districts
83340 census-subdivisions
425739 null
Popular boundaries (>500 requests):
504 1209034
506 new-westminster
509 59018
510 sherbrooke
512 westside-kelowna
514 59007
515 borduas
518 surrey-panorama
520 chilliwack-hope
520 59005
523 saanich-south
523 kootenay-west
527 3519048
528 alberni-pacific-rim
532 vancouver-fraserview
533 abbotsford-south
538 jean-lesage
550 delta-north
553 delta-south
557 burnaby-north
579 surrey-cloverdale
579 nanaimo
583 kootenay-east
586 jean-talon
593 ward-9
596 59032
605 outremont
610 3506008
624 hochelaga-maisonneuve
628 west-vancouver-capilano
629 north-vancouver-lonsdale
630 59014
632 victoria-swan-lake
633 ward-6
637 vancouver-quilchena
639 bertrand
648 3539036
654 cape-breton-centre
665 cowichan-valley
667 ward-10
671 oak-bay-gordon-head
675 vancouver-kensington
687 nelson-creston
688 port-moody-coquitlam
704 59031
706 sainte-marie-saint-jacques
711 north-vancouver-seymour
723 nanaimo-north-cowichan
734 59019
737 vancouver-west-end
755 vancouver-hastings
794 35062
799 rosemont
810 59008
821 laurier-dorion
821 3518009
835 juan-de-fuca
849 victoria-beacon-hill
851 vancouver-false-creek
859 parksville-qualicum
872 comox-valley
880 saanich-north-and-the-islands
900 powell-river-sunshine-coast
900 59033
905 3530010
907 ward-7
908 59024
911 ward-8
917 ward-5
917 ward-3
929 ward-4
938 ward-2
969 mercier
969 1307022
971 59015
973 taschereau
992 3519036
999 59036
1002 columbia-river-revelstoke
1036 3519028
1069 vancouver-fairview
1107 gouin
1134 5915002
1136 vancouver-point-grey
1138 vancouver-mount-pleasant
1166 59035
1222 ward-1
1244 3519038
1365 west-vancouver-sea-to-sky
1372 59030
1418 59029
1502 2467045
1597 5909052
1688 3558004
1725 5935010
1863 5915015
1870 3537034
1888 5917021
1907 5915025
1918 5915034
1963 1001519
2038 5915004
2738 5917034
2930 4819012
3442 3526053
3721 5915022
4306 3518013
2002530 null
Popular terminals:
1 shape%20
1182 shape
8802 simple_shape
14480 candidates
25591 centroid
36238 representatives
2122836 null
limit: 128287
offset: 20515
callback: 96646
format: 22721
pretty: 3524
contains: 204716
touches: 815
intersects: 197
point: 192557
districts: 708
sets (boundaries): 371
sets (postcodes): 804498
Popular formats (>20 requests):
26 'apibrowser
34 apibrowser
22546 apibrowser
2186413 null
Popular sets (>20 requests):
41 manitoba-electoral-districts
42 newfoundland-labrador-electoral-districts
52 toronto-wards%2Cottawa-wards
132 ottawa-wards
152 st-johns-wards%2Ccaledon-wards
176 federal-electoral-districts%2Ccensus-subdivisions
195 saskatchewan-electoral-districts
325 quebec-electoral-districts
2465 cambridge-wards
6603 toronto-wards
11263 federal-electoral-districts
17132 federal-electoral-districts%2Cbritish-columbia-electoral-districts
26219 alberta-electoral-districts
72229 british-columbia-electoral-districts
671912 ontario-electoral-districts
Popular districts (>20 requests):
115 edmonton-wards/ward-3
125 edmonton-wards/ward-2
127 edmonton-wards/ward-1
172 federal-electoral-districts%2F10007%2Ccensus-subdivisions%2F1001519
340 calgary-wards/ward-3
350 calgary-wards/ward-2
350 calgary-wards/ward-1
boundary-sets name: 1
boundaries name: 2454
representatives name: 1728
candidates name: 3
boundary-sets domain: 545
boundaries external_id: 1
representatives name: 1728
representatives first_name: 142
representatives last_name: 543
representatives gender: 0
representatives district_name: 4154
representatives elected_office: 15836
representatives party_name: 4
candidates name: 3
candidates first_name: 4
candidates last_name: 6
candidates gender: 0
candidates district_name: 0
candidates elected_office: 7
candidates party_name: 0
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment