Skip to content

Instantly share code, notes, and snippets.

View gm3dmo's full-sized avatar

David Morris gm3dmo

  • GitHub Staff
  • York
  • 07:20 (UTC +01:00)
View GitHub Profile
@gm3dmo
gm3dmo / prowler-s3
Created December 6, 2017 10:08
Prowler S3 Experiments
Get prowler installed in a virtual env. preferably pip env (don't do pip install prowler) prowler comes from github not pypi then one on pypi is not the amazon auditor.
@gm3dmo
gm3dmo / s3-bucket-list.py
Created December 8, 2017 10:07
Lists objects in an S3 bucket
#!/usr/local/aws/bin/python
import botocore.session
# wanted_profile should be set to the profile for the key you want to use
# normally found in ~/.aws/credentials
wanted_profile = 's3monster'
wanted_bucket = 's3monsters'
session1 = botocore.session.Session(profile=wanted_profile)
'dmos-MacBook-Pro.local' 1513171640.174752 1513171652.03749 'upload2S3' 11.86
'dmos-MacBook-Pro.local' 1513171652.037659 1513171655.677226 'upload2S3encrypted' 3.64
'dmos-MacBook-Pro.local' 1513171655.677367 1513171660.954814 'downloadFromS3' 5.28
'dmos-MacBook-Pro.local' 1513171660.9549499 1513171667.74031 'downloadFromS3Encrypted' 6.79
'dmos-MacBook-Pro.local' 1513171667.740461 1513171671.101078 'upload2S3' 3.36
'dmos-MacBook-Pro.local' 1513171671.101224 1513171674.624882 'upload2S3encrypted' 3.52
'dmos-MacBook-Pro.local' 1513171674.625083 1513171681.1310039 'downloadFromS3' 6.51
'dmos-MacBook-Pro.local' 1513171681.131139 1513171687.3683252 'downloadFromS3Encrypted' 6.24
'dmos-MacBook-Pro.local' 1513171687.3685079 1513171690.7645981 'upload2S3' 3.40
'dmos-MacBook-Pro.local' 1513171690.7647538 1513171694.514485 'upload2S3encrypted' 3.75
import sys
import csv
import json
import pprint
import time
import random
import string
import socket
import subprocess
import os
import sys
import csv
import pandas as pd
def main():
f = sys.argv[1]
df = pd.read_csv(f)
# I had this working on CentOS 7 haproxy 1.5 (haproxy-1.5.18-6.el7.x86_64)
#---------------------------------------------------------------------
# Example configuration for a possible web application. See the
# full configuration options online.
#
# http://haproxy.1wt.eu/download/1.4/doc/configuration.txt
#
#---------------------------------------------------------------------
#---------------------------------------------------------------------

#Quiz Gordon, Queen,Flash Gordon,1980,https://www.youtube.com/watch?v=glFmRMj_Wbc&feature=youtu.be&t=16 Its Evil,Time Bandits,1981,https://youtu.be/F6X9KcrXHwg?t=11 Too many secrets,Sneakers,1992,https://youtu.be/GutJf9umD9c?t=168 He slimed me,Ghostbusters,1984,https://youtu.be/7_pR6mUYtOo?t=107 It's a unix system,Jurrassic Park,1993,https://youtu.be/dxIPcbmo1_U?t=8 Hello Hello Andybody Home,Back to the future,1985,https://youtu.be/95_DB6GgLQs?t=39 'Ello Poppet,Pirates of the Carribean,2003,https://www.youtube.com/watch?v=4kdjPhmQA0k&feature=youtu.be&t=2 We're all misfits here,The Island of Mistfit Toys,2001,https://www.youtube.com/watch?v=Gr6GbKciNCY&feature=youtu.be&t=174 Spartans what is your profession,300,2006,https://www.youtube.com/watch?v=lIr8u0j08gU&feature=youtu.be&t=20

@gm3dmo
gm3dmo / kernel-benchmark.md
Last active January 8, 2018 11:42
Kernel version vs da Capo (batik) benchmark

#Kernel Benchmark Use an off the shelf benchmark to test impact of different kernels on benchmark performance. I chose http://www.dacapobench.org/

times=10
f=$(/usr/bin/uname -r)
jdk1.8.0_77/bin/java -jar dacapo-9.12-bach.jar batik -n ${times} > ${f}.txt 2>&1

now run it

curl has --write-out json for timing testing etc see this article curl-write-out-json

example:

curl_custom_flags="-kso /dev/null --write-out '%{json}'"
@gm3dmo
gm3dmo / watermarker.py
Created June 6, 2018 19:14
watermarker script to overlay a pdf onto another pdf with python
# from an article by Mike Driscoll:
# http://www.blog.pythonlibrary.org/2018/06/06/creating-and-manipulating-pdfs-with-pdfrw/
from pdfrw import PdfReader, PdfWriter, PageMerge
def watermarker(path, watermark, output):
base_pdf = PdfReader(path)
watermark_pdf = PdfReader(watermark)
mark = watermark_pdf.pages[0]
for page in range(len(base_pdf.pages)):