silentgiant oxidizeddreams

Redshift Tables Used

pg_table_def, stl_query, stl_querytext, stl_tr_conflict, stl_explain, stl_alert_event_log, stl_ddltext, stl_scan, stl_save, stl_hashjoin, stl_hash, stl_plan_info, stl_return, and information_schema.table_constraints.

Queries to Extract Features

execution time

select (endtime - starttime) as execution_time_in_ms 
from stl_query 
where query = QUERY_ID;

A curated list of AWS resources to prepare for the AWS Certifications

A curated list of awesome AWS resources you need to prepare for the all 5 AWS Certifications. This gist will include: open source repos, blogs & blogposts, ebooks, PDF, whitepapers, video courses, free lecture, slides, sample test and many other resources.

GitHub for Bug Bounty Hunters

GitHub repositories can disclose all sorts of potentially valuable information for bug bounty hunters. The targets do not always have to be open source for there to be issues. Organization members and their open source projects can sometimes accidentally expose information that could be used against the target company. in this article I will give you a brief overview that should help you get started targeting GitHub repositories for vulnerabilities and for general recon.

Mass Cloning

You can just do your research on github.com, but I would suggest cloning all the target's repositories so that you can run your tests locally. I would highly recommend @mazen160's GitHubCloner. Just run the script and you should be good to go.

$ python githubcloner.py --org organization -o /tmp/output

##Domain

We need some records on our domain (mydomain.com) DNS for connections. Add these records:

t1              IN      NS      t1ns.mydomain.com. ; note final the dot!
t1ns            IN      A       OUR_SERVER_IP

##Server

	# Lambda function to subscribe all new cloudwatch log groups to a log shipper function
	# Used in conjunction with https://github.com/SumoLogic/sumologic-aws-lambda
	import os
	import logging
	import json
	import uuid

	import boto3
	from botocore.exceptions import ClientError

	#!/usr/bin/env bash

	# lists all unused AWS security groups.
	# a group is considered unused if it's not attached to any network interface.
	# requires aws-cli and jq.

	# all groups
	aws ec2 describe-security-groups \
	\| jq --raw-output '.SecurityGroups[] \| [.GroupName, .GroupId] \| @tsv' \
	\| sort > /tmp/sg.all

	import unicodedata
	import string

	valid_filename_chars = "-_.() %s%s" % (string.ascii_letters, string.digits)
	char_limit = 255

	def clean_filename(filename, whitelist=valid_filename_chars, replace=' '):
	# replace spaces
	for r in replace:
	filename = filename.replace(r,'_')

	import numpy as np
	import pandas as pd

	#### creating dataframes, adding and dropping columns

	df = pd.DataFrame(np.arange(1,10).reshape(3,3),['A','B','C'],['w','x','y'])
	df.columns = ['W','X','Y'] # change column names
	df['Z']=df['X']+df['Y'] # new column with values X+Y
	df['XX']=df.apply(lambda row: row['X']*2, axis=1) # new column with values twice of column X
	df['YY']=1 # new column of ones

	# Security groups that contain 0.0.0.0/0 rules
	aws ec2 describe-security-groups --filters Name=ip-permission.cidr,Values=0.0.0.0/0 --output=text \| grep SECURITYGROUPS

	# Security groups for ElasticSearch
	aws ec2 describe-security-groups --filters Name=ip-permission.from-port,Values=9200 --output=text \| grep SECURITYGROUPS

	# Search last 10,000/1MB of CloudTrail logs for 'AccessDenied' (removed AWS account number from stream name)
	aws logs get-log-events --log-group-name CloudTrail/DefaultLogGroup --log-stream-name 000000000000_CloudTrail_eu-west-1 \| grep AccessDenied

	# Get number of AWS API calls in time period (assumes a Cloudwatch Logs 'catch-all' filter and metric has been created against CloudTrail logs)

	INTRO
	I get asked regularly for good resources on AWS security. This gist collects some of these resources (docs, blogs, talks, open source tools, etc.). Feel free to suggest and contribute.

	Short Link: http://tiny.cc/awssecurity

	Official AWS Security Resources
	* Security Blog - http://blogs.aws.amazon.com/security/
	* Security Advisories - http://aws.amazon.com/security/security-bulletins/
	* Security Whitepaper (AWS Security Processes/Practices) - http://media.amazonwebservices.com/pdf/AWS_Security_Whitepaper.pdf
	* Security Best Practices Whitepaper - http://media.amazonwebservices.com/AWS_Security_Best_Practices.pdf