pavgup’s gists

pavgup / gist:a46b8d1ecf07464f6f6f8c855650b1a3

Created October 6, 2017 20:53

pgp public key

	-----BEGIN PGP PUBLIC KEY BLOCK-----

	mQINBFnX7LkBEADYNw+dXd/9Z7ZwQG1WJF27RYkBualuruarY7yDiXJoanYVkNzk
	Cs+9AQ3rEnkYCdEBONdGSiKa2735BxQdojpTcSMeRNDEg8PJQJiAhQ5MkN5P2cTL
	2m6HmOtw+gRKxVerD2e7WsMvt2j2YzpeCGqM72EKmS9coysreeL+7PZy32Oc9MTG
	k/UhaP9Gu44AFlYg6t5W5aKYHoSujbaABGWKl74V77SQwYUE84lhl5eHKIGZvZ/P
	HKV06NzyWWBgFv8MH3ISr+xiMzG+MNPTuwaFrnm9tePIMK+fB14mbn0t2mIXKwvx
	9wB2QjWaXA9n7MCH4znK/eLsVcE1qkHT2S01XtldLCllUikwskHhEKTQOkEjKMH9
	IAPYdJncR3ckwzCZo2mQQoVihnERcZ2gtrlwx2GV+900ntvBr8QHTLDUZkcO0bFF
	o1ICHwwkpansWThgzkTKil6E/bCicPlh7FPmBiFKMqsz5IK8e6DGIAPjDGDJjkMy

pavgup / dogscats.py

Created July 28, 2017 22:09

fast.ai lesson 1 updated files for keras 2.0.2

	from __future__ import division,print_function

	import os, json
	from glob import glob
	import numpy as np
	np.set_printoptions(precision=4, linewidth=100)
	from matplotlib import pyplot as plt
	import sys
	sys.settrace

pavgup / gist:1deee218fa2bc078b117d4e51467384f

Created July 26, 2017 02:33

Random data science tricks

shuf -n 10 -e * | xargs -i mv {} path-to-new-folder <-- random file movement

pavgup / airflow sql deletes

Created July 18, 2017 19:59

getting rid of airflow dags, eek

	Deleting DAGs in Airflow? Well, womp.

	set @dag_id = 'etl_dag';
	delete from airflow.xcom where dag_id = @dag_id;
	delete from airflow.task_instance where dag_id = @dag_id;
	delete from airflow.sla_miss where dag_id = @dag_id;
	delete from airflow.log where dag_id = @dag_id;
	delete from airflow.job where dag_id = @dag_id;
	delete from airflow.dag_run where dag_id = @dag_id;
	delete from airflow.dag where dag_id = @dag_id;

pavgup / commands.sh

Last active October 21, 2023 20:29

Install Python 2.7.13 on Debian Wheezy

	sudo apt-get install build-essential checkinstall
	sudo apt-get install libreadline-gplv2-dev libncursesw5-dev libssl-dev libsqlite3-dev tk-dev libgdbm-dev libc6-dev libbz2-dev

	wget https://www.python.org/ftp/python/2.7.13/Python-2.7.13.tgz
	sudo tar -xzf Python-2.7.13.tgz -C /usr/src
	cd /usr/src/Python-2.7.3

	sudo ./configure
	sudo make
	sudo make altinstall

pavgup / gist:ad730f1191323b4d67d9473068e9ea10

Created August 12, 2016 02:23

Download JDK 8 update 102 at the command line

wget --header "Cookie: oraclelicense=accept-securebackup-cookie" http://download.oracle.com/otn-pub/java/jdk/8u102-b14/jdk-8u102-linux-x64.tar.gz

pavgup / grant.sql

Last active November 25, 2015 16:29

granting everything to root on mariadb over a private subnet

	GRANT ALL PRIVILEGES ON . TO 'root'@'172.31.%.%' IDENTIFIED BY 'APASSWORDTHATISNOTREAL' WITH GRANT OPTION;
	UPDATE mysql.user SET password=PASSWORD('realpasswordzl33t') WHERE User="root";

pavgup / mysql.yml

Created November 24, 2015 07:28

Surprisingly annoying use of conditionals and variables with ec2 instances and volumes. The ec2 module can comfortably create volumes that have controlled delete_on_termination flags but you must first provision the instance and the volume before you are able to tag the volume. Assuming you wanted to tag a single volume based on its device_name …

	---
	data_volume:
	- name: mysql-data-drive
	device_name: /dev/sdb
	device_type: gp2
	volume_size: 500
	delete_on_termination: false

pavgup / ansible_conditionals_examples.yaml

Created November 24, 2015 06:50 — forked from marcusphi/ansible_conditionals_examples.yaml

Ansible 1.3 Conditional Execution -- Very complete example with comments -- I find the conditional expressions to be ridiculously hard to get right in Ansible. I don't have a good model of what's going on under the surface so I often get it wrong. What makes it even harder is that there has been at least three different variants over the course …

	---
	# This has been tested with ansible 1.3 with these commands:
	# ansible-playbook -i hosts ansible_conditionals_examples.yaml --extra-vars="hosts=myhosts isFirstRun=false"
	# ansible-playbook -i hosts ansible_conditionals_examples.yaml --extra-vars="hosts=myhosts isFirstRun=true"
	# ansible-playbook -i hosts ansible_conditionals_examples.yaml --extra-vars="hosts=myhosts"
	# NB: The type of the variable is crucial!

	- name: Ansible Conditionals Examples
	hosts: $hosts
	vars_files:

pavgup / 01.cmake

Created October 31, 2015 01:16

	2015-10-30 21:13:04 -0400

	cmake
	..
	-DCMAKE_C_FLAGS_RELEASE=
	-DCMAKE_CXX_FLAGS_RELEASE=
	-DCMAKE_INSTALL_PREFIX=/usr/local/Cellar/opencv3/HEAD
	-DCMAKE_BUILD_TYPE=Release
	-DCMAKE_FIND_FRAMEWORK=LAST
	-DCMAKE_VERBOSE_MAKEFILE=ON

Pavan Gupta pavgup