Skip to content

Instantly share code, notes, and snippets.

View sandys's full-sized avatar

Sandeep Srinivasa sandys

View GitHub Profile
@sandys
sandys / pg-docker.md
Created March 20, 2020 09:27
running postgresql on your laptop without installing it (using docker) . with connections to python

docker network create pg

docker run -it --rm -P -p 5432:5432 --name pg -e POSTGRES_PASSWORD=password -e POSTGRES_USER=postgres -e POSTGRES_DB=production -v pgdata:/var/lib/postgresql/data --network=pg postgres

pgdata is the name of the docker volume. You can check it using docker volume ls and docker volume inspect pgdata. You can delete the docker volume by docker volume rm pgdata and prune all volumes using docker volume prune docker volumes are created in your central docker directory (usually /var/lib/docker/overlay2 ). You generally dont need to care about this.

You can now access it in many ways:

@sandys
sandys / next.config.js
Created February 17, 2020 14:44
next.config.js for superprops
const withPlugins = require('next-compose-plugins');
const withTM = require('next-transpile-modules')(['reusecore', 'common']);
const withOptimizedImages = require('next-optimized-images');
const withFonts = require('next-fonts');
const withCSS = require('@zeit/next-css');
const path = require("path");
module.exports = withPlugins(
[
@sandys
sandys / gridsearchcv.py
Created August 18, 2019 16:26
Gridsearchcv with k-fold cross validation and early stopping
#
... import xgboost.sklearn as xgb
... from sklearn.model_selection import GridSearchCV
... from sklearn.model_selection import TimeSeriesSplit
...
... cv = 2
...
... trainX= [[1], [2], [3], [4], [5]]
... trainY = [1, 2, 1, 2, 1]
@sandys
sandys / pythonhostedissues.md
Last active May 7, 2018 15:43
pythonhosted issues

user@instance-mumbai:~/docker-setup-v2/flask$ dig files.pythonhosted.org A

; <<>> DiG 9.10.3-P4-Ubuntu <<>> files.pythonhosted.org A ;; global options: +cmd ;; Got answer: ;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 3624 ;; flags: qr rd ra; QUERY: 1, ANSWER: 5, AUTHORITY: 0, ADDITIONAL: 1

;; OPT PSEUDOSECTION: ; EDNS: version: 0, flags:; udp: 512

@sandys
sandys / datadog.service
Last active March 19, 2023 20:10
Getting Datadog logs to work with Docker Swarm or journald
[Unit]
Description=Datadog Docker Swarm
After=systemd-journald.service
Requires=systemd-journald.service
[Service]
ExecStart=/bin/zsh -c "coproc while true; do ncat --ssl intake.logs.datadoghq.com 10516; done ;journalctl -o json -f | jq -r --unbuffered '\"c441ade4f5f4d04c \" + ({ message:.MESSAGE, service_name:.COM_DOCKER_SWARM_SERVICE_NAME, container:.CONTAINER_NAME, containerid:.CONTAINER_ID_FULL, host:._HOSTNAME,pid:(._PID // \"-\"), timestamp:(.__REALTIME_TIMESTAMP|tonumber/1000000|todate),\"syslog.severity\":((.PRIORITY|tonumber)) }|tostring)' >&p 2>&p"
@sandys
sandys / nvidia-docker-cuda-setup.sh
Created March 3, 2018 09:18
getting nvidia-docker2 with CUDA running on Ubuntu-16.04
wget https://developer.nvidia.com/compute/cuda/9.1/Prod/local_installers/cuda-repo-ubuntu1604-9-1-local_9.1.85-1_amd64
sudo add-apt-repository ppa:graphics-drivers
curl -fsSL https://download.docker.com/linux/ubuntu/gpg | sudo apt-key add -
sudo add-apt-repository \
"deb [arch=amd64] https://download.docker.com/linux/ubuntu \
$(lsb_release -cs) \
stable"
curl -s -L https://nvidia.github.io/nvidia-docker/gpgkey | sudo apt-key add -
@sandys
sandys / impil.py
Created February 27, 2018 09:27
Converting set of images into PDF using Pillow
from PIL import Image
import requests
from io import BytesIO
from io import StringIO
url1 = "https://res.cloudinary.com/prestige-gifting/image/fetch/fl_progressive,q_95,e_sharpen:50,w_480/e_saturation:05/https://www.prestigeflowers.co.uk/images/NF4016-130116.jpg"
url2 = "https://static.pexels.com/photos/39517/rose-flower-blossom-bloom-39517.jpeg"
url3 = "https://i.pinimg.com/736x/f2/01/57/f201574c8705365b2c3e182953f765f2--blue-roses-blue-flowers.jpg"
@sandys
sandys / vscode-gatsby.conf
Created January 26, 2018 05:44
visual studio setup to debug gatsbyjs
{
// Use IntelliSense to learn about possible attributes.
// Hover to view descriptions of existing attributes.
// For more information, visit: https://go.microsoft.com/fwlink/?linkid=830387
"version": "0.2.0",
"configurations": [
{
"name": "Launch (Production)",
"type": "node",
"request": "launch",
@sandys
sandys / hardware_token.md
Last active May 19, 2020 14:14
Registering a hardware token
@sandys
sandys / pgbouncer_run.sh
Created February 17, 2017 10:56
how to write a supervisord compatible shell script for pgbouncer (which can restart gracefully)
#!/bin/bash
# inspired by http://veithen.github.io/2014/11/16/sigterm-propagation.html
if [ -z "$DBNAME" ]; then
echo "Environment variable DBNAME is not set!!!"
exit 1
else
sed -i 's|DBNAME|'"$DBNAME"'|' /etc/pgbouncer/pgbouncer.ini
fi