Skip to content

Instantly share code, notes, and snippets.

View dmitryhd's full-sized avatar

Dmitry Khodakov dmitryhd

View GitHub Profile
@dmitryhd
dmitryhd / delete_old_files.py
Created November 30, 2015 12:45
Auto deletion of old files
#!/usr/bin/env python2
import os
from glob import glob
from datetime import datetime, timedelta
root_dir = '/var/local/crm/data/launches/'
def print_oldfiles(root_dir, olddays=20, minsizemb=10):
sizesmb = []
@dmitryhd
dmitryhd / really_simple_mp_example.py
Created December 10, 2015 11:11
simple_mp_example
import multiprocessing as mp
import logging
def get_mp_logger():
logger = mp.get_logger()
logger.handlers = [logging.FileHandler('/tmp/pool.log', mode='a'), logging.StreamHandler()]
logger.setLevel(logging.INFO)
formatter = logging.Formatter('%(asctime)s %(message)s')
logger.handlers[0].setFormatter(f)
logger.handlers[1].setFormatter(f)
@dmitryhd
dmitryhd / flask_tornado_server.py
Created December 16, 2015 07:57
Flask with tornado
from tornado.wsgi import WSGIContainer
from tornado.httpserver import HTTPServer
from tornado.ioloop import IOLoop
app = Flask(....)
http_server = HTTPServer(WSGIContainer(app))
http_server.listen(self.settings.web_port)
IOLoop.instance().start()
@dmitryhd
dmitryhd / dirbackup.sh
Last active September 16, 2016 07:33
directory backup
tar -czf - ./dir | (pv -p --timer --rate --bytes > backup/$(date +"%Y.%d.%m-%H.%M").tgz)
A quick way of backing up a list of programs is to run this:
dpkg --get-selections > ~/Package.list
sudo cp -R /etc/apt/sources.list* ~/
sudo apt-key exportall > ~/Repo.keys
It will back them up in a format that dpkg can read* for after your reinstall, like this:
sudo apt-key add ~/Repo.keys
@dmitryhd
dmitryhd / stored_json_dict.py
Last active January 12, 2016 11:12
stored json dict with access as class members
import json
import pprint
class Stored:
def __init__(self, init_dict=None):
if init_dict:
self.__dict__ = init_dict
def save(self, file_name):
with open(file_name, 'w') as fd:
@dmitryhd
dmitryhd / pandas-nlargest-benchmark.ipynb
Created January 26, 2016 07:17
pandas-nlargest-benchmark
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@dmitryhd
dmitryhd / test_multiprocessing_pass_dataframe.ipynb
Created February 5, 2016 14:04
multiprocessing_pass_dataframe.ipynb
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@dmitryhd
dmitryhd / logging.py
Last active July 20, 2017 11:22
Convenient logger helper
import logging
import logging.handlers
import os.path as path
def configure_logger(
logger_name='logger',
log_dir='/tmp/',
filename='',
to_stdout=True,
@dmitryhd
dmitryhd / backtesting-moving-average-crossover.ipynb
Last active April 8, 2016 14:18
backtesting-moving-average-crossover - ksu
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@dmitryhd
dmitryhd / iris_clusterisation.ipynb
Created March 23, 2016 15:48
iris_clusterisation
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.