Skip to content

Instantly share code, notes, and snippets.

View FrancescAlted's full-sized avatar

Francesc Alted FrancescAlted

View GitHub Profile
@FrancescAlted
FrancescAlted / blocking
Created April 17, 2014 17:43
Study of blocking in numpy/numexpr
{
"metadata": {
"name": "",
"signature": "sha256:5a6759998dc5cecdfc269873ed0afe13bceff1f78f0178535b0e07efc6161892"
},
"nbformat": 3,
"nbformat_minor": 0,
"worksheets": [
{
"cells": [
@FrancescAlted
FrancescAlted / ngrams
Created April 13, 2014 18:27
Example of how to find substrings in large datasets new 'contains' in numexpr
{
"metadata": {
"name": ""
},
"nbformat": 3,
"nbformat_minor": 0,
"worksheets": [
{
"cells": [
{
@FrancescAlted
FrancescAlted / MSFT-Dataset-Query-Complex.ipynb
Created February 26, 2014 16:21
A comparison of BLZ with Pandas DataFrames
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@FrancescAlted
FrancescAlted / gist:7926895
Created December 12, 2013 11:53
Why on hell Python 2.7 (and even 3.3) does not release memory as it should?
Using 2.7.6:
$ python2 ~/mem_prof.py
memory deallocated: 0.0 MB
Using 3.4b1:
$ python3 ~/mem_prof.py
memory deallocated: -1040.09765625 MB
@FrancescAlted
FrancescAlted / gist:4595225
Last active April 22, 2018 19:03
A comparison of variable length storage speed of Blaze vs PyTables
"""
Benchmark that compares the storing of objects in both Blaze and PyTables
"""
import os.path
import shutil
from time import time
import blaze
import tables
@FrancescAlted
FrancescAlted / Query2.ipnb
Created October 24, 2012 17:39
Query2 for PyTables tutorial
{
"metadata": {
"name": "Queries2"
},
"nbformat": 3,
"nbformat_minor": 0,
"worksheets": [
{
"cells": [
{