Skip to content

Instantly share code, notes, and snippets.

@GeorgeSeif

GeorgeSeif/modin_2.py

Last active November 1, 2019 03:18
Show Gist options
  • Save GeorgeSeif/d86aa60dd59ee17c73aa7f09f2051b48 to your computer and use it in GitHub Desktop.
Save GeorgeSeif/d86aa60dd59ee17c73aa7f09f2051b48 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
modin_2.py
import pandas as pd
df = pd.read_csv("esea_master_dmg_demos.part1.csv")
s = time.time()
df = pd.concat([df for _ in range(5)])
e = time.time()
print("Pandas Concat Time = {}".format(e-s))
import modin.pandas as pd
df = pd.read_csv("esea_master_dmg_demos.part1.csv")
s = time.time()
df = pd.concat([df for _ in range(5)])
e = time.time()
print("Modin Concat Time = {}".format(e-s))
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment