Skip to content

Instantly share code, notes, and snippets.

@zhreshold
Created December 5, 2017 23:16
Show Gist options
  • Select an option

  • Save zhreshold/cb99768ba3dc7081d2d91a3f485a0fb0 to your computer and use it in GitHub Desktop.

Select an option

Save zhreshold/cb99768ba3dc7081d2d91a3f485a0fb0 to your computer and use it in GitHub Desktop.
MP loader debug
import argparse
import mxnet as mx
parser = argparse.ArgumentParser('test')
parser.add_argument('-j', '--num-workers', default=4, type=int, dest='num_workers')
args = parser.parse_args()
dataset = mx.gluon.data.vision.MNIST()
loader = mx.gluon.data.DataLoader(dataset, 32, True, num_workers=args.num_workers)
import time
tic = time.time()
for batch in loader:
pass
print('elapsed time:', time.time()-tic)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment