Skip to content

Instantly share code, notes, and snippets.

@yptheangel
Created February 3, 2020 17:48
Show Gist options
  • Save yptheangel/9ffaa072e37a9bf2adfcae7c06037f7b to your computer and use it in GitHub Desktop.
Save yptheangel/9ffaa072e37a9bf2adfcae7c06037f7b to your computer and use it in GitHub Desktop.
traceback of errors from generate lmdb from imagefolder
(base) D:\Efficient-PyTorch\tools>python folder2lmdb.py -f "C:\Users\ChooWilson\.fastai\data\kaggle-cat-dog" -s train
Loading dataset from C:\Users\ChooWilson\.fastai\data\kaggle-cat-dog\train
Generate LMDB to C:\Users\ChooWilson\.fastai\data\kaggle-cat-dog\train.lmdb
2000 2000
Traceback (most recent call last):
File "folder2lmdb.py", line 181, in <module>
folder2lmdb(args.folder, num_workers=args.procs, name=args.split)
File "folder2lmdb.py", line 150, in folder2lmdb
for idx, data in enumerate(data_loader):
File "C:\Users\ChooWilson\Anaconda3\lib\site-packages\torch\utils\data\dataloader.py", line 279, in __iter__
return _MultiProcessingDataLoaderIter(self)
File "C:\Users\ChooWilson\Anaconda3\lib\site-packages\torch\utils\data\dataloader.py", line 719, in __init__
w.start()
File "C:\Users\ChooWilson\Anaconda3\lib\multiprocessing\process.py", line 112, in start
self._popen = self._Popen(self)
File "C:\Users\ChooWilson\Anaconda3\lib\multiprocessing\context.py", line 223, in _Popen
return _default_context.get_context().Process._Popen(process_obj)
File "C:\Users\ChooWilson\Anaconda3\lib\multiprocessing\context.py", line 322, in _Popen
return Popen(process_obj)
File "C:\Users\ChooWilson\Anaconda3\lib\multiprocessing\popen_spawn_win32.py", line 65, in __init__
reduction.dump(process_obj, to_child)
File "C:\Users\ChooWilson\Anaconda3\lib\multiprocessing\reduction.py", line 60, in dump
ForkingPickler(file, protocol).dump(obj)
AttributeError: Can't pickle local object 'folder2lmdb.<locals>.<lambda>'
(base) D:\Efficient-PyTorch\tools>Traceback (most recent call last):
File "<string>", line 1, in <module>
File "C:\Users\ChooWilson\Anaconda3\lib\multiprocessing\spawn.py", line 105, in spawn_main
exitcode = _main(fd)
File "C:\Users\ChooWilson\Anaconda3\lib\multiprocessing\spawn.py", line 115, in _main
self = reduction.pickle.load(from_parent)
EOFError: Ran out of input
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment