Skip to content

Instantly share code, notes, and snippets.

@aaronlidman
Created July 8, 2013 05:21
Show Gist options
  • Select an option

  • Save aaronlidman/5946383 to your computer and use it in GitHub Desktop.

Select an option

Save aaronlidman/5946383 to your computer and use it in GitHub Desktop.
us-west.osm.pbf
{'profile': True, 'group_size': 20, 'source': 'us-west-latest.osm.pbf', 'require_name': False, 'overwrite': True, 'out': 'output.geojson'}
parsing ways and passing through nodes
parsing coordinates
processing...
858745
saved as: output.geojson
1.54
183217409 function calls in 996.461 seconds
Ordered by: internal time
List reduced from 222 to 30 due to restriction <30>
ncalls tottime percall cumtime percall filename:lineno(function)
229898 416.523 0.002 416.523 0.002 {time.sleep}
211076 176.966 0.001 329.198 0.002 osmpois.py:138(coord)
1127245 112.602 0.000 112.602 0.000 {method 'recv' of '_multiprocessing.Connection' objects}
21535333 90.564 0.000 90.564 0.000 {method 'put' of 'plyvel._plyvel.DB' objects}
119490776 76.606 0.000 76.606 0.000 osmpois.py:161(round_down)
2653757 36.880 0.000 36.880 0.000 {method 'release' of '_multiprocessing.SemLock' objects}
2 16.280 8.140 830.816 415.408 /usr/local/lib/python2.7/dist-packages/imposm/parser/simple.py:84(_parse)
858745 15.572 0.000 31.095 0.000 osmpois.py:90(put_refs)
1978762 10.639 0.000 10.639 0.000 {ujson.dumps}
39893 8.986 0.000 54.740 0.001 osmpois.py:81(way)
14372845 7.434 0.000 7.434 0.000 {method 'add' of 'set' objects}
1526508 6.596 0.000 159.519 0.000 /usr/lib/python2.7/multiprocessing/queues.py:113(get)
17620 6.441 0.000 12.938 0.001 osmpois.py:102(node)
2388187 3.124 0.000 3.124 0.000 {method 'poll' of '_multiprocessing.Connection' objects}
10655974 2.610 0.000 2.610 0.000 {len}
1526508 1.919 0.000 161.438 0.000 /usr/lib/python2.7/multiprocessing/queues.py:151(get_nowait)
1526516 1.498 0.000 1.498 0.000 {method 'acquire' of '_multiprocessing.SemLock' objects}
3025 1.277 0.000 163.332 0.054 osmpois.py:250(write)
1 0.980 0.980 0.991 0.991 /usr/lib/python2.7/multiprocessing/pool.py:297(map_async)
1978680 0.541 0.000 0.541 0.000 {method 'append' of 'list' objects}
861679 0.520 0.000 1.702 0.000 /usr/lib/python2.7/multiprocessing/queues.py:145(empty)
3133 0.520 0.000 0.520 0.000 {method 'write' of 'file' objects}
226873 0.341 0.000 0.341 0.000 {method 'items' of 'dict' objects}
111 0.290 0.003 0.743 0.007 osmpois.py:123(batch_write)
3137 0.268 0.000 0.268 0.000 {method 'join' of 'str' objects}
12 0.204 0.017 0.204 0.017 {posix.waitpid}
6 0.098 0.016 0.098 0.016 {posix.fork}
1 0.072 0.072 165.591 165.591 osmpois.py:172(process)
12 0.044 0.004 0.044 0.004 {posix.remove}
36 0.027 0.001 0.027 0.001 {method 'acquire' of 'thread.lock' objects}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment