Skip to content

Instantly share code, notes, and snippets.

@enexusde
Created April 30, 2023 08:13
Show Gist options
  • Save enexusde/05285da750625b5dbaf5f9fb050f3114 to your computer and use it in GitHub Desktop.
Save enexusde/05285da750625b5dbaf5f9fb050f3114 to your computer and use it in GitHub Desktop.
Open Street Map Performance Documentation
In order to copy open-street-map to my server, I decided to publish performance values.
I am using a good desktop computer, here I have some performance values. First things first, my PC
i9 12900k - 32 GB Ram, Ubuntu 23, 3x 1TB NVMe SSD SoftRaid 0.
Open-Street-Map file informations:
- planet-200309.xml is 1.3 TiB in size
- Copy from my storage-hdd to my performance-ssd-raid0 it took about 3 hours.
@enexusde
Copy link
Author

Postgres 15.2

@enexusde
Copy link
Author

Whlie processing this shows the progress (1888590k = about 1.8 TB):
Processing: Node(1888590k 1048.6k/s) Way(0k 0.00k/s) Relation(0 0.0/s)

@enexusde
Copy link
Author

Killed for unknown reasons:

grim@main:~$ sudo su - postgres
postgres@main:~$  osm2pgsql -d osm planet-200309.xml
2023-04-30 10:00:03  osm2pgsql version 1.8.0
2023-04-30 10:00:03  Database version: 15.2 (Ubuntu 15.2-1.pgdg22.10+1)
2023-04-30 10:00:03  PostGIS version: 3.3
2023-04-30 10:00:03  Setting up table 'planet_osm_point'
2023-04-30 10:00:03  Setting up table 'planet_osm_line'
2023-04-30 10:00:03  Setting up table 'planet_osm_polygon'
2023-04-30 10:00:04  Setting up table 'planet_osm_roads'
Processing: Node(2102970k 1058.9k/s) Way(0k 0.00k/s) Relation(0 0.0/s)Killed
postgres@main:~$ date
So 30. Apr 10:33:50 CEST 2023
postgres@main:~$ 

@enexusde
Copy link
Author

enexusde commented May 1, 2023

Turns out I had not enougth space. So I took only germany. That worked under one minute. This are the stats of the tables:
planet_osm_line (18267593)
planet_osm_point (14704240)
planet_osm_polygon (44306220)
planet_osm_roads (1350303)
spatial_ref_sys (8500)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment