Skip to content

Instantly share code, notes, and snippets.

@matiskay
Created October 22, 2014 22:02
Show Gist options
  • Save matiskay/eec6ce89b110517b4ea8 to your computer and use it in GitHub Desktop.
Save matiskay/eec6ce89b110517b4ea8 to your computer and use it in GitHub Desktop.
Download South America files from Geofabrik in parallel using the technique mentioned in http://stackoverflow.com/questions/7577615/parallel-wget-in-bash#answer-11850469
URL_LIST="
http://download.geofabrik.de/south-america-140101.osm.pbf
http://download.geofabrik.de/south-america-140501.osm.pbf
http://download.geofabrik.de/south-america-140601.osm.pbf
http://download.geofabrik.de/south-america-140701.osm.pbf
http://download.geofabrik.de/south-america-140801.osm.pbf
http://download.geofabrik.de/south-america-140901.osm.pbf
http://download.geofabrik.de/south-america-141001.osm.pbf
http://download.geofabrik.de/south-america-141014.osm.pbf
http://download.geofabrik.de/south-america-141015.osm.pbf
http://download.geofabrik.de/south-america-141016.osm.pbf
http://download.geofabrik.de/south-america-141017.osm.pbf
http://download.geofabrik.de/south-america-141018.osm.pbf
http://download.geofabrik.de/south-america-141019.osm.pbf
http://download.geofabrik.de/south-america-141020.osm.pbf
"
echo $URL_LIST | xargs -n 1 -P 8 wget -q
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment