nishadhka

based on this to convert the pbf into paraquet file
The library, https://github.com/adrianulbona/osm-parquetizer to convert the osm.pbf file into three paraquet files

java -jar target/osm-parquetizer-1.0.1-SNAPSHOT.jar ../test1/romania-latest.osm.pbf

The Python pyspark code to read the paraquete file and make subset on extent and save the shape file
Using the docker for https://hub.docker.com/r/airpollutionstudyindia/matplotlib and executing the code in the contianer

from pyspark.sql import SparkSession
from pyspark.sql.functions import col,explode

Handy vim commands

The docker tar.gz'd is 2.4 GB in size, download from here

to set up the new ubuntu docker image, it is 124MB in size,
```
sudo docker search ubuntu
sudo docker pull ubuntu
```

	import fiona
	import geopandas as gpd

	# Enable fiona driver
	gpd.io.file.fiona.drvsupport.supported_drivers['KML'] = 'rw'

	# Read file
	df = gpd.read_file(path, driver='KML')

	# Write file

	"Source https://github.com/j1z0/vim-config/blob/master/vimrc
	"vundle
	set nocompatible
	filetype off

	set rtp+=~/.vim/bundle/Vundle.vim
	call vundle#begin()

	Plugin 'VundleVim/Vundle.vim'
	"git interface

	import numpy as np
	import fiona
	from shapely import geometry
	import ee
	ee.Initialize()
	from gee_library import *
	from rasterio.features import shapes
	import geopandas as gp
	import ntpath
	import glob

	import requests
	import json

	oauth_url = 'http://sample_ushahidinstance/platform/oauth/token'

	oauth_d = {
	"grant_type": "password",
	"scope": "apikeys posts country_codes media forms api tags savedsearches sets users stats layers config messages notifications webhooks contacts roles permissions csv tos dataproviders",
	"client_id": "ushahidiui",
	"client_secret": "35e7f0bca957836d05ca0492211b0ac707671261",