danabauer

link: [https://www.digitalinfrastructures.eu/content/jupyter-notebook-service-enabling-easy-access-parallel-computing]

Jupyter notebook as a Service: enabling easy access to parallel computing

Presenter: Machiel Jansen Organisation: SURFsara Date: Thursday, September 29, 2016 - 11:30

Overview:

danabauer

image mosaicing basics

• intro to image mosaicing
• Survey of image mosaicing techniques and algorithms
• Temporal mosaicing Landsat

Tutorials

• Raster mosaicing and clipping in QGIS
• Image processing tutorial: mosaicing (joining), filtering (smoothing), and Contrast Enhancement

danabauer

Jupyter resources

• IPython magic, running one notebook from another, data viz, and more

danabauer

Types of API documentation: http://nordicapis.com/difference-api-documentation-specification-definition/

RESTful design: http://restful-api-design.readthedocs.io/en/latest/methods.html

Difference between REST and CRUD: https://softwareengineering.stackexchange.com/questions/120716/difference-between-rest-and-crud

What is an API? REST vs RPC https://apigility.org/documentation/api-primer/what-is-an-api

PUT or POST https://stormpath.com/blog/put-or-post

danabauer

GDAL on OS X

This will resolve issues with GDAL on OS X in your virtualenv:

• brew install gdal
• From OUTSIDE a virtualenv (try, deactivate), run this command to find your system site-packages directory: python -c "from distutils.sysconfig import get_python_lib; print(get_python_lib())"
  • Chances are this will be /Library/Python/2.7/site-packages
  • Note: this is where pip install ... packages are placed
• Copy the gdal-XXX.pth file to the site-packages directory of your virtual environment.
• Find your site packages directory for your virtual env by running the earlier command, python -c "from distutils.sysconfig import get_python_lib; print(get_python_lib())", from inside an activated virtualenv.

danabauer

Installing GDAL in a Python virtual environment

Get gdal development libraries:

$ sudo apt-add-repository ppa:ubuntugis/ubuntugis-unstable
$ sudo apt-get update
$ sudo apt-get install libgdal-dev

Create and activate a virtual environment:

danabauer

General information about setting up a developer environment on a mac

• With a Homebrewed Python installation, tips from NPR news apps team: http://blog.apps.npr.org/2013/06/06/how-to-setup-a-developers-environment.html
• Hitchhiker's guide to Python (mac): http://docs.python-guide.org/en/latest/starting/install3/osx/#install3-osx
• https://hackercodex.com/guide/mac-development-configuration/
• https://hackercodex.com/guide/python-development-environment-on-mac-osx/
• python 2/3, virtuanlenv, virtualenvwrapper: http://www.marinamele.com/2014/07/install-python3-on-mac-os-x-and-use-virtualenv-and-virtualenvwrapper.html
• setting up virtualenvwrapper in you bash_profile: http://stackoverflow.com/questions/23997403/installed-virtualenv-and-virtualenvwrapper-python-says-no-module-named-virtuale
• KyngChaos installers for geo: http://www.kyngchaos.com/
• Anaconda for data science: https://www.continuum.io/downloads

danabauer

https://coderwall.com/p/lt2kew/python-creating-your-project-structure

+ bin
  - project
+ project
  - main.py
  + lib
  + tests

danabauer

'''
Use Case 2
Find the most recently acquired image in imagery published in the last 48 hours:
Get all products in Grid-UTM catalog intersecting a rectangular AOI defined by the upper left and lower right 
coordinates (a field in United States, Iowa) published within the last 48 hours. Download the most recently 
acquired analytic asset regardless of provider.
'''

danabauer

'''
Use case 1
Scrape the catalog for an AOI/TOI: Filter the RapidEye Grid-UTM catalog for products in an AOI 
(United States in Iowa) with an acquisition period between "2014-04-01" and "2014-09-15" with a maximum 
cloud cover value of "20%." Download all of the analytic assets.
'''

import requests
from datetime import datetime
import pytz