pomadchin

package geotrellis.spark.io.accumulo

import org.apache.accumulo.core.client.security.tokens.PasswordToken
import org.apache.accumulo.minicluster.{MiniAccumuloCluster, MiniAccumuloConfig}
import org.apache.commons.io.FileUtils

import java.io.File
import org.scalatest.{BeforeAndAfterAll, Suite}

trait AccumuloMiniCluster extends BeforeAndAfterAll { self: Suite =>

pomadchin

#!/usr/bin/env python
# -*- coding: utf-8 -*-
# *****************************************************************************
#  $Id$
#
#  Project:  GDAL
#  Purpose:  Validate Cloud Optimized GeoTIFF file structure
#  Author:   Even Rouault, <even dot rouault at spatialys dot com>
#
# *****************************************************************************

pomadchin

geowave-index > dependencyGraph
[info]                                                    +------------------------------+                                                   
[info]                                                    |sfcurve-geowave-index_2.11 [S]|                                                   
[info]                                                    |   org.locationtech.sfcurve   |                                                   
[info]                                                    |        0.2.1-SNAPSHOT        |                                                   
[info]                                                    +------------------------------+                                                   
[info]                                                            |             | |                                                          
[info]                                     ------------------------             | --------------------------------                          

pomadchin

{
  "__inputs": [
    {
      "name": "DS_GRAPHITE",
      "label": "Graphite",
      "description": "",
      "type": "datasource",
      "pluginId": "graphite",
      "pluginName": "Graphite"
    }

pomadchin

mapreduce.jobtracker.address : local
yarn.resourcemanager.scheduler.monitor.policies : org.apache.hadoop.yarn.server.resourcemanager.monitor.capacity.ProportionalCapacityPreemptionPolicy
mapreduce.jobhistory.client.thread-count : 10
yarn.resourcemanager.leveldb-state-store.compaction-interval-secs : 3600
mapred.child.java.opts : -Xmx200m
yarn.app.mapreduce.am.containerlauncher.threadpool-initial-size : 10
mapreduce.jobtracker.retiredjobs.cache.size : 1000
yarn.admin.acl : *
yarn.app.mapreduce.am.job.committer.cancel-timeout : 60000
mapreduce.job.emit-timeline-data : false

pomadchin

Benchmark sources:

• For #1999
• For GeoTrellis 1.0.0

Results:

1. Of GeoTrellis 1.0.0 (old version)
2. Of #1999 PR with review changes
3. Of #1999 PR

There is a comparable performance in [1/3 - 1/1000000] of all points on aspect-tif.tif (256 x 256 | 512 x 512) benchmarks in all three cases. It looks like the new CostDistance implementation is more dependent on the exact points values. The more points the target tile has, the more inconsistent results we get, and the gap between the old implementation and the new one increases. 1/3 of points and all points (?) are the worst case

pomadchin

#!/usr/bin/env python

# Usage example: ./pointscount.py data

# important imports
import pdal
import json
import pprint
import os
import argparse

pomadchin

How to run

1. You need to install docker
2. Download docker image with all deps and PDAL (+ with the script above): docker pull daunnc/pdal:1.4.0
3. Launch container (example with mounting /data folder):

   docker run -it -v /data:/data daunnc/pdal:1.4.0 bash
   

4. You will be inside the container. -v flag means directory mount: -v {on local machine}:{inside some container}
5. cd /home/local

pomadchin

server > dependencyTree
[info] Updating {file:/Users/daunnc/subversions/git/github/pomadchin/geotrellis-landsat-emr-demo/}server...
[info] Resolving jline#jline;2.12.1 ...
[info] Done updating.
[info] com.azavea:server_2.11:0.1.0 [S]
[info]   +-com.typesafe.akka:akka-actor_2.11:2.3.15 [S]
[info]   | +-com.typesafe:config:1.2.1 (evicted by: 1.3.1)
[info]   | +-com.typesafe:config:1.3.1
[info]   | 

pomadchin

import io.circe.Json
import io.circe.generic.extras._
import io.circe.generic.extras.auto._
import io.circe.generic.extras.semiauto._
import io.circe.syntax._

object Models {  
  sealed trait A
  case class B(str: String) extends A
  case class C(i: Int) extends A