rbuckland

/*

This is some configuration I have used to run a a Scala base SBT webapp on Heroku.

Heroku suggest using startscript. But this doesn;t work on Mac OSX *readline, it also uses an embedded jetty verison, and it uses the jetty distribution.

Instead, Heroku suggest using jetty-runner with Java Maven projects (and I liked that a lot) so I am replicating that setup here.

In short: 
1. Ensure you have the xsbt-web-plugin

rbuckland

/**
 * @author rbuckland
 */
trait H2DatabaseGenerator extends CommonHttpService {


  val generateH2DbRoute = pathPrefix("h2generator") {

//    headerValueByName("Upload-File-Name") { filename =>
//      headerValueByName("DatabaseName") { dbname =>

rbuckland

import org.joda.time.DateTime
import com.soqqo.luap.model.common.Address
import io.straight.fw.model.Uuid
import java.util.Date
import akka.actor.ActorRef

/*
 * file: CampusMessages.scala
 */

rbuckland

package com.soqqo.luap.messages

import com.soqqo.luap.messages.ContextMetaData
import com.soqqo.luap.messages.NoContextMetaData
import com.soqqo.luap.messages.RegisterNewPerson
import io.straight.fw.model.Uuid
import scala.reflect.api.JavaUniverse
import scala.reflect.api
import io.straight.fw.jackson.JacksonBindingSupport._
import scala.Some

rbuckland

package com.soqqo.luap.web.marshalling

import org.scalatest.FlatSpec
import org.scalatest.matchers.ShouldMatchers
import io.straight.fw.spray.marshalling.JacksonUnmarshaller
import com.soqqo.luap.messages.AddNewAccountTenantRegistration
import spray.httpx.unmarshalling._
import spray.util._
import spray.http._
import spray.http.MediaTypes.`application/json`

rbuckland

  def safeSum[A: Numeric](as: Seq[A]):Option[A] =
    if (as.isEmpty) None else Some(as.qsum)

  def safeDiv[A: Numeric](a:Option[A], b:Option[A]):Option[Double] = (a,b) match {
    case (None,_) | (_,Some(0)) | (_,None) => None
    case (Some(x),Some(y)) => Some((x / y).toDouble())
  }

  /**

rbuckland

scala> val x:Double = Long.MaxValue  // x: Double = 9.223372036854776E18    (9223372036854775807)
scala> x == Long.MaxValue            // Boolean = true
scala> x.longValue == Long.MaxValue  // Boolean = true
scala> val y = 1234567890123456789L  // y: Long = 1234567890123456789  // less than Long.MaxValue
scala> y < x                         // Boolean = true
scala> val z:Double = y              // z: Double = 1.23456789012345677E18
scala> z == y                        // Boolean = true
scala> z.longValue == y              // Boolean = false  // why ? MaxValue fits in the Double

rbuckland

  def doWork[A: Numeric, B: Numeric](values: Seq[Option[A]], op: String): Option[B] = {
    import spire.implicits._
    val v = values.flatten
    if (v.isEmpty) {
      None
    } else {
      op match {
        case "sum" => Some(v.qsum) // returns A
        case "avg" | "avg" => Some(v.qsum / v.length) // returns Double
        case "max" => Some(v.qmin) // A

rbuckland

Installing mr4c - MapReduce for C/C++

https://github.com/google/mr4c http://google-opensource.blogspot.com.au/2015/02/mapreduce-for-c-run-native-code-in.html

General Notes

mr4c and it's dependencies will be required installs on all nodes that run your algorithms; This goes without saying, but of course if you get exceptions like below, then that is literally what is going on.

Caused by: java.lang.UnsatisfiedLinkError: Unable to load library '/data/nvme/yarn/nm/usercache/genuser/filecache/10/libmr4c.so': liblog4cxx.so.10: cannot open shared object file: No such file or directory

rbuckland

Overview

I have been working on a project with a number of docker containers that are either run on a local machine, or on a remote machine.

The process is fairly simple, I either need to "build" a docker image, "run" a container, from an image, and/ or push an image to a local docker repository.

The process is like this

dockers/