Jordan jordanburke

Pure ESM package

The package that linked you here is now pure ESM. It cannot be require()'d from CommonJS.

This means you have the following choices:

Use ESM yourself. (preferred)
Use import foo from 'foo' instead of const foo = require('foo') to import the package. You also need to put "type": "module" in your package.json and more. Follow the below guide.
If the package is used in an async context, you could use await import(…) from CommonJS instead of require(…).
Stay on the existing version of the package until you can move to ESM.

Spark - High availability

Components in play

As a reminder, here are the components in play to run an application:

The cluster:
- Spark Master: coordinates the resources
- Spark Workers: offer resources to run the applications
The application:

Latency numbers every programmer should know

L1 cache reference ......................... 0.5 ns
Branch mispredict ............................ 5 ns
L2 cache reference ........................... 7 ns
Mutex lock/unlock ........................... 25 ns
Main memory reference ...................... 100 ns             
Compress 1K bytes with Zippy ............. 3,000 ns  =   3 µs
Send 2K bytes over 1 Gbps network ....... 20,000 ns  =  20 µs
SSD random read ........................ 150,000 ns  = 150 µs

Read 1 MB sequentially from memory ..... 250,000 ns = 250 µs

	/**
	* Generate Case class from DataFrame.schema
	*
	* val df:DataFrame = ...
	*
	* val s2cc = new Schema2CaseClass
	* import s2cc.implicit._
	*
	* println(s2cc.schemaToCaseClass(df.schema, "MyClass"))
	*

	object Main extends App {
	AvoidLosingGenericType.run()
	AvoidMatchingOnGenericTypeParams.run()
	TypeableExample.run()
	TypeTagExample.run()
	}

	class Funky[A, B](val foo: A, val bar: B) {
	override def toString: String = s"Funky($foo, $bar)"
	}

	/** This is in reference to @tploecat's blog http://tpolecat.github.io/2015/04/29/f-bounds.html
	* where he compares F-bounded polymorphism and type classes for implementing "MyType".
	*
	* Curiously, the in my mind obvious solution is missing: Use abstract types.
	*
	* A lot of this material, including an argument against F-bounded for the use-case
	* is discussed in:
	*
	* Kim B. Bruce, Martin Odersky, Philip Wadler:
	* A Statically Safe Alternative to Virtual Types. ECOOP 1998: 523-549

	# As used with CanCan and Devise
	class ApplicationController < ActionController::Base
	protect_from_forgery

	include ErrorResponseActions

	rescue_from CanCan::AccessDenied, :with => :authorization_error
	rescue_from ActiveRecord::RecordNotFound, :with => :resource_not_found

	before_filter :authenticate!

	app.directive('ngFocus', ['$parse', function($parse) {
	return function(scope, element, attr) {
	var fn = $parse(attr['ngFocus']);
	element.bind('focus', function(event) {
	scope.$apply(function() {
	fn(scope, {$event:event});
	});
	});
	}
	}]);

	<h1>Alert</h1>
	<p>Bootstrap JS</p>
	<div class="alert fade in">
	<button type="button" class="close" data-dismiss="alert">×</button>
	<strong>Holy guacamole!</strong> Best check yo self, you're not looking too good.
	</div>

	<p></p><a ng-click="alert=true">Open Alert (AngularJS)</a></p>
	<div class="alert fade" ng-class="{in:alert}">
	<button type="button" class="close" ng-click="alert=false">×</button>

	<script type="text/ng-template" id="one.html">
	<div>This is first template</div>
	</script>

	<script type="text/ng-template" id="two.html">
	<div>This is second template</div>
	</script>