haitaoyao

今年第二次参加湾区的Spark Summit. 现在家倒时差, 没事儿写两句

去年回顾

去年参加 Spark Summit 最关注的是Intel 的 StreamSQL 和 DataBricks Cloud

StreamSQL

简介

• Intel出品
• 直接写SQL, 简化实时计算开发

haitaoyao

You will want to add https://github.com/freewizard/SublimeFormatSQL

And then you can install the sublimeformatsql package.

For a detailed walkthrough of adding a repository, see http://www.macdrifter.com/2012/08/insta ... ithub.html

use command+k && command+s to format the selected code

haitaoyao

import org.scalatest.{Assertions, FunSuite}
import org.eclipse.jetty.server.handler._
import org.eclipse.jetty.server._
import org.eclipse.jetty.server.bio.SocketConnector
import javax.servlet.http.{HttpServletResponse, HttpServletRequest}
import java.util.concurrent.{Executors, TimeUnit}
import java.net.{URLConnection, URL}
import org.apache.commons.io.IOUtils
import java.io.ByteArrayOutputStream

haitaoyao

Latency numbers every programmer should know

L1 cache reference ......................... 0.5 ns
Branch mispredict ............................ 5 ns
L2 cache reference ........................... 7 ns
Mutex lock/unlock ........................... 25 ns
Main memory reference ...................... 100 ns             
Compress 1K bytes with Zippy ............. 3,000 ns  =   3 µs
Send 2K bytes over 1 Gbps network ....... 20,000 ns  =  20 µs
SSD random read ........................ 150,000 ns  = 150 µs

Read 1 MB sequentially from memory ..... 250,000 ns = 250 µs

haitaoyao

import static org.junit.Assert.assertEquals;

import java.util.concurrent.ArrayBlockingQueue;
import java.util.concurrent.Semaphore;
import java.util.concurrent.SynchronousQueue;
import java.util.concurrent.ThreadPoolExecutor;
import java.util.concurrent.TimeUnit;

import org.junit.Test;

haitaoyao

<profiles>

  	<profile>
			<id>windows_profile</id>
			<activation>
				<os>
					<family>Windows</family>
				</os>
			</activation>
			<properties>

haitaoyao

 erl -eval 'erlang:display(erlang:system_info(otp_release)), halt().'  -noshell

haitaoyao

start(App) ->
    start_ok(App, application:start(App, permanent)).

start_ok(_App, ok) ->
    ok;
start_ok(_App, {error, {already_started, _App}}) ->
    ok;
start_ok(App, {error, {not_started, Dep}}) ->
    ok = start(Dep),
    start(App);