Welcome to the kafka workshop @LINE Taiwan!
Today session will help you get started with doing some basic stream processing using Kafka Streams and KSQL, and how you can manage materialzed views using Kafka Connect.
In what follows, we will give you a detail step-by-step guide on building your first stream processing application. The application considers 2 data sources:
| sealed trait Term | |
| case class Const(name: String) extends Term | |
| case class Var(name: String) extends Term | |
| case class Atom(relation: String, terms: Term*) | |
| sealed trait Clause | |
| case class Rule(head: Atom, body: Atom*) extends Clause | |
| case class Fact(atom: Atom) extends Clause | |
| case class Query(name: String, atoms: Atom*) extends Clause |
| {-# LANGUAGE DataKinds #-} | |
| {-# LANGUAGE DeriveGeneric #-} | |
| {-# LANGUAGE FlexibleContexts #-} | |
| {-# LANGUAGE LambdaCase #-} | |
| {-# LANGUAGE NamedFieldPuns #-} | |
| {-# LANGUAGE OverloadedStrings #-} | |
| {-# LANGUAGE QuasiQuotes #-} | |
| {-# LANGUAGE RecordWildCards #-} | |
| {-# LANGUAGE TypeOperators #-} |
I hereby claim:
To claim this, I am signing this object:
| import io.finch._ | |
| import io.finch.syntax._ | |
| import shapeless._ | |
| import scala.language.existentials | |
| trait Route { | |
| private object base extends Endpoint[HNil] { | |
| def apply(input: Input): Endpoint.Result[HNil] = EndpointResult.NotMatched | |
| } | |
| Driver: | |
| -Write the code according to the navigator's specification | |
| -Listen intently to the navigators instructions | |
| -Ask questions wherever there is a lack of clarity | |
| -Offer alternative solutions if you disagree with the navigator | |
| -Where there is disagreement, defer to the navigator. If their idea fails, get to failure quickly and move on | |
| -Make sure code is clean | |
| -Own the computer / keyboard | |
| -Ignore larger issues and focus on the task at hand | |
| -Trust the navigator - ultimately the navigator has the final say in what is written |
| package main | |
| import ( | |
| "fmt" | |
| "io" | |
| "io/ioutil" | |
| "net" | |
| "os" | |
| "strings" |
| obj-m += tcp_svr_sample.o | |
| all: | |
| make -C /lib/modules/$(shell uname -r)/build M=$(PWD) modules | |
| clean: | |
| make -C /lib/modules/$(shell uname -r)/build M=$(PWD) clea |
