Filipe Pais Lenfers filipelenfers

Avro serialization

There are 4 possible serialization format when using avro:

Avro Json encoding
Avro Data Serialization (https://avro.apache.org/docs/current/spec.html#Data+Serialization) Binary format with an header that contains the full schema, this is the format usually used when writing Avro files
Avro Single Object Encoding (https://avro.apache.org/docs/current/spec.html#single_object_encoding) Binary format with an header with only the fingerprint/id of the schema, this it the format used by Kafka (see this
Avro Binary Encoding (https://avro.apache.org/docs/current/spec.html#binary_encoding)

	def dict_to_item(raw:dict):
	return {
	key: _dict_to_item_recurse(value)
	for key, value in raw.items()
	}


	def _dict_to_item_recurse(raw):
	if isinstance(raw, dict):
	return {

	#!/bin/sh
	#
	# redis - this script starts and stops the redis-server daemon
	#
	# chkconfig: - 85 15
	# description: Redis is a persistent key-value database
	# processname: redis-server
	# config: /etc/redis/redis.conf
	# config: /etc/sysconfig/redis
	# pidfile: /var/run/redis/redis.pid

	#!/bin/bash

	# must run as root!!!

	RUBY_VERSION=1.9
	RUBY_PATCH=1.9.3-p429
	#RUBY_PATCH=1.9.3-p286
	#RUBY_PATCH=1.9.3-p194

	aptitude install -y build-essential libssl-dev libreadline-dev zlib1g-dev libyaml-dev libffi-dev

	class Respond extends Service[Request, Response] with Logger {
	def apply(request: Request) = {
	try {
	request.method -> Path(request.path) match {
	case GET -> Root / "todos" => Future.value {
	val data = Todos.allAsJson
	debug("data: %s" format data)
	Responses.json(data, acceptsGzip(request))
	}
	case GET -> Root / "todos" / id => Future.value {