hivefans hivefans

Stargate Scanner Filter Examples

Introduction

So yeah... no documentation for the HBase REST API in regards to what should a filter look like...

So I installed Eclipse, got the library, and took some time to find some of the (seemingly) most useful filters you could use. I'm very green at anything regarding HBase, and I hope this will help anyone trying to get started with it.

What I discovered is that basically, attributes of the filter object follow the same naming than in the documentation. For this reason, I have made the link clickable and direct them to the HBase Class documentation attached to it; check for the instantiation argument names, and you will have your attribute list (more or less).

Python =(parallelize)=> RDD =(collect)=> Python

It works well.

>>> sc = SparkContext('local', 'test', batchSize=2)
>>> data = [([1, 0], [0.5, 0.499]), ([0, 1], [0.5, 0.499])]
>>> rdd = sc.parallelize(data)
>>> rdd.collect()
[([1, 0], [0.5, 0.499]), ([0, 1], [0.5, 0.499])]

Golang Job Queue

A running example of the code from:

Step 1

Small refactorings made to original code:

	#!/usr/bin/env bash
	#
	# ===================================
	# Experiments with the HBase REST API
	# ===================================
	#
	# <http://hbase.apache.org/docs/r0.20.4/api/org/apache/hadoop/hbase/rest/package-summary.html>
	#
	# Usage:
	#

	#!/usr/bin/env python

	"""
	Real time log files watcher supporting log rotation.

	Author: Giampaolo Rodola' <g.rodola [AT] gmail [DOT] com>
	License: MIT
	"""

	import os

	#!/usr/bin/env python
	# -- coding: utf-8 --
	import argparse
	import time

	import requests

	SLEEP_TIME = 5

	# !/usr/bin/env python
	# coding=utf-8
	# http://my.oschina.net/leejun2005/blog/71444
	"""
	简介：这是一个 python 写的轻量级的文件共享服务器（基于内置的SimpleHTTPServer模块），
	支持文件上传下载，只要你安装了python（建议版本2.6~2.7，不支持3.x），
	然后去到想要共享的目录下，执行：
	python SimpleHTTPServerWithUpload.py
	或者 python SimpleHTTPServerWithUpload.py filename
	"""

	package honeycast

	import (
	"io/ioutil"
	"regexp"

	"github.com/imdario/mergo"
	"gopkg.in/yaml.v2"
	)

	package main

	import (
	"github.com/Shopify/sarama"

	"crypto/tls"
	"crypto/x509"
	"encoding/json"
	"flag"
	"fmt"

	package main

	import (
	"log"
	"os"
	"time"

	"github.com/Shopify/sarama"
	)