Jon Roosevelt RooseveltAdvisors

RooseveltAdvisors / wordnet_ES_install.sh

Created October 7, 2016 03:39

install wordnet synonym on Elastic

	sudo su
	mkdir -p /etc/elasticsearch/analysis
	cd /etc/elasticsearch/analysis
	wget http://wordnetcode.princeton.edu/3.0/WNprolog-3.0.tar.gz
	tar xvzf WNprolog-3.0.tar.gz
	mv prolog/wn_s.pl .
	rm -rf prolog
	rm -f WNprolog-3.0.tar.gz

RooseveltAdvisors / spark-elastic

Created September 29, 2016 01:56

	import org.elasticsearch.spark._
	import org.apache.spark.sql._
	//val sqlContext = new SQLContext(sc)
	val options = Map("pushdown" -> "true", "es.nodes" -> "host_ip_here", "es.port" -> "9200",
	"es.nodes.wan.only" -> "true")
	sqlContext.read.format("es").options(options).load("index_name").write.mode(SaveMode.Overwrite).json("path_to_output")
	sc.esRDD("index_name",options)

RooseveltAdvisors / Burrow config

Last active July 30, 2016 20:40

Working conf for Burrow (Kafka consumer lag monitoring )