DrSnowbird
/ benchmark-commands.txt
Created
October 16, 2017 03:38
— forked from jkreps/benchmark-commands.txt
Kafka Benchmark Commands
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Producer | |
| Setup | |
| bin/kafka-topics.sh --zookeeper esv4-hcl197.grid.linkedin.com:2181 --create --topic test-rep-one --partitions 6 --replication-factor 1 | |
| bin/kafka-topics.sh --zookeeper esv4-hcl197.grid.linkedin.com:2181 --create --topic test --partitions 6 --replication-factor 3 | |
| Single thread, no replication | |
| bin/kafka-run-class.sh org.apache.kafka.clients.tools.ProducerPerformance test7 50000000 100 -1 acks=1 bootstrap.servers=esv4-hcl198.grid.linkedin.com:9092 buffer.memory=67108864 batch.size=8196 |
DrSnowbird
/ FileServer.java
Created
April 18, 2017 14:41
— forked from khajavi/FileServer.java
Create File Server With Jetty
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| // | |
| // ======================================================================== | |
| // Copyright (c) 1995-2015 Mort Bay Consulting Pty. Ltd. | |
| // ------------------------------------------------------------------------ | |
| // All rights reserved. This program and the accompanying materials | |
| // are made available under the terms of the Eclipse Public License v1.0 | |
| // and Apache License v2.0 which accompanies this distribution. | |
| // | |
| // The Eclipse Public License is available at | |
| // http://www.eclipse.org/legal/epl-v10.html |
DrSnowbird
/ Spark_OnlineLDA_wikipedia_example.scala
Created
May 18, 2016 16:13
— forked from feynmanliang/Spark_OnlineLDA_wikipedia_example.scala
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import org.apache.spark.ml.feature.{CountVectorizer, RegexTokenizer, StopWordsRemover} | |
| import org.apache.spark.mllib.clustering.{LDA, OnlineLDAOptimizer} | |
| import org.apache.spark.mllib.linalg.Vector | |
| import sqlContext.implicits._ | |
| val numTopics: Int = 100 | |
| val maxIterations: Int = 100 | |
| val vocabSize: Int = 10000 |