manuzhang
/ simple_barrier.py
Last active
March 27, 2020 07:12
— forked from yaroslavvb/simple_barrier.py
TensorFlow in-graph replication example
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| """ | |
| This example is adapted from https://gist.github.com/yaroslavvb/ef407a599f0f549f62d91c3a00dcfb6c | |
| Example of barrier implementation using TensorFlow shared variables. | |
| All workers synchronize on barrier, copy global parameters to local versions | |
| and increment global parameter variable asynchronously. Should see something | |
| like this: | |
| python simple_barrier.py --wk "node13-1:21393,node13-1:21395" | |
| Creating session |
manuzhang
/ benchmark-commands.txt
Last active
August 29, 2015 14:10
— forked from jkreps/benchmark-commands.txt
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Producer | |
| Setup | |
| bin/kafka-topics.sh --zookeeper esv4-hcl197.grid.linkedin.com:2181 --create --topic test-rep-one --partitions 6 --replication-factor 1 | |
| bin/kafka-topics.sh --zookeeper esv4-hcl197.grid.linkedin.com:2181 --create --topic test --partitions 6 --replication-factor 3 | |
| Single thread, no replication | |
| bin/kafka-run-class.sh org.apache.kafka.clients.tools.ProducerPerformance test7 50000000 100 -1 acks=1 bootstrap.servers=esv4-hcl198.grid.linkedin.com:9092 buffer.memory=67108864 batch.size=8196 |