Skip to content

Instantly share code, notes, and snippets.

@msmith-techempower

msmith-techempower/gist:6a01acc11fb5233681c4

Created July 10, 2015 16:28
Show Gist options
  • Save msmith-techempower/6a01acc11fb5233681c4 to your computer and use it in GitHub Desktop.
Save msmith-techempower/6a01acc11fb5233681c4 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
gistfile1.txt
FWROOT is /home/techempower/FrameworkBenchmarks
Configuration options:
{'client_host': '10.0.3.3',
'client_identity_file': '/home/techempower/.ssh/id_rsa',
'client_user': 'techempower',
'concurrency_levels': [8, 16, 32, 64, 128, 256],
'conf_file': 'benchmark.cfg',
'database_host': '10.0.3.5',
'database_identity_file': '/home/techempower/.ssh/id_rsa',
'database_os': 'linux',
'database_user': 'techempower',
'duration': 15,
'exclude': None,
'install': 'server',
'install_error_action': 'continue',
'install_only': False,
'install_strategy': 'unified',
'list_test_metadata': False,
'list_tests': False,
'mode': 'benchmark',
'name': 'ec2',
'os': 'linux',
'parse': None,
'password_prompt': False,
'query_levels': [1, 5, 10, 15, 20],
'runner_user': 'testrunner',
'server_host': '10.0.3.2',
'sleep': 60,
'test': ['play2'],
'threads': 40,
'type': 'all',
'verbose': True}
WARNING:root:results.json for test ec2 not found.
WARNING:root:Framework sabina does not define a default test in benchmark_config.json
WARNING:root:Framework sabina does not define a default test in benchmark_config.json
WARNING:root:Framework sabina does not define a default test in benchmark_config.json
WARNING:root:Framework historical does not define a default test in benchmark_config.json
WARNING:root:Framework sabina does not define a default test in benchmark_config.json
WARNING:root:Framework sabina does not define a default test in benchmark_config.json
WARNING:root:Framework sabina does not define a default test in benchmark_config.json
WARNING:root:Framework historical does not define a default test in benchmark_config.json
================================================================================
Preparing Server, Database, and Client ...
================================================================================
bash: cpu0/cpufreq/scaling_governor: No such file or directory
bash: cpu1/cpufreq/scaling_governor: No such file or directory
bash: cpu10/cpufreq/scaling_governor: No such file or directory
bash: cpu11/cpufreq/scaling_governor: No such file or directory
bash: cpu12/cpufreq/scaling_governor: No such file or directory
bash: cpu13/cpufreq/scaling_governor: No such file or directory
bash: cpu14/cpufreq/scaling_governor: No such file or directory
bash: cpu15/cpufreq/scaling_governor: No such file or directory
bash: cpu16/cpufreq/scaling_governor: No such file or directory
bash: cpu17/cpufreq/scaling_governor: No such file or directory
bash: cpu18/cpufreq/scaling_governor: No such file or directory
bash: cpu19/cpufreq/scaling_governor: No such file or directory
bash: cpu2/cpufreq/scaling_governor: No such file or directory
bash: cpu20/cpufreq/scaling_governor: No such file or directory
bash: cpu21/cpufreq/scaling_governor: No such file or directory
bash: cpu22/cpufreq/scaling_governor: No such file or directory
bash: cpu23/cpufreq/scaling_governor: No such file or directory
bash: cpu24/cpufreq/scaling_governor: No such file or directory
bash: cpu25/cpufreq/scaling_governor: No such file or directory
bash: cpu26/cpufreq/scaling_governor: No such file or directory
bash: cpu27/cpufreq/scaling_governor: No such file or directory
bash: cpu28/cpufreq/scaling_governor: No such file or directory
bash: cpu29/cpufreq/scaling_governor: No such file or directory
bash: cpu3/cpufreq/scaling_governor: No such file or directory
bash: cpu30/cpufreq/scaling_governor: No such file or directory
bash: cpu31/cpufreq/scaling_governor: No such file or directory
bash: cpu32/cpufreq/scaling_governor: No such file or directory
bash: cpu33/cpufreq/scaling_governor: No such file or directory
bash: cpu34/cpufreq/scaling_governor: No such file or directory
bash: cpu35/cpufreq/scaling_governor: No such file or directory
bash: cpu36/cpufreq/scaling_governor: No such file or directory
bash: cpu37/cpufreq/scaling_governor: No such file or directory
bash: cpu38/cpufreq/scaling_governor: No such file or directory
bash: cpu39/cpufreq/scaling_governor: No such file or directory
bash: cpu4/cpufreq/scaling_governor: No such file or directory
bash: cpu5/cpufreq/scaling_governor: No such file or directory
bash: cpu6/cpufreq/scaling_governor: No such file or directory
bash: cpu7/cpufreq/scaling_governor: No such file or directory
bash: cpu8/cpufreq/scaling_governor: No such file or directory
bash: cpu9/cpufreq/scaling_governor: No such file or directory
Welcome to Ubuntu 14.04 LTS (GNU/Linux 3.13.0-30-generic x86_64)
* Documentation: https://help.ubuntu.com/
System information as of Fri Jul 10 12:09:46 EDT 2015
System load: 0.0 Processes: 433
Usage of /: 0.7% of 884.81GB Users logged in: 1
Memory usage: 21% IP address for p6p1: 10.0.3.5
Swap usage: 0% IP address for bond0: 69.194.0.135
Graph this data and manage this system at:
https://landscape.canonical.com/
279 packages can be updated.
158 updates are security updates.
net.ipv4.tcp_max_syn_backlog = 65535
net.core.somaxconn = 65535
kernel.sched_autogroup_enabled = 0
net.ipv4.tcp_tw_reuse = 1
net.ipv4.tcp_tw_recycle = 1
kernel.shmmax = 2147483648
kernel.shmall = 2097152
kernel.sem = 250 32000 256 512
Welcome to Ubuntu 12.04.5 LTS (GNU/Linux 3.2.0-74-generic x86_64)
* Documentation: https://help.ubuntu.com/
System information as of Fri Jul 10 09:21:55 PDT 2015
System load: 0.0 Processes: 261
Usage of /: 0.2% of 884.93GB Users logged in: 0
Memory usage: 2% IP address for eth5: 10.0.3.3
Swap usage: 0% IP address for bond0: 69.194.0.133
Graph this data and manage this system at:
https://landscape.canonical.com/
104 packages can be updated.
84 updates are security updates.
New release '14.04.1 LTS' available.
Run 'do-release-upgrade' to upgrade to it.
net.ipv4.tcp_max_syn_backlog = 65535
net.core.somaxconn = 65535
net.ipv4.tcp_tw_reuse = 1
net.ipv4.tcp_tw_recycle = 1
kernel.shmmax = 2147483648
kernel.shmall = 2097152
================================================================================
Running Tests...
================================================================================
-------------------------------------------------------------------------------- | Rough ETA: --:--:--
Running Test: play2
--------------------------------------------------------------------------------
INFO:root:Running setup module start (cwd=/home/techempower/FrameworkBenchmarks/frameworks/Java/play2-java)
INFO:root:To run play2 manually, copy/paste this:
export FWROOT=/home/techempower/FrameworkBenchmarks && \
export TROOT=/home/techempower/FrameworkBenchmarks/frameworks/Java/play2-java && \
export IROOT=/home/techempower/FrameworkBenchmarks/installs && \
export DBHOST=10.0.3.5 && \
export LOGDIR=/home/techempower/FrameworkBenchmarks/results/ec2/latest/logs/play2 && \
export MAX_THREADS=40 && \
export MAX_CONCURRENCY=/home/techempower/FrameworkBenchmarks/frameworks/Java/play2-java && \
cd 256 && \
sudo -u testrunner -E -H stdbuf -o0 -e0 bash -exc "source /home/techempower/FrameworkBenchmarks/toolset/setup/linux/bash_functions.sh && source /home/techempower/FrameworkBenchmarks/frameworks/Java/play2-java/setup_java.sh"
Setup play2: + source /home/techempower/FrameworkBenchmarks/toolset/setup/linux/bash_functions.sh
Setup play2: ++ FW_dep_error=0
Setup play2: ++ FW_any_errors=0
Setup play2: + source /home/techempower/FrameworkBenchmarks/frameworks/Java/play2-java/setup_java.sh
Setup play2: ++ fw_depends java8 sbt
Setup play2: ++ set -E
Setup play2: ++ for depend in '"$@"'
Setup play2: +++ echo java8
Setup play2: +++ awk '{print tolower($0)}'
Setup play2: ++ depend=java8
Setup play2: ++ echo Searching for java8
Setup play2: Searching for java8
Setup play2: ++ trap 'fw_traperror $depend $? $LINENO "$BASH_COMMAND" $(printf ":%s" ${FUNCNAME[@]}) $(printf ":%s" ${BASH_SOURCE[@]}) $(printf ":%s" ${BASH_LINENO[@]})' ERR
Setup play2: ++ retcode=0
Setup play2: ++ pushd /home/techempower/FrameworkBenchmarks/installs
Setup play2: /home/techempower/FrameworkBenchmarks/installs /home/techempower/FrameworkBenchmarks/frameworks/Java/play2-java
Setup play2: +++ pwd
Setup play2: ++ wd=/home/techempower/FrameworkBenchmarks/installs
Setup play2: ++ relative_wd='$FWROOT/installs'
Setup play2: +++ fw_exists /home/techempower/FrameworkBenchmarks/installs/prerequisites.installed
Setup play2: +++ '[' -f /home/techempower/FrameworkBenchmarks/installs/prerequisites.installed ']'
Setup play2: +++ echo 0
Setup play2: ++ RETCODE=0
Setup play2: ++ '[' 0 == 0 ']'
Setup play2: ++ '[' -f /home/techempower/FrameworkBenchmarks/toolset/setup/linux/systools/java8.sh ']'
Setup play2: ++ '[' -f /home/techempower/FrameworkBenchmarks/toolset/setup/linux/languages/java8.sh ']'
Setup play2: ++ echo Installing language: java8 in '$FWROOT/installs'
Setup play2: Installing language: java8 in $FWROOT/installs
Setup play2: ++ set -x
Setup play2: ++ . /home/techempower/FrameworkBenchmarks/toolset/setup/linux/languages/java8.sh
Setup play2: ++++ fw_exists java8.installed
Setup play2: ++++ '[' -f java8.installed ']'
Setup play2: ++++ echo 0
Setup play2: +++ RETCODE=0
Setup play2: +++ '[' '!' 0 == 0 ']'
Setup play2: +++ source /home/techempower/FrameworkBenchmarks/installs/java8.installed
Setup play2: ++++ export JAVA_HOME=/usr/lib/jvm/java-8-oracle
Setup play2: ++++ JAVA_HOME=/usr/lib/jvm/java-8-oracle
Setup play2: ++++ export PATH=/usr/lib/jvm/java-8-oracle/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
Setup play2: ++++ PATH=/usr/lib/jvm/java-8-oracle/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
Setup play2: +++ return 0
Setup play2: ++ set +x
Setup play2: /home/techempower/FrameworkBenchmarks/frameworks/Java/play2-java
Setup play2: java8 is installed!
Setup play2: Searching for sbt
Setup play2: /home/techempower/FrameworkBenchmarks/installs /home/techempower/FrameworkBenchmarks/frameworks/Java/play2-java
Setup play2: Installing system tool: sbt in $FWROOT/installs
Setup play2: ++ . /home/techempower/FrameworkBenchmarks/toolset/setup/linux/systools/sbt.sh
Setup play2: ++++ fw_exists /home/techempower/FrameworkBenchmarks/installs/sbt.installed
Setup play2: ++++ '[' -f /home/techempower/FrameworkBenchmarks/installs/sbt.installed ']'
Setup play2: ++++ echo 0
Setup play2: +++ RETCODE=0
Setup play2: +++ '[' '!' 0 == 0 ']'
Setup play2: +++ source /home/techempower/FrameworkBenchmarks/installs/sbt.installed
Setup play2: ++++ export PATH=/home/techempower/FrameworkBenchmarks/installs/sbt/bin:/usr/lib/jvm/java-8-oracle/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
Setup play2: ++++ PATH=/home/techempower/FrameworkBenchmarks/installs/sbt/bin:/usr/lib/jvm/java-8-oracle/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
Setup play2: +++ return 0
Setup play2: ++ set +x
Setup play2: /home/techempower/FrameworkBenchmarks/frameworks/Java/play2-java
Setup play2: sbt is installed!
Setup play2: [info] Loading project definition from /home/techempower/FrameworkBenchmarks/frameworks/Java/play2-java/play2-java/project
Setup play2: [info] Set current project to play2-java (in build file:/home/techempower/FrameworkBenchmarks/frameworks/Java/play2-java/play2-java/)
Setup play2: [info] Wrote /home/techempower/FrameworkBenchmarks/frameworks/Java/play2-java/play2-java/target/scala-2.11/play2-java_2.11-1.0-SNAPSHOT.pom
Setup play2: [success] Total time: 0 s, completed Jul 10, 2015 9:21:59 AM
Setup play2: Play server process ID is 10204
Setup play2: Status: Poll: 0, Port 9000 bound: False, Time Left: 1:44:55.131129
Setup play2: setup_java.sh process exited naturally with 0
INFO:root:Executed setup_java.sh, returning 0
INFO:root:Sleeping 60 seconds to ensure framework is ready
INFO:root:Verifying framework URLs
Accessing URL http://10.0.3.2:9000/json:
Response (trimmed to 40 bytes): "{"message":"Hello, World!"}"
PASS for http://10.0.3.2:9000/json
Accessing URL http://10.0.3.2:9000/plaintext:
Response (trimmed to 40 bytes): "Hello, World!"
PASS for http://10.0.3.2:9000/plaintext
INFO:root:Benchmarking
Module dstat_rpc failed to load. (Cannot open file /proc/net/rpc/nfs)
Module dstat_rpcd failed to load. (Cannot open file /proc/net/rpc/nfsd)
Benchmark results:
{'results': [{'endTime': 1436545427,
'latencyAvg': '151.68us',
'latencyMax': '3.89ms',
'latencyStdev': '71.65us',
'startTime': 1436545412,
'totalRequests': 774164},
{'endTime': 1436545444,
'latencyAvg': '212.40us',
'latencyMax': '15.61ms',
'latencyStdev': '212.27us',
'startTime': 1436545429,
'totalRequests': 1137413},
{'endTime': 1436545461,
'latencyAvg': '454.28us',
'latencyMax': '25.20ms',
'latencyStdev': '1.58ms',
'startTime': 1436545446,
'totalRequests': 1616742},
{'endTime': 1436545478,
'latencyAvg': '644.67us',
'latencyMax': '27.27ms',
'latencyStdev': '2.34ms',
'startTime': 1436545463,
'totalRequests': 1814179},
{'endTime': 1436545495,
'latencyAvg': '0.90ms',
'latencyMax': '40.35ms',
'latencyStdev': '1.24ms',
'startTime': 1436545480,
'totalRequests': 2117636},
{'connect': 0,
'endTime': 1436545512,
'latencyAvg': '1.90ms',
'latencyMax': '624.71ms',
'latencyStdev': '6.02ms',
'read': 0,
'startTime': 1436545497,
'timeout': 15,
'totalRequests': 2094226,
'write': 0}]}
Module dstat_rpc failed to load. (Cannot open file /proc/net/rpc/nfs)
Module dstat_rpcd failed to load. (Cannot open file /proc/net/rpc/nfsd)
Benchmark results:
{'results': [{'connect': 0,
'endTime': 1436545561,
'latencyAvg': '28.35ms',
'latencyMax': '63.97ms',
'latencyStdev': '18.95ms',
'read': 0,
'startTime': 1436545546,
'timeout': 40,
'totalRequests': 1978664,
'write': 0},
{'connect': 0,
'endTime': 1436545578,
'latencyAvg': '62.24ms',
'latencyMax': '695.04ms',
'latencyStdev': '38.15ms',
'read': 0,
'startTime': 1436545563,
'timeout': 3507,
'totalRequests': 2024970,
'write': 0},
{'connect': 0,
'endTime': 1436545595,
'latencyAvg': '163.56ms',
'latencyMax': '716.03ms',
'latencyStdev': '160.73ms',
'read': 0,
'startTime': 1436545580,
'timeout': 24618,
'totalRequests': 1978531,
'write': 0},
{'connect': 0,
'endTime': 1436545612,
'latencyAvg': '240.94ms',
'latencyMax': '784.75ms',
'latencyStdev': '84.96ms',
'read': 0,
'startTime': 1436545597,
'timeout': 109213,
'totalRequests': 1795347,
'write': 0}]}
play2: setup_java.sh and framework processes have terminated
Server play2: Framework processes have terminated
benchmark: 100% |#####################################################################| Rough Time: 00:05:19
================================================================================
Parsing Results ...
================================================================================
WARNING:root:Framework sabina does not define a default test in benchmark_config.json
WARNING:root:Framework sabina does not define a default test in benchmark_config.json
WARNING:root:Framework sabina does not define a default test in benchmark_config.json
WARNING:root:Framework historical does not define a default test in benchmark_config.json
WARNING:root:Framework sabina does not define a default test in benchmark_config.json
WARNING:root:Framework sabina does not define a default test in benchmark_config.json
WARNING:root:Framework sabina does not define a default test in benchmark_config.json
WARNING:root:Framework historical does not define a default test in benchmark_config.json
WARNING:root:Cannot count lines of code for play2 - no 'source_code' file
WARNING:root:Framework sabina does not define a default test in benchmark_config.json
WARNING:root:Framework sabina does not define a default test in benchmark_config.json
WARNING:root:Framework sabina does not define a default test in benchmark_config.json
WARNING:root:Framework historical does not define a default test in benchmark_config.json
================================================================================
Verification Summary
| Test: play2
| plaintext : PASS
| json : PASS
================================================================================
Time to complete: 320 seconds
Results are saved in results/ec2/20150710092153
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment