Skip to content

Instantly share code, notes, and snippets.

@hamiltont
Last active August 29, 2015 14:04
Show Gist options
  • Save hamiltont/7333cfc0ebaf03736d1e to your computer and use it in GitHub Desktop.
Save hamiltont/7333cfc0ebaf03736d1e to your computer and use it in GitHub Desktop.
Output of 1) console with DEBUG 2) console 3) test log file
╰─$ toolset/run-tests.py --test go --sleep 5 --type json --max-threads 8 --max-concurrency 8 --log DEBUG
FWROOT is /localhdd
run-tests : INFO Configuration: Namespace(client_host='10.0.2.17', client_identity_file='~/.ssh/id_rsa', client_user='hamiltont', conf_file='benchmark.cfg', database_host='10.0.2.18', database_identity_file='~/.ssh/id_rsa', database_os='linux', database_user='hamiltont', duration=15, exclude=None, install=None, install_error_action='continue', install_strategy='pertest', list_test_metadata=False, list_tests=False, log='DEBUG', max_concurrency=8, max_queries=20, max_threads=8, mode='benchmark', name='ec2', os='linux', parse=None, password_prompt=False, query_interval=5, server_host='10.0.2.3', sleep=5, starting_concurrency=8, test=['go'], type='json')
benchmarker : DEBUG latest_results_directory
benchmarker : INFO __gather_tests
benchmarker : INFO run
benchmarker : INFO __gather_tests
================================================================================
Preparing Server, Database, and Client ...
================================================================================
benchmarker : INFO __setup_server
benchmarker : INFO __setup_database
benchmarker : INFO __setup_client
================================================================================
Running Tests...
================================================================================
benchmarker : INFO __run_tests
benchmarker : DEBUG __run_tests with __name__ = benchmark.benchmarker
benchmarker : INFO Executing __run_tests on Linux
--------------------------------------------------------------------------------
Running Test: go
--------------------------------------------------------------------------------
benchmarker : INFO __run_test
benchmarker : DEBUG test.os.lower() = linux test.database_os.lower() = linux
benchmarker : DEBUG self.results['frameworks'] != None: True
benchmarker : DEBUG test.name: go
benchmarker : DEBUG self.results['completed']: {u'go': u'20140715174717'}
benchmarker : INFO
================================================================================
Beginning go
--------------------------------------------------------------------------------
benchmarker : INFO
--------------------------------------------------------------------------------
Starting go
--------------------------------------------------------------------------------
framework_test: INFO start
benchmarker : INFO Sleeping for 5
benchmarker : INFO
--------------------------------------------------------------------------------
VERIFYING JSON (/json)
--------------------------------------------------------------------------------
benchmarker : INFO VALIDATING JSON ...
benchmarker : INFO PASS
benchmarker : INFO
--------------------------------------------------------------------------------
Benchmarking go
--------------------------------------------------------------------------------
benchmarker : INFO BENCHMARKING JSON ...
benchmarker : DEBUG output_file
benchmarker : DEBUG get_output_file
framework_test: INFO __parse_test
benchmarker : DEBUG get_output_file
benchmarker : DEBUG output_file
benchmarker : DEBUG get_output_file
benchmarker : DEBUG report_results: go - json
benchmarker : DEBUG report_results: [{'latencyAvg': '410.11us', 'latencyStdev': '121.80us', 'latencyMax': '1.43ms', 'totalRequests': 287773}]
benchmarker : INFO Complete
benchmarker : INFO
--------------------------------------------------------------------------------
Stopping go
--------------------------------------------------------------------------------
framework_test: INFO stop
benchmarker : INFO
--------------------------------------------------------------------------------
Stopped go
--------------------------------------------------------------------------------
benchmarker : INFO
--------------------------------------------------------------------------------
Saving results through go
--------------------------------------------------------------------------------
benchmarker : DEBUG __write_intermediate_results: go reports 20140715175109
benchmarker : DEBUG Dumping to results/ec2/latest/results.json: {"name": "ec2", "succeeded": {"fortune": [], "plaintext": [], "db": [], "update": [], "json": ["go"], "query": []}, "frameworks": ["go"], "completed": {"go": "20140715175109"}, "failed": {"fortune": [], "plaintext": [], "db": [], "update": [], "json": [], "query": []}, "warning": {"fortune": [], "plaintext": [], "db": [], "update": [], "json": [], "query": []}, "rawData": {"fortune": {}, "plaintext": {}, "db": {}, "update": {}, "json": {"go": [{"latencyAvg": "410.11us", "latencyStdev": "121.80us", "latencyMax": "1.43ms", "totalRequests": 287773}]}, "query": {}}, "duration": 15, "queryIntervals": [1, 5, 10, 15, 20], "concurrencyLevels": [8]}
benchmarker : INFO End __run_tests
================================================================================
Parsing Results ...
================================================================================
benchmarker : INFO __parse_results
benchmarker : INFO __count_commits
benchmarker : INFO __gather_frameworks
benchmarker : INFO __count_sloc
benchmarker : INFO __gather_frameworks
benchmarker : DEBUG full_results_directory
benchmarker : DEBUG Writing results to results/ec2/20140715175005/results.json
benchmarker : DEBUG Results: {"name": "ec2", "succeeded": {"fortune": [], "plaintext": [], "db": [], "update": [], "json": ["go"], "query": []}, "frameworks": ["go"], "completed": {"go": "20140715174717"}, "failed": {"fortune": [], "plaintext": [], "db": [], "update": [], "json": [], "query": []}, "warning": {"fortune": [], "plaintext": [], "db": [], "update": [], "json": [], "query": []}, "rawData": {"fortune": {}, "plaintext": {}, "slocCounts": {}, "db": {}, "update": {}, "json": {"go": [{"latencyAvg": "376.38us", "latencyStdev": "137.75us", "latencyMax": "2.28ms", "totalRequests": 326385}]}, "commitCounts": {"wsgi": 34, "dropwizard": 27, "falcon": 18, "symfony2-stripped": 0, "cpoll_cppsp": 34, "sinatra": 36, "flask": 81, "treefrog": 21, "grizzly-jersey": 22, "kelp": 21, "fuel": 0, "weber": 0, "undertow-edge": 11, "beego": 24, "evhttp-sharp": 9, "express": 28, "dart": 39, "ninja": 10, "servlet": 32, "falcore": 17, "netty": 39, "luminus": 62, "onion": 45, "grizzly": 0, "pimf": 0, "hhvm": 19, "rack": 32, "senthot": 0, "spring": 41, "elli": 24, "go": 68, "curacao": 15, "hapi": 21, "ringojs": 36, "php-phalcon-micro": 24, "play-scala": 58, "php-kohana": 41, "uwsgi": 21, "urweb": 9, "jester": 17, "spray": 23, "wt": 5, "spark": 19, "silex-orm": 0, "laravel": 0, "undertow": 42, "wai": 14, "play1": 16, "cowboy": 30, "lapis": 22, "symfony2": 0, "plack": 30, "mojolicious": 30, "racket-ws": 11, "dancer": 28, "HttpListener": 15, "play-slick": 27, "ninja-standalone": 29, "scalatra": 16, "codeigniter": 0, "aspnet-stripped": 15, "restexpress": 23, "rails": 43, "wicket": 43, "start": 0, "revel": 48, "http-kit": 23, "jetty-servlet": 10, "play-activate-mysql": 21, "phreeze": 27, "micromvc": 0, "activeweb": 15, "silex": 0, "snap": 27, "revel-qbs": 22, "lift-stateless": 23, "play2": 0, "yaf": 0, "play-scala-mongodb": 28, "nawak": 8, "plain": 44, "openresty": 28, "cake": 30, "yii2": 0, "vertx": 27, "aspnet": 54, "pyramid": 13, "stream": 0, "nodejs": 37, "slim": 0, "gemini": 48, "tapestry": 19, "dropwizard-mongodb": 5, "ringojs-convenient": 27, "webgo": 25, "play1siena": 15, "ZendFramework": 0, "unfiltered": 21, "revel-jet": 23, "lithium": 0, "finagle": 30, "php-phalcon": 41, "play": 0, "web-simple": 24, "nancy": 34, "tornado": 66, "wildfly-ee7": 6, "servicestack": 57, "yesod": 46, "php": 40, "php-phpixie": 32, "rails-stripped": 29, "grails": 58, "django": 56, "bottle": 50, "silica": 0, "compojure": 35}, "query": {}}, "duration": 15, "queryIntervals": [1, 5, 10, 15, 20], "concurrencyLevels": [8]}
benchmarker : INFO __finish
Time to complete: 70 seconds
Results are saved in results/ec2/20140715175005
╰─$ toolset/run-tests.py --test go --sleep 5 --type json --max-threads 8 --max-concurrency 8
FWROOT is /localhdd
================================================================================
Preparing Server, Database, and Client ...
================================================================================
================================================================================
Running Tests...
================================================================================
--------------------------------------------------------------------------------
Running Test: go
--------------------------------------------------------------------------------
================================================================================
Beginning go
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Starting go
--------------------------------------------------------------------------------
Sleeping for 5
--------------------------------------------------------------------------------
VERIFYING JSON (/json)
--------------------------------------------------------------------------------
VALIDATING JSON ...
PASS
--------------------------------------------------------------------------------
Benchmarking go
--------------------------------------------------------------------------------
BENCHMARKING JSON ...
Complete
--------------------------------------------------------------------------------
Stopping go
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Stopped go
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Saving results through go
--------------------------------------------------------------------------------
================================================================================
Parsing Results ...
================================================================================
Time to complete: 70 seconds
Results are saved in results/ec2/20140715174613
╰─$ cat results/ec2/latest/logs/go/output.log
2014-07-15 17:50:06,567: benchmarker : DEBUG test.os.lower() = linux test.database_os.lower() = linux
2014-07-15 17:50:06,568: benchmarker : DEBUG self.results['frameworks'] != None: True
2014-07-15 17:50:06,568: benchmarker : DEBUG test.name: go
2014-07-15 17:50:06,568: benchmarker : DEBUG self.results['completed']: {u'go': u'20140715174717'}
2014-07-15 17:50:06,569: benchmarker : INFO
================================================================================
Beginning go
--------------------------------------------------------------------------------
2014-07-15 17:50:06,569: benchmarker : INFO
--------------------------------------------------------------------------------
Starting go
--------------------------------------------------------------------------------
2014-07-15 17:50:07,561: benchmarker : INFO Sleeping for 5
2014-07-15 17:50:12,567: benchmarker : INFO
--------------------------------------------------------------------------------
VERIFYING JSON (/json)
--------------------------------------------------------------------------------
2014-07-15 17:50:12,589: benchmarker : INFO VALIDATING JSON ...
2014-07-15 17:50:12,590: benchmarker : INFO PASS
2014-07-15 17:50:12,590: benchmarker : INFO
--------------------------------------------------------------------------------
Benchmarking go
--------------------------------------------------------------------------------
2014-07-15 17:50:12,590: benchmarker : INFO BENCHMARKING JSON ...
2014-07-15 17:50:12,590: benchmarker : DEBUG output_file
2014-07-15 17:50:12,590: benchmarker : DEBUG get_output_file
2014-07-15 17:50:59,887: benchmarker : DEBUG get_output_file
2014-07-15 17:50:59,887: benchmarker : DEBUG output_file
2014-07-15 17:50:59,887: benchmarker : DEBUG get_output_file
2014-07-15 17:50:59,889: benchmarker : DEBUG report_results: go - json
2014-07-15 17:50:59,889: benchmarker : DEBUG report_results: [{'latencyAvg': '410.11us', 'latencyStdev': '121.80us', 'latencyMax': '1.43ms', 'totalRequests': 287773}]
2014-07-15 17:50:59,889: benchmarker : INFO Complete
2014-07-15 17:50:59,889: benchmarker : INFO
--------------------------------------------------------------------------------
Stopping go
--------------------------------------------------------------------------------
2014-07-15 17:51:04,922: benchmarker : INFO
--------------------------------------------------------------------------------
Stopped go
--------------------------------------------------------------------------------
2014-07-15 17:51:09,927: benchmarker : INFO
--------------------------------------------------------------------------------
Saving results through go
--------------------------------------------------------------------------------
2014-07-15 17:51:09,927: benchmarker : DEBUG __write_intermediate_results: go reports 20140715175109
2014-07-15 17:51:09,928: benchmarker : DEBUG Dumping to results/ec2/latest/results.json: {"name": "ec2", "succeeded": {"fortune": [], "plaintext": [], "db": [], "update": [], "json": ["go"], "query": []}, "frameworks": ["go"], "completed": {"go": "20140715175109"}, "failed": {"fortune": [], "plaintext": [], "db": [], "update": [], "json": [], "query": []}, "warning": {"fortune": [], "plaintext": [], "db": [], "update": [], "json": [], "query": []}, "rawData": {"fortune": {}, "plaintext": {}, "db": {}, "update": {}, "json": {"go": [{"latencyAvg": "410.11us", "latencyStdev": "121.80us", "latencyMax": "1.43ms", "totalRequests": 287773}]}, "query": {}}, "duration": 15, "queryIntervals": [1, 5, 10, 15, 20], "concurrencyLevels": [8]}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment