Created
November 18, 2019 10:23
-
-
Save zloster/7d51fa9732b94db8210e4b428241aa29 to your computer and use it in GitHub Desktop.
FrameworkBenchmarks Toolset - Concurrency set to 128 Python error
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| vagrant@TFB-all:~$ tfb --mode verify --test dropwizard-postgres --concurrency-levels 128 | |
| Sending build context to Docker daemon 2.56kB | |
| Step 1/9 : FROM buildpack-deps:bionic | |
| ---> da7bebef4e62 | |
| Step 2/9 : RUN apt-get -yqq update | |
| ---> Using cache | |
| ---> 20cac748fdbc | |
| Step 3/9 : RUN apt-get -yqq install -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" git-core cloc dstat `# Collect resource usage statistics` python-dev python-pip software-properties-common libmysqlclient-dev `# Needed for MySQL-python` | |
| ---> Using cache | |
| ---> b1c704fea105 | |
| Step 4/9 : RUN pip install colorama==0.3.1 requests MySQL-python psycopg2-binary pymongo docker==4.0.2 psutil | |
| ---> Using cache | |
| ---> 22f285687e68 | |
| Step 5/9 : RUN apt-get install -yqq siege | |
| ---> Using cache | |
| ---> 573301629929 | |
| Step 6/9 : RUN cp -r /usr/local/lib/python2.7/dist-packages/backports/ssl_match_hostname/ /usr/lib/python2.7/dist-packages/backports | |
| ---> Using cache | |
| ---> 472713d4e315 | |
| Step 7/9 : ENV PYTHONPATH /FrameworkBenchmarks | |
| ---> Using cache | |
| ---> 899f73c62319 | |
| Step 8/9 : ENV FWROOT /FrameworkBenchmarks | |
| ---> Using cache | |
| ---> 2c2f392d69ec | |
| Step 9/9 : ENTRYPOINT ["python", "/FrameworkBenchmarks/toolset/run-tests.py"] | |
| ---> Using cache | |
| ---> af4384cb337d | |
| Successfully built af4384cb337d | |
| Successfully tagged techempower/tfb:latest | |
| ================================================================================ | |
| Running Tests... | |
| ================================================================================ | |
| wrk: Step 1/19 : FROM buildpack-deps:bionic | |
| wrk: ---> da7bebef4e62 | |
| wrk: Step 2/19 : WORKDIR /wrk | |
| wrk: ---> Using cache | |
| wrk: ---> 600779a0cadc | |
| wrk: Step 3/19 : RUN curl -sL https://github.com/wg/wrk/archive/4.1.0.tar.gz | tar xz --strip-components=1 | |
| wrk: ---> Using cache | |
| wrk: ---> 7b2352df087e | |
| wrk: Step 4/19 : RUN make > /dev/null | |
| wrk: ---> Using cache | |
| wrk: ---> 59e72081f1a9 | |
| wrk: Step 5/19 : RUN cp wrk /usr/local/bin | |
| wrk: ---> Using cache | |
| wrk: ---> 70a234244749 | |
| wrk: Step 6/19 : WORKDIR / | |
| wrk: ---> Using cache | |
| wrk: ---> 7ebb0c044efc | |
| wrk: Step 7/19 : COPY pipeline.lua pipeline.lua | |
| wrk: ---> Using cache | |
| wrk: ---> dfae6901b9f2 | |
| wrk: Step 8/19 : COPY concurrency.sh concurrency.sh | |
| wrk: ---> Using cache | |
| wrk: ---> 4afecfcb174f | |
| wrk: Step 9/19 : COPY pipeline.sh pipeline.sh | |
| wrk: ---> Using cache | |
| wrk: ---> 3fea67de80f6 | |
| wrk: Step 10/19 : COPY query.sh query.sh | |
| wrk: ---> Using cache | |
| wrk: ---> 6aff5ef5ac2f | |
| wrk: Step 11/19 : RUN chmod 777 pipeline.lua concurrency.sh pipeline.sh query.sh | |
| wrk: ---> Using cache | |
| wrk: ---> 3d813fa63898 | |
| wrk: Step 12/19 : ENV name name | |
| wrk: ---> Using cache | |
| wrk: ---> ca8ca194ade9 | |
| wrk: Step 13/19 : ENV server_host server_host | |
| wrk: ---> Using cache | |
| wrk: ---> 99ea9116c321 | |
| wrk: Step 14/19 : ENV levels levels | |
| wrk: ---> Using cache | |
| wrk: ---> a3cee2489fca | |
| wrk: Step 15/19 : ENV duration duration | |
| wrk: ---> Using cache | |
| wrk: ---> 365ad531132a | |
| wrk: Step 16/19 : ENV max_concurrency max_concurrency | |
| wrk: ---> Using cache | |
| wrk: ---> 08fc3b8c976e | |
| wrk: Step 17/19 : ENV max_threads max_threads | |
| wrk: ---> Using cache | |
| wrk: ---> 30789f345343 | |
| wrk: Step 18/19 : ENV pipeline pipeline | |
| wrk: ---> Using cache | |
| wrk: ---> 8a75f853f6aa | |
| wrk: Step 19/19 : ENV accept accept | |
| wrk: ---> Using cache | |
| wrk: ---> 1fdd6a598026 | |
| wrk: Successfully built 1fdd6a598026 | |
| wrk: Successfully tagged techempower/tfb.wrk:latest | |
| wrk: Build time: 3s | |
| techempower/postgres:latest: Step 1/35 : FROM buildpack-deps:bionic | |
| techempower/postgres:latest: ---> da7bebef4e62 | |
| techempower/postgres:latest: Step 2/35 : ADD postgresql.conf postgresql.conf | |
| techempower/postgres:latest: ---> Using cache | |
| techempower/postgres:latest: ---> afda08ed62e0 | |
| techempower/postgres:latest: Step 3/35 : ADD pg_hba.conf pg_hba.conf | |
| techempower/postgres:latest: ---> Using cache | |
| techempower/postgres:latest: ---> 7cbe1432dcc5 | |
| techempower/postgres:latest: Step 4/35 : ADD 60-postgresql-shm.conf 60-postgresql-shm.conf | |
| techempower/postgres:latest: ---> Using cache | |
| techempower/postgres:latest: ---> 69a4c7b367c9 | |
| techempower/postgres:latest: Step 5/35 : ADD create-postgres-database.sql create-postgres-database.sql | |
| techempower/postgres:latest: ---> Using cache | |
| techempower/postgres:latest: ---> 64ea4fb8d1bc | |
| techempower/postgres:latest: Step 6/35 : ADD create-postgres.sql create-postgres.sql | |
| techempower/postgres:latest: ---> Using cache | |
| techempower/postgres:latest: ---> eafa109e40f2 | |
| techempower/postgres:latest: Step 7/35 : ADD pgdg.list pgdg.list | |
| techempower/postgres:latest: ---> Using cache | |
| techempower/postgres:latest: ---> d03fe3d2dc27 | |
| techempower/postgres:latest: Step 8/35 : RUN cp pgdg.list /etc/apt/sources.list.d/ | |
| techempower/postgres:latest: ---> Using cache | |
| techempower/postgres:latest: ---> 0e6acead8841 | |
| techempower/postgres:latest: Step 9/35 : RUN wget --quiet -O - https://www.postgresql.org/media/keys/ACCC4CF8.asc | apt-key add - | |
| techempower/postgres:latest: ---> Using cache | |
| techempower/postgres:latest: ---> d6998f33f65c | |
| techempower/postgres:latest: Step 10/35 : RUN apt-get -yqq update > /dev/null | |
| techempower/postgres:latest: ---> Using cache | |
| techempower/postgres:latest: ---> 4da0c07556fb | |
| techempower/postgres:latest: Step 11/35 : RUN apt-get -yqq install locales | |
| techempower/postgres:latest: ---> Using cache | |
| techempower/postgres:latest: ---> bab63138050c | |
| techempower/postgres:latest: Step 12/35 : ENV PG_VERSION 12 | |
| techempower/postgres:latest: ---> Using cache | |
| techempower/postgres:latest: ---> 404b93331979 | |
| techempower/postgres:latest: Step 13/35 : RUN locale-gen en_US.UTF-8 | |
| techempower/postgres:latest: ---> Using cache | |
| techempower/postgres:latest: ---> 82207febbae3 | |
| techempower/postgres:latest: Step 14/35 : ENV LANG en_US.UTF-8 | |
| techempower/postgres:latest: ---> Using cache | |
| techempower/postgres:latest: ---> bfe1eefba506 | |
| techempower/postgres:latest: Step 15/35 : ENV LANGUAGE en_US:en | |
| techempower/postgres:latest: ---> Using cache | |
| techempower/postgres:latest: ---> aa13007c5419 | |
| techempower/postgres:latest: Step 16/35 : ENV LC_ALL en_US.UTF-8 | |
| techempower/postgres:latest: ---> Using cache | |
| techempower/postgres:latest: ---> f04db279c773 | |
| techempower/postgres:latest: Step 17/35 : ENV DEBIAN_FRONTEND noninteractive | |
| techempower/postgres:latest: ---> Using cache | |
| techempower/postgres:latest: ---> e9eb8d9973b1 | |
| techempower/postgres:latest: Step 18/35 : RUN apt-get -yqq install -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" postgresql postgresql-contrib | |
| techempower/postgres:latest: ---> Using cache | |
| techempower/postgres:latest: ---> 331010d2d8e1 | |
| techempower/postgres:latest: Step 19/35 : RUN mv postgresql.conf /etc/postgresql/${PG_VERSION}/main/postgresql.conf | |
| techempower/postgres:latest: ---> Using cache | |
| techempower/postgres:latest: ---> d4fbcc0e8f81 | |
| techempower/postgres:latest: Step 20/35 : RUN mv pg_hba.conf /etc/postgresql/${PG_VERSION}/main/pg_hba.conf | |
| techempower/postgres:latest: ---> Using cache | |
| techempower/postgres:latest: ---> 6f79e80458e2 | |
| techempower/postgres:latest: Step 21/35 : RUN chown -Rf postgres:postgres /etc/postgresql/${PG_VERSION}/main | |
| techempower/postgres:latest: ---> Using cache | |
| techempower/postgres:latest: ---> d1dcd7012de5 | |
| techempower/postgres:latest: Step 22/35 : RUN mkdir /ssd | |
| techempower/postgres:latest: ---> Using cache | |
| techempower/postgres:latest: ---> 677c58019362 | |
| techempower/postgres:latest: Step 23/35 : RUN cp -R -p /var/lib/postgresql/${PG_VERSION}/main /ssd/postgresql | |
| techempower/postgres:latest: ---> Using cache | |
| techempower/postgres:latest: ---> a6692472ff0e | |
| techempower/postgres:latest: Step 24/35 : RUN cp /etc/postgresql/${PG_VERSION}/main/postgresql.conf /ssd/postgresql | |
| techempower/postgres:latest: ---> Using cache | |
| techempower/postgres:latest: ---> 51421e866637 | |
| techempower/postgres:latest: Step 25/35 : RUN mv 60-postgresql-shm.conf /etc/sysctl.d/60-postgresql-shm.conf | |
| techempower/postgres:latest: ---> Using cache | |
| techempower/postgres:latest: ---> 402e02d714f4 | |
| techempower/postgres:latest: Step 26/35 : RUN chown -Rf postgres:postgres /var/run/postgresql | |
| techempower/postgres:latest: ---> Using cache | |
| techempower/postgres:latest: ---> 53ef16d5b9f3 | |
| techempower/postgres:latest: Step 27/35 : RUN chmod 2777 /var/run/postgresql | |
| techempower/postgres:latest: ---> Using cache | |
| techempower/postgres:latest: ---> bbcc2ecea618 | |
| techempower/postgres:latest: Step 28/35 : RUN chown postgres:postgres /etc/sysctl.d/60-postgresql-shm.conf | |
| techempower/postgres:latest: ---> Using cache | |
| techempower/postgres:latest: ---> 00462db6b9aa | |
| techempower/postgres:latest: Step 29/35 : RUN chown postgres:postgres create-postgres* | |
| techempower/postgres:latest: ---> Using cache | |
| techempower/postgres:latest: ---> 81a2723d33d0 | |
| techempower/postgres:latest: Step 30/35 : RUN chown -Rf postgres:postgres /ssd | |
| techempower/postgres:latest: ---> Using cache | |
| techempower/postgres:latest: ---> efe545e9c25d | |
| techempower/postgres:latest: Step 31/35 : ENV PGDATA=/ssd/postgresql | |
| techempower/postgres:latest: ---> Using cache | |
| techempower/postgres:latest: ---> 382866fa512b | |
| techempower/postgres:latest: Step 32/35 : USER postgres | |
| techempower/postgres:latest: ---> Using cache | |
| techempower/postgres:latest: ---> ac33f78b555c | |
| techempower/postgres:latest: Step 33/35 : RUN service postgresql start && until psql -c "\q"; do sleep 1; done && psql < create-postgres-database.sql && psql -a hello_world < create-postgres.sql && service postgresql stop | |
| techempower/postgres:latest: ---> Using cache | |
| techempower/postgres:latest: ---> 213e17557c34 | |
| techempower/postgres:latest: Step 34/35 : ENV PATH $PATH:/usr/lib/postgresql/$PG_VERSION/bin | |
| techempower/postgres:latest: ---> Using cache | |
| techempower/postgres:latest: ---> c76aef3f4547 | |
| techempower/postgres:latest: Step 35/35 : CMD ["postgres"] | |
| techempower/postgres:latest: ---> Using cache | |
| techempower/postgres:latest: ---> df1c1cfe3997 | |
| techempower/postgres:latest: Successfully built df1c1cfe3997 | |
| techempower/postgres:latest: Successfully tagged techempower/postgres:latest | |
| techempower/postgres:latest: Build time: 3s | |
| -------------------------------------------------------------------------------- | |
| Running Test: dropwizard-postgres | |
| -------------------------------------------------------------------------------- | |
| dropwizard-postgres: Step 1/10 : FROM maven:3.6.1-jdk-11-slim as maven | |
| dropwizard-postgres: ---> b67032e30f89 | |
| dropwizard-postgres: Step 2/10 : WORKDIR /dropwizard | |
| dropwizard-postgres: ---> Using cache | |
| dropwizard-postgres: ---> 4143ee52d037 | |
| dropwizard-postgres: Step 3/10 : COPY pom.xml pom.xml | |
| dropwizard-postgres: ---> Using cache | |
| dropwizard-postgres: ---> 6611d67a52fc | |
| dropwizard-postgres: Step 4/10 : COPY src src | |
| dropwizard-postgres: ---> Using cache | |
| dropwizard-postgres: ---> 65aab27c0f4a | |
| dropwizard-postgres: Step 5/10 : RUN mvn package -q -P postgres | |
| dropwizard-postgres: ---> Using cache | |
| dropwizard-postgres: ---> 3c9ab6f8b7c3 | |
| dropwizard-postgres: Step 6/10 : FROM openjdk:11.0.3-jdk-slim | |
| dropwizard-postgres: ---> a22f1f595f31 | |
| dropwizard-postgres: Step 7/10 : WORKDIR /dropwizard | |
| dropwizard-postgres: ---> Using cache | |
| dropwizard-postgres: ---> f5b3f752d29c | |
| dropwizard-postgres: Step 8/10 : COPY --from=maven /dropwizard/target/hello-world-0.0.1-SNAPSHOT.jar app.jar | |
| dropwizard-postgres: ---> Using cache | |
| dropwizard-postgres: ---> 04d6fbe5fb55 | |
| dropwizard-postgres: Step 9/10 : COPY hello-world-postgres.yml hello-world-postgres.yml | |
| dropwizard-postgres: ---> Using cache | |
| dropwizard-postgres: ---> c341460b3fd2 | |
| dropwizard-postgres: Step 10/10 : CMD ["java", "-jar", "app.jar", "server", "hello-world-postgres.yml"] | |
| dropwizard-postgres: ---> Using cache | |
| dropwizard-postgres: ---> 52f46c4bd510 | |
| dropwizard-postgres: [Warning] One or more build-args [BENCHMARK_ENV TFB_TEST_DATABASE TFB_TEST_NAME] were not consumed | |
| dropwizard-postgres: Successfully built 52f46c4bd510 | |
| dropwizard-postgres: Successfully tagged techempower/tfb.test.dropwizard-postgres:latest | |
| dropwizard-postgres: Build time: 10s | |
| dropwizard-postgres: WARNING: An illegal reflective access operation has occurred | |
| dropwizard-postgres: WARNING: Illegal reflective access by com.fasterxml.jackson.module.afterburner.util.MyClassLoader (file:/dropwizard/app.jar) to method java.lang.ClassLoader.findLoadedClass(java.lang.String) | |
| dropwizard-postgres: WARNING: Please consider reporting this to the maintainers of com.fasterxml.jackson.module.afterburner.util.MyClassLoader | |
| dropwizard-postgres: WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations | |
| dropwizard-postgres: WARNING: All illegal access operations will be denied in a future release | |
| dropwizard-postgres: Verifying framework URLs | |
| -------------------------------------------------------------------------------- | |
| VERIFYING DB | |
| -------------------------------------------------------------------------------- | |
| Accessing URL http://tfb-server:9090/db: | |
| Accessing URL http://tfb-server:9090/db: | |
| -------------------------------------------------------------------------------- | |
| VERIFYING QUERY COUNT FOR http://tfb-server:9090/db | |
| -------------------------------------------------------------------------------- | |
| New configuration template added to /root/.siege | |
| Run siege -C to view the current settings in that file | |
| ** SIEGE 4.0.4 | |
| ** Preparing 128 concurrent users for battle. | |
| The server is now under siege... | |
| Transactions: 128 hits | |
| Availability: 100.00 % | |
| Elapsed time: 3.10 secs | |
| Data transferred: 0.00 MB | |
| Response time: 1.83 secs | |
| Transaction rate: 41.29 trans/sec | |
| Throughput: 0.00 MB/sec | |
| Concurrency: 75.49 | |
| Successful transactions: 128 | |
| Failed transactions: 0 | |
| Longest transaction: 2.99 | |
| Shortest transaction: 0.61 | |
| Verifying test db for dropwizard-postgres caused an exception: can't multiply sequence by non-int of type 'float' | |
| FAIL for http://tfb-server:9090 | |
| Caused Exception in TFB | |
| This almost certainly means your return value is incorrect, | |
| but also that you have found a bug. Please submit an issue | |
| including this message: can't multiply sequence by non-int of type 'float' | |
| Traceback (most recent call last): | |
| File "/FrameworkBenchmarks/toolset/benchmark/framework_test.py", line 113, in verify_type | |
| results = test.verify(base_url) | |
| File "/FrameworkBenchmarks/toolset/benchmark/test_types/db_type.py", line 61, in verify | |
| problems += verify_queries_count(self, "World", url, concurrency, repetitions, expected_queries, expected_queries) | |
| File "/FrameworkBenchmarks/toolset/benchmark/test_types/verifications.py", line 433, in verify_queries_count | |
| problems.append(display_queries_count_result(queries * queries_margin, expected_queries, queries, "executed queries", url)) | |
| File "/FrameworkBenchmarks/toolset/benchmark/test_types/verifications.py", line 451, in display_queries_count_result | |
| if result > expected_result * 1.05: | |
| TypeError: can't multiply sequence by non-int of type 'float' | |
| See https://github.com/TechEmpower/FrameworkBenchmarks/wiki/Project-Information-Framework-Tests-Overview#specific-test-requirements | |
| {'Date': 'Mon, 18 Nov 2019 09:55:51 GMT', 'Content-Length': '31', 'Content-Type': 'application/json', 'Server': 'Jetty(9.4.z-SNAPSHOT)'} | |
| {"id":2065,"randomNumber":8706} | |
| -------------------------------------------------------------------------------- | |
| VERIFYING QUERY | |
| -------------------------------------------------------------------------------- | |
| Accessing URL http://tfb-server:9090/db/query?queries=2: | |
| Accessing URL http://tfb-server:9090/db/query?queries=2: | |
| Accessing URL http://tfb-server:9090/db/query?queries=0: | |
| Accessing URL http://tfb-server:9090/db/query?queries=0: | |
| Accessing URL http://tfb-server:9090/db/query?queries=foo: | |
| Accessing URL http://tfb-server:9090/db/query?queries=foo: | |
| Accessing URL http://tfb-server:9090/db/query?queries=501: | |
| Accessing URL http://tfb-server:9090/db/query?queries=501: | |
| Accessing URL http://tfb-server:9090/db/query?queries=: | |
| Accessing URL http://tfb-server:9090/db/query?queries=: | |
| -------------------------------------------------------------------------------- | |
| VERIFYING QUERY COUNT FOR http://tfb-server:9090/db/query?queries=20 | |
| -------------------------------------------------------------------------------- | |
| ** SIEGE 4.0.4 | |
| ** Preparing 128 concurrent users for battle. | |
| The server is now under siege... | |
| Transactions: 128 hits | |
| Availability: 100.00 % | |
| Elapsed time: 8.11 secs | |
| Data transferred: 0.08 MB | |
| Response time: 6.71 secs | |
| Transaction rate: 15.78 trans/sec | |
| Throughput: 0.01 MB/sec | |
| Concurrency: 105.89 | |
| Successful transactions: 128 | |
| Failed transactions: 0 | |
| Longest transaction: 7.83 | |
| Shortest transaction: 2.42 | |
| Verifying test query for dropwizard-postgres caused an exception: can't multiply sequence by non-int of type 'float' | |
| FAIL for http://tfb-server:9090 | |
| Caused Exception in TFB | |
| This almost certainly means your return value is incorrect, | |
| but also that you have found a bug. Please submit an issue | |
| including this message: can't multiply sequence by non-int of type 'float' | |
| Traceback (most recent call last): | |
| File "/FrameworkBenchmarks/toolset/benchmark/framework_test.py", line 113, in verify_type | |
| results = test.verify(base_url) | |
| File "/FrameworkBenchmarks/toolset/benchmark/test_types/query_type.py", line 32, in verify | |
| problems = verify_query_cases(self, cases, url, False) | |
| File "/FrameworkBenchmarks/toolset/benchmark/test_types/verifications.py", line 399, in verify_query_cases | |
| problems += verify_queries_count(self, "world", url+"20", concurrency, repetitions, expected_queries, expected_rows, check_updates) | |
| File "/FrameworkBenchmarks/toolset/benchmark/test_types/verifications.py", line 433, in verify_queries_count | |
| problems.append(display_queries_count_result(queries * queries_margin, expected_queries, queries, "executed queries", url)) | |
| File "/FrameworkBenchmarks/toolset/benchmark/test_types/verifications.py", line 451, in display_queries_count_result | |
| if result > expected_result * 1.05: | |
| TypeError: can't multiply sequence by non-int of type 'float' | |
| See https://github.com/TechEmpower/FrameworkBenchmarks/wiki/Project-Information-Framework-Tests-Overview#specific-test-requirements | |
| {'Date': 'Mon, 18 Nov 2019 09:56:14 GMT', 'Content-Length': '33', 'Content-Type': 'application/json', 'Server': 'Jetty(9.4.z-SNAPSHOT)'} | |
| [{"id":4724,"randomNumber":1011}] | |
| -------------------------------------------------------------------------------- | |
| VERIFYING UPDATE | |
| -------------------------------------------------------------------------------- | |
| Accessing URL http://tfb-server:9090/db/update?queries=2: | |
| Accessing URL http://tfb-server:9090/db/update?queries=2: | |
| Accessing URL http://tfb-server:9090/db/update?queries=0: | |
| Accessing URL http://tfb-server:9090/db/update?queries=0: | |
| Accessing URL http://tfb-server:9090/db/update?queries=foo: | |
| Accessing URL http://tfb-server:9090/db/update?queries=foo: | |
| Accessing URL http://tfb-server:9090/db/update?queries=501: | |
| Accessing URL http://tfb-server:9090/db/update?queries=501: | |
| Accessing URL http://tfb-server:9090/db/update?queries=: | |
| Accessing URL http://tfb-server:9090/db/update?queries=: | |
| -------------------------------------------------------------------------------- | |
| VERIFYING QUERY COUNT FOR http://tfb-server:9090/db/update?queries=20 | |
| -------------------------------------------------------------------------------- | |
| ** SIEGE 4.0.4 | |
| ** Preparing 128 concurrent users for battle. | |
| The server is now under siege... | |
| Transactions: 128 hits | |
| Availability: 100.00 % | |
| Elapsed time: 5.78 secs | |
| Data transferred: 0.08 MB | |
| Response time: 4.40 secs | |
| Transaction rate: 22.15 trans/sec | |
| Throughput: 0.01 MB/sec | |
| Concurrency: 97.36 | |
| Successful transactions: 128 | |
| Failed transactions: 0 | |
| Longest transaction: 5.71 | |
| Shortest transaction: 1.05 | |
| Verifying test update for dropwizard-postgres caused an exception: can't multiply sequence by non-int of type 'float' | |
| FAIL for http://tfb-server:9090 | |
| Caused Exception in TFB | |
| This almost certainly means your return value is incorrect, | |
| but also that you have found a bug. Please submit an issue | |
| including this message: can't multiply sequence by non-int of type 'float' | |
| Traceback (most recent call last): | |
| File "/FrameworkBenchmarks/toolset/benchmark/framework_test.py", line 113, in verify_type | |
| results = test.verify(base_url) | |
| File "/FrameworkBenchmarks/toolset/benchmark/test_types/update_type.py", line 31, in verify | |
| problems = verify_query_cases(self, cases, url, True) | |
| File "/FrameworkBenchmarks/toolset/benchmark/test_types/verifications.py", line 399, in verify_query_cases | |
| problems += verify_queries_count(self, "world", url+"20", concurrency, repetitions, expected_queries, expected_rows, check_updates) | |
| File "/FrameworkBenchmarks/toolset/benchmark/test_types/verifications.py", line 417, in verify_queries_count | |
| isBulk = check_updates and (queries < 1.001 * expected_queries) and (queries > 0.999 * expected_queries) | |
| TypeError: can't multiply sequence by non-int of type 'float' | |
| See https://github.com/TechEmpower/FrameworkBenchmarks/wiki/Project-Information-Framework-Tests-Overview#specific-test-requirements | |
| {'Date': 'Mon, 18 Nov 2019 09:56:44 GMT', 'Content-Length': '33', 'Content-Type': 'application/json', 'Server': 'Jetty(9.4.z-SNAPSHOT)'} | |
| [{"id":4132,"randomNumber":5170}] | |
| -------------------------------------------------------------------------------- | |
| VERIFYING FORTUNE | |
| -------------------------------------------------------------------------------- | |
| Accessing URL http://tfb-server:9090/fortunes: | |
| Accessing URL http://tfb-server:9090/fortunes: | |
| -------------------------------------------------------------------------------- | |
| VERIFYING QUERY COUNT FOR http://tfb-server:9090/fortunes | |
| -------------------------------------------------------------------------------- | |
| ** SIEGE 4.0.4 | |
| ** Preparing 128 concurrent users for battle. | |
| The server is now under siege... | |
| Transactions: 128 hits | |
| Availability: 100.00 % | |
| Elapsed time: 2.45 secs | |
| Data transferred: 0.18 MB | |
| Response time: 1.50 secs | |
| Transaction rate: 52.24 trans/sec | |
| Throughput: 0.08 MB/sec | |
| Concurrency: 78.12 | |
| Successful transactions: 128 | |
| Failed transactions: 0 | |
| Longest transaction: 2.35 | |
| Shortest transaction: 0.45 | |
| Verifying test fortune for dropwizard-postgres caused an exception: can't multiply sequence by non-int of type 'float' | |
| FAIL for http://tfb-server:9090 | |
| Caused Exception in TFB | |
| This almost certainly means your return value is incorrect, | |
| but also that you have found a bug. Please submit an issue | |
| including this message: can't multiply sequence by non-int of type 'float' | |
| Traceback (most recent call last): | |
| File "/FrameworkBenchmarks/toolset/benchmark/framework_test.py", line 113, in verify_type | |
| results = test.verify(base_url) | |
| File "/FrameworkBenchmarks/toolset/benchmark/test_types/fortune_type.py", line 47, in verify | |
| problems += verify_queries_count(self, "fortune", url, concurrency, repetitions, expected_queries, expected_rows) | |
| File "/FrameworkBenchmarks/toolset/benchmark/test_types/verifications.py", line 433, in verify_queries_count | |
| problems.append(display_queries_count_result(queries * queries_margin, expected_queries, queries, "executed queries", url)) | |
| File "/FrameworkBenchmarks/toolset/benchmark/test_types/verifications.py", line 451, in display_queries_count_result | |
| if result > expected_result * 1.05: | |
| TypeError: can't multiply sequence by non-int of type 'float' | |
| See https://github.com/TechEmpower/FrameworkBenchmarks/wiki/Project-Information-Framework-Tests-Overview#specific-test-requirements | |
| {'Date': 'Mon, 18 Nov 2019 09:56:54 GMT', 'Content-Length': '1509', 'Content-Type': 'text/html;charset=utf-8', 'Server': 'Jetty(9.4.z-SNAPSHOT)'} | |
| <!DOCTYPE html> | |
| <html> | |
| <head> | |
| <title>Fortunes</title> | |
| </head> | |
| <body> | |
| <table> | |
| <tr><th>id</th><th>message</th></tr> | |
| <tr><td>11</td><td><script>alert("This should not be displayed in a browser alert box.");</script></td></tr> | |
| <tr><td>4</td><td>A bad random number generator: 1, 1, 1, 1, 1, 4.33e+67, 1, 1, 1</td></tr> | |
| <tr><td>5</td><td>A computer program does what you tell it to do, not what you want it to do.</td></tr> | |
| <tr><td>2</td><td>A computer scientist is someone who fixes things that aren't broken.</td></tr> | |
| <tr><td>8</td><td>A list is only as strong as its weakest link. — Donald Knuth</td></tr> | |
| <tr><td>0</td><td>Additional fortune added at request time.</td></tr> | |
| <tr><td>3</td><td>After enough decimal places, nobody gives a damn.</td></tr> | |
| <tr><td>7</td><td>Any program that runs right is obsolete.</td></tr> | |
| <tr><td>10</td><td>Computers make very fast, very accurate mistakes.</td></tr> | |
| <tr><td>6</td><td>Emacs is a nice operating system, but I prefer UNIX. — Tom Christaensen</td></tr> | |
| <tr><td>9</td><td>Feature: A bug with seniority.</td></tr> | |
| <tr><td>1</td><td>fortune: No such file or directory</td></tr> | |
| <tr><td>12</td><td>フレームワークのベンチマーク</td></tr> | |
| </table> | |
| </body> | |
| </html> | |
| Auditing /FrameworkBenchmarks/frameworks/Java/dropwizard: | |
| No problems to report | |
| wrk: Build time: 3s | |
| techempower/postgres:latest: Build time: 3s | |
| dropwizard-postgres: Build time: 10s | |
| dropwizard-postgres: Time starting database: 13s | |
| dropwizard-postgres: Time until accepting requests: 40s | |
| dropwizard-postgres: Verify time: 1m 10s | |
| dropwizard-postgres: Failed verify! | |
| dropwizard-postgres: Total test time: 2m 18s | |
| tfb: Total time building so far: 16s | |
| tfb: Total time verifying so far: 1m 10s | |
| tfb: Total execution time so far: 2m 28s | |
| ================================================================================ | |
| Verification Summary | |
| -------------------------------------------------------------------------------- | |
| | dropwizard-postgres | |
| | query : FAIL | |
| | db : FAIL | |
| | update : FAIL | |
| | fortune : FAIL | |
| ================================================================================ | |
| Results are saved in /FrameworkBenchmarks/results/20191118095429 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment