Skip to content

Instantly share code, notes, and snippets.

Show Gist options
  • Save Bouncner/2d134821662626047cb8d629660e504c to your computer and use it in GitHub Desktop.
Save Bouncner/2d134821662626047cb8d629660e504c to your computer and use it in GitHub Desktop.
Loading binary to new encoding
Martin.Boissier@nemea:~/hyrise_master$ ./rel/hyriseBenchmarkJoinOrder -q 1 -r 1
- Writing benchmark results to stdout
- MVCC is disabled
- Running in single-threaded mode
- 1 simulated clients are scheduling queries in parallel
- Running benchmark in 'IndividualQueries' mode
- Visualization is off
- Encoding is 'Dictionary'
- Chunk size is 100000
- Max runs per query is 1
- Max duration per query is 60 seconds
- No warmup runs are performed
- Not caching tables as binary files
- JIT is disabled
- Retrieving the IMDB dataset.
- IMDB setup already complete, no setup action required
- Benchmarking queries from third_party/join-order-benchmark
- Running on tables from imdb_data
- Running subset of queries: 1
- Loading/Generating tables
- Loading table 'movie_companies' from "imdb_data/movie_companies.bin" (4958296 rows; 121 ms 477 µs)
- Loading table 'info_type' from "imdb_data/info_type.bin" (113 rows; 72 µs 888 ns)
- Loading table 'cast_info' from "imdb_data/cast_info.bin" (63475835 rows; 1 s 543 ms)
- Loading table 'company_name' from "imdb_data/company_name.bin" (362131 rows; 53 ms 368 µs)
- Loading table 'keyword' from "imdb_data/keyword.bin" (236627 rows; 15 ms 296 µs)
- Loading table 'movie_link' from "imdb_data/movie_link.bin" (2585150 rows; 42 ms 184 µs)
- Loading table 'movie_info' from "imdb_data/movie_info.bin" (29774984 rows; 1 s 917 ms)
- Loading table 'title' from "imdb_data/title.bin" (4736508 rows; 636 ms 413 µs)
- Loading table 'link_type' from "imdb_data/link_type.bin" (18 rows; 42 µs 350 ns)
- Loading table 'person_info' from "imdb_data/person_info.bin" (4130207 rows; 687 ms 621 µs)
- Loading table 'movie_keyword' from "imdb_data/movie_keyword.bin" (7480087 rows; 113 ms 205 µs)
- Loading table 'aka_title' from "imdb_data/aka_title.bin" (528337 rows; 75 ms 983 µs)
- Loading table 'company_type' from "imdb_data/company_type.bin" (4 rows; 36 µs 850 ns)
- Loading table 'comp_cast_type' from "imdb_data/comp_cast_type.bin" (4 rows; 13 µs 652 ns)
- Loading table 'aka_name' from "imdb_data/aka_name.bin" (1312273 rows; 182 ms 980 µs)
- Loading table 'complete_cast' from "imdb_data/complete_cast.bin" (135086 rows; 1 ms 998 µs)
- Loading table 'movie_info_idx' from "imdb_data/movie_info_idx.bin" (1380035 rows; 32 ms 984 µs)
- Loading table 'name' from "imdb_data/name.bin" (6379740 rows; 860 ms 862 µs)
- Loading table 'role_type' from "imdb_data/role_type.bin" (12 rows; 46 µs 802 ns)
- Loading table 'kind_type' from "imdb_data/kind_type.bin" (9 rows; 28 µs 355 ns)
- Loading table 'char_name' from "imdb_data/char_name.bin" (4314863 rows; 596 ms 718 µs)
- Loading/Generating tables done (6 s 881 ms)
- Encoding tables if necessary
- Encoding 'movie_companies' - no encoding necessary (1 ms 967 µs)
- Encoding 'info_type' - no encoding necessary (330 µs 739 ns)
- Encoding 'cast_info' - no encoding necessary (7 ms 404 µs)
- Encoding 'company_name' - no encoding necessary (178 µs 120 ns)
- Encoding 'keyword' - no encoding necessary (84 µs 58 ns)
- Encoding 'movie_link' - no encoding necessary (667 µs 28 ns)
- Encoding 'movie_info' - no encoding necessary (6 ms 675 µs)
- Encoding 'title' - no encoding necessary (1 ms 331 µs)
- Encoding 'link_type' - no encoding necessary (47 µs 891 ns)
- Encoding 'person_info' - no encoding necessary (1 ms 118 µs)
- Encoding 'movie_keyword' - no encoding necessary (2 ms 200 µs)
- Encoding 'aka_title' - no encoding necessary (218 µs 391 ns)
- Encoding 'company_type' - no encoding necessary (47 µs 163 ns)
- Encoding 'comp_cast_type' - no encoding necessary (40 µs 22 ns)
- Encoding 'aka_name' - no encoding necessary (396 µs 254 ns)
- Encoding 'complete_cast' - no encoding necessary (58 µs 303 ns)
- Encoding 'movie_info_idx' - no encoding necessary (407 µs 103 ns)
- Encoding 'name' - no encoding necessary (1 ms 752 µs)
- Encoding 'role_type' - no encoding necessary (46 µs 25 ns)
- Encoding 'kind_type' - no encoding necessary (46 µs 695 ns)
- Encoding 'char_name' - no encoding necessary (1 ms 272 µs)
- Encoding tables done (26 ms 506 µs)
- Adding tables to StorageManager and generating statistics
- Adding 'movie_companies' (798 ms 149 µs)
- Adding 'info_type' (50 µs 501 ns)
- Adding 'cast_info' (12 s 134 ms)
- Adding 'company_name' (420 ms 230 µs)
- Adding 'keyword' (109 ms 566 µs)
- Adding 'movie_link' (235 ms 920 µs)
- Adding 'movie_info' (10 s 807 ms)
- Adding 'title' (5 s 849 ms)
- Adding 'link_type' (30 µs 802 ns)
- Adding 'person_info' (3 s 640 ms)
- Adding 'movie_keyword' (603 ms 308 µs)
- Adding 'aka_title' (631 ms 750 µs)
- Adding 'company_type' (22 µs 226 ns)
- Adding 'comp_cast_type' (4 µs 634 ns)
- Adding 'aka_name' (1 s 639 ms)
- Adding 'complete_cast' (14 ms 687 µs)
- Adding 'movie_info_idx' (240 ms 897 µs)
- Adding 'name' (9 s 194 ms)
- Adding 'role_type' (56 µs 903 ns)
- Adding 'kind_type' (2 ms 66 µs)
- Adding 'char_name' (6 s 410 ms)
- Adding tables to StorageManager and generating statistics done (52 s 731 ms)
done.
- Starting Benchmark...
Martin.Boissier@nemea:~/hyrise_master$ ./rel/hyriseBenchmarkJoinOrder -q 1 -r 1 -e LZ4
- Writing benchmark results to stdout
- MVCC is disabled
- Running in single-threaded mode
- 1 simulated clients are scheduling queries in parallel
- Running benchmark in 'IndividualQueries' mode
- Visualization is off
- Encoding is 'LZ4'
- Chunk size is 100000
- Max runs per query is 1
- Max duration per query is 60 seconds
- No warmup runs are performed
- Not caching tables as binary files
- JIT is disabled
- Retrieving the IMDB dataset.
- IMDB setup already complete, no setup action required
- Benchmarking queries from third_party/join-order-benchmark
- Running on tables from imdb_data
- Running subset of queries: 1
- Loading/Generating tables
- Loading table 'movie_companies' from "imdb_data/movie_companies.bin" (4958296 rows; 127 ms 161 µs)
- Loading table 'info_type' from "imdb_data/info_type.bin" (113 rows; 36 µs 444 ns)
- Loading table 'cast_info' from "imdb_data/cast_info.bin" (63475835 rows; 1 s 591 ms)
- Loading table 'company_name' from "imdb_data/company_name.bin" (362131 rows; 58 ms 416 µs)
- Loading table 'keyword' from "imdb_data/keyword.bin" (236627 rows; 16 ms 726 µs)
- Loading table 'movie_link' from "imdb_data/movie_link.bin" (2585150 rows; 46 ms 840 µs)
- Loading table 'movie_info' from "imdb_data/movie_info.bin" (29774984 rows; 2 s 110 ms)
- Loading table 'title' from "imdb_data/title.bin" (4736508 rows; 682 ms 527 µs)
- Loading table 'link_type' from "imdb_data/link_type.bin" (18 rows; 33 µs 793 ns)
- Loading table 'person_info' from "imdb_data/person_info.bin" (4130207 rows; 763 ms 705 µs)
- Loading table 'movie_keyword' from "imdb_data/movie_keyword.bin" (7480087 rows; 126 ms 920 µs)
- Loading table 'aka_title' from "imdb_data/aka_title.bin" (528337 rows; 87 ms 270 µs)
- Loading table 'company_type' from "imdb_data/company_type.bin" (4 rows; 27 µs 742 ns)
- Loading table 'comp_cast_type' from "imdb_data/comp_cast_type.bin" (4 rows; 10 µs 411 ns)
- Loading table 'aka_name' from "imdb_data/aka_name.bin" (1312273 rows; 200 ms 557 µs)
- Loading table 'complete_cast' from "imdb_data/complete_cast.bin" (135086 rows; 2 ms 296 µs)
- Loading table 'movie_info_idx' from "imdb_data/movie_info_idx.bin" (1380035 rows; 36 ms 845 µs)
- Loading table 'name' from "imdb_data/name.bin" (6379740 rows; 928 ms 542 µs)
- Loading table 'role_type' from "imdb_data/role_type.bin" (12 rows; 38 µs 872 ns)
- Loading table 'kind_type' from "imdb_data/kind_type.bin" (9 rows; 13 µs 974 ns)
- Loading table 'char_name' from "imdb_data/char_name.bin" (4314863 rows; 665 ms 318 µs)
- Loading/Generating tables done (7 s 445 ms)
- Encoding tables if necessary
- Encoding 'movie_companies' - encoding applied (1 s 971 ms)
- Encoding 'info_type' - encoding applied (867 µs 698 ns)
- Encoding 'cast_info' - encoding applied (9 s 877 ms)
- Encoding 'company_name' - encoding applied (1 s 788 ms)
- Encoding 'keyword' - encoding applied (780 ms 136 µs)
- Encoding 'movie_link' - encoding applied (473 ms 136 µs)
- Encoding 'movie_info' - encoding applied (17 s 957 ms)
- Encoding 'title' - encoding applied (5 s 136 ms)
- Encoding 'link_type' - encoding applied (1 ms 285 µs)
- Encoding 'person_info' - encoding applied (8 s 177 ms)
- Encoding 'movie_keyword' - encoding applied (923 ms 51 µs)
- Encoding 'aka_title' - encoding applied (3 s 13 ms)
- Encoding 'company_type' - encoding applied (1 ms 594 µs)
- Encoding 'comp_cast_type' - encoding applied (453 µs 413 ns)
- Encoding 'aka_name' - encoding applied (2 s 213 ms)
- Encoding 'complete_cast' - encoding applied (228 ms 109 µs)
- Encoding 'movie_info_idx' - encoding applied (638 ms 790 µs)
- Encoding 'name' - encoding applied (6 s 386 ms)
- Encoding 'role_type' - encoding applied (1 ms 340 µs)
- Encoding 'kind_type' - encoding applied (446 µs 666 ns)
- Encoding 'char_name' - encoding applied (4 s 399 ms)
- Encoding tables done (1 min 4 s)
- Adding tables to StorageManager and generating statistics
- Adding 'movie_companies' (1 s 109 ms)
- Adding 'info_type' (137 µs 296 ns)
- Adding 'cast_info' (16 s 89 ms)
- Adding 'company_name' (467 ms 923 µs)
- Adding 'keyword' (114 ms 352 µs)
- Adding 'movie_link' (267 ms 444 µs)
- Adding 'movie_info' (12 s 841 ms)
- Adding 'title' (5 s 956 ms)
- Adding 'link_type' (169 µs 926 ns)
- Adding 'person_info' (4 s 88 ms)
- Adding 'movie_keyword' (646 ms 789 µs)
- Adding 'aka_title' (719 ms 711 µs)
- Adding 'company_type' (32 µs 63 ns)
- Adding 'comp_cast_type' (6 µs 421 ns)
- Adding 'aka_name' (1 s 657 ms)
- Adding 'complete_cast' (15 ms 77 µs)
- Adding 'movie_info_idx' (300 ms 781 µs)
- Adding 'name' (9 s 500 ms)
- Adding 'role_type' (29 µs 92 ns)
- Adding 'kind_type' (8 µs 989 ns)
- Adding 'char_name' (6 s 146 ms)
- Adding tables to StorageManager and generating statistics done (59 s 918 ms)
done.
- Starting Benchmark...
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment