[Scheduler] Change order in task grouping #2656
Open
+432
−252
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
AMDSystem cx17 - click to expand
Commit Info and Build Time
hyriseBenchmarkTPCH - single-threaded, SF 10.0 Sum of avg. item runtimes: +0% || Geometric mean of throughput changes: -0%Configuration Overview - click to expand +Configuration Overview----+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCH_29332b1ca0b941194d0cb7ba7aa2438b20442365_st.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCH_5ee9098de05cdcf3b290393d44461d8970302257_st.json |
+--------------------------+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 29332b1ca0b941194d0cb7ba7aa2438b20442365-dirty | 5ee9098de05cdcf3b290393d44461d8970302257-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-08-10 22:44:32 | 2024-08-11 02:46:29 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+--------------------------+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+ +----------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| TPC-H 01 || 5878.17 | 5894.31 | +0% || 0.17 | 0.17 | -0% | 0.8347 |
| TPC-H 02 || 41.16 | 41.69 | +1%˄ || 24.29 | 23.98 | -1%˄ | (run time too short) |
| TPC-H 03 || 1705.84 | 1662.48 | -3% || 0.59 | 0.60 | +3% | 0.0000 |
| TPC-H 04 || 1849.63 | 1833.23 | -1% || 0.54 | 0.55 | +1% | 0.0657 |
| TPC-H 05 || 3261.85 | 3239.19 | -1% || 0.31 | 0.31 | +1% | 0.0507 |
| TPC-H 06 || 213.95 | 206.77 | -3%˄ || 4.67 | 4.84 | +3%˄ | (run time too short) |
| TPC-H 07 || 976.55 | 950.74 | -3%˄ || 1.02 | 1.05 | +3%˄ | (run time too short) |
| TPC-H 08 || 703.08 | 711.21 | +1%˄ || 1.42 | 1.41 | -1%˄ | (run time too short) |
| TPC-H 09 || 7106.62 | 7177.97 | +1% || 0.14 | 0.14 | -1% | ˅ |
| TPC-H 10 || 1731.24 | 1736.40 | +0% || 0.58 | 0.58 | -0% | 0.5284 |
| TPC-H 11 || 68.88 | 70.57 | +2%˄ || 14.52 | 14.17 | -2%˄ | (run time too short) |
| TPC-H 12 || 1598.19 | 1628.60 | +2% || 0.63 | 0.61 | -2% | 0.0000 |
| TPC-H 13 || 6430.67 | 6333.10 | -2% || 0.16 | 0.16 | +2% | 0.0000 |
| TPC-H 14 || 586.76 | 581.08 | -1%˄ || 1.70 | 1.72 | +1%˄ | (run time too short) |
| TPC-H 15 || 255.85 | 250.46 | -2%˄ || 3.91 | 3.99 | +2%˄ | (run time too short) |
| TPC-H 16 || 635.55 | 648.62 | +2%˄ || 1.57 | 1.54 | -2%˄ | (run time too short) |
| TPC-H 17 || 277.37 | 284.15 | +2%˄ || 3.61 | 3.52 | -2%˄ | (run time too short) |
| TPC-H 18 || 1684.77 | 1696.76 | +1% || 0.59 | 0.59 | -1% | 0.4220 |
-| TPC-H 19 || 253.56 | 272.04 | +7%˄ || 3.94 | 3.68 | -7%˄ | (run time too short) |
| TPC-H 20 || 638.22 | 641.48 | +1%˄ || 1.57 | 1.56 | -1%˄ | (run time too short) |
| TPC-H 21 || 5906.57 | 6024.22 | +2% || 0.17 | 0.17 | -2% | 0.0137 |
| TPC-H 22 || 609.97 | 614.42 | +1%˄ || 1.64 | 1.63 | -1%˄ | (run time too short) |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| Sum || 42414.45 | 42499.47 | +0% || | | | |
| Geomean || | | || | | -0% | |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
| || ˅ Insufficient number of runs for p-value calculation |
+----------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCH - single-threaded, SF 0.01 Sum of avg. item runtimes: -0% || Geometric mean of throughput changes: +2%Configuration Overview - click to expand +Configuration Overview----+----------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCH_29332b1ca0b941194d0cb7ba7aa2438b20442365_st_s01.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCH_5ee9098de05cdcf3b290393d44461d8970302257_st_s01.json |
+--------------------------+----------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 29332b1ca0b941194d0cb7ba7aa2438b20442365-dirty | 5ee9098de05cdcf3b290393d44461d8970302257-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-08-10 23:02:08 | 2024-08-11 03:04:00 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 0.009999999776482582 | 0.009999999776482582 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+--------------------------+----------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------+ +----------++----------+---------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+----------++----------+---------+--------++----------+----------+--------+----------------------+
| TPC-H 01 || 9.91 | 9.93 | +0%˄ || 100.88 | 100.66 | -0%˄ | (run time too short) |
-| TPC-H 02 || 3.24 | 3.54 | +9%˄ || 308.50 | 282.68 | -8%˄ | (run time too short) |
+| TPC-H 03 || 0.59 | 0.55 | -6%˄ || 1690.09 | 1804.16 | +7%˄ | (run time too short) |
| TPC-H 04 || 0.36 | 0.36 | -1%˄ || 2742.48 | 2780.04 | +1%˄ | (run time too short) |
| TPC-H 05 || 0.90 | 0.92 | +2%˄ || 1111.61 | 1087.94 | -2%˄ | (run time too short) |
| TPC-H 06 || 0.20 | 0.20 | -1%˄ || 4866.05 | 4939.49 | +2%˄ | (run time too short) |
| TPC-H 07 || 8.38 | 8.22 | -2%˄ || 119.38 | 121.69 | +2%˄ | (run time too short) |
| TPC-H 08 || 13.03 | 13.04 | +0%˄ || 76.73 | 76.68 | -0%˄ | (run time too short) |
| TPC-H 09 || 3.01 | 2.89 | -4%˄ || 331.76 | 346.40 | +4%˄ | (run time too short) |
| TPC-H 10 || 0.63 | 0.64 | +3%˄ || 1590.58 | 1549.31 | -3%˄ | (run time too short) |
| TPC-H 11 || 0.16 | 0.17 | +4%˄ || 6250.84 | 6016.15 | -4%˄ | (run time too short) |
| TPC-H 12 || 0.61 | 0.60 | -3%˄ || 1631.47 | 1675.80 | +3%˄ | (run time too short) |
| TPC-H 13 || 1.97 | 1.95 | -1%˄ || 506.40 | 511.36 | +1%˄ | (run time too short) |
+| TPC-H 14 || 0.28 | 0.27 | -5%˄ || 3514.94 | 3691.39 | +5%˄ | (run time too short) |
| TPC-H 15 || 1.08 | 1.06 | -2%˄ || 919.34 | 936.84 | +2%˄ | (run time too short) |
| TPC-H 16 || 1.86 | 1.86 | +1%˄ || 538.62 | 535.76 | -1%˄ | (run time too short) |
+| TPC-H 17 || 0.57 | 0.42 | -25%˄ || 1762.89 | 2359.71 | +34%˄ | (run time too short) |
| TPC-H 18 || 1.13 | 1.16 | +3%˄ || 882.95 | 860.21 | -3%˄ | (run time too short) |
| TPC-H 19 || 4.31 | 4.35 | +1%˄ || 232.05 | 229.96 | -1%˄ | (run time too short) |
| TPC-H 20 || 2.40 | 2.35 | -2%˄ || 416.80 | 425.33 | +2%˄ | (run time too short) |
| TPC-H 21 || 0.95 | 0.93 | -2%˄ || 1049.20 | 1073.03 | +2%˄ | (run time too short) |
| TPC-H 22 || 1.04 | 1.05 | +1%˄ || 957.19 | 951.90 | -1%˄ | (run time too short) |
+----------++----------+---------+--------++----------+----------+--------+----------------------+
| Sum || 56.62 | 56.46 | -0% || | | | |
| Geomean || | | || | | +2% | |
+----------++----------+---------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+----------++----------+---------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCH - multi-threaded, ordered, 1 client, 64 cores, SF 10.0 Sum of avg. item runtimes: -0% || Geometric mean of throughput changes: +0%Configuration Overview - click to expand +Configuration Overview---------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCH_29332b1ca0b941194d0cb7ba7aa2438b20442365_mt_ordered.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCH_5ee9098de05cdcf3b290393d44461d8970302257_mt_ordered.json |
+-------------------------------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 29332b1ca0b941194d0cb7ba7aa2438b20442365-dirty | 5ee9098de05cdcf3b290393d44461d8970302257-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2024-08-10 23:02:33 | 2024-08-11 03:04:25 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+ +----------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| TPC-H 01 || 5463.39 | 5435.80 | -1% || 0.18 | 0.18 | +1% | 0.2747 |
| TPC-H 02 || 63.65 | 61.16 | -4%˄ || 15.68 | 16.32 | +4%˄ | (run time too short) |
| TPC-H 03 || 822.02 | 835.16 | +2%˄ || 1.22 | 1.20 | -2%˄ | (run time too short) |
| TPC-H 04 || 822.89 | 837.54 | +2%˄ || 1.22 | 1.19 | -2%˄ | (run time too short) |
| TPC-H 05 || 665.32 | 660.41 | -1%˄ || 1.50 | 1.51 | +1%˄ | (run time too short) |
+| TPC-H 06 || 72.05 | 68.01 | -6%˄ || 13.86 | 14.68 | +6%˄ | (run time too short) |
| TPC-H 07 || 306.75 | 306.57 | -0%˄ || 3.26 | 3.26 | +0%˄ | (run time too short) |
| TPC-H 08 || 273.39 | 276.30 | +1%˄ || 3.66 | 3.62 | -1%˄ | (run time too short) |
| TPC-H 09 || 2731.54 | 2766.87 | +1% || 0.37 | 0.36 | -1% | 0.0511 |
| TPC-H 10 || 800.99 | 800.69 | -0%˄ || 1.25 | 1.25 | +0%˄ | (run time too short) |
| TPC-H 11 || 78.06 | 79.16 | +1%˄ || 12.79 | 12.61 | -1%˄ | (run time too short) |
| TPC-H 12 || 644.73 | 638.17 | -1%˄ || 1.55 | 1.57 | +1%˄ | (run time too short) |
| TPC-H 13 || 3961.79 | 3859.53 | -3% || 0.25 | 0.26 | +3% | 0.0028 |
| TPC-H 14 || 169.59 | 166.44 | -2%˄ || 5.89 | 6.00 | +2%˄ | (run time too short) |
| TPC-H 15 || 172.93 | 170.11 | -2%˄ || 5.78 | 5.87 | +2%˄ | (run time too short) |
| TPC-H 16 || 843.83 | 853.36 | +1%˄ || 1.18 | 1.17 | -1%˄ | (run time too short) |
| TPC-H 17 || 98.54 | 97.33 | -1%˄ || 10.14 | 10.26 | +1%˄ | (run time too short) |
| TPC-H 18 || 2574.01 | 2596.57 | +1% || 0.39 | 0.39 | -1% | 0.5825 |
| TPC-H 19 || 121.27 | 121.17 | -0%˄ || 8.24 | 8.25 | +0%˄ | (run time too short) |
| TPC-H 20 || 258.41 | 256.71 | -1%˄ || 3.87 | 3.89 | +1%˄ | (run time too short) |
| TPC-H 21 || 1387.56 | 1378.79 | -1% || 0.72 | 0.73 | +1% | 0.6354 |
| TPC-H 22 || 172.01 | 177.07 | +3%˄ || 5.81 | 5.64 | -3%˄ | (run time too short) |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| Sum || 22504.71 | 22442.90 | -0% || | | | |
| Geomean || | | || | | +0% | |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+----------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCH - multi-threaded, shuffled, 64 clients, 64 cores, SF 10.0 Sum of avg. item runtimes: -1% || Geometric mean of throughput changes: +1%Configuration Overview - click to expand +Configuration Overview---------+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCH_29332b1ca0b941194d0cb7ba7aa2438b20442365_mt.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCH_5ee9098de05cdcf3b290393d44461d8970302257_mt.json |
+-------------------------------+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 29332b1ca0b941194d0cb7ba7aa2438b20442365-dirty | 5ee9098de05cdcf3b290393d44461d8970302257-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| clustering | None | None |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2024-08-10 23:16:21 | 2024-08-11 03:18:19 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+ +----------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+----------++----------+----------+--------++----------+----------+--------+---------+
| TPC-H 01 || 6139.24 | 6088.19 | -1% || 1.04 | 1.05 | +1% | 0.4812 |
-| TPC-H 02 || 487.89 | 707.04 | +45% || 1.05 | 1.05 | +1% | 0.0024 |
-| TPC-H 03 || 2754.52 | 3133.25 | +14% || 1.04 | 1.05 | +0% | 0.0046 |
| TPC-H 04 || 2418.30 | 2520.34 | +4% || 1.04 | 1.05 | +1% | 0.4509 |
| TPC-H 05 || 4230.20 | 4144.33 | -2% || 1.04 | 1.05 | +1% | 0.6211 |
+| TPC-H 06 || 709.14 | 545.84 | -23% || 1.04 | 1.05 | +1% | 0.0042 |
| TPC-H 07 || 3396.92 | 3402.03 | +0% || 1.04 | 1.05 | +1% | 0.9767 |
| TPC-H 08 || 2517.23 | 2445.80 | -3% || 1.05 | 1.05 | +0% | 0.6125 |
| TPC-H 09 || 6559.44 | 6301.77 | -4% || 1.04 | 1.05 | +0% | 0.1603 |
-| TPC-H 10 || 3601.56 | 3859.17 | +7% || 1.04 | 1.05 | +0% | 0.1344 |
-| TPC-H 11 || 522.94 | 658.19 | +26% || 1.05 | 1.05 | +0% | 0.0564 |
+| TPC-H 12 || 2657.66 | 2529.80 | -5% || 1.05 | 1.05 | +0% | 0.3136 |
| TPC-H 13 || 5770.78 | 5749.63 | -0% || 1.04 | 1.05 | +1% | 0.8234 |
+| TPC-H 14 || 1220.25 | 1136.26 | -7% || 1.05 | 1.05 | +1% | 0.4845 |
+| TPC-H 15 || 744.31 | 663.76 | -11% || 1.04 | 1.05 | +1% | 0.1898 |
-| TPC-H 16 || 2293.17 | 2529.24 | +10% || 1.04 | 1.05 | +1% | 0.0447 |
-| TPC-H 17 || 838.10 | 879.81 | +5% || 1.05 | 1.05 | +0% | 0.5792 |
| TPC-H 18 || 3732.82 | 3662.45 | -2% || 1.04 | 1.05 | +1% | 0.5671 |
+| TPC-H 19 || 1296.90 | 1120.63 | -14% || 1.04 | 1.05 | +1% | 0.1154 |
| TPC-H 20 || 1948.77 | 1902.74 | -2% || 1.04 | 1.05 | +1% | 0.7045 |
+| TPC-H 21 || 5816.67 | 5388.76 | -7% || 1.04 | 1.05 | +1% | 0.0433 |
| TPC-H 22 || 1133.20 | 1108.33 | -2% || 1.04 | 1.05 | +1% | 0.8125 |
+----------++----------+----------+--------++----------+----------+--------+---------+
| Sum || 60790.01 | 60477.39 | -1% || | | | |
| Geomean || | | || | | +1% | |
+----------++----------+----------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCDS - single-threaded Sum of avg. item runtimes: +1% || Geometric mean of throughput changes: -1%Configuration Overview - click to expand +Configuration Overview---+-------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCDS_29332b1ca0b941194d0cb7ba7aa2438b20442365_st.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCDS_5ee9098de05cdcf3b290393d44461d8970302257_st.json |
+-------------------------+-------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 29332b1ca0b941194d0cb7ba7aa2438b20442365-dirty | 5ee9098de05cdcf3b290393d44461d8970302257-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-08-10 23:38:30 | 2024-08-11 03:40:29 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+-------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| 01 || 290.83 | 288.60 | -1%˄ || 3.44 | 3.46 | +1%˄ | (run time too short) |
| 03 || 99.09 | 97.68 | -1%˄ || 10.09 | 10.24 | +1%˄ | (run time too short) |
| 06 || 223.87 | 220.15 | -2%˄ || 4.47 | 4.54 | +2%˄ | (run time too short) |
| 07 || 344.90 | 340.59 | -1%˄ || 2.90 | 2.94 | +1%˄ | (run time too short) |
| 09 || 1047.07 | 1092.34 | +4%˄ || 0.96 | 0.92 | -4%˄ | (run time too short) |
| 10 || 148.10 | 150.31 | +1%˄ || 6.75 | 6.65 | -1%˄ | (run time too short) |
| 13 || 633.24 | 647.12 | +2%˄ || 1.58 | 1.55 | -2%˄ | (run time too short) |
| 15 || 127.88 | 128.59 | +1%˄ || 7.82 | 7.78 | -1%˄ | (run time too short) |
| 16 || 64.88 | 67.04 | +3%˄ || 15.41 | 14.92 | -3%˄ | (run time too short) |
| 17 || 401.25 | 405.38 | +1%˄ || 2.49 | 2.47 | -1%˄ | (run time too short) |
| 19 || 120.77 | 121.37 | +0%˄ || 8.28 | 8.24 | -0%˄ | (run time too short) |
| 25 || 196.35 | 201.89 | +3%˄ || 5.09 | 4.95 | -3%˄ | (run time too short) |
| 26 || 140.43 | 143.89 | +2%˄ || 7.12 | 6.95 | -2%˄ | (run time too short) |
| 28 || 773.94 | 784.69 | +1%˄ || 1.29 | 1.27 | -1%˄ | (run time too short) |
| 29 || 568.14 | 573.63 | +1%˄ || 1.76 | 1.74 | -1%˄ | (run time too short) |
| 31 || 1504.
8000
25 | 1489.41 | -1% || 0.66 | 0.67 | +1% | 0.0121 |
| 32 || 34.57 | 34.77 | +1%˄ || 28.92 | 28.76 | -1%˄ | (run time too short) |
| 34 || 197.03 | 195.33 | -1%˄ || 5.08 | 5.12 | +1%˄ | (run time too short) |
| 35 || 758.78 | 757.03 | -0%˄ || 1.32 | 1.32 | +0%˄ | (run time too short) |
+| 37 || 799.88 | 752.92 | -6%˄ || 1.25 | 1.33 | +6%˄ | (run time too short) |
| 39a || 1895.91 | 1911.86 | +1% || 0.53 | 0.52 | -1% | 0.0100 |
| 39b || 1867.50 | 1876.29 | +0% || 0.54 | 0.53 | -0% | 0.1107 |
-| 41 || 263.51 | 297.94 | +13%˄ || 3.79 | 3.36 | -12%˄ | (run time too short) |
| 42 || 97.72 | 97.74 | +0%˄ || 10.23 | 10.23 | -0%˄ | (run time too short) |
| 43 || 916.85 | 933.50 | +2%˄ || 1.09 | 1.07 | -2%˄ | (run time too short) |
| 45 || 152.16 | 151.79 | -0%˄ || 6.57 | 6.59 | +0%˄ | (run time too short) |
| 48 || 1099.28 | 1115.31 | +1%˄ || 0.91 | 0.90 | -1%˄ | (run time too short) |
| 50 || 151.20 | 151.03 | -0%˄ || 6.61 | 6.62 | +0%˄ | (run time too short) |
| 52 || 96.13 | 94.98 | -1%˄ || 10.40 | 10.53 | +1%˄ | (run time too short) |
| 55 || 89.62 | 88.64 | -1%˄ || 11.16 | 11.28 | +1%˄ | (run time too short) |
| 62 || 559.68 | 563.73 | +1%˄ || 1.79 | 1.77 | -1%˄ | (run time too short) |
| 65 || 2355.98 | 2334.57 | -1% || 0.42 | 0.43 | +1% | 0.0388 |
| 69 || 166.81 | 168.73 | +1%˄ || 5.99 | 5.93 | -1%˄ | (run time too short) |
| 73 || 94.11 | 94.76 | +1%˄ || 10.63 | 10.55 | -1%˄ | (run time too short) |
| 79 || 568.26 | 570.40 | +0%˄ || 1.76 | 1.75 | -0%˄ | (run time too short) |
| 81 || 186.70 | 187.91 | +1%˄ || 5.36 | 5.32 | -1%˄ | (run time too short) |
| 82 || 848.61 | 820.31 | -3%˄ || 1.18 | 1.22 | +3%˄ | (run time too short) |
| 83 || 50.04 | 52.14 | +4%˄ || 19.98 | 19.18 | -4%˄ | (run time too short) |
+| 84 || 18.19 | 17.24 | -5%˄ || 54.97 | 58.00 | +6%˄ | (run time too short) |
| 85 || 184.16 | 191.08 | +4%˄ || 5.43 | 5.23 | -4%˄ | (run time too short) |
-| 88 || 706.68 | 850.45 | +20%˄ || 1.42 | 1.18 | -17%˄ | (run time too short) |
-| 91 || 18.16 | 20.70 | +14%˄ || 55.05 | 48.29 | -12%˄ | (run time too short) |
| 92 || 44.76 | 45.27 | +1%˄ || 22.34 | 22.09 | -1%˄ | (run time too short) |
| 93 || 5100.49 | 5107.42 | +0% || 0.20 | 0.20 | -0% | 0.2949 |
| 94 || 46.07 | 45.91 | -0%˄ || 21.71 | 21.78 | +0%˄ | (run time too short) |
| 95 || 4677.56 | 4780.05 | +2% || 0.21 | 0.21 | -2% | 0.0764 |
| 96 || 75.90 | 74.51 | -2%˄ || 13.17 | 13.42 | +2%˄ | (run time too short) |
| 97 || 4531.94 | 4552.99 | +0% || 0.22 | 0.22 | -0% | 0.3738 |
| 99 || 1042.78 | 1042.32 | -0%˄ || 0.96 | 0.96 | +0%˄ | (run time too short) |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Sum || 36382.00 | 36732.26 | +1% || | | | |
| Geomean || | | || | | -1% | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCDS - multi-threaded, ordered, 1 client, 64 cores Sum of avg. item runtimes: +0% || Geometric mean of throughput changes: +0%Configuration Overview - click to expand +Configuration Overview---------+---------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCDS_29332b1ca0b941194d0cb7ba7aa2438b20442365_mt_ordered.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCDS_5ee9098de05cdcf3b290393d44461d8970302257_mt_ordered.json |
+-------------------------------+---------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 29332b1ca0b941194d0cb7ba7aa2438b20442365-dirty | 5ee9098de05cdcf3b290393d44461d8970302257-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2024-08-10 23:59:23 | 2024-08-11 04:01:35 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------------+---------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| 01 || 298.39 | 292.00 | -2%˄ || 3.35 | 3.42 | +2%˄ | (run time too short) |
| 03 || 37.51 | 36.73 | -2%˄ || 26.61 | 27.18 | +2%˄ | (run time too short) |
| 06 || 203.36 | 199.45 | -2%˄ || 4.91 | 5.01 | +2%˄ | (run time too short) |
| 07 || 240.27 | 238.74 | -1%˄ || 4.16 | 4.19 | +1%˄ | (run time too short) |
| 09 || 129.19 | 131.42 | +2%˄ || 7.74 | 7.60 | -2%˄ | (run time too short) |
| 10 || 37.90 | 37.63 | -1%˄ || 26.35 | 26.55 | +1%˄ | (run time too short) |
| 13 || 330.65 | 330.05 | -0%˄ || 3.02 | 3.03 | +0%˄ | (run time too short) |
| 15 || 77.14 | 77.58 | +1%˄ || 12.95 | 12.87 | -1%˄ | (run time too short) |
| 16 || 37.60 | 37.32 | -1%˄ || 26.56 | 26.75 | +1%˄ | (run time too short) |
| 17 || 158.97 | 161.67 | +2%˄ || 6.29 | 6.18 | -2%˄ | (run time too short) |
| 19 || 81.95 | 83.04 | +1%˄ || 12.19 | 12.03 | -1%˄ | (run time too short) |
| 25 || 121.83 | 122.24 | +0%˄ || 8.20 | 8.17 | -0%˄ | (run time too short) |
| 26 || 125.28 | 128.60 | +3%˄ || 7.98 | 7.77 | -3%˄ | (run time too short) |
| 28 || 181.42 | 175.67 | -3%˄ || 5.51 | 5.69 | +3%˄ | (run time too short) |
| 29 || 482.88 | 477.02 | -1%˄ || 2.07 | 2.10 | +1%˄ | (run time too short) |
| 31 || 643.14 | 651.29 | +1%˄ || 1.55 | 1.54 | -1%˄ | (run time too short) |
| 32 || 34.12 | 34.59 | +1%˄ || 29.23 | 28.83 | -1%˄ | (run time too short) |
| 34 || 108.03 | 106.13 | -2%˄ || 9.25 | 9.41 | +2%˄ | (run time too short) |
| 35 || 523.19 | 527.96 | +1%˄ || 1.91 | 1.89 | -1%˄ | (run time too short) |
| 37 || 243.72 | 236.62 | -3%˄ || 4.10 | 4.22 | +3%˄ | (run time too short) |
| 39a || 1113.50 | 1078.37 | -3%˄ || 0.90 | 0.93 | +3%˄ | (run time too short) |
-| 39b || 1030.74 | 1093.24 | +6%˄ || 0.97 | 0.91 | -6%˄ | (run time too short) |
-| 41 || 553.04 | 584.24 | +6%˄ || 1.81 | 1.71 | -5%˄ | (run time too short) |
| 42 || 57.59 | 57.21 | -1%˄ || 17.34 | 17.46 | +1%˄ | (run time too short) |
| 43 || 597.52 | 608.52 | +2%˄ || 1.67 | 1.64 | -2%˄ | (run time too short) |
| 45 || 62.90 | 63.19 | +0%˄ || 15.88 | 15.81 | -0%˄ | (run time too short) |
| 48 || 574.15 | 569.08 | -1%˄ || 1.74 | 1.76 | +1%˄ | (run time too short) |
| 50 || 129.87 | 128.95 | -1%˄ || 7.69 | 7.75 | +1%˄ | (run time too short) |
| 52 || 60.65 | 59.96 | -1%˄ || 16.47 | 16.66 | +1%˄ | (run time too short) |
| 55 || 52.94 | 52.46 | -1%˄ || 18.86 | 19.04 | +1%˄ | (run time too short) |
+| 62 || 507.70 | 478.37 | -6%˄ || 1.97 | 2.09 | +6%˄ | (run time too short) |
| 65 || 2298.14 | 2300.63 | +0% || 0.44 | 0.43 | -0% | 0.8560 |
| 69 || 80.70 | 78.85 | -2%˄ || 12.38 | 12.67 | +2%˄ | (run time too short) |
| 73 || 63.84 | 63.31 | -1%˄ || 15.65 | 15.78 | +1%˄ | (run time too short) |
| 79 || 710.81 | 708.42 | -0%˄ || 1.41 | 1.41 | +0%˄ | (run time too short) |
| 81 || 212.42 | 210.84 | -1%˄ || 4.71 | 4.74 | +1%˄ | (run time too short) |
| 82 || 273.34 | 268.62 | -2%˄ || 3.66 | 3.72 | +2%˄ | (run time too short) |
| 83 || 47.53 | 49.60 | +4%˄ || 21.01 | 20.13 | -4%˄ | (run time too short) |
| 84 || 12.15 | 12.37 | +2%˄ || 81.68 | 80.26 | -2%˄ | (run time too short) |
| 85 || 72.49 | 74.77 | +3%˄ || 13.78 | 13.36 | -3%˄ | (run time too short) |
+| 88 || 88.09 | 84.15 | -4%˄ || 11.34 | 11.87 | +5%˄ | (run time too short) |
| 91 || 17.49 | 17.16 | -2%˄ || 56.90 | 58.04 | +2%˄ | (run time too short) |
| 92 || 50.58 | 50.41 | -0%˄ || 19.71 | 19.78 | +0%˄ | (run time too short) |
| 93 || 1056.09 | 1084.75 | +3%˄ || 0.95 | 0.92 | -3%˄ | (run time too short) |
| 94 || 36.14 | 35.88 | -1%˄ || 27.62 | 27.83 | +1%˄ | (run time too short) |
| 95 || 1000.19 | 983.78 | -2%˄ || 1.00 | 1.02 | +2%˄ | (run time too short) |
| 96 || 56.93 | 57.18 | +0%˄ || 17.54 | 17.47 | -0%˄ | (run time too short) |
| 97 || 2063.50 | 2063.24 | -0% || 0.48 | 0.48 | +0% | 0.9842 |
| 99 || 945.97 | 933.59 | -1%˄ || 1.06 | 1.07 | +1%˄ | (run time too short) |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Sum || 17923.55 | 17936.91 | +0% || | | | |
| Geomean || | | || | | +0% | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCDS - multi-threaded, shuffled, 64 clients, 64 cores Sum of avg. item runtimes: -2% || Geometric mean of throughput changes: +2%Configuration Overview - click to expand +Configuration Overview---------+-------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCDS_29332b1ca0b941194d0cb7ba7aa2438b20442365_mt.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCDS_5ee9098de05cdcf3b290393d44461d8970302257_mt.json |
+-------------------------------+-------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 29332b1ca0b941194d0cb7ba7aa2438b20442365-dirty | 5ee9098de05cdcf3b290393d44461d8970302257-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2024-08-11 00:14:51 | 2024-08-11 04:17:03 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+-------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+---------+
-| 01 || 741.45 | 945.09 | +27% || 1.00 | 1.01 | +2% | 0.0001 |
| 03 || 303.97 | 290.44 | -4% || 1.00 | 1.01 | +2% | 0.6663 |
| 06 || 990.17 | 1021.37 | +3% || 1.00 | 1.01 | +2% | 0.6590 |
-| 07 || 971.25 | 1042.54 | +7% || 1.00 | 1.01 | +2% | 0.2266 |
+| 09 || 905.03 | 726.21 | -20% || 1.00 | 1.01 | +1% | 0.0045 |
| 10 || 763.78 | 781.03 | +2% || 1.00 | 1.01 | +2% | 0.8010 |
| 13 || 1698.55 | 1742.65 | +3% || 1.00 | 1.01 | +2% | 0.5734 |
-| 15 || 532.00 | 649.77 | +22% || 1.00 | 1.01 | +1% | 0.0192 |
-| 16 || 459.23 | 531.91 | +16% || 1.00 | 1.01 | +1% | 0.1793 |
+| 17 || 1501.16 | 1412.53 | -6% || 1.00 | 1.01 | +2% | 0.3074 |
+| 19 || 716.71 | 680.97 | -5% || 1.00 | 1.01 | +2% | 0.4872 |
-| 25 || 1062.86 | 1117.03 | +5% || 1.00 | 1.01 | +2% | 0.4402 |
-| 26 || 550.92 | 584.62 | +6% || 1.00 | 1.01 | +2% | 0.5160 |
+| 28 || 1662.59 | 1093.15 | -34% || 1.00 | 1.01 | +2% | 0.0000 |
| 29 || 1771.49 | 1824.96 | +3% || 1.00 | 1.01 | +1% | 0.5341 |
| 31 || 2719.78 | 2613.39 | -4% || 1.00 | 1.01 | +2% | 0.3442 |
+| 32 || 213.78 | 177.92 | -17% || 1.00 | 1.01 | +1% | 0.2212 |
+| 34 || 738.55 | 668.65 | -9% || 1.00 | 1.01 | +1% | 0.1682 |
| 35 || 2238.56 | 2244.73 | +0% || 1.00 | 1.01 | +2% | 0.9510 |
+| 37 || 1019.15 | 806.06 | -21% || 1.00 | 1.01 | +2% | 0.0003 |
-| 39a || 2790.14 | 2982.26 | +7% || 1.00 | 1.01 | +2% | 0.0426 |
+| 39b || 2923.84 | 2684.64 | -8% || 1.00 | 1.01 | +2% | 0.0081 |
-| 41 || 2152.57 | 4083.24 | +90% || 1.00 | 1.01 | +1% | 0.0000 |
| 42 || 457.93 | 442.43 | -3% || 1.00 | 1.01 | +2% | 0.6870 |
+| 43 || 1575.42 | 1332.70 | -15% || 1.00 | 1.01 | +2% | 0.0007 |
+| 45 || 864.21 | 824.16 | -5% || 1.00 | 1.01 | +2% | 0.5691 |
| 48 || 2699.92 | 2733.16 | +1% || 1.00 | 1.01 | +1% | 0.7575 |
+| 50 || 1092.46 | 989.31 | -9% || 1.00 | 1.01 | +2% | 0.1646 |
| 52 || 519.00 | 517.76 | -0% || 1.00 | 1.01 | +2% | 0.9818 |
+| 55 || 475.29 | 355.99 | -25% || 1.00 | 1.01 | +2% | 0.0050 |
+| 62 || 1195.07 | 1018.02 | -15% || 1.00 | 1.01 | +2% | 0.0045 |
| 65 || 4474.37 | 4351.63 | -3% || 0.99 | 1.01 | +2% | 0.0840 |
| 69 || 1080.35 | 1048.16 | -3% || 1.00 | 1.01 | +1% | 0.6478 |
+| 73 || 549.41 | 449.28 | -18% || 1.00 | 1.01 | +2% | 0.0338 |
+| 79 || 1595.53 | 1411.43 | -12% || 1.00 | 1.01 | +2% | 0.0040 |
-| 81 || 678.60 | 989.00 | +46% || 1.00 | 1.01 | +2% | 0.0000 |
+| 82 || 1044.53 | 976.10 | -7% || 1.00 | 1.01 | +1% | 0.2734 |
-| 83 || 314.75 | 388.45 | +23% || 1.00 | 1.01 | +2% | 0.0611 |
| 84 || 159.65 | 159.42 | -0% || 1.00 | 1.01 | +2% | 0.9933 |
| 85 || 936.93 | 931.03 | -1% || 1.00 | 1.01 | +1% | 0.9338 |
+| 88 || 2866.79 | 1987.91 | -31% || 1.00 | 1.01 | +2% | 0.0000 |
| 91 || 305.48 | 301.88 | -1% || 1.00 | 1.01 | +2% | 0.9430 |
+| 92 || 327.22 | 267.64 | -18% || 1.00 | 1.01 | +2% | 0.1156 |
+| 93 || 2285.46 | 2070.37 | -9% || 1.00 | 1.01 | +2% | 0.0055 |
-| 94 || 474.14 | 604.04 | +27% || 1.00 | 1.01 | +2% | 0.0292 |
+| 95 || 2349.94 | 2140.91 | -9% || 1.00 | 1.01 | +1% | 0.0194 |
+| 96 || 461.93 | 351.58 | -24% || 1.00 | 1.01 | +2% | 0.0081 |
| 97 || 4389.81 | 4246.46 | -3% || 0.99 | 1.01 | +2% | 0.1413 |
| 99 || 1416.91 | 1372.64 | -3% || 1.00 | 1.01 | +2% | 0.4852 |
+---------++----------+----------+--------++----------+----------+--------+---------+
| Sum || 64018.64 | 62966.61 | -2% || | | | |
| Geomean || | | || | | +2% | |
+---------++----------+----------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCC - single-threaded Sum of avg. item runtimes: +2% || Geometric mean of throughput changes: +1%Configuration Overview - click to expand +Configuration Overview---+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCC_29332b1ca0b941194d0cb7ba7aa2438b20442365_st.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCC_5ee9098de05cdcf3b290393d44461d8970302257_st.json |
+-------------------------+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 29332b1ca0b941194d0cb7ba7aa2438b20442365-dirty | 5ee9098de05cdcf3b290393d44461d8970302257-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-08-11 00:35:27 | 2024-08-11 04:37:38 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10 | 10 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+ +--------------++----------+---------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| ||
6855
old | new | || old | new | | |
+--------------++----------+---------+--------++----------+----------+--------+---------+
| Delivery || 25.86 | 26.39 | +2% || 5.40 | 5.28 | -2% | 0.0018 |
| New-Order || 12.31 | 12.61 | +2% || 57.97 | 56.85 | -2% | 0.0011 |
| Order-Status || 1.21 | 1.26 | +4% || 4.95 | 4.75 | -4% | 0.0000 |
| Payment || 2.25 | 2.24 | -0% || 57.22 | 55.60 | -3% | 0.2784 |
+| Stock-Level || 2.03 | 1.98 | -2% || 4.82 | 5.60 | +16% | 0.0439 |
+--------------++----------+---------+--------++----------+----------+--------+---------+
| Sum || 43.66 | 44.48 | +2% || | | | |
| Geomean || | | || | | +1% | |
+--------------++----------+---------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCC - multi-threaded, shuffled, 64 clients, 10 warehouses, 64 cores (high contention) Sum of avg. item runtimes: -1% || Geometric mean of throughput changes: +0%Configuration Overview - click to expand +Configuration Overview---------+---------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCC_29332b1ca0b941194d0cb7ba7aa2438b20442365_mt_highcont.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCC_5ee9098de05cdcf3b290393d44461d8970302257_mt_highcont.json |
+-------------------------------+---------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 29332b1ca0b941194d0cb7ba7aa2438b20442365-dirty | 5ee9098de05cdcf3b290393d44461d8970302257-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2024-08-11 00:36:37 | 2024-08-11 04:38:49 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 600000000000 | 600000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10 | 10 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+---------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------+ +--------------++----------+---------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+--------------++----------+---------+--------++----------+----------+--------+---------+
| Delivery || 186.97 | 185.44 | -1% || 32.67 | 32.88 | +1% | 0.0506 |
| unsucc.: || 3.38 | 3.67 | +8% || 49.63 | 49.53 | -0% | |
| New-Order || 96.73 | 95.15 | -2% || 458.33 | 464.90 | +1% | 0.0000 |
| unsucc.: || 8.73 | 8.74 | +0% || 466.88 | 460.92 | -1% | |
| Order-Status || 9.49 | 9.47 | -0% || 82.24 | 82.47 | +0% | 0.8685 |
| Payment || 15.77 | 15.83 | +0% || 234.79 | 234.10 | -0% | 0.4176 |
| unsucc.: || 5.53 | 5.74 | +4% || 650.43 | 651.42 | +0% | |
| Stock-Level || 14.22 | 14.20 | -0% || 82.31 | 82.10 | -0% | 0.9220 |
+--------------++----------+---------+--------++----------+----------+--------+---------+
| Sum || 323.18 | 320.09 | -1% || | | | |
| Geomean || | | || | | +0% | |
+--------------++----------+---------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCC - multi-threaded, shuffled, 10 clients, 10 warehouses, 64 cores (low contention) Sum of avg. item runtimes: +1% || Geometric mean of throughput changes: -1%Configuration Overview - click to expand +Configuration Overview---------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCC_29332b1ca0b941194d0cb7ba7aa2438b20442365_mt_lowcont.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCC_5ee9098de05cdcf3b290393d44461d8970302257_mt_lowcont.json |
+-------------------------------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 29332b1ca0b941194d0cb7ba7aa2438b20442365-dirty | 5ee9098de05cdcf3b290393d44461d8970302257-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 10 | 10 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 64 | 64
A373
|
| data_preparation_cores | 0 | 0 |
| date | 2024-08-11 00:46:52 | 2024-08-11 04:49:04 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 600000000000 | 600000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10 | 10 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+ +--------------++----------+---------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+--------------++----------+---------+--------++----------+----------+--------+---------+
| Delivery || 80.23 | 81.34 | +1% || 15.67 | 15.71 | +0% | 0.0000 |
| unsucc.: || 0.90 | 0.96 | +6% || 2.00 | 1.99 | -1% | |
| New-Order || 39.47 | 39.87 | +1% || 181.46 | 178.58 | -2% | 0.0000 |
| unsucc.: || 3.22 | 4.01 | +24% || 17.22 | 17.15 | -0% | |
| Order-Status || 4.16 | 4.25 | +2% || 17.81 | 17.24 | -3% | 0.0000 |
| Payment || 8.05 | 8.21 | +2% || 156.31 | 154.05 | -1% | 0.0000 |
| unsucc.: || 2.10 | 2.17 | +4% || 34.06 | 33.63 | -1% | |
| Stock-Level || 5.92 | 5.93 | +0% || 17.60 | 17.78 | +1% | 0.4296 |
+--------------++----------+---------+--------++----------+----------+--------+---------+
| Sum || 137.84 | 139.61 | +1% || | | | |
| Geomean || | | || | | -1% | |
+--------------++----------+---------+--------++----------+----------+--------+---------+hyriseBenchmarkJoinOrder - single-threaded Sum of avg. item runtimes: +0% || Geometric mean of throughput changes: -1%Configuration Overview - click to expand +Configuration Overview---+-----------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkJoinOrder_29332b1ca0b941194d0cb7ba7aa2438b20442365_st.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkJoinOrder_5ee9098de05cdcf3b290393d44461d8970302257_st.json |
+-------------------------+-----------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 29332b1ca0b941194d0cb7ba7aa2438b20442365-dirty | 5ee9098de05cdcf3b290393d44461d8970302257-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-08-11 00:57:04 | 2024-08-11 04:59:14 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+-----------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| 10a || 124.37 | 120.31 | -3%˄ || 8.04 | 8.31 | +3%˄ | (run time too short) |
| 10b || 74.36 | 75.38 | +1%˄ || 13.45 | 13.27 | -1%˄ | (run time too short) |
+| 10c || 410.47 | 391.70 | -5%˄ || 2.44 | 2.55 | +5%˄ | (run time too short) |
| 11a || 117.94 | 118.67 | +1%˄ || 8.48 | 8.43 | -1%˄ | (run time too short) |
| 11b || 116.69 | 117.23 | +0%˄ || 8.57 | 8.53 | -0%˄ | (run time too short) |
| 11c || 27.65 | 28.29 | +2%˄ || 36.16 | 35.34 | -2%˄ | (run time too short) |
| 11d || 30.01 | 30.48 | +2%˄ || 33.32 | 32.81 | -2%˄ | (run time too short) |
-| 12a || 36.47 | 38.64 | +6%˄ || 27.42 | 25.88 | -6%˄ | (run time too short) |
| 12b || 33.38 | 33.72 | +1%˄ || 29.95 | 29.65 | -1%˄ | (run time too short) |
| 12c || 95.88 | 99.18 | +3%˄ || 10.43 | 10.08 | -3%˄ | (run time too short) |
| 13a || 221.60 | 225.54 | +2%˄ || 4.51 | 4.43 | -2%˄ | (run time too short) |
| 13b || 279.09 | 280.01 | +0%˄ || 3.58 | 3.57 | -0%˄ | (run time too short) |
| 13c || 217.55 | 219.36 | +1%˄ || 4.60 | 4.56 | -1%˄ | (run time too short) |
| 13d || 567.70 | 566.29 | -0%˄ || 1.76 | 1.77 | +0%˄ | (run time too short) |
| 14a || 131.53 | 135.64 | +3%˄ || 7.60 | 7.37 | -3%˄ | (run time too short) |
| 14b || 128.23 | 132.41 | +3%˄ || 7.80 | 7.55 | -3%˄ | (run time too short) |
| 14c || 228.50 | 232.68 | +2%˄ || 4.38 | 4.30 | -2%˄ | (run time too short) |
| 15a || 62.36 | 61.92 | -1%˄ || 16.03 | 16.15 | +1%˄ | (run time too short) |
| 15b || 64.22 | 63.75 | -1%˄ || 15.57 | 15.69 | +1%˄ | (run time too short) |
| 15c || 50.68 | 50.19 | -1%˄ || 19.73 | 19.92 | +1%˄ | (run time too short) |
| 15d || 48.74 | 48.42 | -1%˄ || 20.52 | 20.65 | +1%˄ | (run time too short) |
| 16a || 1861.28 | 1876.28 | +1% || 0.54 | 0.53 | -1% | 0.0016 |
| 16b || 3048.77 | 3035.32 | -0% || 0.33 | 0.33 | +0% | 0.0847 |
| 16c || 2053.43 | 2071.63 | +1% || 0.49 | 0.48 | -1% | 0.0001 |
| 16d || 2013.90 | 2026.56 | +1% || 0.50 | 0.49 | -1% | 0.0041 |
| 17a || 692.91 | 698.61 | +1%˄ || 1.44 | 1.43 | -1%˄ | (run time too short) |
| 17b || 589.51 | 578.92 | -2%˄ || 1.70 | 1.73 | +2%˄ | (run time too short) |
| 17c || 559.90 | 556.75 | -1%˄ || 1.79 | 1.80 | +1%˄ | (run time too short) |
| 17d || 616.73 | 618.66 | +0%˄ || 1.62 | 1.62 | -0%˄ | (run time too short) |
| 17e || 2061.59 | 2087.34 | +1% || 0.49 | 0.48 | -1% | 0.0000 |
+| 17f || 1169.65 | 1102.12 | -6%˄ || 0.85 | 0.91 | +6%˄ | (run time too short) |
| 18a || 140.51 | 137.31 | -2%˄ || 7.12 | 7.28 | +2%˄ | (run time too short) |
-| 18b || 128.36 | 135.46 | +6%˄ || 7.79 | 7.38 | -5%˄ | (run time too short) |
| 18c || 291.25 | 302.30 | +4%˄ || 3.43 | 3.31 | -4%˄ | (run time too short) |
-| 19a || 245.29 | 263.09 | +7%˄ || 4.08 | 3.80 | -7%˄ | (run time too short) |
| 19b || 214.05 | 220.63 | +3%˄ || 4.67 | 4.53 | -3%˄ | (run time too short) |
-| 19c || 294.76 | 312.64 | +6%˄ || 3.39 | 3.20 | -6%˄ | (run time too short) |
| 19d || 739.80 | 749.26 | +1%˄ || 1.35 | 1.33 | -1%˄ | (run time too short) |
| 1a || 13.48 | 13.70 | +2%˄ || 74.19 | 72.98 | -2%˄ | (run time too short) |
| 1b || 18.69 | 18.94 | +1%˄ || 53.51 | 52.79 | -1%˄ | (run time too short) |
| 1c || 18.76 | 18.32 | -2%˄ || 53.30 | 54.58 | +2%˄ | (run time too short) |
| 1d || 12.83 | 13.06 | +2%˄ || 77.91 | 76.56 | -2%˄ | (run time too short) |
| 20a || 744.21 | 749.17 | +1%˄ || 1.34 | 1.33 | -1%˄ | (run time too short) |
| 20b || 769.27 | 774.42 | +1%˄ || 1.30 | 1.29 | -1%˄ | (run time too short) |
| 20c || 462.29 | 461.66 | -0%˄ || 2.16 | 2.17 | +0%˄ | (run time too short) |
| 21a || 131.30 | 135.20 | +3%˄ || 7.62 | 7.40 | -3%˄ | (run time too short) |
| 21b || 120.57 | 121.21 | +1%˄ || 8.29 | 8.25 | -1%˄ | (run time too short) |
| 21c || 128.19 | 132.02 | +3%˄ || 7.80 | 7.57 | -3%˄ | (run time too short) |
| 22a || 214.48 | 216.04 | +1%˄ || 4.66 | 4.63 | -1%˄ | (run time too short) |
| 22b || 195.02 | 196.02 | +1%˄ || 5.13 | 5.10 | -1%˄ | (run time too short) |
| 22c || 290.92 | 294.50 | +1%˄ || 3.44 | 3.40 | -1%˄ | (run time too short) |
| 22d || 459.92 | 459.87 | -0%˄ || 2.17 | 2.17 | +0%˄ | (run time too short) |
| 23a || 54.61 | 54.49 | -0%˄ || 18.31 | 18.35 | +0%˄ | (run time too short) |
| 23b || 70.73 | 70.00 | -1%˄ || 14.14 | 14.28 | +1%˄ | (run time too short) |
| 23c || 59.42 | 59.19 | -0%˄ || 16.83 | 16.89 | +0%˄ | (run time too short) |
-| 24a || 222.85 | 242.46 | +9%˄ || 4.49 | 4.12 | -8%˄ | (run time too short) |
-| 24b || 213.92 | 231.20 | +8%˄ || 4.67 | 4.33 | -7%˄ | (run time too short) |
-| 25a || 141.11 | 147.62 | +5%˄ || 7.09 | 6.77 | -4%˄ | (run time too short) |
-| 25b || 81.06 | 87.01 | +7%˄ || 12.34 | 11.49 | -7%˄ | (run time too short) |
| 25c || 330.07 | 337.74 | +2%˄ || 3.03 | 2.96 | -2%˄ | (run time too short) |
+| 26a || 262.62 | 229.01 | -13%˄ || 3.81 | 4.37 | +15%˄ | (run time too short) |
+| 26b || 226.05 | 165.71 | -27%˄ || 4.42 | 6.03 | +36%˄ | (run time too short) |
+| 26c || 437.00 | 373.98 | -14%˄ || 2.29 | 2.67 | +17%˄ | (run time too short) |
+| 27a || 122.99 | 103.20 | -16%˄ || 8.13 | 9.69 | +19%˄ | (run time too short) |
+| 27b || 108.75 | 91.76 | -16%˄ || 9.19 | 10.90 | +19%˄ | (run time too short) |
| 27c || 128.84 | 132.33 | +3%˄ || 7.76 | 7.56 | -3%˄ | (run time too short) |
| 28a || 243.69 | 248.85 | +2%˄ || 4.10 | 4.02 | -2%˄ | (run time too short) |
| 28b || 89.16 | 90.20 | +1%˄ || 11.22 | 11.09 | -1%˄ | (run time too short) |
| 28c || 217.93 | 221.03 | +1%˄ || 4.59 | 4.52 | -1%˄ | (run time too short) |
-| 29a || 175.68 | 191.29 | +9%˄ || 5.69 | 5.23 | -8%˄ | (run time too short) |
| 29b || 833.01 | 869.13 | +4%˄ || 1.20 | 1.15 | -4%˄ | (run time too short) |
-| 29c || 227.11 | 244.78 | +8%˄ || 4.40 | 4.09 | -7%˄ | (run time too short) |
| 2a || 41.40 | 41.82 | +1%˄ || 24.15 | 23.91 | -1%˄ | (run time too short) |
| 2b || 38.07 | 38.54 | +1%˄ || 26.26 | 25.95 | -1%˄ | (run time too short) |
-| 2c || 32.55 | 39.19 | +20%˄ || 30.72 | 25.51 | -17%˄ | (run time too short) |
+| 2d || 80.61 | 67.70 | -16%˄ || 12.40 | 14.77 | +19%˄ | (run time too short) |
-| 30a || 118.91 | 128.61 | +8%˄ || 8.41 | 7.77 | -8%˄ | (run time too short) |
-| 30b || 122.00 | 130.01 | +7%˄ || 8.20 | 7.69 | -6%˄ | (run time too short) |
-| 30c || 211.57 | 225.70 | +7%˄ || 4.73 | 4.43 | -6%˄ | (run time too short) |
-| 31a || 101.50 | 109.32 | +8%˄ || 9.85 | 9.15 | -7%˄ | (run time too short) |
-| 31b || 97.80 | 105.86 | +8%˄ || 10.22 | 9.45 | -8%˄ | (run time too short) |
-| 31c || 112.41 | 122.36 | +9%˄ || 8.90 | 8.17 | -8%˄ | (run time too short) |
-| 32a || 22.60 | 23.81 | +5%˄ || 44.23 | 41.99 | -5%˄ | (run time too short) |
-| 32b || 51.22 | 54.36 | +6%˄ || 19.52 | 18.39 | -6%˄ | (run time too short) |
| 33a || 40.51 | 41.73 | +3%˄ || 24.68 | 23.96 | -3%˄ | (run time too short) |
-| 33b || 26.19 | 27.88 | +6%˄ || 38.18 | 35.86 | -6%˄ | (run time too short) |
| 33c || 52.91 | 54.94 | +4%˄ || 18.90 | 18.20 | -4%˄ | (run time too short) |
| 3a || 89.82 | 93.23 | +4%˄ || 11.13 | 10.73 | -4%˄ | (run time too short) |
| 3b || 21.00 | 21.72 | +3%˄ || 47.61 | 46.03 | -3%˄ | (run time too short) |
| 3c || 277.03 | 284.07 | +3%˄ || 3.61 | 3.52 | -2%˄ | (run time too short) |
| 4a || 184.69 | 185.28 | +0%˄ || 5.41 | 5.40 | -0%˄ | (run time too short) |
| 4b || 19.81 | 19.78 | -0%˄ || 50.47 | 50.54 | +0%˄ | (run time too short) |
| 4c || 238.91 | 241.26 | +1%˄ || 4.19 | 4.14 | -1%˄ | (run time too short) |
-| 5a || 58.69 | 62.82 | +7%˄ || 17.04 | 15.92 | -7%˄ | (run time too
F438
short) |
| 5b || 54.57 | 55.28 | +1%˄ || 18.32 | 18.09 | -1%˄ | (run time too short) |
-| 5c || 100.46 | 105.15 | +5%˄ || 9.95 | 9.51 | -4%˄ | (run time too short) |
| 6a || 215.31 | 216.64 | +1%˄ || 4.64 | 4.62 | -1%˄ | (run time too short) |
| 6b || 233.88 | 234.91 | +0%˄ || 4.28 | 4.26 | -0%˄ | (run time too short) |
| 6c || 203.08 | 204.32 | +1%˄ || 4.92 | 4.89 | -1%˄ | (run time too short) |
| 6d || 530.68 | 539.25 | +2%˄ || 1.88 | 1.85 | -2%˄ | (run time too short) |
| 6e || 210.74 | 213.15 | +1%˄ || 4.75 | 4.69 | -1%˄ | (run time too short) |
| 6f || 983.96 | 980.17 | -0%˄ || 1.02 | 1.02 | +0%˄ | (run time too short) |
| 7a || 91.11 | 92.05 | +1%˄ || 10.98 | 10.86 | -1%˄ | (run time too short) |
| 7b || 83.78 | 84.71 | +1%˄ || 11.94 | 11.80 | -1%˄ | (run time too short) |
| 7c || 667.93 | 676.74 | +1%˄ || 1.50 | 1.48 | -1%˄ | (run time too short) |
| 8a || 182.41 | 187.82 | +3%˄ || 5.48 | 5.32 | -3%˄ | (run time too short) |
| 8b || 174.32 | 179.48 | +3%˄ || 5.74 | 5.57 | -3%˄ | (run time too short) |
| 8c || 2128.13 | 2082.17 | -2% || 0.47 | 0.48 | +2% | 0.0597 |
| 8d || 342.35 | 341.66 | -0%˄ || 2.92 | 2.93 | +0%˄ | (run time too short) |
-| 9a || 293.86 | 313.00 | +7%˄ || 3.40 | 3.19 | -6%˄ | (run time too short) |
| 9b || 189.14 | 196.40 | +4%˄ || 5.29 | 5.09 | -4%˄ | (run time too short) |
-| 9c || 321.95 | 340.55 | +6%˄ || 3.11 | 2.94 | -5%˄ | (run time too short) |
| 9d || 506.59 | 520.36 | +3%˄ || 1.97 | 1.92 | -3%˄ | (run time too short) |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Sum || 37170.13 | 37321.57 | +0% || | | | |
| Geomean || | | || | | -1% | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkJoinOrder - multi-threaded, ordered, 1 client, 64 cores Sum of avg. item runtimes: -1% || Geometric mean of throughput changes: +0%Configuration Overview - click to expand +Configuration Overview---------+-------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkJoinOrder_29332b1ca0b941194d0cb7ba7aa2438b20442365_mt_ordered.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkJoinOrder_5ee9098de05cdcf3b290393d44461d8970302257_mt_ordered.json |
+-------------------------------+-------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 29332b1ca0b941194d0cb7ba7aa2438b20442365-dirty | 5ee9098de05cdcf3b290393d44461d8970302257-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2024-08-11 01:25:56 | 2024-08-11 05:28:10 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------------+-------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| 10a || 40.63 | 38.90 | -4%˄ || 24.56 | 25.66 | +4%˄ | (run time too short) |
| 10b || 18.23 | 17.96 | -1%˄ || 54.73 | 55.54 | +1%˄ | (run time too short) |
| 10c || 127.39 | 125.77 | -1%˄ || 7.84 | 7.94 | +1%˄ | (run time too short) |
| 11a || 25.38 | 24.63 | -3%˄ || 39.31 | 40.51 | +3%˄ | (run time too short) |
| 11b || 21.37 | 20.90 | -2%˄ || 46.69 | 47.73 | +2%˄ | (run time too short) |
| 11c || 23.46 | 23.36 | -0%˄ || 42.49 | 42.65 | +0%˄ | (run time too short) |
| 11d || 29.29 | 28.75 | -2%˄ || 33.92 | 34.58 | +2%˄ | (run time too short) |
| 12a || 25.29 | 25.52 | +1%˄ || 39.43 | 39.11 | -1%˄ | (run time too short) |
+| 12b || 13.79 | 12.99 | -6%˄ || 72.24 | 76.73 | +6%˄ | (run time too short) |
| 12c || 56.71 | 56.50 | -0%˄ || 17.62 | 17.68 | +0%˄ | (run time too short) |
| 13a || 170.44 | 169.05 | -1%˄ || 5.86 | 5.91 | +1%˄ | (run time too short) |
| 13b || 103.34 | 104.63 | +1%˄ || 9.67 | 9.55 | -1%˄ | (run time too short) |
+| 13c || 92.88 | 83.24 | -10%˄ || 10.76 | 12.00 | +12%˄ | (run time too short) |
| 13d || 510.63 | 498.95 | -2%˄ || 1.96 | 2.00 | +2%˄ | (run time too short) |
| 14a || 67.49 | 65.35 | -3%˄ || 14.80 | 15.29 | +3%˄ | (run time too short) |
| 14b || 82.10 | 80.01 | -3%˄ || 12.17 | 12.49 | +3%˄ | (run time too short) |
| 14c || 175.48 | 170.33 | -3%˄ || 5.69 | 5.87 | +3%˄ | (run time too short) |
| 15a || 32.70 | 33.27 | +2%˄ || 30.51 | 29.99 | -2%˄ | (run time too short) |
| 15b || 26.82 | 26.35 | -2%˄ || 37.20 | 37.86 | +2%˄ | (run time too short) |
| 15c || 24.71 | 25.32 | +2%˄ || 40.37 | 39.37 | -2%˄ | (run time too short) |
| 15d || 31.81 | 31.28 | -2%˄ || 31.35 | 31.90 | +2%˄ | (run time too short) |
| 16a || 952.98 | 953.31 | +0%˄ || 1.05 | 1.05 | -0%˄ | (run time too short) |
| 16b || 2436.52 | 2420.63 | -1% || 0.41 | 0.41 | +1% | 0.0652 |
| 16c || 1174.92 | 1180.85 | +1%˄ || 0.85 | 0.85 | -1%˄ | (run time too short) |
| 16d || 1137.42 | 1131.92 | -0%˄ || 0.88 | 0.88 | +0%˄ | (run time too short) |
| 17a || 229.81 | 235.55 | +2%˄ || 4.35 | 4.24 | -2%˄ | (run time too short) |
| 17b || 185.19 | 190.41 | +3%˄ || 5.40 | 5.25 | -3%˄ | (run time too short) |
-| 17c || 153.02 | 163.36 | +7%˄ || 6.53 | 6.12 | -6%˄ | (run time too short) |
| 17d || 140.02 | 140.83 | +1%˄ || 7.14 | 7.10 | -1%˄ | (run time too short) |
| 17e || 1069.49 | 1074.85 | +1%˄ || 0.93 | 0.93 | -0%˄ | (run time too short) |
| 17f || 433.23 | 435.73 | +1%˄ || 2.31 | 2.29 | -1%˄ | (run time too short) |
| 18a || 59.50 | 59.73 | +0%˄ || 16.78 | 16.72 | -0%˄ | (run time too short) |
-| 18b || 60.71 | 66.96 | +10%˄ || 16.45 | 14.92 | -9%˄ | (run time too short) |
| 18c || 153.01 | 152.78 | -0%˄ || 6.53 | 6.54 | +0%˄ | (run time too short) |
| 19a || 109.64 | 110.01 | +0%˄ || 9.11 | 9.08 | -0%˄ | (run time too short) |
| 19b || 72.64 | 72.70 | +0%˄ || 13.75 | 13.74 | -0%˄ | (run time too short) |
| 19c || 141.22 | 137.45 | -3%˄ || 7.08 | 7.27 | +3%˄ | (run time too short) |
+| 19d || 770.10 | 736.48 | -4%˄ || 1.30 | 1.36 | +5%˄ | (run time too short) |
| 1a || 7.72 | 7.68 | -1%˄ || 128.68 | 129.51 | +1%˄ | (run time too short) |
| 1b || 4.86 | 4.97 | +2%˄ || 204.03 | 199.65 | -2%˄ | (run time too short) |
| 1c || 4.45 | 4.36 | -2%˄ || 222.78 | 227.38 | +2%˄ | (run time too short) |
| 1d || 6.14 | 6.08 | -1%˄ || 161.78 | 163.45 | +1%˄ | (run time too short) |
| 20a || 92.48 | 92.83 | +0%˄ || 10.81 | 10.76 | -0%˄ | (run time too short) |
| 20b || 75.14 | 74.72 | -1%˄ || 13.30 | 13.37 | +1%˄ | (run time too short) |
| 20c || 93.10 | 93.77 | +1%˄ || 10.73 | 10.66 | -1%˄ | (run time too short) |
| 21a || 30.90 | 30.05 | -3%˄ || 32.30 | 33.21 | +3%˄ | (run time too short) |
| 21b || 26.43 | 26.11 | -1%˄ || 37.75 | 38.22 | +1%˄ | (run time too short) |
| 21c || 32.09 | 32.15 | +0%˄ || 31.11 | 31.05 | -0%˄ | (run time too short) |
| 22a || 84.10 | 87.11 | +4%˄ || 11.88 | 11.47 | -3%˄ | (run time too short) |
| 22b || 64.59 | 63.90 | -1%˄ || 15.47 | 15.63 | +1%˄ | (run time too short) |
| 22c || 143.64 | 144.04 | +0%˄ || 6.96 | 6.94 | -0%˄ | (run time too short) |
| 22d || 245.51 | 237.89 | -3%˄ || 4.07 | 4.20 | +3%˄ | (run time too short) |
| 23a || 19.43 | 18.91 | -3%˄ || 51.33 | 52.74 | +3%˄ | (run time too short) |
| 23b || 30.27 | 30.95 | +2%˄ || 32.95 | 32.23 | -2%˄ | (run time too short) |
| 23c || 21.28 | 21.36 | +0%˄ || 46.86 | 46.70 | -0%˄ | (run time too short) |
| 24a || 63.32 | 65.63 | +4%˄ || 15.78 | 15.22 | -4%˄ | (run time too short) |
-| 24b || 68.58 | 71.74 | +5%˄ || 14.56 | 13.92 | -4%˄ | (run time too short) |
| 25a || 68.19 | 69.20 | +1%˄ || 14.65 | 14.44 | -1%˄ | (run time too short) |
| 25b || 40.04 | 39.14 | -2%˄ || 24.93 | 25.51 | +2%˄ | (run time too short) |
| 25c || 208.24 | 201.18 | -3%˄ || 4.80 | 4.97 | +4%˄ | (run time too short) |
| 26a || 96.20 | 98.21 | +2%˄ || 10.39 | 10.17 | -2%˄ | (run time too short) |
| 26b || 69.95 | 69.62 | -0%˄ || 14.28 | 14.35 | +0%˄ | (run time too short) |
| 26c || 156.52 | 155.84 | -0%˄ || 6.39 | 6.41 | +0%˄ | (run time too short) |
| 27a || 26.94 | 27.31 | +1%˄ || 37.05 | 36.54 | -1%˄ | (run time too short) |
| 27b || 25.86 | 25.44 | -2%˄ || 38.58 | 39.23 | +2%˄ | (run time too short) |
| 27c || 31.45 | 31.35 | -0%˄ || 31.74 | 31.83 | +0%˄ | (run time too short) |
| 28a || 148.97 | 146.84 | -1%˄ || 6.71 | 6.80 | +1%˄ | (run time too short) |
| 28b || 32.99 | 32.84 | -0%˄ || 30.26 | 30.40 | +0%˄ | (run time too short) |
| 28c || 127.79 | 126.78 | -1%˄ || 7.82 | 7.88 | +1%˄ | (run time too short) |
| 29a || 60.69 | 60.56 | -0%˄ || 16.46 | 16.49 | +0%˄ | (run time too short) |
+| 29b || 204.81 | 175.17 | -14%˄ || 4.88 | 5.71 | +17%˄ | (run time too short) |
| 29c || 71.61 | 72.37 | +1%˄ || 13.95 | 13.80 | -1%˄ | (run time too short) |
| 2a || 27.53 | 27.99 | +2%˄ || 36.27 | 35.65 | -2%˄ | (run time too short) |
| 2b || 24.63 | 24.83 | +1%˄ || 40.54 | 40.15 | -1%˄ | (run time too short) |
| 2c || 16.82 | 16.94 | +1%˄ || 59.30 | 58.86 | -1%˄ | (run time too short) |
| 2d || 63.70 | 63.68 | -0%˄ || 15.66 | 15.68 | +0%˄ | (run time too short) |
| 30a || 58.81 | 61.16 | +4%˄ || 16.98 | 16.33 | -4%˄ | (run time too short) |
-| 30b || 43.88 | 47.27 | +8%˄ || 22.75 | 21.13 | -7%˄ | (run time too short) |
| 30c || 137.44 | 139.88 | +2%˄ || 7.27 | 7.14 | -2%˄ | (run time too short) |
| 31a || 45.69 | 46.17 | +1%˄ || 21.85 | 21.63 | -1%˄ | (run time too short) |
| 31b || 40.85 | 41.17 | +1%˄ || 24.44 | 24.25 | -1%˄ | (run time too short) |
| 31c || 49.81 | 51.29 | +3%˄ || 20.05 | 19.47 | -3%˄ | (run time too short) |
| 32a || 7.88 | 7.96 | +1%˄ || 126.19 | 125.00 | -1%˄ | (run time too short) |
| 32b || 36.46 | 36.59 | +0%˄ || 27.39 | 27.30 | -0%˄ | (run time too short) |
| 33a || 12.15 | 12.32 | +1%˄ || 81.96 | 80.85 | -1%˄ | (run time too short) |
| 33b || 9.70 | 9.79 | +1%˄ || 102.65 | 101.65 | -1%˄ | (run time too short) |
| 33c || 20.10 | 20.60 | +2%˄ || 49.63 | 48.43 | -2%˄ | (run time too short) |
| 3a || 44.18 | 44.54 | +1%˄ || 22.59 | 22.42 | -1%˄ | (run time too short) |
| 3b || 7.60 | 7.75 | +2%˄ || 131.02 | 128.44 | -2%˄ | (run time too short) |
| 3c || 85.74 | 86.20 | +1%˄ || 11.65 | 11.59 | -1%˄ | (run time too short) |
| 4a || 79.80 | 81.26 | +2%˄ || 12.52 | 12.29 | -2%˄ | (run time too short) |
-| 4b || 6.09 | 6.55 | +7%˄ || 163.16 | 151.90 | -7%˄ | (run time too short) |
| 4c || 103.54 | 102.15 | -1%˄ || 9.65 | 9.78 | +1%˄ | (run time too short) |
| 5a || 29.58 | 28.67 | -3%˄ || 33.75 | 34.82 | +3%˄ | (run time too short) |
| 5b || 22.68 | 23.19 | +2%˄ || 44.01 | 43.04 | -2%˄ | (run time too short) |
| 5c || 56.45 | 54.22 | -4%˄ || 17.69 | 18.42 | +4%˄ | (run time too short) |
| 6a || 29.94 | 30.23 | +1%˄ || 33.34 | 33.01 | -1%˄ | (run time too short) |
| 6b || 57.80 | 58.34 | +1%˄ || 17.28 | 17.12 | -1%˄ | (run time too short) |
| 6c || 27.78 | 28.61 | +3%˄ || 35.92 | 34.88 | -3%˄ | (run time too short) |
| 6d || 160.70 | 160.73 | +0%˄ || 6.22 | 6.22 | -0%˄ | (run time too short) |
| 6e || 30.18 | 29.90 | -1%˄ || 33.07 | 33.38 | +1%˄ | (run time too short) |
| 6f || 682.17 | 676.72 | -1%˄ || 1.47 | 1.48 | +1%˄ | (run time too short) |
| 7a || 26.86 | 27.05 | +1%˄ || 37.15 | 36.89 | -1%˄ | (run time too short) |
| 7b || 27.02 | 27.97 | +4%˄ || 36.94 | 35.68 | -3%˄ | (run time too short) |
| 7c || 352.37 | 346.84 | -2%˄ || 2.84 | 2.88 | +2%˄ | (run time too short) |
| 8a || 42.24 | 41.78 | -1%˄ || 23.64 | 23.90 | +1%˄ | (run time too short) |
| 8b || 38.98 | 38.53 | -1%˄ || 25.61 | 25.91 | +1%˄ | (run time too short) |
| 8c || 1713.22 | 1670.62 | -2% || 0.58 | 0.60 | +3% | 0.0004 |
| 8d || 292.16 | 294.20 | +1%˄ || 3.42 | 3.40 | -1%˄ | (run time too short) |
| 9a || 167.95 | 162.65 | -3%˄ || 5.95 | 6.14 | +3%˄ | (run time too short) |
| 9b || 92.68 | 93.73 | +1%˄ || 10.78 | 10.66 | -1%˄ | (run time too short) |
| 9c || 170.45 | 168.05 | -1%˄ || 5.86 | 5.95 | +1%˄ | (run time too short) |
| 9d || 520.13 | 502.57 | -3%˄ || 1.92 | 1.99 | +3%˄ | (run time too short) |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Sum || 18927.38 | 18773.38 | -1% || | | | |
| Geomean || | | || | | +0% | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkJoinOrder - multi-threaded, shuffled, 64 clients, 64 cores Sum of avg. item runtimes: -4% || Geometric mean of throughput changes: +4%Configuration Overview - click to expand +Configuration Overview---------+-----------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkJoinOrder_29332b1ca0b941194d0cb7ba7aa2438b20442365_mt.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkJoinOrder_5ee9098de05cdcf3b290393d44461d8970302257_mt.json |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 29332b1ca0b941194d0cb7ba7aa2438b20442365-dirty | 5ee9098de05cdcf3b290393d44461d8970302257-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2024-08-11 01:43:37 | 2024-08-11 05:45:40 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+---------+
-| 10a || 195.62 | 250.26 | +28% || 1.16 | 1.21 | +4% | 0.0033 |
-| 10b || 131.11 | 139.22 | +6% || 1.16 | 1.21 | +4% | 0.5884 |
| 10c || 630.52 | 603.70 | -4% || 1.16 | 1.20 | +4% | 0.4249 |
+| 11a || 148.21 | 114.25 | -23% || 1.16 | 1.21 | +4% | 0.0405 |
| 11b || 125.63 | 120.32 | -4% || 1.16 | 1.21 | +4% | 0.7430 |
+| 11c || 109.24 | 103.10 | -6% || 1.16 | 1.21 | +4% | 0.6410 |
| 11d || 95.18 | 96.99 | +2% || 1.16 | 1.21 | +4% | 0.8861 |
| 12a || 171.99 | 177.84 | +3% || 1.16 | 1.21 | +4% | 0.7291 |
| 12b || 87.61 | 87.44 | -0% || 1.16 | 1.21 | +4% | 0.9874 |
-| 12c || 383.91 | 438.12 | +14% || 1.16 | 1.21 | +4% | 0.0453 |
-| 13a || 521.35 | 583.06 | +12% || 1.16 | 1.21 | +4% | 0.0447 |
-| 13b || 386.51 | 432.60 | +12% || 1.16 | 1.21 | +4% | 0.1080 |
-| 13c || 343.28 | 365.52 | +6% || 1.16 | 1.21 | +4% | 0.3559 |
-| 13d || 918.19 | 1043.28 | +14% || 1.16 | 1.21 | +4% | 0.0003 |
+| 14a || 495.67 | 455.66 | -8% || 1.16 | 1.21 | +4% | 0.2320 |
+| 14b || 479.17 | 440.73 | -8% || 1.16 | 1.21 | +4% | 0.2029 |
| 14c || 637.23 | 614.47 | -4% || 1.16 | 1.21 | +4% | 0.4937 |
| 15a || 129.36 | 128.24 | -1% || 1.16 | 1.21 | +4% | 0.9404 |
+| 15b || 136.38 | 120.73 | -11% || 1.16 | 1.21 | +4% | 0.3546 |
+| 15c || 153.56 | 146.32 | -5% || 1.16 | 1.21 | +4% | 0.6188 |
-| 15d || 167.04 | 201.62 | +21% || 1.16 | 1.21 | +4% | 0.0511 |
| 16a || 1684.72 | 1648.72 | -2% || 1.16 | 1.20 | +4% | 0.3617 |
| 16b || 3173.01 | 3055.06 | -4% || 1.16 | 1.20 | +4% | 0.0142 |
+| 16c || 1990.01 | 1876.89 | -6% || 1.16 | 1.20 | +4% | 0.0103 |
| 16d || 1845.63 | 1865.34 | +1% || 1.16 | 1.20 | +4% | 0.6467 |
| 17a || 971.71 | 957.57 | -1% || 1.16 | 1.21 | +4% | 0.7234 |
| 17b || 709.34 | 719.53 | +1% || 1.16 | 1.21 | +4% | 0.7583 |
| 17c || 645.73 | 657.30 | +2% || 1.16 | 1.21 | +4% | 0.7432 |
| 17d || 605.31 | 612.94 | +1% || 1.16 | 1.21 | +4% | 0.8043 |
| 17e || 1781.76 | 1737.83 | -2% || 1.16 | 1.20 | +4% | 0.3162 |
| 17f || 1211.51 | 1167.91 | -4% || 1.16 | 1.21 | +4% | 0.2766 |
+| 18a || 272.96 | 252.30 | -8% || 1.16 | 1.21 | +4% | 0.3093 |
+| 18b || 391.62 | 347.09 | -11% || 1.16 | 1.21 | +4% | 0.1139 |
+| 18c || 749.70 | 611.87 | -18% || 1.16 | 1.21 | +4% | 0.0001 |
+| 19a || 607.14 | 520.26 | -14% || 1.16 | 1.21 | +4% | 0.0082 |
+| 19b || 473.82 | 437.41 | -8% || 1.16 | 1.21 | +4% | 0.2564 |
+| 19c || 705.28 | 625.45 | -11% || 1.16 | 1.21 | +4% | 0.0223 |
+| 19d || 1457.47 | 1337.91 | -8% || 1.16 | 1.21 | +4% | 0.0052 |
-| 1a || 35.48 | 43.72 | +23% || 1.16 | 1.21 | +4% | 0.1940 |
| 1b || 47.22 | 46.80 | -1% || 1.16 | 1.21 | +4% | 0.9608 |
-| 1c || 52.78 | 65.42 | +24% || 1.16 | 1.21 | +4% | 0.2328 |
+| 1d || 42.02 | 35.77 | -15% || 1.16 | 1.21 | +4% | 0.4483 |
| 20a || 505.28 | 518.81 | +3% || 1.16 | 1.21 | +4% | 0.6749 |
-| 20b || 386.53 | 445.56 | +15% || 1.16 | 1.21 | +4% | 0.0234 |
+| 20c || 439.42 | 399.94 | -9% || 1.16 | 1.21 | +4% | 0.1638 |
+| 21a || 254.56 | 159.53 | -37% || 1.16 | 1.21 | +4% | 0.0000 |
| 21b || 153.82 | 154.80 | +1% || 1.16 | 1.21 | +4% | 0.9572 |
+| 21c || 228.85 | 168.24 | -26% || 1.16 | 1.21 | +4% | 0.0035 |
+| 22a || 569.02 | 520.48 | -9% || 1.16 | 1.21 | +4% | 0.1377 |
+| 22b || 459.31 | 417.94 | -9% || 1.16 | 1.21 | +4% | 0.1572 |
| 22c || 719.36 | 718.32 | -0% || 1.16 | 1.21 | +4% | 0.9773 |
| 22d || 1021.35 | 1053.83 | +3% || 1.16 | 1.21 | +4% | 0.4681 |
-| 23a || 159.73 | 176.44 | +10% || 1.16 | 1.21 | +4% | 0.3832 |
| 23b || 130.36 | 125.56 | -4% || 1.16 | 1.21 | +4% | 0.7403 |
-| 23c || 149.87 | 172.67 | +15% || 1.16 | 1.21 | +4% | 0.1365 |
| 24a || 407.73 | 403.31 | -1% || 1.16 | 1.21 | +4% | 0.8785 |
+| 24b || 320.39 | 261.61 | -18% || 1.16 | 1.21 | +4% | 0.0084 |
| 25a || 463.70 | 471.14 | +2% || 1.16 | 1.21 | +4% | 0.8001 |
+| 25b || 274.12 | 178.45 | -35% || 1.16 | 1.21 | +4% | 0.0000 |
+| 25c || 973.82 | 883.55 | -9% || 1.16 | 1.21 | +4% | 0.0243 |
-| 26a || 426.25 | 449.88 | +6% || 1.16 | 1.21 | +4% | 0.3171 |
| 26b || 280.37 | 273.79 | -2% || 1.16 | 1.21 | +4% | 0.7468 |
| 26c || 660.60 | 633.10 | -4% || 1.16 | 1.21 | +4% | 0.3636 |
+| 27a || 183.31 | 167.27 | -9% || 1.16 | 1.21 | +4% | 0.3718 |
| 27b || 182.45 | 183.07 | +0% || 1.16 | 1.21 | +4% | 0.9749 |
+| 27c || 235.72 | 171.88 | -27% || 1.16 | 1.21 | +4% | 0.0026 |
+| 28a || 760.12 | 699.30 | -8% || 1.16 | 1.21 | +4% | 0.1080 |
+| 28b || 278.01 | 248.03 | -11% || 1.16 | 1.21 | +4% | 0.1999 |
-| 28c || 633.96 | 693.87 | +9% || 1.16 | 1.21 | +4% | 0.0748 |
+| 29a || 316.33 | 260.64 | -18% || 1.16 | 1.21 | +4% | 0.0103 |
+| 29b || 406.61 | 343.13 | -16% || 1.16 | 1.21 | +4% | 0.0128 |
+| 29c || 389.19 | 320.01 | -18% || 1.16 | 1.21 | +4% | 0.0066 |
-| 2a || 135.42 | 169.45 | +25% || 1.16 | 1.21 | +4% | 0.0195 |
-| 2b || 120.35 | 148.82 | +24% || 1.16 | 1.21 | +4% | 0.0357 |
+| 2c || 112.46 | 96.06 | -15% || 1.16 | 1.21 | +4% | 0.2528 |
-| 2d || 233.54 | 275.22 | +18% || 1.16 | 1.21 | +4% | 0.0255 |
+| 30a || 379.16 | 340.98 | -10% || 1.16 | 1.21 | +4% | 0.1534 |
+| 30b || 403.16 | 304.62 | -24% || 1.16 | 1.21 | +4% | 0.0008 |
| 30c || 706.33 | 700.64 | -1% || 1.16 | 1.21 | +4% | 0.8732 |
+| 31a || 333.28 | 270.13 | -19% || 1.16 | 1.21 | +4% | 0.0213 |
+| 31b || 299.89 | 182.81 | -39% || 1.16 | 1.21 | +4% | 0.0000 |
+| 31c || 379.65 | 252.25 | -34% || 1.16 | 1.21 | +4% | 0.0000 |
| 32a || 47.30 | 46.28 | -2% || 1.16 | 1.21 | +4% | 0.8758 |
+| 32b || 190.36 | 165.09 | -13% || 1.16 | 1.21 | +4% | 0.0864 |
+| 33a || 168.22 | 135.93 | -19% || 1.16 | 1.21 | +4% | 0.0698 |
-| 33b || 95.24 | 122.14 | +28% || 1.16 | 1.21 | +4% | 0.1065 |
+| 33c || 222.30 | 198.55 | -11% || 1.16 | 1.21 | +4% | 0.3271 |
+| 3a || 317.85 | 243.12 | -24% || 1.16 | 1.21 | +4% | 0.0023 |
+| 3b || 91.65 | 59.66 | -35% || 1.16 | 1.21 | +4% | 0.0099 |
+| 3c || 485.79 | 432.28 | -11% || 1.16 | 1.21 | +4% | 0.1005 |
-| 4a || 300.32 | 342.24 | +14% || 1.16 | 1.21 | +4% | 0.0801 |
-| 4b || 71.24 | 75.73 | +6% || 1.16 | 1.21 | +4% | 0.7283 |
-| 4c || 340.28 | 385.59 | +13% || 1.16 | 1.21 | +4% | 0.0813 |
+| 5a || 261.83 | 186.15 | -29% || 1.16 | 1.21 | +4% | 0.0009 |
+| 5b || 158.55 | 145.76 | -8% || 1.16 | 1.21 | +4% | 0.5170 |
+| 5c || 355.41 | 281.47 | -21% || 1.16 | 1.21 | +4% | 0.0064 |
-| 6a || 164.97 | 179.78 | +9% || 1.16 | 1.21 | +4% | 0.4175 |
| 6b || 229.91 | 220.25 | -4% || 1.16 | 1.21 | +4% | 0.6407 |
-| 6c || 127.62 | 144.65 | +13% || 1.16 | 1.21 | +4% | 0.2324 |
| 6d || 568.71 | 584.04 | +3% || 1.16 | 1.21 | +4% | 0.6081 |
-| 6e || 158.97 | 167.89 | +6% || 1.16 | 1.21 | +4% | 0.6196 |
+| 6f || 1200.99 | 1143.50 | -5% || 1.16 | 1.21 | +4% | 0.0582 |
-| 7a || 196.56 | 207.22 | +5% || 1.16 | 1.21 | +4% | 0.6241 |
| 7b || 200.87 | 200.76 | -0% || 1.16 | 1.21 | +4% | 0.9963 |
+| 7c || 1137.96 | 1065.16 | -6% || 1.16 | 1.21 | +4% | 0.0546 |
| 8a || 217.60 | 215.04 | -1% || 1.16 | 1.21 | +4% | 0.9052 |
-| 8b || 176.61 | 202.49 | +15% || 1.16 | 1.21 | +4% | 0.2068 |
| 8c || 2365.12 | 2324.52 | -2% || 1.16 | 1.20 | +4% | 0.3586 |
-| 8d || 707.69 | 766.49 | +8% || 1.16 | 1.21 | +4% | 0.0963 |
| 9a || 715.55 | 691.81 | -3% || 1.16 | 1.21 | +4% | 0.5368 |
-| 9b || 482.42 | 515.79 | +7% || 1.16 | 1.21 | +4% | 0.2843 |
+| 9c || 747.96 | 664.67 | -11% || 1.16 | 1.21 | +4% | 0.0401 |
| 9d || 1119.26 | 1091.95 | -2% || 1.16 | 1.21 | +4% | 0.4735 |
+---------++----------+----------+--------++----------+----------+--------+---------+
| Sum || 54999.41 | 52907.70 | -4% || | | | |
| Geomean || | | || | | +4% | |
+---------++----------+----------+--------++----------+----------+--------+---------+hyriseBenchmarkStarSchema - single-threaded Sum of avg. item runtimes: +4% || Geometric mean of throughput changes: -3%Configuration Overview - click to expand +Configuration Overview---+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkStarSchema_29332b1ca0b941194d0cb7ba7aa2438b20442365_st.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkStarSchema_5ee9098de05cdcf3b290393d44461d8970302257_st.json |
+-------------------------+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 29332b1ca0b941194d0cb7ba7aa2438b20442365-dirty | 5ee9098de05cdcf3b290393d44461d8970302257-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-08-11 02:04:11 | 2024-08-11 06:06:16 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| 1.1 || 449.18 | 461.52 | +3%˄ || 2.23 | 2.17 | -3%˄ | (run time too short) |
| 1.2 || 226.30 | 228.45 | +1%˄ || 4.42 | 4.38 | -1%˄ | (run time too short) |
| 1.3 || 216.68 | 225.57 | +4%˄ || 4.62 | 4.43 | -4%˄ | (run time too short) |
| 2.1 || 761.68 | 768.77 | +1%˄ || 1.31 | 1.30 | -1%˄ | (run time too short) |
| 2.2 || 420.54 | 422.34 | +0%˄ || 2.38 | 2.37 | -0%˄ | (run time too short) |
| 2.3 || 260.13 | 260.67 | +0%˄ || 3.84 | 3.84 | -0%˄ | (run time too short) |
| 3.1 || 2842.22 | 2957.56 | +4% || 0.35 | 0.34 | -4% | 0.0006 |
-| 3.2 || 393.50 | 413.45 | +5%˄ || 2.54 | 2.42 | -5%˄ | (run time too short) |
| 3.3 || 154.29 | 161.23 | +4%˄ || 6.48 | 6.20 | -4%˄ | (run time too short) |
| 3.4 || 147.32 | 152.27 | +3%˄ || 6.79 | 6.57 | -3%˄ | (run time too short) |
-| 4.1 || 3205.98 | 3392.73 | +6% || 0.31 | 0.29 | -6% | 0.0000 |
| 4.2 || 934.35 | 939.61 | +1%˄ || 1.07 | 1.06 | -1%˄ | (run time too short) |
| 4.3 || 287.66 | 299.23 | +4%˄ || 3.48 | 3.34 | -4%˄ | (run time too short) |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Sum || 10299.83 | 10683.39 | +4% || | | | |
| Geomean || | | || | | -3% | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkStarSchema - multi-threaded, ordered, 1 client, 64 cores Sum of avg. item runtimes: -1% || Geometric mean of throughput changes: -0%Configuration Overview - click to expand +Configuration Overview---------+--------------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkStarSchema_29332b1ca0b941194d0cb7ba7aa2438b20442365_mt_ordered.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkStarSchema_5ee9098de05cdcf3b290393d44461d8970302257_mt_ordered.json |
+-------------------------------+--------------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 29332b1ca0b941194d0cb7ba7aa2438b20442365-dirty | 5ee9098de05cdcf3b290393d44461d8970302257-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2024-08-11 02:10:33 | 2024-08-11 06:12:43 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------------+--------------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------+ +---------++----------+---------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| 1.1 || 139.15 | 137.71 | -1%˄ || 7.18 | 7.26 | +1%˄ | (run time too short) |
| 1.2 || 94.32 | 93.13 | -1%˄ || 10.59 | 10.73 | +1%˄ | (run time too short) |
| 1.3 || 91.19 | 90.26 | -1%˄ || 10.95 | 11.07 | +1%˄ | (run time too short) |
| 2.1 || 413.25 | 418.90 | +1%˄ || 2.42 | 2.39 | -1%˄ | (run time too short) |
| 2.2 || 198.53 | 200.87 | +1%˄ || 5.03 | 4.98 | -1%˄ | (run time too short) |
| 2.3 || 71.85 | 72.55 | +1%˄ || 13.90 | 13.77 | -1%˄ | (run time too short) |
| 3.1 || 1179.95 | 1146.67 | -3%˄ || 0.85 | 0.87 | +3%˄ | (run time too short) |
| 3.2 || 190.17 | 195.24 | +3%˄ || 5.26 | 5.12 | -3%˄ | (run time too short) |
| 3.3 || 89.87 | 90.03 | +0%˄ || 11.12 | 11.10 | -0%˄ | (run time too short) |
| 3.4 || 80.10 | 80.83 | +1%˄ || 12.47 | 12.36 | -1%˄ | (run time too short) |
| 4.1 || 1054.06 | 1043.67 | -1%˄ || 0.95 | 0.96 | +1%˄ | (run time too short) |
| 4.2 || 417.56 | 419.24 | +0%˄ || 2.39 | 2.38 | -0%˄ | (run time too short) |
| 4.3 || 122.10 | 125.63 | +3%˄ || 8.18 | 7.96 | -3%˄ | (run time too short) |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| Sum || 4142.11 | 4114.73 | -1% || | | | |
| Geomean || | | || | | -0% | |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+---------+--------++----------+----------+--------+----------------------+hyriseBenchmarkStarSchema - multi-threaded, shuffled, 64 clients, 64 cores Sum of avg. item runtimes: -3% || Geometric mean of throughput changes: +4%Configuration Overview - click to expand +Configuration Overview---------+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkStarSchema_29332b1ca0b941194d0cb7ba7aa2438b20442365_mt.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkStarSchema_5ee9098de05cdcf3b290393d44461d8970302257_mt.json |
+-------------------------------+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 29332b1ca0b941194d0cb7ba7aa2438b20442365-dirty | 5ee9098de05cdcf3b290393d44461d8970302257-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2024-08-11 02:14:49 | 2024-08-11 06:16:55 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+---------+
+| 1.1 || 838.95 | 735.00 | -12% || 3.72 | 3.85 | +4% | 0.0000 |
+| 1.2 || 480.82 | 432.76 | -10% || 3.72 | 3.85 | +4% | 0.0004 |
+| 1.3 || 415.08 | 392.83 | -5% || 3.72 | 3.85 | +4% | 0.0560 |
+| 2.1 || 2110.17 | 1593.27 | -24% || 3.71 | 3.85 | +4% | 0.0000 |
+| 2.2 || 1092.73 | 996.26 | -9% || 3.72 | 3.85 | +4% | 0.0001 |
-| 2.3 || 376.99 | 474.43 | +26% || 3.72 | 3.85 | +4% | 0.0000 |
| 3.1 || 3372.27 | 3274.36 | -3% || 3.71 | 3.84 | +4% | 0.0027 |
| 3.2 || 1033.09 | 1016.23 | -2% || 3.72 | 3.85 | +4% | 0.4695 |
+| 3.3 || 490.53 | 467.03 | -5% || 3.72 | 3.85 | +4% | 0.1497 |
+| 3.4 || 503.37 | 441.71 | -12% || 3.72 | 3.85 | +4% | 0.0006 |
-| 4.1 || 3280.54 | 3474.77 | +6% || 3.71 | 3.84 | +4% | 0.0000 |
| 4.2 || 2460.27 | 2492.83 | +1% || 3.71 | 3.85 | +4% | 0.3766 |
-| 4.3 || 726.74 | 796.95 | +10% || 3.72 | 3.85 | +4% | 0.0007 |
+---------++----------+----------+--------++----------+----------+--------+---------+
| Sum || 17181.56 | 16588.42 | -3% || | | | |
| Geomean || | | || | | +4% | |
+---------++----------+----------+--------++----------+----------+--------+---------+ |
IntelSystem nx05 - click to expand
Commit Info and Build Time
hyriseBenchmarkTPCH - single-threaded, SF 10.0 Sum of avg. item runtimes: +2% || Geometric mean of throughput changes: -1%Configuration Overview - click to expand +Configuration Overview----+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCH_29332b1ca0b941194d0cb7ba7aa2438b20442365_st.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCH_5ee9098de05cdcf3b290393d44461d8970302257_st.json |
+--------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 29332b1ca0b941194d0cb7ba7aa2438b20442365-dirty | 5ee9098de05cdcf3b290393d44461d8970302257-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-08-10 22:19:35 | 2024-08-11 02:01:47 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+--------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+ +----------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| TPC-H 01 || 6634.51 | 6726.26 | +1% || 0.15 | 0.15 | -1% | ˅ |
| TPC-H 02 || 38.56 | 38.67 | +0%˄ || 25.93 | 25.86 | -0%˄ | (run time too short) |
| TPC-H 03 || 1200.81 | 1238.28 | +3%˄ || 0.83 | 0.81 | -3%˄ | 0.0001 |
| TPC-H 04 || 1313.01 | 1356.72 | +3% || 0.76 | 0.74 | -3% | 0.0001 |
| TPC-H 05 || 1768.46 | 1793.53 | +1% || 0.57 | 0.56 | -1% | 0.0001 |
| TPC-H 06 || 162.64 | 163.15 | +0%˄ || 6.15 | 6.13 | -0%˄ | (run time too short) |
| TPC-H 07 || 639.83 | 652.96 | +2%˄ || 1.56 | 1.53 | -2%˄ | (run time too short) |
| TPC-H 08 || 415.94 | 422.72 | +2%˄ || 2.40 | 2.37 | -2%˄ | (run time too short) |
| TPC-H 09 || 4347.19 | 4404.57 | +1% || 0.23 | 0.23 | -1% | 0.0065 |
| TPC-H 10 || 1088.48 | 1113.67 | +2%˄ || 0.92 | 0.90 | -2%˄ | (run time too short) |
| TPC-H 11 || 54.42 | 55.18 | +1%˄ || 18.37 | 18.12 | -1%˄ | (run time too short) |
| TPC-H 12 || 833.55 | 836.60 | +0%˄ || 1.20 | 1.20 | -0%˄ | (run time too short) |
| TPC-H 13 || 4289.54 | 4352.35 | +1% || 0.23 | 0.23 | -1% | 0.0342 |
| TPC-H 14 || 355.07 | 358.87 | +1%˄ || 2.82 | 2.79 | -1%˄ | (run time too short) |
| TPC-H 15 || 160.75 | 164.48 | +2%˄ || 6.22 | 6.08 | -2%˄ | (run time too short) |
| TPC-H 16 || 507.83 | 511.68 | +1%˄ || 1.97 | 1.95 | -1%˄ | (run time too short) |
| TPC-H 17 || 160.68 | 160.26 | -0%˄ || 6.22 | 6.24 | +0%˄ | (run time too short) |
| TPC-H 18 || 1634.08 | 1661.68 | +2% || 0.61 | 0.60 | -2% | 0.1314 |
| TPC-H 19 || 198.52 | 200.79 | +1%˄ || 5.04 | 4.98 | -1%˄ | (run time too short) |
-| TPC-H 20 || 409.82 | 428.43 | +5%˄ || 2.44 | 2.33 | -4%˄ | (run time too short) |
| TPC-H 21 || 3040.58 | 3056.65 | +1% || 0.33 | 0.33 | -1% | 0.1779 |
| TPC-H 22 || 429.63 | 433.99 | +1%˄ || 2.33 | 2.30 | -1%˄ | (run time too short) |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| Sum || 29683.90 | 30131.50 | +2% || | | | |
| Geomean || | | || | | -1% | |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
| || ˅ Insufficient number of runs for p-value calculation |
+----------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCH - single-threaded, SF 0.01 Sum of avg. item runtimes: +1% || Geometric mean of throughput changes: +0%Configuration Overview - click to expand +Configuration Overview----+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCH_29332b1ca0b941194d0cb7ba7aa2438b20442365_st_s01.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCH_5ee9098de05cdcf3b290393d44461d8970302257_st_s01.json |
+--------------------------+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 29332b1ca0b941194d0cb7ba7aa2438b20442365-dirty | 5ee9098de05cdcf3b290393d44461d8970302257-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-08-10 22:34:28 | 2024-08-11 02:16:41 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 0.009999999776482582 | 0.009999999776482582 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+--------------------------+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+ +----------++----------+---------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+----------++----------+---------+--------++----------+----------+--------+----------------------+
| TPC-H 01 || 5.95 | 5.78 | -3%˄ || 168.11 | 172.87 | +3%˄ | (run time too short) |
| TPC-H 02 || 4.03 | 3.94 | -2%˄ || 248.22 | 253.57 | +2%˄ | (run time too short) |
| TPC-H 03 || 0.52 | 0.51 | -1%˄ || 1925.26 | 1937.22 | +1%˄ | (run time too short) |
| TPC-H 04 || 0.39 | 0.39 | -0%˄ || 2556.59 | 2567.44 | +0%˄ | (run time too short) |
| TPC-H 05 || 0.99 | 1.02 | +3%˄ || 1008.35 | 976.64 | -3%˄ | (run time too short) |
| TPC-H 06 || 0.16 | 0.16 | +0%˄ || 6073.03 | 6065.08 | -0%˄ | (run time too short) |
-| TPC-H 07 || 9.20 | 9.68 | +5%˄ || 108.67 | 103.28 | -5%˄ | (run time too short) |
| TPC-H 08 || 15.30 | 15.32 | +0%˄ || 65.36 | 65.28 | -0%˄ | (run time too short) |
-| TPC-H 09 || 3.45 | 3.80 | +10%˄ || 289.95 | 262.80 | -9%˄ | (run time too short) |
| TPC-H 10 || 0.65 | 0.63 | -3%˄ || 1537.00 | 1580.74 | +3%˄ | (run time too short) |
| TPC-H 11 || 0.18 | 0.17 | -3%˄ || 5614.45 | 5769.99 | +3%˄ | (run time too short) |
| TPC-H 12 || 0.61 | 0.60 | -1%˄ || 1635.45 | 1650.56 | +1%˄ | (run time too short) |
| TPC-H 13 || 2.30 | 2.28 | -1%˄ || 433.73 | 438.38 | +1%˄ | (run time too short) |
| TPC-H 14 || 0.31 | 0.31 | +1%˄ || 3233.82 | 3207.67 | -1%˄ | (run time too short) |
| TPC-H 15 || 1.30 | 1.27 | -2%˄ || 769.78 | 781.94 | +2%˄ | (run time too short) |
| TPC-H 16 || 2.09 | 2.06 | -1%˄ || 478.67 | 484.48 | +1%˄ | (run time too short) |
| TPC-H 17 || 0.50 | 0.52 | +3%˄ || 1982.06 | 1925.57 | -3%˄ | (run time too short) |
| TPC-H 18 || 1.27 | 1.25 | -2%˄ || 787.09 | 800.12 | +2%˄ | (run time too short) |
| TPC-H 19 || 4.93 | 4.93 | +0%˄ || 202.77 | 202.70 | -0%˄ | (run time too short) |
| TPC-H 20 || 2.54 | 2.55 | +1%˄ || 394.11 | 391.11 | -1%˄ | (run time too short) |
+| TPC-H 21 || 1.08 | 1.00 | -7%˄ || 928.80 | 994.11 | +7%˄ | (run time too short) |
| TPC-H 22 || 1.14 | 1.13 | -1%˄ || 872.77 | 883.52 | +1%˄ | (run time t
426B
oo short) |
+----------++----------+---------+--------++----------+----------+--------+----------------------+
| Sum || 58.87 | 59.34 | +1% || | | | |
| Geomean || | | || | | +0% | |
+----------++----------+---------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+----------++----------+---------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCH - multi-threaded, ordered, 1 client, 32 cores, SF 10.0 Sum of avg. item runtimes: -0% || Geometric mean of throughput changes: +1%Configuration Overview - click to expand +Configuration Overview---------+----------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCH_29332b1ca0b941194d0cb7ba7aa2438b20442365_mt_ordered.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCH_5ee9098de05cdcf3b290393d44461d8970302257_mt_ordered.json |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 29332b1ca0b941194d0cb7ba7aa2438b20442365-dirty | 5ee9098de05cdcf3b290393d44461d8970302257-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 32 | 32 |
| data_preparation_cores | 0 | 0 |
| date | 2024-08-10 22:34:53 | 2024-08-11 02:17:06 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [32] | [32] |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------+ +----------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| TPC-H 01 || 5119.53 | 5184.18 | +1% || 0.20 | 0.19 | -1% | 0.0302 |
| TPC-H 02 || 68.72 | 68.23 | -1%˄ || 14.54 | 14.65 | +1%˄ | (run time too short) |
| TPC-H 03 || 742.37 | 730.52 | -2%˄ || 1.35 | 1.37 | +2%˄ | (run time too short) |
| TPC-H 04 || 649.33 | 633.32 | -2%˄ || 1.54 | 1.58 | +3%˄ | (run time too short) |
| TPC-H 05 || 590.47 | 585.62 | -1%˄ || 1.69 | 1.71 | +1%˄ | (run time too short) |
| TPC-H 06 || 74.92 | 73.59 | -2%˄ || 13.34 | 13.58 | +2%˄ | (run time too short) |
| TPC-H 07 || 295.10 | 291.97 | -1%˄ || 3.39 | 3.42 | +1%˄ | (run time too short) |
| TPC-H 08 || 276.54 | 275.92 | -0%˄ || 3.62 | 3.62 | +0%˄ | (run time too short) |
| TPC-H 09 || 1755.63 | 1735.85 | -1% || 0.57 | 0.58 | +1% | 0.0539 |
| TPC-H 10 || 595.31 | 584.45 | -2%˄ || 1.68 | 1.71 | +2%˄ | (run time too short) |
| TPC-H 11 || 89.98 | 92.87 | +3%˄ || 11.11 | 10.76 | -3%˄ | (run time too short) |
| TPC-H 12 || 508.43 | 505.64 | -1%˄ || 1.97 | 1.98 | +1%˄ | (run time too short) |
| TPC-H 13 || 1936.70 | 1930.39 | -0% || 0.52 | 0.52 | +0% | 0.2964 |
| TPC-H 14 || 164.83 | 165.37 | +0%˄ || 6.07 | 6.05 | -0%˄ | (run time too short) |
| TPC-H 15 || 143.62 | 142.80 | -1%˄ || 6.96 | 7.00 | +1%˄ | (run time too short) |
| TPC-H 16 || 628.13 | 632.06 | +1%˄ || 1.59 | 1.58 | -1%˄ | (run time too short) |
| TPC-H 17 || 93.16 | 91.72 | -2%˄ || 10.73 | 10.90 | +2%˄ | (run time too short) |
| TPC-H 18 || 1879.21 | 1858.18 | -1% || 0.53 | 0.54 | +1% | 0.4848 |
| TPC-H 19 || 130.99 | 131.54 | +0%˄ || 7.63 | 7.60 | -0%˄ | (run time too short) |
+| TPC-H 20 || 238.33 | 227.83 | -4%˄ || 4.20 | 4.39 | +5%˄ | (run time too short) |
| TPC-H 21 || 1033.84 | 1018.17 | -2%˄ || 0.97 | 0.98 | +2%˄ | (run time too short) |
| TPC-H 22 || 169.29 | 162.99 | -4%˄ || 5.91 | 6.13 | +4%˄ | (run time too short) |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| Sum || 17184.44 | 17123.21 | -0% || | | | |
| Geomean || | | || | | +1% | |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+----------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCH - multi-threaded, shuffled, 32 clients, 32 cores, SF 10.0 Sum of avg. item runtimes: -1% || Geometric mean of throughput changes: +1%Configuration Overview - click to expand +Configuration Overview---------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCH_29332b1ca0b941194d0cb7ba7aa2438b20442365_mt.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCH_5ee9098de05cdcf3b290393d44461d8970302257_mt.json |
+-------------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 29332b1ca0b941194d0cb7ba7aa2438b20442365-dirty | 5ee9098de05cdcf3b290393d44461d8970302257-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 32 | 32 |
| clustering | None | None |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 32 | 32 |
| data_preparation_cores | 0 | 0 |
| date | 2024-08-10 22:46:57 | 2024-08-11 02:29:07 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [32] | [32] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+ +----------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+----------++----------+----------+--------++----------+----------+--------+---------+
| TPC-H 01 || 5637.13 | 5727.73 | +2% || 0.78 | 0.79 | +1% | 0.1230 |
-| TPC-H 02 || 313.68 | 411.36 | +31% || 0.78 | 0.79 | +1% | 0.0795 |
-| TPC-H 03 || 1929.64 | 2068.14 | +7% || 0.78 | 0.79 | +1% | 0.2339 |
| TPC-H 04 || 1518.04 | 1500.11 | -1% || 0.78 | 0.79 | +1% | 0.8496 |
| TPC-H 05 || 2659.13 | 2684.49 | +1% || 0.78 | 0.79 | +1% | 0.8607 |
+| TPC-H 06 || 436.61 | 364.41 | -17% || 0.78 | 0.79 | +1% | 0.0920 |
| TPC-H 07 || 2125.44 | 2056.23 | -3% || 0.78 | 0.79 | +1% | 0.6110 |
| TPC-H 08 || 1497.52 | 1469.56 | -2% || 0.78 | 0.79 | +1% | 0.7971 |
| TPC-H 09 || 4069.05 | 3893.41 | -4% || 0.78 | 0.79 | +2% | 0.2365 |
| TPC-H 10 || 2302.86 | 2298.30 | -0% || 0.78 | 0.79 | +1% | 0.9717 |
| TPC-H 11 || 331.57 | 336.80 | +2% || 0.78 | 0.79 | +1% | 0.9041 |
+| TPC-H 12 || 1663.33 | 1563.62 | -6% || 0.78 | 0.79 | +1% | 0.3108 |
| TPC-H 13 || 3829.30 | 3847.53 | +0% || 0.78 | 0.79 | +1% | 0.8375 |
-| TPC-H 14 || 675.06 | 714.09 | +6% || 0.78 | 0.79 | +1% | 0.5354 |
+| TPC-H 15 || 503.89 | 448.51 | -11% || 0.78 | 0.79 | +1% | 0.3438 |
+| TPC-H 16 || 1611.34 | 1531.21 | -5% || 0.78 | 0.79 | +1% | 0.4155 |
| TPC-H 17 || 531.65 | 555.14 | +4% || 0.78 | 0.79 | +1% | 0.7216 |
| TPC-H 18 || 2925.74 | 2823.11 | -4% || 0.78 | 0.79 | +1% | 0.2316 |
+| TPC-H 19 || 827.52 | 774.22 | -6% || 0.78 | 0.79 | +1% | 0.5231 |
+| TPC-H 20 || 1256.78 | 1107.75 | -12% || 0.78 | 0.79 | +1% | 0.1213 |
| TPC-H 21 || 3229.51 | 3344.41 | +4% || 0.78 | 0.79 | +1% | 0.4177 |
+| TPC-H 22 || 901.94 | 757.82 | -16% || 0.78 | 0.79 | +1% | 0.1132 |
+----------++----------+----------+--------++----------+----------+--------+---------+
| Sum || 40776.74 | 40277.95 | -1% || | | | |
| Geomean || | | || | | +1% | |
+----------++----------+----------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCDS - single-threaded Sum of avg. item runtimes: -2% || Geometric mean of throughput changes: +1%Configuration Overview - click to expand +Configuration Overview---+---------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCDS_29332b1ca0b941194d0cb7ba7aa2438b20442365_st.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCDS_5ee9098de05cdcf3b290393d44461d8970302257_st.json |
+-------------------------+---------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 29332b1ca0b941194d0cb7ba7aa2438b20442365-dirty | 5ee9098de05cdcf3b290393d44461d8970302257-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-08-10 23:08:28 | 2024-08-11 02:50:43 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+---------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| 01 || 216.71 | 213.41 | -2%˄ || 4.61 | 4.69 | +2%˄ | (run time too short) |
| 03 || 55.96 | 58.05 | +4%˄ || 17.87 | 17.22 | -4%˄ | (run time too short) |
| 06 || 177.50 | 174.50 | -2%˄ || 5.63 | 5.73 | +2%˄ | (run time too short) |
| 07 || 267.29 | 268.32 | +0%˄ || 3.74 | 3.73 | -0%˄ | (run time too short) |
| 09 || 581.60 | 583.82 | +0%˄ || 1.72 | 1.71 | -0%˄ | (run time too short) |
| 10 || 137.89 | 134.24 | -3%˄ || 7.25 | 7.45 | +3%˄ | (run time too short) |
| 13 || 473.62 | 473.51 | -0%˄ || 2.11 | 2.11 | +0%˄ | (run time too short) |
| 15 || 106.62 | 103.47 | -3%˄ || 9.38 | 9.66 | +3%˄ | (run time too short) |
| 16 || 67.28 | 69.45 | +3%˄ || 14.86 | 14.40 | -3%˄ | (run time too short) |
| 17 || 293.94 | 294.24 | +0%˄ || 3.40 | 3.40 | -0%˄ | (run time too short) |
| 19 || 98.32 | 97.78 | -1%˄ || 10.17 | 10.23 | +1%˄ | (run time too short) |
| 25 || 161.55 | 164.46 | +2%˄ || 6.19 | 6.08 | -2%˄ | (run time too short) |
| 26 || 116.45 | 121.32 | +4%˄ || 8.59 | 8.24 | -4%˄ | (run time too short) |
| 28 || 587.65 | 578.89 | -1%˄ || 1.70 | 1.73 | +2%˄ | (run time too short) |
| 29 || 468.46 | 467.26 | -0%˄ || 2.13 | 2.14 | +0%˄ | (run time too short) |
| 31 || 1209.27 | 1198.01 | -1%˄ || 0.83 | 0.83 | +1%˄ | 0.0000 |
| 32 || 33.11 | 33.41 | +1%˄ || 30.20 | 29.93 | -1%˄ | (run time too short) |
| 34 || 153.24 | 149.09 | -3%˄ || 6.53 | 6.71 | +3%˄ | (run time too short) |
| 35 || 581.12 | 576.02 | -1%˄ || 1.72 | 1.74 | +1%˄ | (run time too short) |
-| 37 || 427.83 | 454.29 | +6%˄ || 2.34 | 2.20 | -6%˄ | (run time too short) |
| 39a || 1482.42 | 1471.79 | -1% || 0.67 | 0.68 | +1% | 0.0453 |
| 39b || 1494.89 | 1453.58 | -3% || 0.67 | 0.69 | +3% | 0.0000 |
| 41 || 282.87 | 281.89 | -0%˄ || 3.54 | 3.55 | +0%˄ | (run time too short) |
| 42 || 80.59 | 80.57 | -0%˄ || 12.41 | 12.41 | +0%˄ | (run time too short) |
| 43 || 906.57 | 905.16 | -0%˄ || 1.10 | 1.10 | +0%˄ | (run time too short) |
| 45 || 103.83 | 100.54 | -3%˄ || 9.63 | 9.95 | +3%˄ | (run time too short) |
| 48 || 1035.22 | 1005.61 | -3%˄ || 0.97 | 0.99 | +3%˄ | (run time too short) |
| 50 || 118.81 | 118.14 | -1%˄ || 8.42 | 8.46 | +1%˄ | (run time too short) |
| 52 || 78.05 | 78.26 | +0%˄ || 12.81 | 12.78 | -0%˄ | (run time too short) |
| 55 || 77.10 | 76.68 | -1%˄ || 12.97 | 13.04 | +1%˄ | (run time too short) |
| 62 || 570.52 | 578.85 | +1%˄ || 1.75 | 1.73 | -1%˄ | (run time too short) |
| 65 || 1565.71 | 1528.08 | -2% || 0.64 | 0.65 | +2% | 0.0000 |
| 69 || 146.98 | 144.49 | -2%˄ || 6.80 | 6.92 | +2%˄ | (run time too short) |
| 73 || 83.06 | 80.63 | -3%˄ || 12.04 | 12.40 | +3%˄ | (run time too short) |
| 79 || 447.94 | 444.76 | -1%˄ || 2.23 | 2.25 | +1%˄ | (run time too short) |
| 81 || 138.14 | 135.40 | -2%˄ || 7.24 | 7.39 | +2%˄ | (run time too short) |
| 82 || 490.57 | 495.62 | +1%˄ || 2.04 | 2.02 | -1%˄ | (run time too short) |
+| 83 || 35.80 | 33.79 | -6%˄ || 27.93 | 29.59 | +6%˄ | (run time too short) |
| 84 || 10.69 | 10.75 | +1%˄ || 93.49 | 93.00 | -1%˄ | (run time too short) |
| 85 || 148.56 | 148.47 | -0%˄ || 6.73 | 6.74 | +0%˄ | (run time too short) |
| 88 || 663.43 | 651.64 | -2%˄ || 1.51 | 1.53 | +2%˄ | (run time too short) |
| 91 || 15.06 | 14.98 | -1%˄ || 66.38 | 66.75 | +1%˄ | (run time too short) |
| 92 || 25.57 | 24.61 | -4%˄ || 39.10 | 40.63 | +4%˄ | (run time too short) |
| 93 || 3347.09 | 3270.44 | -2% || 0.30 | 0.31 | +2% | 0.0000 |
| 94 || 41.07 | 40.87 | -0%˄ || 24.35 | 24.47 | +0%˄ | (run time too short) |
+| 95 || 4955.77 | 4739.58 | -4% || 0.20 | 0.21 | +5% | 0.0139 |
| 96 || 65.52 | 63.70 | -3%˄ || 15.26 | 15.70 | +3%˄ | (run time too short) |
| 97 || 3951.12 | 3940.10 | -0% || 0.25 | 0.25 | +0% | 0.8332 |
| 99 || 1102.30 | 1096.17 | -1%˄ || 0.91 | 0.91 | +1%˄ | (run time too short) |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Sum || 29680.65 | 29228.73 | -2% || | | | |
| Geomean || | | || | | +1% | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCDS - multi-threaded, ordered, 1 client, 32 cores Sum of avg. item runtimes: -0% || Geometric mean of throughput changes: +1%Configuration Overview - click to expand +Configuration Overview---------+-----------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCDS_29332b1ca0b941194d0cb7ba7aa2438b20442365_mt_ordered.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCDS_5ee9098de05cdcf3b290393d44461d8970302257_mt_ordered.json |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 29332b1ca0b941194d0cb7ba7aa2438b20442365-dirty | 5ee9098de05cdcf3b290393d44461d8970302257-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 32 | 32 |
| data_preparation_cores | 0 | 0 |
| date | 2024-08-10 23:26:59 | 2024-08-11 03:09:04 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [32] | [32] |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
+| 01 || 210.07 | 191.25 | -9%˄ || 4.76 | 5.23 | +10%˄ | (run time too short) |
+| 03 || 33.26 | 30.75 | -8%˄ || 30.03 | 32.49 | +8%˄ | (run time too short) |
+| 06 || 182.55 | 158.15 | -13%˄ || 5.48 | 6.32 | +15%˄ | (run time too short) |
+| 07 || 176.90 | 166.58 | -6%˄ || 5.65 | 6.00 | +6%˄ | (run time too short) |
| 09 || 101.45 | 99.57 | -2%˄ || 9.85 | 10.04 | +2%˄ | (run time too short) |
| 10 || 53.06 | 54.61 | +3%˄ || 18.83 | 18.30 | -3%˄ | (run time too short) |
| 13 || 277.80 | 276.58 | -0%˄ || 3.60 | 3.61 | +0%˄ | (run time too short) |
-| 15 || 68.57 | 72.78 | +6%˄ || 14.57 | 13.73 | -6%˄ | (run time too short) |
| 16 || 45.17 | 44.50 | -1%˄ || 22.12 | 22.45 | +1%˄ | (run time too short) |
| 17 || 149.15 | 147.56 | -1%˄ || 6.70 | 6.78 | +1%˄ | (run time too short) |
| 19 || 89.12 | 85.36 | -4%˄ || 11.22 | 11.71 | +4%˄ | (run time too short) |
| 25 || 108.97 | 107.89 | -1%˄ || 9.17 | 9.27 | +1%˄ | (run time too short) |
| 26 || 96.29 | 96.64 | +0%˄ || 10.38 | 10.34 | -0%˄ | (run time too short) |
| 28 || 142.08 | 136.28 | -4%˄ || 7.04 | 7.34 | +4%˄ | (run time too short) |
| 29 || 535.68 | 529.58 | -1%˄ || 1.87 | 1.89 | +1%˄ | (run time too short) |
| 31 || 482.19 | 462.63 | -4%˄ || 2.07 | 2.16 | +4%˄ | (run time too short) |
| 32 || 44.06 | 43.25 | -2%˄ || 22.68 | 23.10 | +2%˄ | (run time too short) |
| 34 || 120.80 | 120.27 | -0%˄ || 8.28 | 8.31 | +0%˄ | (run time too short) |
| 35 || 368.56 | 367.61 | -0%˄ || 2.71 | 2.72 | +0%˄ | (run time too short) |
| 37 || 194.00 | 188.10 | -3%˄ || 5.15 | 5.32 | +3%˄ | (run time too short) |
-| 39a || 726.76 | 775.09 | +7%˄ || 1.38 | 1.29 | -6%˄ | (run time too short) |
-| 39b || 710.48 | 793.08 | +12%˄ || 1.41 | 1.26 | -10%˄ | (run time too short) |
| 41 || 423.19 | 411.76 | -3%˄ || 2.36 | 2.43 | +3%˄ | (run time too short) |
| 42 || 66.59 | 65.69 | -1%˄ || 15.01 | 15.21 | +1%˄ | (run time too short) |
| 43 || 491.82 | 495.63 | +1%˄ || 2.03 | 2.02 | -1%˄ | (run time too short) |
| 45 || 57.83 | 57.63 | -0%˄ || 17.28 | 17.34 | +0%˄ | (run time too short) |
| 48 || 540.02 | 539.52 | -0%˄ || 1.85 | 1.85 | +0%˄ | (run time too short) |
| 50 || 110.41 | 106.82 | -3%˄ || 9.05 | 9.36 | +3%˄ | (run time too short) |
| 52 || 68.67 | 68.67 | -0%˄ || 14.55 | 14.55 | +0%˄ | (run time too short) |
| 55 || 64.05 | 62.13 | -3%˄ || 15.60 | 16.08 | +3%˄ | (run time too short) |
| 62 || 361.98 | 363.25 | +0%˄ || 2.76 | 2.75 | -0%˄ | (run time too short) |
| 65 || 1301.43 | 1307.22 | +0% || 0.77 | 0.76 | -0% | 0.3329 |
| 69 || 91.93 | 89.42 | -3%˄ || 10.87 | 11.18 | +3%˄ | (run time too short) |
| 73 || 78.19 | 76.16 | -3%˄ || 12.78 | 13.12 | +3%˄ | (run time too short) |
| 79 || 475.99 | 477.76 | +0%˄ || 2.10 | 2.09 | -0%˄ | (run time too short) |
| 81 || 185.16 | 187.31 | +1%˄ || 5.40 | 5.34 | -1%˄ | (run time too short) |
| 82 || 237.16 | 243.66 | +3%˄ || 4.22 | 4.10 | -3%˄ | (run time too short) |
| 83 || 63.40 | 63.47 | +0%˄ || 15.76 | 15.75 | -0%˄ | (run time too short) |
-| 84 || 13.14 | 13.94 | +6%˄ || 75.94 | 71.55 | -6%˄ | (run time too short) |
| 85 || 85.08 | 86.22 | +1%˄ || 11.75 | 11.59 | -1%˄ | (run time too short) |
+| 88 || 135.26 | 122.80 | -9%˄ || 7.39 | 8.14 | +10%˄ | (run time too short) |
| 91 || 25.64 | 25.61 | -0%˄ || 38.96 | 39.00 | +0%˄ | (run time too short) |
| 92 || 36.31 | 35.83 | -1%˄ || 27.51 | 27.88 | +1%˄ | (run time too short) |
| 93 || 652.51 | 635.54 | -3%˄ || 1.53 | 1.57 | +3%˄ | (run time too short) |
| 94 || 42.77 | 41.78 | -2%˄ || 23.36 | 23.91 | +2%˄ | (run time too short) |
| 95 || 769.36 | 745.59 | -3%˄ || 1.30 | 1.34 | +3%˄ | (run time too short) |
+| 96 || 65.52 | 62.52 | -5%˄ || 15.25 | 15.99 | +5%˄ | (run time too short) |
| 97 || 1425.77 | 1411.63 | -1% || 0.70 | 0.71 | +1% | 0.1826 |
| 99 || 633.78 | 628.89 | -1%˄ || 1.58 | 1.59 | +1%˄ | (run time too short) |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Sum || 13419.91 | 13374.57 | -0% || | | | |
| Geomean || | | || | | +1% | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCDS - multi-threaded, shuffled, 32 clients, 32 cores Sum of avg. item runtimes: -2% || Geometric mean of throughput changes: +2%Configuration Overview - click to expand +Configuration Overview---------+---------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCDS_29332b1ca0b941194d0cb7ba7aa2438b20442365_mt.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCDS_5ee9098de05cdcf3b290393d44461d8970302257_mt.json |
+-------------------------------+---------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 29332b1ca0b941194d0cb7ba7aa2438b20442365-dirty | 5ee9098de05cdcf3b290393d44461d8970302257-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 32 | 32 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 32 | 32 |
| data_preparation_cores | 0 | 0 |
| date | 2024-08-10 23:39:47 | 2024-08-11 03:21:48 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [32] | [32] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+---------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+---------+
-| 01 || 513.16 | 573.92 | +12% || 0.76 | 0.78 | +2% | 0.0904 |
+| 03 || 221.98 | 209.46 | -6% || 0.77 | 0.78 | +2% | 0.6561 |
| 06 || 625.48 | 618.83 | -1% || 0.76 | 0.78 | +2% | 0.8834 |
| 07 || 718.38 | 692.83 | -4% || 0.76 | 0.78 | +2% | 0.5895 |
+| 09 || 446.74 | 355.45 | -20% || 0.76 | 0.78 | +2% | 0.0057 |
+| 10 || 614.07 | 511.96 | -17% || 0.77 | 0.78 | +2% | 0.0592 |
| 13 || 1172.47 | 1177.10 | +0% || 0.76 | 0.78 | +2% | 0.9420 |
-| 15 || 325.78 | 419.12 | +29% || 0.76 | 0.78 | +2% | 0.0152 |
-| 16 || 336.74 | 353.58 | +5% || 0.76 | 0.78 | +2% | 0.6618 |
+| 17 || 869.05 | 828.74 | -5% || 0.76 | 0.78 | +2% | 0.4477 |
+| 19 || 499.58 | 428.17 | -14% || 0.76 | 0.78 | +2% | 0.0911 |
+| 25 || 663.53 | 631.77 | -5% || 0.76 | 0.78 | +2% | 0.5298 |
-| 26 || 356.96 | 440.25 | +23% || 0.76 | 0.78 | +2% | 0.0286 |
+| 28 || 920.92 | 643.34 | -30% || 0.76 | 0.78 | +2% | 0.0000 |
+| 29 || 1258.22 | 1095.63 | -13% || 0.76 | 0.78 | +2% | 0.0193 |
+| 31 || 1828.54 | 1580.65 | -14% || 0.76 | 0.78 | +2% | 0.0027 |
| 32 || 141.16 | 146.35 | +4% || 0.76 | 0.78 | +2% | 0.8252 |
+| 34 || 518.52 | 445.83 | -14% || 0.76 | 0.78 | +2% | 0.0775 |
| 35 || 1357.32 | 1384.56 | +2% || 0.76 | 0.78 | +2% | 0.6944 |
+| 37 || 599.99 | 501.18 | -16% || 0.76 | 0.78 | +2% | 0.0050 |
| 39a || 1822.98 | 1812.52 | -1% || 0.76 | 0.78 | +2% | 0.8755 |
| 39b || 1815.32 | 1825.35 | +1% || 0.76 | 0.78 | +2% | 0.8832 |
-| 41 || 1591.82 | 2958.27 | +86% || 0.76 | 0.77 | +1% | 0.0000 |
| 42 || 332.88 | 342.41 | +3% || 0.77 | 0.78 | +2% | 0.7911 |
+| 43 || 1153.69 | 1068.90 | -7% || 0.76 | 0.78 | +2% | 0.1112 |
-| 45 || 493.38 | 540.45 | +10% || 0.76 | 0.78 | +2% | 0.3424 |
-| 48 || 1608.98 | 1708.56 | +6% || 0.76 | 0.78 | +2% | 0.1502 |
+| 50 || 690.31 | 628.71 | -9% || 0.76 | 0.78 | +2% | 0.2089 |
+| 52 || 329.16 | 308.25 | -6% || 0.76 | 0.78 | +2% | 0.5160 |
+| 55 || 315.43 | 267.55 | -15% || 0.76 | 0.78 | +2% | 0.1457 |
+| 62 || 914.79 | 839.63 | -8% || 0.76 | 0.78 | +2% | 0.1276 |
| 65 || 2610.21 | 2516.76 | -4% || 0.76 | 0.78 | +2% | 0.0818 |
| 69 || 699.39 | 692.09 | -1% || 0.76 | 0.78 | +2% | 0.9016 |
+| 73 || 365.20 | 335.34 | -8% || 0.76 | 0.78 | +2% | 0.4077 |
+| 79 || 1101.94 | 986.60 | -10% || 0.76 | 0.78 | +1% | 0.0172 |
-| 81 || 404.11 | 648.22 | +60% || 0.76 | 0.78 | +2% | 0.0000 |
+| 82 || 749.57 | 668.67 | -11% || 0.76 | 0.78 | +2% | 0.0969 |
-| 83 || 277.99 | 310.18 | +12% || 0.76 | 0.78 | +2% | 0.4187 |
-| 84 || 98.42 | 118.43 | +20% || 0.76 | 0.78 | +2% | 0.3290 |
-| 85 || 551.11 | 697.77 | +27% || 0.77 | 0.78 | +2% | 0.0069 |
+| 88 || 1668.82 | 1215.22 | -27% || 0.76 | 0.78 | +2% | 0.0000 |
-| 91 || 123.83 | 210.65 | +70% || 0.76 | 0.78 | +2% | 0.0113 |
| 92 || 205.17 | 198.64 | -3% || 0.76 | 0.78 | +2% | 0.8309 |
+| 93 || 1310.15 | 1193.77 | -9% || 0.76 | 0.78 | +2% | 0.0248 |
| 94 || 305.58 | 296.59 | -3% || 0.76 | 0.78 | +2% | 0.7901 |
+| 95 || 1624.75 | 1390.75 | -14% || 0.76 | 0.78 | +2% | 0.0001 |
+| 96 || 317.65 | 208.02 | -35% || 0.76 | 0.78 | +2% | 0.0001 |
| 97 || 3162.01 | 3025.42 | -4% || 0.76 | 0.78 | +2% | 0.0725 |
+| 99 || 1129.18 | 1035.48 | -8% || 0.76 | 0.78 | +2% | 0.0538 |
+---------++----------+----------+--------++----------+----------+--------+---------+
| Sum || 41762.41 | 41087.92 | -2% || | | | |
| Geomean || | | || | | +2% | |
+---------++----------+----------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCC - single-threaded Sum of avg. item runtimes: +2% || Geometric mean of throughput changes: -3%Configuration Overview - click to expand +Configuration Overview---+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCC_29332b1ca0b941194d0cb7ba7aa2438b20442365_st.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCC_5ee9098de05cdcf3b290393d44461d8970302257_st.json |
+-------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 29332b1ca0b941194d0cb7ba7aa2438b20442365-dirty | 5ee9098de05cdcf3b290393d44461d8970302257-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-08-11 00:00:11 | 2024-08-11 03:42:20 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10 | 10 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+ +--------------++----------+---------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+--------------++----------+---------+--------++----------+----------+--------+---------+
| Delivery || 27.17 | 27.79 | +2% || 5.13 | 5.13 | +0% | 0.0000 |
| New-Order || 12.72 | 13.04 | +3% || 56.21 | 54.56 | -3% | 0.0004 |
| Order-Status || 1.21 | 1.23 | +2% || 4.77 | 4.83 | +1% | 0.0000 |
| Payment || 2.33 | 2.38 | +2% || 54.41 | 53.71 | -1% | 0.0000 |
-| Stock-Level || 2.06 | 2.07 | +1% || 5.28 | 4.77 | -10% | 0.5010 |
+--------------++----------+---------+--------++----------+----------+--------+---------+
| Sum || 45.48 | 46.52 | +2% || | | | |
| Geomean || | | || | | -3% | |
+--------------++----------+---------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCC - multi-threaded, shuffled, 32 clients, 10 warehouses, 32 cores (high contention) Sum of avg. item runtimes: -1% || Geometric mean of throughput changes: +1%Configuration Overview - click to expand +Configuration Overview---------+-----------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCC_29332b1ca0b941194d0cb7ba7aa2438b20442365_mt_highcont.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCC_5ee9098de05cdcf3b290393d44461d8970302257_mt_highcont.json |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 29332b1ca0b941194d0cb7ba7aa2438b20442365-dirty | 5ee9098de05cdcf3b290393d44461d8970302257-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 32 | 32 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 32 | 32 |
| data_preparation_cores | 0 | 0 |
| date | 2024-08-11 00:01:18 | 2024-08-11 03:43:29 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 600000000000 | 600000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10 | 10 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [32] | [32] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------+ +--------------++----------+---------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+--------------++----------+---------+--------++----------+----------+--------+---------+
| Delivery || 86.12 | 86.09 | -0% || 43.40 | 43.95 | +1% | 0.9264 |
| unsucc.: || 1.85 | 2.08 | +13% || 24.72 | 25.28 | +2% | |
| New-Order || 39.24 | 38.59 | -2% || 564.99 | 572.91 | +1% | 0.0000 |
| unsucc.: || 6.12 | 5.60 | -9% || 202.16 | 199.34 | -1% | |
| Order-Status || 4.70 | 4.67 | -1% || 68.02 | 68.87 | +1% | 0.6412 |
| Payment || 7.38 | 7.52 | +2% || 383.55 | 380.82 | -1% | 0.0000 |
| unsucc.: || 3.03 | 3.25 | +7% || 352.14 | 359.12 | +2% | |
| Stock-Level || 8.15 | 7.91 | -3% || 68.22 | 69.01 | +1% | 0.0222 |
+--------------++----------+---------+--------++----------+----------+--------+---------+
| Sum || 145.60 | 144.78 | -1% || | | | |
| Geomean || | | || | | +1% | |
+--------------++----------+---------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCC - multi-threaded, shuffled, 10 clients, 10 warehouses, 32 cores (low contention) Sum of avg. item runtimes: -3% || Geometric mean of throughput changes: +3%Configuration Overview - click to expand +Configuration Overview---------+----------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCC_29332b1ca0b941194d0cb7ba7aa2438b20442365_mt_lowcont.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCC_5ee9098de05cdcf3b290393d44461d8970302257_mt_lowcont.json |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 29332b1ca0b941194d0cb7ba7aa2438b20442365-dirty | 5ee9098de05cdcf3b290393d44461d8970302257-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 10 | 10 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 32 | 32 |
| data_preparation_cores | 0 | 0 |
| date | 2024-08-11 00:11:29 | 2024-08-11 03:53:40 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 600000000000 | 600000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10 | 10 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [32] | [32] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------+ +--------------++----------+---------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+--------------++----------+---------+--------++----------+----------+--------+---------+
| Delivery || 95.02 | 92.33 | -3% || 12.64 | 12.96 | +3% | 0.0000 |
| unsucc.: || 1.20 | 0.97 | -19% || 1.50 | 1.56 | +4% | |
| New-Order || 48.55 | 47.60 | -2% || 146.83 | 150.05 | +2% | 0.0000 |
| unsucc.: || 4.08 | 3.59 | -12% || 14.03 | 13.27 | -5% | |
+| Order-Status || 5.42 | 5.33 | -2% || 14.08 | 14.85 | +5% | 0.0000 |
| Payment || 10.73 | 10.48 | -2% || 124.96 | 127.73 | +2% | 0.0000 |
| unsucc.: || 2.70 | 2.62 | -3% || 28.50 | 28.57 | +0% | |
| Stock-Level || 7.49 | 7.30 | -3% || 14.03 | 14.65 | +4% | 0.0000 |
+--------------++----------+---------+--------++----------+----------+--------+---------+
| Sum || 167.21 | 163.03 | -3% || | | | |
| Geomean || | | || | | +3% | |
+--------------++----------+---------+--------++----------+----------+--------+---------+hyriseBenchmarkJoinOrder - single-threaded Sum of avg. item runtimes: -0% || Geometric mean of throughput changes: +0%Configuration Overview - click to expand +Configuration Overview---+-------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkJoinOrder_29332b1ca0b941194d0cb7ba7aa2438b20442365_st.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkJoinOrder_5ee9098de05cdcf3b290393d44461d8970302257_st.json |
+-------------------------+-------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 29332b1ca0b941194d0cb7ba7aa2438b20442365-dirty | 5ee9098de05cdcf3b290393d44461d8970302257-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-08-11 00:21:39 | 2024-08-11 04:03:49 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+-------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| 10a || 114.55 | 114.62 | +0%˄ || 8.73 | 8.72 | -0%˄ | (run time too short) |
| 10b || 63.90 | 63.67 | -0%˄ || 15.65 | 15.70 | +0%˄ | (run time too short) |
| 10c || 306.06 | 306.66 | +0%˄ || 3.27 | 3.26 | -0%˄ | (run time too short) |
| 11a || 81.06 | 81.00 | -0%˄ || 12.34 | 12.34 | +0%˄ | (run time too short) |
| 11b || 79.08 | 79.44 | +0%˄ || 12.65 | 12.59 | -0%˄ | (run time too short) |
| 11c || 18.90 | 18.84 | -0%˄ || 52.90 | 53.07 | +0%˄ | (run time too short) |
| 11d || 21.24 | 20.95 | -1%˄ || 47.09 | 47.72 | +1%˄ | (run time too short) |
| 12a || 26.04 | 25.86 | -1%˄ || 38.40 | 38.67 | +1%˄ | (run time too short) |
| 12b || 29.47 | 29.28 | -1%˄ || 33.93 | 34.15 | +1%˄ | (run time too short) |
| 12c || 56.63 | 56.31 | -1%˄ || 17.66 | 17.76 | +1%˄ | (run time too short) |
| 13a || 173.44 | 175.14 | +1%˄ || 5.77 | 5.71 | -1%˄ | (run time too short) |
| 13b || 216.82 | 215.99 | -0%˄ || 4.61 | 4.63 | +0%˄ | (run time too short) |
| 13c || 179.93 | 179.18 | -0%˄ || 5.56 | 5.58 | +0%˄ | (run time too short) |
| 13d || 477.24 | 473.29 | -1%˄ || 2.10 | 2.11 | +1%˄ | (run time too short) |
| 14a || 87.50 | 88.00 | +1%˄ || 11.43 | 11.36 | -1%˄ | (run time too short) |
| 14b || 99.53 | 101.06 | +2%˄ || 10.05 | 9.89 | -2%˄ | (run time too short) |
| 14c || 196.32 | 195.90 | -0%˄ || 5.09 | 5.10 | +0%˄ | (run time too short) |
| 15a || 56.39 | 56.06 | -1%˄ || 17.73 | 17.84 | +1%˄ | (run time too short) |
| 15b || 57.25 | 57.20 | -0%˄ || 17.47 | 17.48 | +0%˄ | (run time too short) |
| 15c || 45.60 | 45.93 | +1%˄ || 21.93 | 21.77 | -1%˄ | (run time too short) |
| 15d || 40.32 | 40.22 | -0%˄ || 24.80 | 24.86 | +0%˄ | (run time too short) |
| 16a || 1201.59 | 1194.69 | -1%˄ || 0.83 | 0.84 | +1%˄ | 0.0401 |
| 16b || 2255.82 | 2234.48 | -1% || 0.44 | 0.45 | +1% | 0.0027 |
| 16c || 1347.35 | 1375.39 | +2% || 0.74 | 0.73 | -2% | 0.1694 |
| 16d || 1324.12 | 1314.56 | -1% || 0.76 | 0.76 | +1% | 0.0048 |
| 17a || 369.71 | 369.29 | -0%˄ || 2.70 | 2.71 | +0%˄ | (run time too short) |
| 17b || 296.56 | 293.17 | -1%˄ || 3.37 | 3.41 | +1%˄ | (run time too short) |
| 17c || 277.97 | 277.02 | -0%˄ || 3.60 | 3.61 | +0%˄ | (run time too short) |
| 17d || 365.06 | 364.07 | -0%˄ || 2.74 | 2.75 | +0%˄ | (run time too short) |
| 17e || 1369.80 | 1366.03 | -0% || 0.73 | 0.73 | +0% | 0.2064 |
| 17f || 846.86 | 846.42 | -0%˄ || 1.18 | 1.18 | +0%˄ | (run time too short) |
| 18a || 146.93 | 147.00 | +0%˄ || 6.81 | 6.80 | -0%˄ | (run time too short) |
| 18b || 95.57 | 95.46 | -0%˄ || 10.46 | 10.48 | +0%˄ | (run time too short) |
| 18c || 199.39 | 199.40 | +0%˄ || 5.02 | 5.01 | -0%˄ | (run time too short) |
| 19a || 214.99 | 214.23 | -0%˄ || 4.65 | 4.67 | +0%˄ | (run time too short) |
| 19b || 178.33 | 178.24 | -0%˄ || 5.61 | 5.61 | +0%˄ | (run time too short) |
| 19c || 265.97 | 265.53 | -0%˄ || 3.76 | 3.77 | +0%˄ | (run time too short) |
| 19d || 627.79 | 625.79 | -0%˄ || 1.59 | 1.60 | +0%˄ | (run time too short) |
| 1a || 8.81 | 8.93 | +1%˄ || 113.46 | 111.94 | -1%˄ | (run time too short) |
| 1b || 10.13 | 10.15 | +0%˄ || 98.73 | 98.49 | -0%˄ | (run time too short) |
| 1c || 13.47 | 13.48 | +0%˄ || 74.21 | 74.16 | -0%˄ | (run time too short) |
| 1d || 8.28 | 8.23 | -1%˄ || 120.74 | 121.45 | +1%˄ | (run time too short) |
| 20a || 572.58 | 569.92 | -0%˄ || 1.75 | 1.75 | +0%˄ | (run time too short) |
| 20b || 623.13 | 620.20 | -0%˄ || 1.60 | 1.61 | +0%˄ | (run time too short) |
| 20c || 394.66 | 393.46 | -0%˄ || 2.53 | 2.54 | +0%˄ | (run time too short) |
| 21a || 94.53 | 94.73 | +0%˄ || 10.58 | 10.56 | -0%˄ | (run time too short) |
| 21b || 86.42 | 86.50 | +0%˄ || 11.57 | 11.56 | -0%˄ | (run time too short) |
| 21c || 96.50 | 96.19 | -0%˄ || 10.36 | 10.40 | +0%˄ | (run time too short) |
| 22a || 153.85 | 154.16 | +0%˄ || 6.50 | 6.49 | -0%˄ | (run time too short) |
| 22b || 141.46 | 140.31 | -1%˄ || 7.07 | 7.13 | +1%˄ | (run time too short) |
| 22c || 207.94 | 206.99 | -0%˄ || 4.81 | 4.83 | +0%˄ | (run time too short) |
| 22d || 323.97 | 323.80 | -0%˄ || 3.09 | 3.09 | +0%˄ | (run time too short) |
| 23a || 49.28 | 49.28 | -0%˄ || 20.29 | 20.29 | +0%˄ | (run time too short) |
| 23b || 52.12 | 51.98 | -0%˄ || 19.19 | 19.24 | +0%˄ | (run time too short) |
| 23c || 51.53 | 51.53 | -0%˄ || 19.40 | 19.41 | +0%˄ | (run time too short) |
| 24a || 224.91 | 223.63 | -1%˄ || 4.45 | 4.47 | +1%˄ | (run time too short) |
| 24b || 218.93 | 219.04 | +0%˄ || 4.57 | 4.57 | -0%˄ | (run time too short) |
| 25a || 96.00 | 95.20 | -1%˄ || 10.42 | 10.50 | +1%˄ | (run time too short) |
| 25b || 62.84 | 62.44 | -1%˄ || 15.91 | 16.01 | +1%˄ | (run time too short) |
| 25c || 225.24 | 224.00 | -1%˄ || 4.44 | 4.46 | +1%˄ | (run time too short) |
| 26a || 146.32 | 145.75 | -0%˄ || 6.83 | 6.86 | +0%˄ | (run time too short) |
| 26b || 118.02 | 117.39 | -1%˄ || 8.47 | 8.52 | +1%˄ | (run time too short) |
| 26c || 256.36 | 255.54 | -0%˄ || 3.90 | 3.91 | +0%˄ | (run time too short) |
| 27a || 89.57 | 89.42 | -0%˄ || 11.16 | 11.18 | +0%˄ | (run time too short) |
| 27b || 84.20 | 83.91 | -0%˄ || 11.88 | 11.92 | +0%˄ | (run time too short) |
| 27c || 96.28 | 95.72 | -1%˄ || 10.39 | 10.45 | +1%˄ | (run time too short) |
| 28a || 190.61 | 187.69 | -2%˄ || 5.25 | 5.33 | +2%˄ | (run time too short) |
| 28b || 61.00 | 60.88 | -0%˄ || 16.39 | 16.43 | +0%˄ | (run time too short) |
| 28c || 153.39 | 152.40 | -1%˄ || 6.52 | 6.56 | +1%˄ | (run time too short) |
| 29a || 192.69 | 192.73 | +0%˄ || 5.19 | 5.19 | -0%˄ | (run time too short) |
| 29b || 808.69 | 811.73 | +0%˄ || 1.24 | 1.23 | -0%˄ | (run time too short) |
| 29c || 224.30 | 225.03 | +0%˄ || 4.46 | 4.44 | -0%˄ | (run time too short) |
| 2a || 25.05 | 24.90 | -1%˄ || 39.91 | 40.16 | +1%˄ | (run time too short) |
| 2b || 23.13 | 23.08 | -0%˄ || 43.23 | 43.32 | +0%˄ | (run time too short) |
| 2c || 20.07 | 19.72 | -2%˄ || 49.83 | 50.71 | +2%˄ | (run time too short) |
| 2d || 47.52 | 46.75 | -2%˄ || 21.03 | 21.39 | +2%˄ | (run time too short) |
| 30a || 87.61 | 87.42 | -0%˄ || 11.41 | 11.44 | +0%˄ | (run time too short) |
| 30b || 93.34 | 93.36 | +0%˄ || 10.71 | 10.71 | -0%˄ | (run time too short) |
| 30c || 148.97 | 148.11 | -1%˄ || 6.71 | 6.75 | +1%˄ | (run time too short) |
| 31a || 77.24 | 76.86 | -0%˄ || 12.95 | 13.01 | +0%˄ | (run time too short) |
| 31b || 78.09 | 77.86 | -0%˄ || 12.81 | 12.84 | +0%˄ | (run time too short) |
| 31c || 88.16 | 88.29 | +0%˄ || 11.34 | 11.33 | -0%˄ | (run time too short) |
| 32a || 12.39 | 12.38 | -0%˄ || 80.69 | 80.75 | +0%˄ | (run time too short) |
| 32b || 26.92 | 27.00 | +0%˄ || 37.14 | 37.03 | -0%˄ | (run time too short) |
| 33a || 29.53 | 29.62 | +0%˄ || 33.86 | 33.76 | -0%˄ | (run time too short) |
| 33b || 19.79 | 19.75 | -0%˄ || 50.52 | 50.63 | +0%˄ | (run time too short) |
| 33c || 34.97 | 34.99 | +0%˄ || 28.59 | 28.57 | -0%˄ | (run time too short) |
| 3a || 54.81 | 54.74 | -0%˄ || 18.25 | 18.27 | +0%˄ | (run time too short) |
| 3b || 15.55 | 15.76 | +1%˄ || 64.32 | 63.44 | -1%˄ | (run time too short) |
| 3c || 208.84 | 208.65 | -0%˄ || 4.79 | 4.79 | +0%˄ | (run time too short) |
| 4a || 130.20 | 130.17 | -0%˄ || 7.68 | 7.68 | +0%˄ | (run time too short) |
-| 4b || 14.91 | 15.62 | +5%˄ || 67.07 | 64.00 | -5%˄ | (run time too short) |
| 4c || 184.98 | 183.01 | -1%˄ || 5.41 | 5.46 | +1%˄ | (run time too short) |
| 5a || 41.11 | 40.78 | -1%˄ || 24.32 | 24.52 | +1%˄ | (run time too short) |
| 5b || 45.08 | 44.93 | -0%˄ || 22.18 | 22.26 | +0%˄ | (run time too short) |
| 5c || 81.25 | 80.63 | -1%˄ || 12.31 | 12.40 | +1%˄ | (run time too short) |
| 6a || 150.80 | 150.38 | -0%˄ || 6.63 | 6.65 | +0%˄ | (run time too short) |
| 6b || 164.53 | 164.17 | -0%˄ || 6.08 | 6.09 | +0%˄ | (run time too short) |
| 6c || 144.12 | 142.76 | -1%˄ || 6.94 | 7.00 | +1%˄ | (run time too short) |
| 6d || 336.15 | 331.69 | -1%˄ || 2.97 | 3.01 | +1%˄ | (run time too short) |
| 6e || 149.36 | 148.61 | -1%˄ || 6.69 | 6.73 | +1%˄ | (run time too short) |
| 6f || 608.37 | 608.41 | +0%˄ || 1.64 | 1.64 | -0%˄ | (run time too short) |
| 7a || 99.89 | 98.34 | -2%˄ || 10.01 | 10.17 | +2%˄ | (run time too short) |
| 7b || 93.31 | 93.97 | +1%˄ || 10.72 | 10.64 | -1%˄ | (run time too short) |
| 7c || 530.23 | 532.50 | +0%˄ || 1.89 | 1.88 | -0%˄ | (run time too short) |
| 8a || 205.46 | 205.72 | +0%˄ || 4.87 | 4.86 | -0%˄ | (run time too short) |
| 8b || 202.74 | 202.44 | -0%˄ || 4.93 | 4.94 | +0%˄ | (run time too short) |
| 8c || 1696.16 | 1688.54 | -0% || 0.59 | 0.59 | +0% | 0.0236 |
| 8d || 287.23 | 285.24 | -1%˄ || 3.48 | 3.51 | +1%˄ | (run time too short) |
| 9a || 237.18 | 236.89 | -0%˄ || 4.22 | 4.22 | +0%˄ | (run time too short) |
-| 9b || 150.63 | 165.88 | +10%˄ || 6.64 | 6.03 | -9%˄ | (run time too short) |
-| 9c || 273.70 | 294.09 | +7%˄ || 3.65 | 3.40 | -7%˄ | (run time too short) |
| 9d || 384.74 | 385.80 | +0%˄ || 2.60 | 2.59 | -0%˄ | (run time too short) |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Sum || 27253.17 | 27227.50 | -0% || | | | |
| Geomean || | | || | | +0% | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkJoinOrder - multi-threaded, ordered, 1 client, 32 cores Sum of avg. item runtimes: +0% || Geometric mean of throughput changes: -2%Configuration Overview - click to expand +Configuration Overview---------+---------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkJoinOrder_29332b1ca0b941194d0cb7ba7aa2438b20442365_mt_ordered.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkJoinOrder_5ee9098de05cdcf3b290393d44461d8970302257_mt_ordered.json |
+-------------------------------+---------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 29332b1ca0b941194d0cb7ba7aa2438b20442365-dirty | 5ee9098de05cdcf3b290393d44461d8970302257-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 32 | 32 |
| data_preparation_cores | 0 | 0 |
| date | 2024-08-11 00:45:23 | 2024-08-11 04:27:26 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [32] | [32] |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------------+---------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
-| 10a || 36.24 | 55.77 | +54%˄ || 27.57 | 17.92 | -35%˄ | (run time too short) |
-| 10b || 17.71 | 24.69 | +39%˄ || 56.37 | 40.43 | -28%˄ | (run time too short) |
-| 10c || 106.91 | 137.15 | +28%˄ || 9.35 | 7.29 | -22%˄ | (run time too short) |
-| 11a || 26.56 | 28.84 | +9%˄ || 37.60 | 34.63 | -8%˄ | (run time too short) |
| 11b || 24.74 | 25.31 | +2%˄ || 40.37 | 39.45 | -2%˄ | (run time too short) |
-| 11c || 24.79 | 28.10 | +13%˄ || 40.28 | 35.54 | -12%˄ | (run time too short) |
-| 11d || 25.82 | 35.34 | +37%˄ || 38.69 | 28.27 | -27%˄ | (run time too short) |
-| 12a || 17.95 | 24.89 | +39%˄ || 55.62 | 40.12 | -28%˄ | (run time too short) |
-| 12b || 13.12 | 16.66 | +27%˄ || 76.07 | 59.90 | -21%˄ | (run time too short) |
-| 12c || 40.31 | 56.57 | +40%˄ || 24.79 | 17.66 | -29%˄ | (run time too short) |
| 13a || 151.98 | 157.34 | +4%˄ || 6.58 | 6.35 | -3%˄ | (run time too short) |
| 13b || 101.37 | 101.93 | +1%˄ || 9.86 | 9.81 | -1%˄ | (run time too short) |
-| 13c || 85.34 | 89.25 | +5%˄ || 11.71 | 11.20 | -4%˄ | (run time too short) |
| 13d || 350.29 | 356.15 | +2%˄ || 2.85 | 2.81 | -2%˄ | (run time too short) |
| 14a || 66.03 | 65.25 | -1%˄ || 15.13 | 15.31 | +1%˄ | (run time too short) |
| 14b || 82.46 | 81.50 | -1%˄ || 12.12 | 12.26 | +1%˄ | (run time too short) |
| 14c || 181.38 | 181.19 | -0%˄ || 5.51 | 5.52 | +0%˄ | (run time too short) |
| 15a || 40.75 | 41.73 | +2%˄ || 24.51 | 23.94 | -2%˄ | (run time too short) |
| 15b || 35.84 | 35.94 | +0%˄ || 27.87 | 27.79 | -0%˄ | (run time too short) |
-| 15c || 28.65 | 30.62 | +7%˄ || 34.86 | 32.62 | -6%˄ | (run time too short) |
| 15d || 36.87 | 37.07 | +1%˄ || 27.10 | 26.95 | -1%˄ | (run time too short) |
| 16a || 912.64 | 906.77 | -1%˄ || 1.10 | 1.10 | +1%˄ | (run time too short) |
| 16b || 2048.20 | 2035.45 | -1% || 0.49 | 0.49 | +1% | 0.1619 |
| 16c || 1077.23 | 1080.37 | +0%˄ || 0.93 | 0.93 | -0%˄ | (run time too short) |
| 16d || 1040.49 | 1030.41 | -1%˄ || 0.96 | 0.97 | +1%˄ | (run time too short) |
| 17a || 220.75 | 230.05 | +4%˄ || 4.53 | 4.35 | -4%˄ | (run time too short) |
| 17b || 189.11 | 190.00 | +0%˄ || 5.29 | 5.26 | -0%˄ | (run time too short) |
| 17c || 171.90 | 172.07 | +0%˄ || 5.82 | 5.81 | -0%˄ | (run time too short) |
| 17d || 156.24 | 154.15 | -1%˄ || 6.40 | 6.49 | +1%˄ | (run time too short) |
| 17e || 852.37 | 850.20 | -0%˄ || 1.17 | 1.21 | +3%˄ | (run time too short) |
| 17f || 363.12 | 354.14 | -2%˄ || 2.75 | 2.82 | +3%˄ | (run time too short) |
| 18a || 78.01 | 77.98 | -0%˄ || 12.81 | 12.82 | +0%˄ | (run time too short) |
| 18b || 65.19 | 63.96 | -2%˄ || 15.33 | 15.62 | +2%˄ | (run time too short) |
| 18c || 127.59 | 129.45 | +1%˄ || 7.84 | 7.72 | -1%˄ | (run time too short) |
| 19a || 133.73 | 131.44 | -2%˄ || 7.48 | 7.61 | +2%˄ | (run time too short) |
| 19b || 80.58 | 79.12 | -2%˄ || 12.40 | 12.63 | +2%˄ | (run time too short) |
+| 19c || 152.95 | 144.98 | -5%˄ || 6.54 | 6.90 | +5%˄ | (run time too short) |
| 19d || 516.98 | 508.81 | -2%˄ || 1.93 | 1.97 | +2%˄ | (run time too short) |
| 1a || 8.18 | 8.20 | +0%˄ || 121.85 | 121.50 | -0%˄ | (run time too short) |
| 1b || 4.52 | 4.45 | -2%˄ || 219.61 | 222.88 | +1%˄ | (run time too short) |
| 1c || 4.94 | 4.86 | -2%˄ || 201.19 | 204.33 | +2%˄ | (run time too short) |
| 1d || 6.57 | 6.63 | +1%˄ || 151.55 | 150.03 | -1%˄ | (run time too short) |
| 20a || 100.65 | 101.63 | +1%˄ || 9.93 | 9.84 | -1%˄ | (run time too short) |
| 20b || 86.79 | 88.05 | +1%˄ || 11.52 | 11.35 | -1%˄ | (run time too short) |
| 20c || 95.01 | 95.57 | +1%˄ || 10.52 | 10.46 | -1%˄ | (run time too short) |
| 21a || 34.95 | 34.77 | -1%˄ || 28.58 | 28.73 | +1%˄ | (run time too short) |
| 21b || 30.06 | 29.51 | -2%˄ || 33.22 | 33.84 | +2%˄ | (run time too short) |
| 21c || 37.55 | 37.02 | -1%˄ || 26.60 | 26.98 | +1%˄ | (run time too short) |
| 22a || 71.02 | 70.55 | -1%˄ || 14.07 | 14.16 | +1%˄ | (run time too short) |
| 22b || 58.63 | 57.73 | -2%˄ || 17.04 | 17.31 | +2%˄ | (run time too short) |
| 22c || 124.61 | 122.05 | -2%˄ || 8.02 | 8.19 | +2%˄ | (run time too short) |
| 22d || 228.32 | 224.92 | -1%˄ || 4.38 | 4.45 | +2%˄ | (run time too short) |
| 23a || 21.45 | 21.49 | +0%˄ || 46.54 | 46.46 | -0%˄ | (run time too short) |
| 23b || 32.07 | 32.14 | +0%˄ || 31.15 | 31.08 | -0%˄ | (run time too short) |
| 23c || 22.57 | 22.52 | -0%˄ || 44.23 | 44.32 | +0%˄ | (run time too short) |
| 24a || 86.97 | 86.42 | -1%˄ || 11.49 | 11.57 | +1%˄ | (run time too short) |
| 24b || 80.84 | 80.92 | +0%˄ || 12.36 | 12.35 | -0%˄ | (run time too short) |
| 25a || 69.18 | 68.96 | -0%˄ || 14.45 | 14.49 | +0%˄ | (run time too short) |
| 25b || 39.04 | 39.32 | +1%˄ || 25.59 | 25.40 | -1%˄ | (run time too short) |
+| 25c || 192.50 | 175.45 | -9%˄ || 5.19 | 5.70 | +10%˄ | (run time too short) |
| 26a || 98.23 | 98.37 | +0%˄ || 10.18 | 10.16 | -0%˄ | (run time too short) |
| 26b || 71.57 | 71.80 | +0%˄ || 13.96 | 13.92 | -0%˄ | (run time too short) |
+| 26c || 141.51 | 135.15 | -4%˄ || 7.06 | 7.40 | +5%˄ | (run time too short) |
| 27a || 30.40 | 30.70 | +1%˄ || 32.85 | 32.53 | -1%˄ | (run time too short) |
| 27b || 29.94 | 30.00 | +0%˄ || 33.35 | 33.29 | -0%˄ | (run time too short) |
| 27c || 36.52 | 36.08 | -1%˄ || 27.35 | 27.68 | +1%˄ | (run time too short) |
| 28a || 141.18 | 139.01 | -2%˄ || 7.08 | 7.19 | +2%˄ | (run time too short) |
| 28b || 34.24 | 34.06 | -1%˄ || 29.17 | 29.32 | +1%˄ | (run time too short) |
| 28c || 115.35 | 112.29 | -3%˄ || 8.67 | 8.90 | +3%˄ | (run time too short) |
| 29a || 77.66 | 76.97 | -1%˄ || 12.87 | 12.98 | +1%˄ | (run time too short) |
| 29b || 142.31 | 148.06 | +4%˄ || 7.03 | 6.75 | -4%˄ | (run time too short) |
| 29c || 92.64 | 91.36 | -1%˄ || 10.79 | 10.94 | +1%˄ | (run time too short) |
| 2a || 28.71 | 28.71 | -0%˄ || 34.78 | 34.79 | +0%˄ | (run time too short) |
| 2b || 25.38 | 25.23 | -1%˄ || 39.35 | 39.58 | +1%˄ | (run time too short) |
| 2c || 18.32 | 18.60 | +2%˄ || 54.49 | 53.67 | -1%˄ | (run time too short) |
| 2d || 58.06 | 56.59 | -3%˄ || 17.21 | 17.66 | +3%˄ | (run time too short) |
| 30a || 59.37 | 59.19 | -0%˄ || 16.83 | 16.88 | +0%˄ | (run time too short) |
| 30b || 46.81 | 47.11 | +1%˄ || 21.34 | 21.21 | -1%˄ | (run time too short) |
| 30c || 133.15 | 132.80 | -0%˄ || 7.51 | 7.53 | +0%˄ | (run time too short) |
| 31a || 45.69 | 45.57 | -0%˄ || 21.86 | 21.92 | +0%˄ | (run time too short) |
| 31b || 40.11 | 40.07 | -0%˄ || 24.91 | 24.93 | +0%˄ | (run time too short) |
| 31c || 50.92 | 51.00 | +0%˄ || 19.62 | 19.59 | -0%˄ | (run time too short) |
| 32a || 8.77 | 8.65 | -1%˄ || 113.58 | 115.23 | +1%˄ | (run time too short) |
| 32b || 35.62 | 36.59 | +3%˄ || 28.05 | 27.30 | -3%˄ | (run time too short) |
| 33a || 13.00 | 12.85 | -1%˄ || 76.67 | 77.60 | +1%˄ | (run time too short) |
| 33b || 11.01 | 10.82 | -2%˄ || 90.52 | 92.08 | +2%˄ | (run time too short) |
-| 33c || 20.18 | 21.35 | +6%˄ || 49.45 | 46.74 | -5%˄ | (run time too short) |
| 3a || 43.08 | 43.08 | -0%˄ || 23.19 | 23.19 | +0%˄ | (run time too short) |
| 3b || 8.78 | 8.72 | -1%˄ || 113.46 | 114.26 | +1%˄ | (run time too short) |
| 3c || 81.32 | 80.80 | -1%˄ || 12.29 | 12.37 | +1%˄ | (run time too short) |
| 4a || 78.54 | 79.01 | +1%˄ || 12.73 | 12.65 | -1%˄ | (run time too short) |
| 4b || 7.08 | 7.31 | +3%˄ || 140.61 | 136.18 | -3%˄ | (run time too short) |
| 4c || 95.12 | 97.61 | +3%˄ || 10.51 | 10.24 | -3%˄ | (run time too short) |
| 5a || 33.47 | 33.19 | -1%˄ || 29.84 | 30.09 | +1%˄ | (run time too short) |
| 5b || 24.95 | 25.61 | +3%˄ || 40.01 | 38.98 | -3%˄ | (run time too short) |
| 5c || 60.03 | 60.28 | +0%˄ || 16.64 | 16.58 | -0%˄ | (run time too short) |
| 6a || 34.83 | 34.43 | -1%˄ || 28.68 | 29.01 | +1%˄ | (run time too short) |
| 6b || 60.14 | 60.87 | +1%˄ || 16.62 | 16.42 | -1%˄ | (run time too short) |
| 6c || 32.35 | 32.36 | +0%˄ || 30.88 | 30.87 | -0%˄ | (run time too short) |
| 6d || 171.29 | 172.21 | +1%˄ || 5.84 | 5.81 | -1%˄ | (run time too short) |
| 6e || 34.53 | 34.52 | -0%˄ || 28.93 | 28.94 | +0%˄ | (run time too short) |
| 6f || 497.13 | 498.69 | +0%˄ || 2.01 | 2.01 | -0%˄ | (run time too short) |
-| 7a || 37.01 | 38.74 | +5%˄ || 26.99 | 25.78 | -4%˄ | (run time too short) |
| 7b || 36.79 | 36.84 | +0%˄ || 27.15 | 27.11 | -0%˄ | (run time too short) |
| 7c || 324.05 | 312.96 | -3%˄ || 3.09 | 3.19 | +4%˄ | (run time too short) |
| 8a || 65.02 | 64.09 | -1%˄ || 15.37 | 15.59 | +1%˄ | (run time too short) |
| 8b || 62.74 | 62.43 | -0%˄ || 15.93 | 16.01 | +0%˄ | (run time too short) |
| 8c || 1290.39 | 1279.19 | -1% || 0.77 | 0.78 | +1% | 0.0282 |
| 8d || 240.46 | 241.78 | +1%˄ || 4.16 | 4.14 | -1%˄ | (run time too short) |
| 9a || 169.08 | 167.58 | -1%˄ || 5.91 | 5.97 | +1%˄ | (run time too short) |
| 9b || 90.50 | 89.99 | -1%˄ || 11.04 | 11.11 | +1%˄ | (run time too short) |
| 9c || 168.16 | 169.76 | +1%˄ || 5.95 | 5.89 | -1%˄ | (run time too short) |
| 9d || 371.56 | 368.77 | -1%˄ || 2.69 | 2.71 | +1%˄ | (run time too short) |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Sum || 16843.70 | 16863.61 | +0% || | | | |
| Geomean || | | || | | -2% | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkJoinOrder - multi-threaded, shuffled, 32 clients, 32 cores Sum of avg. item runtimes: -3% || Geometric mean of throughput changes: +3%Configuration Overview - click to expand +Configuration Overview---------+-------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkJoinOrder_29332b1ca0b941194d0cb7ba7aa2438b20442365_mt.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkJoinOrder_5ee9098de05cdcf3b290393d44461d8970302257_mt.json |
+-------------------------------+-------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 29332b1ca0b941194d0cb7ba7aa2438b20442365-dirty | 5ee9098de05cdcf3b290393d44461d8970302257-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 32 | 32 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 32 | 32 |
| data_preparation_cores | 0 | 0 |
| date | 2024-08-11 01:01:45 | 2024-08-11 04:43:51 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [32] | [32] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+-------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+---------+
| 10a || 158.91 | 164.99 | +4% || 0.85 | 0.88 | +3% | 0.7091 |
-| 10b || 99.02 | 116.01 | +17% || 0.85 | 0.88 | +3% | 0.2215 |
+| 10c || 382.59 | 362.80 | -5% || 0.85 | 0.88 | +3% | 0.3850 |
+| 11a || 104.38 | 79.72 | -24% || 0.85 | 0.88 | +3% | 0.0569 |
+| 11b || 90.92 | 76.56 | -16% || 0.85 | 0.88 | +3% | 0.3699 |
| 11c || 70.61 | 69.28 | -2% || 0.85 | 0.88 | +3% | 0.8881 |
-| 11d || 75.28 | 92.15 | +22% || 0.85 | 0.88 | +3% | 0.2075 |
| 12a || 138.42 | 138.56 | +0% || 0.85 | 0.88 | +3% | 0.9943 |
+| 12b || 72.01 | 55.83 | -22% || 0.85 | 0.88 | +3% | 0.0819 |
| 12c || 260.05 | 255.63 | -2% || 0.85 | 0.88 | +3% | 0.8287 |
-| 13a || 343.79 | 369.73 | +8% || 0.85 | 0.88 | +3% | 0.2192 |
+| 13b || 295.28 | 266.16 | -10% || 0.85 | 0.88 | +3% | 0.2141 |
-| 13c || 241.91 | 271.65 | +12% || 0.85 | 0.88 | +3% | 0.1363 |
-| 13d || 625.61 | 678.74 | +8% || 0.85 | 0.88 | +3% | 0.0362 |
-| 14a || 271.45 | 290.62 | +7% || 0.85 | 0.88 | +3% | 0.3924 |
| 14b || 285.74 | 291.01 | +2% || 0.85 | 0.88 | +3% | 0.8188 |
| 14c || 418.16 | 399.58 | -4% || 0.85 | 0.88 | +3% | 0.4546 |
-| 15a || 91.77 | 100.73 | +10% || 0.85 | 0.88 | +3% | 0.4537 |
+| 15b || 94.08 | 88.41 | -6% || 0.85 | 0.88 | +3% | 0.6050 |
+| 15c || 108.35 | 99.15 | -8% || 0.85 | 0.88 | +3% | 0.4155 |
-| 15d || 135.46 | 157.57 | +16% || 0.85 | 0.88 | +3% | 0.2416 |
+| 16a || 1182.11 | 1115.99 | -6% || 0.85 | 0.88 | +3% | 0.0531 |
| 16b || 2249.77 | 2154.51 | -4% || 0.85 | 0.88 | +3% | 0.0049 |
| 16c || 1322.43 | 1280.33 | -3% || 0.85 | 0.88 | +3% | 0.2367 |
| 16d || 1281.94 | 1261.84 | -2% || 0.85 | 0.88 | +3% | 0.5466 |
| 17a || 585.77 | 600.27 | +2% || 0.85 | 0.88 | +3% | 0.6055 |
-| 17b || 426.65 | 472.03 | +11% || 0.85 | 0.88 | +3% | 0.0518 |
| 17c || 417.20 | 433.45 | +4% || 0.85 | 0.88 | +3% | 0.5294 |
+| 17d || 509.00 | 427.31 | -16% || 0.85 | 0.88 | +3% | 0.0056 |
| 17e || 1214.84 | 1200.60 | -1% || 0.85 | 0.88 | +3% | 0.6959 |
| 17f || 820.43 | 783.71 | -4% || 0.85 | 0.88 | +3% | 0.2251 |
+| 18a || 198.98 | 186.66 | -6% || 0.85 | 0.88 | +3% | 0.4915 |
+| 18b || 273.51 | 209.74 | -23% || 0.85 | 0.88 | +3% | 0.0012 |
+| 18c || 467.11 | 411.30 | -12% || 0.85 | 0.88 | +3% | 0.0438 |
+| 19a || 423.56 | 353.35 | -17% || 0.85 | 0.88 | +3% | 0.0037 |
+| 19b || 297.83 | 276.17 | -7% || 0.85 | 0.88 | +3% | 0.3181 |
+| 19c || 486.98 | 463.49 | -5% || 0.85 | 0.88 | +3% | 0.4169 |
+| 19d || 1008.33 | 958.27 | -5% || 0.85 | 0.88 | +3% | 0.1390 |
-| 1a || 38.84 | 42.42 | +9% || 0.85 | 0.88 | +3% | 0.6668 |
+| 1b || 44.81 | 29.39 | -34% || 0.85 | 0.88 | +3% | 0.0165 |
| 1c || 42.22 | 42.15 | -0% || 0.85 | 0.88 | +3% | 0.9938 |
| 1d || 25.33 | 26.40 | +4% || 0.85 | 0.88 | +3% | 0.8137 |
| 20a || 331.26 | 332.93 | +1% || 0.85 | 0.88 | +3% | 0.9404 |
| 20b || 302.16 | 306.24 | +1% || 0.85 | 0.88 | +3% | 0.8596 |
-| 20c || 294.61 | 325.40 | +10% || 0.85 | 0.88 | +3% | 0.2108 |
+| 21a || 142.18 | 106.24 | -25% || 0.85 | 0.88 | +3% | 0.0161 |
+| 21b || 121.77 | 93.88 | -23% || 0.85 | 0.88 | +3% | 0.0573 |
+| 21c || 167.44 | 115.41 | -31% || 0.85 | 0.88 | +3% | 0.0077 |
| 22a || 347.03 | 361.05 | +4% || 0.85 | 0.88 | +3% | 0.5992 |
+| 22b || 307.83 | 292.08 | -5% || 0.85 | 0.88 | +3% | 0.5354 |
| 22c || 449.30 | 456.58 | +2% || 0.85 | 0.88 | +3% | 0.7846 |
| 22d || 632.37 | 631.60 | -0% || 0.85 | 0.88 | +3% | 0.9817 |
-| 23a || 115.57 | 122.22 | +6% || 0.85 | 0.88 | +3% | 0.6358 |
+| 23b || 103.59 | 89.32 | -14% || 0.85 | 0.88 | +3% | 0.2370 |
-| 23c || 114.74 | 148.06 | +29% || 0.85 | 0.88 | +3% | 0.0357 |
+| 24a || 300.57 | 260.65 | -13% || 0.85 | 0.88 | +3% | 0.0809 |
+| 24b || 225.96 | 194.71 | -14% || 0.85 | 0.88 | +3% | 0.1017 |
-| 25a || 296.05 | 322.38 | +9% || 0.85 | 0.88 | +3% | 0.2929 |
+| 25b || 180.99 | 138.00 | -24% || 0.85 | 0.88 | +3% | 0.0377 |
+| 25c || 636.36 | 576.64 | -9% || 0.85 | 0.88 | +3% | 0.0561 |
-| 26a || 290.46 | 319.96 | +10% || 0.85 | 0.88 | +3% | 0.1316 |
-| 26b || 179.26 | 227.08 | +27% || 0.85 | 0.88 | +3% | 0.0067 |
+| 26c || 417.73 | 386.20 | -8% || 0.85 | 0.88 | +3% | 0.1642 |
+| 27a || 136.11 | 124.79 | -8% || 0.85 | 0.88 | +3% | 0.4868 |
+| 27b || 149.51 | 131.86 | -12% || 0.85 | 0.88 | +3% | 0.2689 |
+| 27c || 162.77 | 125.82 | -23% || 0.85 | 0.88 | +3% | 0.0522 |
-| 28a || 440.19 | 482.65 | +10% || 0.85 | 0.88 | +3% | 0.1158 |
| 28b || 191.74 | 194.01 | +1% || 0.85 | 0.88 | +3% | 0.9133 |
| 28c || 442.23 | 439.33 | -1% || 0.85 | 0.88 | +3% | 0.9173 |
+| 29a || 223.10 | 193.05 | -13% || 0.85 | 0.88 | +3% | 0.1021 |
+| 29b || 344.21 | 244.45 | -29% || 0.85 | 0.88 | +3% | 0.0000 |
+| 29c || 301.69 | 243.95 | -19% || 0.85 | 0.88 | +3% | 0.0120 |
+| 2a || 114.72 | 106.88 | -7% || 0.85 | 0.88 | +3% | 0.5962 |
-| 2b || 96.28 | 108.37 | +13% || 0.85 | 0.88 | +3% | 0.3538 |
-| 2c || 74.43 | 91.38 | +23% || 0.85 | 0.88 | +3% | 0.2104 |
-| 2d || 167.93 | 186.63 | +11% || 0.85 | 0.88 | +3% | 0.2386 |
+| 30a || 292.98 | 239.90 | -18% || 0.85 | 0.88 | +3% | 0.0339 |
+| 30b || 238.27 | 222.51 | -7% || 0.85 | 0.88 | +3% | 0.4404 |
-| 30c || 422.35 | 477.55 | +13% || 0.85 | 0.88 | +3% | 0.0419 |
+| 31a || 208.43 | 185.50 | -11% || 0.85 | 0.88 | +3% | 0.2714 |
+| 31b || 171.21 | 144.27 | -16% || 0.85 | 0.88 | +3% | 0.1324 |
+| 31c || 235.24 | 192.65 | -18% || 0.85 | 0.88 | +3% | 0.0326 |
-| 32a || 29.68 | 34.28 | +15% || 0.85 | 0.88 | +3% | 0.4399 |
-| 32b || 114.06 | 138.79 | +22% || 0.85 | 0.88 | +3% | 0.0709 |
| 33a || 104.93 | 104.51 | -0% || 0.85 | 0.88 | +3% | 0.9784 |
-| 33b || 68.42 | 84.10 | +23% || 0.85 | 0.88 | +3% | 0.1996 |
-| 33c || 121.08 | 143.06 | +18% || 0.85 | 0.88 | +3% | 0.1675 |
+| 3a || 198.89 | 167.90 | -16% || 0.85 | 0.88 | +3% | 0.1205 |
-| 3b || 44.00 | 46.96 | +7% || 0.85 | 0.88 | +3% | 0.6943 |
+| 3c || 315.64 | 274.36 | -13% || 0.85 | 0.88 | +3% | 0.0759 |
-| 4a || 200.35 | 238.44 | +19% || 0.85 | 0.88 | +3% | 0.0530 |
-| 4b || 36.10 | 57.85 | +60% || 0.85 | 0.88 | +3% | 0.0242 |
| 4c || 265.89 | 258.28 | -3% || 0.85 | 0.88 | +3% | 0.7465 |
+| 5a || 156.34 | 135.25 | -13% || 0.85 | 0.88 | +3% | 0.2209 |
| 5b || 123.16 | 118.69 | -4% || 0.85 | 0.88 | +3% | 0.7808 |
+| 5c || 223.46 | 186.15 | -17% || 0.85 | 0.88 | +3% | 0.0408 |
| 6a || 125.06 | 123.57 | -1% || 0.85 | 0.88 | +3% | 0.9167 |
| 6b || 135.32 | 131.38 | -3% || 0.85 | 0.88 | +3% | 0.7794 |
| 6c || 99.37 | 100.36 | +1% || 0.85 | 0.88 | +3% | 0.9337 |
| 6d || 379.00 | 385.84 | +2% || 0.85 | 0.88 | +3% | 0.7617 |
-| 6e || 108.22 | 138.98 | +28% || 0.85 | 0.88 | +3% | 0.0774 |
+| 6f || 890.10 | 841.63 | -5% || 0.85 | 0.88 | +3% | 0.0596 |
-| 7a || 131.87 | 141.95 | +8% || 0.85 | 0.88 | +3% | 0.5167 |
+| 7b || 142.08 | 135.12 | -5% || 0.85 | 0.88 | +3% | 0.6780 |
+| 7c || 827.22 | 744.44 | -10% || 0.85 | 0.88 | +3% | 0.0098 |
-| 8a || 150.37 | 188.42 | +25% || 0.85 | 0.88 | +3% | 0.0554 |
+| 8b || 168.26 | 159.76 | -5% || 0.85 | 0.88 | +3% | 0.6726 |
| 8c || 1660.90 | 1641.26 | -1% || 0.85 | 0.88 | +3% | 0.5622 |
-| 8d || 438.84 | 554.22 | +26% || 0.85 | 0.88 | +3% | 0.0000 |
+| 9a || 483.55 | 440.32 | -9% || 0.85 | 0.88 | +3% | 0.1160 |
-| 9b || 321.19 | 353.57 | +10% || 0.85 | 0.88 | +3% | 0.1975 |
+| 9c || 551.04 | 416.28 | -24% || 0.85 | 0.88 | +3% | 0.0000 |
+| 9d || 788.32 | 730.14 | -7% || 0.85 | 0.88 | +3% | 0.0490 |
+---------++----------+----------+--------++----------+----------+--------+---------+
| Sum || 37454.77 | 36312.35 | -3% || | | | |
| Geomean || | | || | | +3% | |
+---------++----------+----------+--------++----------+----------+--------+---------+hyriseBenchmarkStarSchema - single-threaded Sum of avg. item runtimes: -1% || Geometric mean of throughput changes: +1%Configuration Overview - click to expand +Configuration Overview---+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkStarSchema_29332b1ca0b941194d0cb7ba7aa2438b20442365_st.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkStarSchema_5ee9098de05cdcf3b290393d44461d8970302257_st.json |
+-------------------------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 29332b1ca0b941194d0cb7ba7aa2438b20442365-dirty | 5ee9098de05cdcf3b290393d44461d8970302257-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-08-11 01:22:16 | 2024-08-11 05:04:25 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+ +---------++----------+---------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| 1.1 || 290.34 | 283.84 | -2%˄ || 3.44 | 3.52 | +2%˄ | (run time too short) |
| 1.2 || 147.32 | 145.06 | -2%˄ || 6.79 | 6.89 | +2%˄ | (run time too short) |
| 1.3 || 139.74 | 138.87 | -1%˄ || 7.16 | 7.20 | +1%˄ | (run time too short) |
| 2.1 || 424.90 | 419.92 | -1%˄ || 2.35 | 2.38 | +1%˄ | (run time too short) |
| 2.2 || 215.05 | 213.96 | -1%˄ || 4.65 | 4.67 | +1%˄ | (run time too short) |
| 2.3 || 142.92 | 142.70 | -0%˄ || 7.00 | 7.01 | +0%˄ | (run time too short) |
| 3.1 || 2625.49 | 2590.99 | -1% || 0.38 | 0.39 | +1% | 0.1510 |
| 3.2 || 245.96 | 242.88 | -1%˄ || 4.07 | 4.12 | +1%˄ | (run time too short) |
| 3.3 || 116.87 | 116.22 | -1%˄ || 8.56 | 8.60 | +1%˄ | (run time too short) |
| 3.4 || 110.22 | 113.87 | +3%˄ || 9.07 | 8.78 | -3%˄ | (run time too short) |
| 4.1 || 2359.79 | 2328.54 | -1% || 0.42 | 0.43 | +1% | 0.0508 |
| 4.2 || 752.54 | 737.43 | -2%˄ || 1.33 | 1.36 | +2%˄ | (run time too short) |
| 4.3 || 217.83 | 213.55 | -2%˄ || 4.59 | 4.68 | +2%˄ | (run time too short) |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| Sum || 7788.96 | 7687.82 | -1% || | | | |
| Geomean || | | || | | +1% | |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+---------+--------++----------+----------+--------+----------------------+hyriseBenchmarkStarSchema - multi-threaded, ordered, 1 client, 32 cores Sum of avg. item runtimes: -5% || Geometric mean of throughput changes: +7%Configuration Overview - click to expand +Configuration Overview---------+----------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkStarSchema_29332b1ca0b941194d0cb7ba7aa2438b20442365_mt_ordered.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkStarSchema_5ee9098de05cdcf3b290393d44461d8970302257_mt_ordered.json |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 29332b1ca0b941194d0cb7ba7aa2438b20442365-dirty | 5ee9098de05cdcf3b290393d44461d8970302257-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535
AE88
|
| clients | 1 | 1 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 32 | 32 |
| data_preparation_cores | 0 | 0 |
| date | 2024-08-11 01:27:19 | 2024-08-11 05:09:28 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [32] | [32] |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------+ +---------++----------+---------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
+| 1.1 || 115.04 | 107.05 | -7%˄ || 8.69 | 9.34 | +7%˄ | (run time too short) |
+| 1.2 || 90.85 | 83.82 | -8%˄ || 11.00 | 11.92 | +8%˄ | (run time too short) |
+| 1.3 || 84.96 | 79.40 | -7%˄ || 11.76 | 12.59 | +7%˄ | (run time too short) |
+| 2.1 || 396.83 | 356.10 | -10%˄ || 2.52 | 2.81 | +11%˄ | (run time too short) |
+| 2.2 || 186.06 | 166.72 | -10%˄ || 5.37 | 6.00 | +12%˄ | (run time too short) |
+| 2.3 || 75.51 | 68.12 | -10%˄ || 13.24 | 14.67 | +11%˄ | (run time too short) |
| 3.1 || 934.22 | 912.30 | -2%˄ || 1.07 | 1.10 | +2%˄ | (run time too short) |
+| 3.2 || 175.99 | 160.85 | -9%˄ || 5.68 | 6.22 | +9%˄ | (run time too short) |
+| 3.3 || 101.61 | 88.91 | -12%˄ || 9.84 | 11.24 | +14%˄ | (run time too short) |
+| 3.4 || 97.87 | 93.18 | -5%˄ || 10.21 | 10.73 | +5%˄ | (run time too short) |
| 4.1 || 931.73 | 908.16 | -3%˄ || 1.07 | 1.10 | +3%˄ | (run time too short) |
| 4.2 || 436.81 | 418.75 | -4%˄ || 2.29 | 2.39 | +4%˄ | (run time too short) |
| 4.3 || 147.11 | 144.41 | -2%˄ || 6.80 | 6.92 | +2%˄ | (run time too short) |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
+| Sum || 3774.58 | 3587.78 | -5% || | | | |
+| Geomean || | | || | | +7% | |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+---------+--------++----------+----------+--------+----------------------+hyriseBenchmarkStarSchema - multi-threaded, shuffled, 32 clients, 32 cores Sum of avg. item runtimes: -4% || Geometric mean of throughput changes: +4%Configuration Overview - click to expand +Configuration Overview---------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkStarSchema_29332b1ca0b941194d0cb7ba7aa2438b20442365_mt.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkStarSchema_5ee9098de05cdcf3b290393d44461d8970302257_mt.json |
+-------------------------------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 29332b1ca0b941194d0cb7ba7aa2438b20442365-dirty | 5ee9098de05cdcf3b290393d44461d8970302257-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 32 | 32 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 32 | 32 |
| data_preparation_cores | 0 | 0 |
| date | 2024-08-11 01:31:14 | 2024-08-11 05:13:14 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [32] | [32] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+---------+
+| 1.1 || 521.52 | 454.62 | -13% || 3.06 | 3.18 | +4% | 0.0000 |
+| 1.2 || 294.37 | 268.65 | -9% || 3.06 | 3.18 | +4% | 0.0058 |
+| 1.3 || 272.79 | 244.00 | -11% || 3.06 | 3.18 | +4% | 0.0011 |
+| 2.1 || 1278.29 | 960.35 | -25% || 3.06 | 3.17 | +4% | 0.0000 |
+| 2.2 || 671.26 | 593.21 | -12% || 3.06 | 3.17 | +4% | 0.0000 |
-| 2.3 || 233.59 | 290.93 | +25% || 3.06 | 3.18 | +4% | 0.0000 |
| 3.1 || 2069.01 | 2084.17 | +1% || 3.06 | 3.17 | +4% | 0.5060 |
| 3.2 || 619.13 | 597.91 | -3% || 3.06 | 3.17 | +4% | 0.2174 |
| 3.3 || 307.61 | 314.79 | +2% || 3.06 | 3.18 | +4% | 0.5738 |
| 3.4 || 288.22 | 283.00 | -2% || 3.06 | 3.18 | +4% | 0.6455 |
-| 4.1 || 1843.32 | 1948.84 | +6% || 3.06 | 3.17 | +4% | 0.0001 |
| 4.2 || 1570.63 | 1528.33 | -3% || 3.06 | 3.17 | +4% | 0.1213 |
-| 4.3 || 462.55 | 498.18 | +8% || 3.06 | 3.18 | +4% | 0.0184 |
+---------++----------+----------+--------++----------+----------+--------+---------+
| Sum || 10432.31 | 10066.99 | -4% || | | | |
| Geomean || | | || | | +4% | |
+---------++----------+----------+--------++----------+----------+--------+---------+ |
dey4ss
reviewed
Aug 12, 2024
|
Struggling with a macOS-only issue that I don't understand yet. |
BenchmarksIntelSystem nx05 - click to expand
Commit Info and Build Time
hyriseBenchmarkTPCH - single-threaded, SF 10.0 Sum of avg. item runtimes: -0% || Geometric mean of throughput changes: -0%Configuration Overview - click to expand +Configuration Overview----+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCH_a7abe4451af5dea62f4c67749d4356f60b0ce712_st.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCH_fcb37b4081805fcd3c4e1b99414436f9631730e3_st.json |
+--------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
| GIT-HASH | a7abe4451af5dea62f4c67749d4356f60b0ce712-dirty | fcb37b4081805fcd3c4e1b99414436f9631730e3-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-10-02 06:20:56 | 2024-10-02 10:04:14 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+--------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+ +----------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| TPC-H 01 || 6661.62 | 6784.27 | +2% || 0.15 | 0.15 | -2% | ˅ |
| TPC-H 02 || 37.96 | 39.61 | +4%˄ || 26.34 | 25.24 | -4%˄ | (run time too short) |
| TPC-H 03 || 1211.77 | 1193.10 | -2%˄ || 0.83 | 0.84 | +2%˄ | 0.0266 |
| TPC-H 04 || 1350.18 | 1321.21 | -2% || 0.74 | 0.76 | +2% | 0.0051 |
| TPC-H 05 || 1764.93 | 1785.75 | +1% || 0.57 | 0.56 | -1% | 0.0036 |
| TPC-H 06 || 163.55 | 163.21 | -0%˄ || 6.11 | 6.13 | +0%˄ | (run time too short) |
| TPC-H 07 || 654.56 | 657.28 | +0%˄ || 1.53 | 1.52 | -0%˄ | (run time too short) |
| TPC-H 08 || 425.64 | 420.81 | -1%˄ || 2.35 | 2.38 | +1%˄ | (run time too short) |
| TPC-H 09 || 4375.53 | 4413.76 | +1% || 0.23 | 0.23 | -1% | 0.0316 |
| TPC-H 10 || 1117.26 | 1128.92 | +1%˄ || 0.90 | 0.89 | -1%˄ | (run time too short) |
| TPC-H 11 || 54.67 | 55.92 | +2%˄ || 18.29 | 17.88 | -2%˄ | (run time too short) |
| TPC-H 12 || 842.64 | 832.82 | -1%˄ || 1.19 | 1.20 | +1%˄ | (run time too short) |
| TPC-H 13 || 4361.49 | 4327.86 | -1% || 0.23 | 0.23 | +1% | 0.3167 |
| TPC-H 14 || 359.65 | 362.00 | +1%˄ || 2.78 | 2.76 | -1%˄ | (run time too short) |
| TPC-H 15 || 162.56 | 162.88 | +0%˄ || 6.15 | 6.14 | -0%˄ | (run time too short) |
| TPC-H 16 || 507.32 | 510.10 | +1%˄ || 1.97 | 1.96 | -1%˄ | (run time too short) |
| TPC-H 17 || 159.25 | 161.15 | +1%˄ || 6.28 | 6.21 | -1%˄ | (run time too short) |
+| TPC-H 18 || 1727.22 | 1635.69 | -5% || 0.58 | 0.61 | +6% | 0.0006 |
| TPC-H 19 || 201.68 | 199.66 | -1%˄ || 4.96 | 5.01 | +1%˄ | (run time too short) |
| TPC-H 20 || 419.94 | 422.98 | +1%˄ || 2.38 | 2.36 | -1%˄ | (run time too short) |
| TPC-H 21 || 3205.20 | 3158.69 | -1% || 0.31 | 0.32 | +1% | 0.0993 |
| TPC-H 22 || 417.89 | 424.44 | +2%˄ || 2.39 | 2.36 | -2%˄ | (run time too short) |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| Sum || 30182.51 | 30162.11 | -0% || | | | |
| Geomean || | | || | | -0% | |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
| || ˅ Insufficient number of runs for p-value calculation |
+----------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCH - single-threaded, SF 0.01 Sum of avg. item runtimes: -0% || Geometric mean of throughput changes: -1%Configuration Overview - click to expand +Configuration Overview----+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCH_a7abe4451af5dea62f4c67749d4356f60b0ce712_st_s01.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCH_fcb37b4081805fcd3c4e1b99414436f9631730e3_st_s01.json |
+--------------------------+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | a7abe4451af5dea62f4c67749d4356f60b0ce712-dirty | fcb37b4081805fcd3c4e1b99414436f9631730e3-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-10-02 06:36:02 | 2024-10-02 10:19:21 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 0.009999999776482582 | 0.009999999776482582 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+--------------------------+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+ +----------++----------+---------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+----------++----------+---------+--------++----------+----------+--------+----------------------+
| TPC-H 01 || 5.75 | 5.74 | -0%˄ || 173.97 | 174.17 | +0%˄ | (run time too short) |
+| TPC-H 02 || 3.95 | 3.75 | -5%˄ || 253.17 | 266.56 | +5%˄ | (run time too short) |
| TPC-H 03 || 0.51 | 0.51 | +0%˄ || 1963.63 | 1958.29 | -0%˄ | (run time too short) |
| TPC-H 04 || 0.39 | 0.40 | +3%˄ || 2572.13 | 2506.60 | -3%˄ | (run time too short) |
| TPC-H 05 || 0.99 | 1.00 | +1%˄ || 1005.16 | 997.87 | -1%˄ | (run time too short) |
| TPC-H 06 || 0.16 | 0.16 | -1%˄ || 6134.56 | 6176.54 | +1%˄ | (run time too short) |
+| TPC-H 07 || 10.64 | 10.14 | -5%˄ || 93.97 | 98.58 | +5%˄ | (run time too short) |
| TPC-H 08 || 15.13 | 14.72 | -3%˄ || 66.07 | 67.94 | +3%˄ | (run time too short) |
-| TPC-H 09 || 2.85 | 3.85 | +35%˄ || 350.23 | 259.86 | -26%˄ | (run time too short) |
| TPC-H 10 || 0.64 | 0.64 | -1%˄ || 1548.73 | 1559.09 | +1%˄ | (run time too short) |
| TPC-H 11 || 0.17 | 0.17 | -1%˄ || 5727.73 | 5763.11 | +1%˄ | (run time too short) |
| TPC-H 12 || 0.60 | 0.60 | -0%˄ || 1657.58 | 1658.99 | +0%˄ | (run time too short) |
| TPC-H 13 || 2.29 | 2.27 | -1%˄ || 436.37 | 441.03 | +1%˄ | (run time too short) |
| TPC-H 14 || 0.30 | 0.30 | -1%˄ || 3283.93 | 3332.60 | +1%˄ | (run time too short) |
| TPC-H 15 || 1.28 | 1.26 | -2%˄ || 775.97 | 793.17 | +2%˄ | (run time too short) |
| TPC-H 16 || 2.04 | 2.06 | +1%˄ || 489.82 | 484.65 | -1%˄ | (run time too short) |
-| TPC-H 17 || 0.54 | 0.61 | +13%˄ || 1859.16 | 1647.98 | -11%˄ | (run time too short) |
| TPC-H 18 || 1.27 | 1.25 | -1%˄ || 789.33 | 799.15 | +1%˄ | (run time too short) |
| TPC-H 19 || 4.87 | 4.85 | -0%˄ || 205.11 | 205.90 | +0%˄ | (run time too short) |
| TPC-H 20 || 2.57 | 2.52 | -2%˄ || 388.22 | 396.00 | +2%˄ | (run time too short) |
| TPC-H 21 || 1.06 | 1.04 | -1%˄ || 944.03 | 956.19 | +1%˄ | (run time too short) |
| TPC-H 22 || 1.11 | 1.11 | +0%˄ || 898.97 | 896.67 | -0%˄ | (run time too short) |
+----------++----------+---------+--------++----------+----------+--------+----------------------+
| Sum || 59.13 | 58.95 | -0% || | | | |
| Geomean || | | || | | -1% | |
+----------++----------+---------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+----------++----------+---------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCH - multi-threaded, ordered, 1 client, 32 cores, SF 10.0 Sum of avg. item runtimes: -0% || Geometric mean of throughput changes: +1%Configuration Overview - click to expand +Configuration Overview---------+----------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCH_a7abe4451af5dea62f4c67749d4356f60b0ce712_mt_ordered.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCH_fcb37b4081805fcd3c4e1b99414436f9631730e3_mt_ordered.json |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | a7abe4451af5dea62f4c67749d4356f60b0ce712-dirty | fcb37b4081805fcd3c4e1b99414436f9631730e3-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 32 | 32 |
| data_preparation_cores | 0 | 0 |
| date | 2024-10-02 06:36:27 | 2024-10-02 10:19:46 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [32] | [32] |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------+ +----------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| TPC-H 01 || 5125.80 | 5155.78 | +1% || 0.20 | 0.19 | -1% | 0.4062 |
| TPC-H 02 || 69.07 | 66.46 | -4%˄ || 14.47 | 15.04 | +4%˄ | (run time too short) |
| TPC-H 03 || 738.66 | 725.63 | -2%˄ || 1.35 | 1.38 | +2%˄ | (run time too short) |
| TPC-H 04 || 657.00 | 645.36 | -2%˄ || 1.52 | 1.55 | +2%˄ | (run time too short) |
| TPC-H 05 || 591.91 | 586.68 | -1%˄ || 1.69 | 1.70 | +1%˄ | (run time too short) |
| TPC-H 06 || 74.05 | 72.20 | -2%˄ || 13.50 | 13.84 | +3%˄ | (run time too short) |
| TPC-H 07 || 296.09 | 291.68 | -1%˄ || 3.38 | 3.43 | +2%˄ | (run time too short) |
| TPC-H 08 || 276.70 | 274.66 | -1%˄ || 3.61 | 3.64 | +1%˄ | (run time too short) |
| TPC-H 09 || 1758.71 | 1729.93 | -2% || 0.57 | 0.58 | +2% | 0.0086 |
| TPC-H 10 || 579.32 | 578.50 | -0%˄ || 1.73 | 1.73 | +0%˄ | (run time too short) |
| TPC-H 11 || 88.72 | 88.78 | +0%˄ || 11.27 | 11.26 | -0%˄ | (run time too short) |
| TPC-H 12 || 510.71 | 501.90 | -2%˄ || 1.96 | 1.99 | +2%˄ | (run time too short) |
| TPC-H 13 || 1930.15 | 1940.77 | +1% || 0.52 | 0.52 | -1% | 0.1366 |
| TPC-H 14 || 167.24 | 165.60 | -1%˄ || 5.98 | 6.04 | +1%˄ | (run time too short) |
| TPC-H 15 || 143.59 | 143.27 | -0%˄ || 6.96 | 6.98 | +0%˄ | (run time too short) |
| TPC-H 16 || 630.52 | 637.68 | +1%˄ || 1.59 | 1.57 | -1%˄ | (run time too short) |
| TPC-H 17 || 91.85 | 91.07 | -1%˄ || 10.88 | 10.98 | +1%˄ | (run time too short) |
| TPC-H 18 || 1879.38 | 1862.28 | -1% || 0.53 | 0.54 | +1% | 0.5253 |
| TPC-H 19 || 129.98 | 131.13 | +1%˄ || 7.69 | 7.62 | -1%˄ | (run time too short) |
| TPC-H 20 || 239.07 | 235.02 | -2%˄ || 4.18 | 4.25 | +2%˄ | (run time too short) |
| TPC-H 21 || 1038.19 | 1030.20 | -1%˄ || 0.96 | 0.97 | +1%˄ | (run time too short) |
| TPC-H 22 || 163.14 | 163.25 | +0%˄ || 6.13 | 6.12 | -0%˄ | (run time too short) |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| Sum || 17179.85 | 17117.85 | -0% || | | | |
| Geomean || | | || | | +1% | |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+----------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCH - multi-threaded, shuffled, 32 clients, 32 cores, SF 10.0 Sum of avg. item runtimes: -1% || Geometric mean of throughput changes: +1%Configuration Overview - click to expand +Configuration Overview---------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCH_a7abe4451af5dea62f4c67749d4356f60b0ce712_mt.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCH_fcb37b4081805fcd3c4e1b99414436f9631730e3_mt.json |
+-------------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
| GIT-HASH | a7abe4451af5dea62f4c67749d4356f60b0ce712-dirty | fcb37b4081805fcd3c4e1b99414436f9631730e3-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 32 | 32 |
| clustering | None | None |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 32 | 32 |
| data_preparation_cores | 0 | 0 |
| date | 2024-10-02 06:48:36 | 2024-10-02 10:31:48 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [32] | [32] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+ +----------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+----------++----------+----------+--------++----------+----------+--------+---------+
| TPC-H 01 || 5727.39 | 5673.78 | -1% || 0.77 | 0.79 | +1% | 0.3741 |
-| TPC-H 02 || 269.23 | 405.48 | +51% || 0.78 | 0.79 | +1% | 0.0114 |
| TPC-H 03 || 1920.12 | 2001.21 | +4% || 0.78 | 0.79 | +1% | 0.4813 |
-| TPC-H 04 || 1502.15 | 1589.68 | +6% || 0.78 | 0.79 | +1% | 0.3683 |
-| TPC-H 05 || 2525.31 | 2762.63 | +9% || 0.78 | 0.79 | +1% | 0.1159 |
+| TPC-H 06 || 514.89 | 413.50 | -20% || 0.78 | 0.79 | +1% | 0.1412 |
+| TPC-H 07 || 2102.90 | 1858.61 | -12% || 0.78 | 0.79 | +1% | 0.0582 |
| TPC-H 08 || 1556.68 | 1603.95 | +3% || 0.78 | 0.79 | +1% | 0.7100 |
+| TPC-H 09 || 4168.78 | 3797.52 | -9% || 0.78 | 0.79 | +1% | 0.0200 |
| TPC-H 10 || 2235.16 | 2294.35 | +3% || 0.78 | 0.79 | +1% | 0.6342 |
-| TPC-H 11 || 360.69 | 400.26 | +11% || 0.78 | 0.79 | +1% | 0.4689 |
+| TPC-H 12 || 1753.50 | 1547.68 | -12% || 0.78 | 0.79 | +1% | 0.0498 |
| TPC-H 13 || 3849.30 | 3832.02 | -0% || 0.78 | 0.79 | +1% | 0.8556 |
+| TPC-H 14 || 811.73 | 675.04 | -17% || 0.78 | 0.79 | +1% | 0.0837 |
+| TPC-H 15 || 485.51 | 397.27 | -18% || 0.78 | 0.79 | +1% | 0.0528 |
-| TPC-H 16 || 1394.53 | 1591.98 | +14% || 0.78 | 0.79 | +1% | 0.0337 |
-| TPC-H 17 || 477.46 | 607.50 | +27% || 0.78 | 0.79 | +1% | 0.0248 |
+| TPC-H 18 || 3011.88 | 2741.56 | -9% || 0.78 | 0.79 | +1% | 0.0010 |
+| TPC-H 19 || 820.48 | 764.85 | -7% || 0.78 | 0.79 | +1% | 0.5513 |
| TPC-H 20 || 1191.39 | 1234.84 | +4% || 0.78 | 0.79 | +1% | 0.6787 |
| TPC-H 21 || 3368.99 | 3376.82 | +0% || 0.78 | 0.79 | +1% | 0.9604 |
-| TPC-H 22 || 721.19 | 791.33 | +10% || 0.78 | 0.79 | +1% | 0.3690 |
+----------++----------+----------+--------++----------+----------+--------+---------+
| Sum || 40769.28 | 40361.87 | -1% || | | | |
| Geomean || | | || | | +1% | |
+----------++----------+----------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCDS - single-threaded Sum of avg. item runtimes: +1% || Geometric mean of throughput changes: -3%Configuration Overview - click to expand +Configuration Overview---+---------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCDS_a7abe4451af5dea62f4c67749d4356f60b0ce712_st.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCDS_fcb37b4081805fcd3c4e1b99414436f9631730e3_st.json |
+-------------------------+---------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------+
| GIT-HASH | a7abe4451af5dea62f4c67749d4356f60b0ce712-dirty | fcb37b4081805fcd3c4e1b99414436f9631730e3-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-10-02 07:10:14 | 2024-10-02 10:53:28 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+---------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| 01 || 212.51 | 217.57 | +2%˄ || 4.71 | 4.60 | -2%˄ | (run time too short) |
-| 03 || 54.61 | 58.96 | +8%˄ || 18.31 | 16.96 | -7%˄ | (run time too short) |
-| 06 || 173.02 | 182.33 | +5%˄ || 5.78 | 5.48 | -5%˄ | (run time too short) |
-| 07 || 260.00 | 272.02 | +5%˄ || 3.85 | 3.68 | -4%˄ | (run time too short) |
-| 09 || 564.68 | 592.44 | +5%˄ || 1.77 | 1.69 | -5%˄ | (run time too short) |
-| 10 || 135.01 | 142.31 | +5%˄ || 7.41 | 7.03 | -5%˄ | (run time too short) |
| 13 || 467.18 | 463.39 | -1%˄ || 2.14 | 2.16 | +1%˄ | (run time too short) |
| 15 || 103.97 | 103.41 | -1%˄ || 9.62 | 9.67 | +1%˄ | (run time too short) |
| 16 || 69.55 | 70.60 | +2%˄ || 14.38 | 14.16 | -1%˄ | (run time too short) |
| 17 || 294.13 | 297.45 | +1%˄ || 3.40 | 3.36 | -1%˄ | (run time too short) |
| 19 || 97.06 | 100.77 | +4%˄ || 10.30 | 9.92 | -4%˄ | (run time too short) |
| 25 || 161.07 | 166.00 | +3%˄ || 6.21 | 6.02 | -3%˄ | (run time too short) |
| 26 || 120.73 | 119.01 | -1%˄ || 8.28 | 8.40 | +1%˄ | (run time too short) |
| 28 || 580.16 | 585.02 | +1%˄ || 1.72 | 1.71 | -1%˄ | (run time too short) |
| 29 || 461.85 | 472.33 | +2%˄ || 2.17 | 2.12 | -2%˄ | (run time too short) |
| 31 || 1203.81 | 1225.15 | +2%˄ || 0.83 | 0.82 | -2%˄ | 0.0000 |
| 32 || 33.31 | 32.43 | -3%˄ || 30.02 | 30.83 | +3%˄ | (run time too short) |
| 34 || 151.61 | 157.17 | +4%˄ || 6.60 | 6.36 | -4%˄ | (run time too short) |
| 35 || 574.79 | 588.37 | +2%˄ || 1.74 | 1.70 | -2%˄ | (run time too short) |
| 37 || 446.19 | 462.02 | +4%˄ || 2.24 | 2.16 | -3%˄ | (run time too short) |
| 39a || 1468.67 | 1509.66 | +3% || 0.68 | 0.66 | -3% | 0.0000 |
| 39b || 1508.04 | 1513.45 | +0% || 0.66 | 0.66 | -0% | 0.5496 |
| 41 || 280.80 | 284.45 | +1%˄ || 3.56 | 3.52 | -1%˄ | (run time too short) |
-| 42 || 79.62 | 84.43 | +6%˄ || 12.56 | 11.84 | -6%˄ | (run time too short) |
| 43 || 914.53 | 916.81 | +0%˄ || 1.09 | 1.09 | -0%˄ | (run time too short) |
| 45 || 101.42 | 104.35 | +3%˄ || 9.86 | 9.58 | -3%˄ | (run time too short) |
| 48 || 1010.38 | 1025.85 | +2%˄ || 0.99 | 0.97 | -2%˄ | (run time too short) |
| 50 || 119.39 | 123.94 | +4%˄ || 8.38 | 8.07 | -4%˄ | (run time too short) |
| 52 || 80.55 | 83.03 | +3%˄ || 12.41 | 12.04 | -3%˄ | (run time too short) |
| 55 || 77.82 | 80.53 | +3%˄ || 12.85 | 12.42 | -3%˄ | (run time too short) |
| 62 || 574.67 | 573.82 | -0%˄ || 1.74 | 1.74 | +0%˄ | (run time too short) |
| 65 || 1535.84 | 1563.31 | +2% || 0.65 | 0.64 | -2% | 0.0001 |
| 69 || 145.86 | 151.66 | +4%˄ || 6.86 | 6.59 | -4%˄ | (run time too short) |
-| 73 || 81.52 | 85.77 | +5%˄ || 12.27 | 11.66 | -5%˄ | (run time too short) |
| 79 || 441.13 | 450.62 | +2%˄ || 2.27 | 2.22 | -2%˄ | (run time too short) |
| 81 || 136.89 | 139.96 | +2%˄ || 7.30 | 7.14 | -2%˄ | (run time too short) |
| 82 || 491.66 | 489.98 | -0%˄ || 2.03 | 2.04 | +0%˄ | (run time too short) |
-| 83 || 33.94 | 36.20 | +7%˄ || 29.46 | 27.63 | -6%˄ | (run time too short) |
-| 84 || 10.48 | 11.12 | +6%˄ || 95.37 | 89.95 | -6%˄ | (run time too short) |
| 85 || 145.31 | 148.64 | +2%˄ || 6.88 | 6.73 | -2%˄ | (run time too short) |
| 88 || 652.00 | 680.93 | +4%˄ || 1.53 | 1.47 | -4%˄ | (run time too short) |
| 91 || 14.95 | 15.52 | +4%˄ || 66.89 | 64.43 | -4%˄ | (run time too short) |
-| 92 || 24.83 | 26.17 | +5%˄ || 40.26 | 38.21 | -5%˄ | (run time too short) |
| 93 || 3288.56 | 3330.84 | +1% || 0.30 | 0.30 | -1% | 0.0169 |
-| 94 || 40.66 | 43.45 | +7%˄ || 24.60 | 23.01 | -6%˄ | (run time too short) |
| 95 || 4846.80 | 4821.23 | -1% || 0.21 | 0.21 | +1% | 0.8155 |
-| 96 || 64.77 | 69.25 | +7%˄ || 15.44 | 14.44 | -6%˄ | (run time too short) |
| 97 || 3885.82 | 3953.62 | +2% || 0.26 | 0.25 | -2% | 0.0025 |
| 99 || 1101.42 | 1104.63 | +0%˄ || 0.91 | 0.91 | -0%˄ | (run time too short) |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Sum || 29323.55 | 29731.96 | +1% || | | | |
| Geomean || | | || | | -3% | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCDS - multi-threaded, ordered, 1 client, 32 cores Sum of avg. item runtimes: -0% || Geometric mean of throughput changes: +0%Configuration Overview - click to expand +Configuration Overview---------+-----------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCDS_a7abe4451af5dea62f4c67749d4356f60b0ce712_mt_ordered.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCDS_fcb37b4081805fcd3c4e1b99414436f9631730e3_mt_ordered.json |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | a7abe4451af5dea62f4c67749d4356f60b0ce712-dirty | fcb37b4081805fcd3c4e1b99414436f9631730e3-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 32 | 32 |
| data_preparation_cores | 0 | 0 |
| date | 2024-10-02 07:28:47 | 2024-10-02 11:12:10 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [32] | [32] |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| 01 || 219.31 | 227.09 | +4%˄ || 4.56 | 4.40 | -3%˄ | (run time too short) |
| 03 || 38.36 | 39.85 | +4%˄ || 26.05 | 25.07 | -4%˄ | (run time too short) |
| 06 || 201.96 | 208.52 | +3%˄ || 4.95 | 4.79 | -3%˄ | (run time too short) |
+| 07 || 185.91 | 176.66 | -5%˄ || 5.38 | 5.66 | +5%˄ | (run time too short) |
| 09 || 101.24 | 100.08 | -1%˄ || 9.87 | 9.99 | +1%˄ | (run time too short) |
| 10 || 55.22 | 55.39 | +0%˄ || 18.10 | 18.04 | -0%˄ | (run time too short) |
| 13 || 281.26 | 270.39 | -4%˄ || 3.55 | 3.70 | +4%˄ | (run time too short) |
| 15 || 68.98 | 68.91 | -0%˄ || 14.49 | 14.50 | +0%˄ | (run time too short) |
| 16 || 44.50 | 45.02 | +1%˄ || 22.45 | 22.19 | -1%˄ | (run time too short) |
| 17 || 144.96 | 149.54 | +3%˄ || 6.90 | 6.69 | -3%˄ | (run time too short) |
| 19 || 85.70 | 85.72 | +0%˄ || 11.66 | 11.66 | -0%˄ | (run time too short) |
| 25 || 105.72 | 107.39 | +2%˄ || 9.46 | 9.31 | -2%˄ | (run time too short) |
| 26 || 97.98 | 98.42 | +0%˄ || 10.20 | 10.16 | -0%˄ | (run time too short) |
+| 28 || 143.78 | 132.77 | -8%˄ || 6.95 | 7.53 | +8%˄ | (run time too short) |
| 29 || 532.97 | 534.24 | +0%˄ || 1.88 | 1.87 | -0%˄ | (run time too short) |
| 31 || 468.34 | 474.72 | +1%˄ || 2.13 | 2.11 | -1%˄ | (run time too short) |
| 32 || 45.45 | 45.27 | -0%˄ || 21.98 | 22.07 | +0%˄ | (run time too short) |
| 34 || 119.36 | 118.67 | -1%˄ || 8.38 | 8.42 | +1%˄ | (run time too short) |
| 35 || 368.78 | 373.81 | +1%˄ || 2.71 | 2.67 | -1%˄ | (run time too short) |
| 37 || 190.52 | 193.08 | +1%˄ || 5.25 | 5.18 | -1%˄ | (run time too short) |
| 39a || 754.27 | 773.51 | +3%˄ || 1.33 | 1.29 | -2%˄ | (run time too short) |
| 39b || 727.38 | 726.72 | -0%˄ || 1.37 | 1.38 | +0%˄ | (run time too short) |
| 41 || 414.12 | 412.14 | -0%˄ || 2.41 | 2.43 | +0%˄ | (run time too short) |
| 42 || 63.64 | 64.29 | +1%˄ || 15.70 | 15.54 | -1%˄ | (run time too short) |
| 43 || 494.44 | 497.07 | +1%˄ || 2.02 | 2.01 | -1%˄ | (run time too short) |
| 45 || 56.77 | 57.77 | +2%˄ || 17.60 | 17.30 | -2%˄ | (run time too short) |
| 48 || 532.78 | 538.44 | +1%˄ || 1.88 | 1.86 | -1%˄ | (run time too short) |
| 50 || 109.68 | 112.38 | +2%˄ || 9.11 | 8.90 | -2%˄ | (run time too short) |
| 52 || 66.85 | 67.03 | +0%˄ || 14.95 | 14.91 | -0%˄ | (run time too short) |
| 55 || 61.66 | 60.80 | -1%˄ || 16.21 | 16.44 | +1%˄ | (run time too short) |
| 62 || 359.49 | 361.30 | +1%˄ || 2.78 | 2.77 | -1%˄ | (run time too short) |
| 65 || 1297.44 | 1322.04 | +2% || 0.77 | 0.76 | -2% | 0.0005 |
| 69 || 88.68 | 90.83 | +2%˄ || 11.27 | 11.00 | -2%˄ | (run time too short) |
| 73 || 75.27 | 75.14 | -0%˄ || 13.28 | 13.30 | +0%˄ | (run time too short) |
| 79 || 473.03 | 475.31 | +0%˄ || 2.11 | 2.10 | -0%˄ | (run time too short) |
| 81 || 187.66 | 190.56 | +2%˄ || 5.33 | 5.25 | -2%˄ | (run time too short) |
| 82 || 238.09 | 239.55 | +1%˄ || 4.20 | 4.17 | -1%˄ | (run time too short) |
| 83 || 61.27 | 61.41 | +0%˄ || 16.31 | 16.28 | -0%˄ | (run time too short) |
-| 84 || 12.64 | 13.25 | +5%˄ || 78.92 | 75.30 | -5%˄ | (run time too short) |
| 85 || 85.84 | 84.62 | -1%˄ || 11.64 | 11.81 | +1%˄ | (run time too short) |
+| 88 || 135.33 | 119.94 | -11%˄ || 7.39 | 8.33 | +13%˄ | (run time too short) |
| 91 || 25.68 | 24.69 | -4%˄ || 38.89 | 40.45 | +4%˄ | (run time too short) |
-| 92 || 34.79 | 37.55 | +8%˄ || 28.71 | 26.60 | -7%˄ | (run time too short) |
| 93 || 646.27 | 629.96 | -3%˄ || 1.55 | 1.59 | +3%˄ | (run time too short) |
| 94 || 41.80 | 40.11 | -4%˄ || 23.90 | 24.91 | +4%˄ | (run time too short) |
| 95 || 771.48 | 761.65 | -1%˄ || 1.30 | 1.31 | +1%˄ | (run time too short) |
| 96 || 62.19 | 61.99 | -0%˄ || 16.07 | 16.12 | +0%˄ | (run time too short) |
| 97 || 1417.96 | 1413.89 | -0% || 0.71 | 0.71 | +0% | 0.7013 |
+| 99 || 656.06 | 625.90 | -5%˄ || 1.52 | 1.60 | +5%˄ | (run time too short) |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Sum || 13452.83 | 13445.36 | -0% || | | | |
| Geomean || | | || | | +0% | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCDS - multi-threaded, shuffled, 32 clients, 32 cores Sum of avg. item runtimes: -1% || Geometric mean of throughput changes: +1%Configuration Overview - click to expand +Configuration Overview---------+---------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCDS_a7abe4451af5dea62f4c67749d4356f60b0ce712_mt.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCDS_fcb37b4081805fcd3c4e1b99414436f9631730e3_mt.json |
+-------------------------------+---------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------+
| GIT-HASH | a7abe4451af5dea62f4c67749d4356f60b0ce712-dirty | fcb37b4081805fcd3c4e1b99414436f9631730e3-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 32 | 32 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 32 | 32 |
| data_preparation_cores | 0 | 0 |
| date | 2024-10-02 07:41:38 | 2024-10-02 11:25:01 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [32] | [32] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+---------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+---------+
| 01 || 552.45 | 575.14 | +4% || 0.77 | 0.77 | +1% | 0.5919 |
| 03 || 214.42 | 212.25 | -1% || 0.77 | 0.77 | +1% | 0.9425 |
| 06 || 593.01 | 572.14 | -4% || 0.77 | 0.77 | +1% | 0.6491 |
| 07 || 668.07 | 644.74 | -3% || 0.77 | 0.77 | +1% | 0.5882 |
+| 09 || 577.25 | 399.15 | -31% || 0.77 | 0.77 | +1% | 0.0001 |
| 10 || 540.05 | 543.99 | +1% || 0.77 | 0.77 | +1% | 0.9379 |
| 13 || 1170.74 | 1209.61 | +3% || 0.77 | 0.77 | +1% | 0.5428 |
-| 15 || 375.35 | 438.55 | +17% || 0.77 | 0.77 | +1% | 0.1482 |
| 16 || 368.80 | 378.29 | +3% || 0.77 | 0.77 | +1% | 0.8059 |
| 17 || 855.46 | 856.23 | +0% || 0.77 | 0.77 | +1% | 0.9894 |
| 19 || 451.13 | 465.64 | +3% || 0.77 | 0.77 | +1% | 0.7301 |
-| 25 || 651.52 | 775.69 | +19% || 0.77 | 0.77 | +1% | 0.0306 |
-| 26 || 384.25 | 435.39 | +13% || 0.77 | 0.77 | +1% | 0.1451 |
+| 28 || 1006.32 | 629.75 | -37% || 0.77 | 0.77 | +1% | 0.0000 |
| 29 || 1094.17 | 1118.63 | +2% || 0.77 | 0.77 | +1% | 0.6957 |
+| 31 || 1766.76 | 1631.25 | -8% || 0.77 | 0.77 | +1% | 0.0929 |
-| 32 || 130.47 | 152.04 | +17% || 0.77 | 0.77 | +1% | 0.3367 |
+| 34 || 495.52 | 445.89 | -10% || 0.77 | 0.77 | +1% | 0.1567 |
| 35 || 1396.40 | 1366.02 | -2% || 0.76 | 0.77 | +1% | 0.6440 |
+| 37 || 630.43 | 564.72 | -10% || 0.77 | 0.77 | +1% | 0.0933 |
| 39a || 1921.91 | 1845.53 | -4% || 0.77 | 0.77 | +1% | 0.3047 |
+| 39b || 1850.78 | 1759.43 | -5% || 0.76 | 0.77 | +1% | 0.1376 |
-| 41 || 1541.59 | 2880.19 | +87% || 0.77 | 0.77 | +1% | 0.0000 |
| 42 || 308.10 | 309.18 | +0% || 0.76 | 0.77 | +1% | 0.9735 |
+| 43 || 1202.04 | 1016.90 | -15% || 0.77 | 0.77 | +1% | 0.0005 |
-| 45 || 479.57 | 514.84 | +7% || 0.77 | 0.77 | +1% | 0.4677 |
| 48 || 1696.39 | 1711.04 | +1% || 0.77 | 0.77 | +1% | 0.8437 |
+| 50 || 712.86 | 599.79 | -16% || 0.77 | 0.77 | +1% | 0.0170 |
+| 52 || 307.55 | 290.52 | -6% || 0.77 | 0.77 | +1% | 0.5722 |
+| 55 || 311.27 | 274.21 | -12% || 0.77 | 0.77 | +1% | 0.2406 |
-| 62 || 839.11 | 888.52 | +6% || 0.77 | 0.77 | +1% | 0.2984 |
| 65 || 2540.03 | 2499.04 | -2% || 0.76 | 0.77 | +1% | 0.3973 |
| 69 || 701.75 | 671.28 | -4% || 0.77 | 0.77 | +1% | 0.5898 |
+| 73 || 373.53 | 308.91 | -17% || 0.77 | 0.77 | +1% | 0.0461 |
| 79 || 1043.42 | 1054.32 | +1% || 0.77 | 0.77 | +1% | 0.8348 |
-| 81 || 430.07 | 567.24 | +32% || 0.77 | 0.77 | +1% | 0.0002 |
| 82 || 686.97 | 664.41 | -3% || 0.77 | 0.77 | +1% | 0.5888 |
-| 83 || 247.29 | 287.03 | +16% || 0.77 | 0.77 | +1% | 0.2817 |
-| 84 || 99.09 | 113.42 | +14% || 0.77 | 0.77 | +1% | 0.5058 |
| 85 || 640.50 | 639.54 | -0% || 0.76 | 0.77 | +1% | 0.9860 |
+| 88 || 1653.16 | 1086.72 | -34% || 0.77 | 0.77 | +1% | 0.0000 |
-| 91 || 164.01 | 198.32 | +21% || 0.77 | 0.77 | +1% | 0.3266 |
+| 92 || 182.26 | 161.97 | -11% || 0.77 | 0.77 | +1% | 0.3430 |
+| 93 || 1402.66 | 1239.86 | -12% || 0.77 | 0.77 | +1% | 0.0021 |
+| 94 || 358.79 | 337.97 | -6% || 0.77 | 0.77 | +1% | 0.6088 |
+| 95 || 1641.37 | 1518.89 | -7% || 0.77 | 0.77 | +1% | 0.0800 |
+| 96 || 330.24 | 217.63 | -34% || 0.77 | 0.77 | +1% | 0.0004 |
| 97 || 3012.78 | 3059.44 | +2% || 0.76 | 0.77 | +1% | 0.4933 |
| 99 || 1092.22 | 1054.85 | -3% || 0.76 | 0.77 | +1% | 0.3774 |
+---------++----------+----------+--------++----------+----------+--------+---------+
| Sum || 41693.89 | 41186.08 | -1% || | | | |
| Geomean || | | || | | +1% | |
+---------++----------+----------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCC - single-threaded Sum of avg. item runtimes: +0% || Geometric mean of throughput changes: +2%Configuration Overview - click to expand +Configuration Overview---+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCC_a7abe4451af5dea62f4c67749d4356f60b0ce712_st.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCC_fcb37b4081805fcd3c4e1b99414436f9631730e3_st.json |
+-------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
| GIT-HASH | a7abe4451af5dea62f4c67749d4356f60b0ce712-dirty | fcb37b4081805fcd3c4e1b99414436f9631730e3-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-10-02 08:02:13 | 2024-10-02 11:45:36 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10 | 10 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+ +--------------++----------+---------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+--------------++----------+---------+--------++----------+----------+--------+---------+
+| Delivery || 27.24 | 27.42 | +1% || 4.85 | 5.45 | +12% | 0.0146 |
| New-Order || 12.89 | 12.90 | +0% || 56.16 | 55.00 | -2% | 0.8980 |
+| Order-Status || 1.21 | 1.22 | +1% || 4.42 | 4.67 | +6% | 0.1523 |
| Payment || 2.36 | 2.37 | +0% || 53.41 | 52.05 | -3% | 0.3992 |
-| Stock-Level || 2.06 | 2.03 | -1% || 5.05 | 4.82 | -5% | 0.1383 |
+--------------++----------+---------+--------++----------+----------+--------+---------+
| Sum || 45.76 | 45.94 | +0% || | | | |
| Geomean || | | || | | +2% | |
+--------------++----------+---------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCC - multi-threaded, shuffled, 32 clients, 10 warehouses, 32 cores (high contention) Sum of avg. item runtimes: -1% || Geometric mean of throughput changes: +1%Configuration Overview - click to expand +Configuration Overview---------+-----------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCC_a7abe4451af5dea62f4c67749d4356f60b0ce712_mt_highcont.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCC_fcb37b4081805fcd3c4e1b99414436f9631730e3_mt_highcont.json |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | a7abe4451af5dea62f4c67749d4356f60b0ce712-dirty | fcb37b4081805fcd3c4e1b99414436f9631730e3-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 32 | 32 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 32 | 32 |
| data_preparation_cores | 0 | 0 |
| date | 2024-10-02 08:03:23 | 2024-10-02 11:46:47 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 600000000000 | 600000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10 | 10 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [32] | [32] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------+ +--------------++----------+---------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+--------------++----------+---------+--------++----------+----------+--------+---------+
| Delivery || 86.28 | 86.19 | -0% || 43.24 | 43.62 | +1% | 0.8294 |
| unsucc.: || 2.01 | 1.97 | -2% || 24.94 | 24.57 | -2% | |
| New-Order || 39.32 | 38.55 | -2% || 559.75 | 573.59 | +2% | 0.0000 |
| unsucc.: || 6.62 | 5.82 | -12% || 206.28 | 200.37 | -3% | |
| Order-Status || 4.75 | 4.67 | -2% || 67.93 | 69.11 | +2% | 0.2334 |
| Payment || 7.42 | 7.52 | +1% || 380.93 | 381.13 | +0% | 0.0030 |
| unsucc.: || 3.07 | 3.21 | +5% || 350.17 | 356.73 | +2% | |
+| Stock-Level || 8.52 | 7.89 | -7% || 68.03 | 68.65 | +1% | 0.0000 |
+--------------++----------+---------+--------++----------+----------+--------+---------+
| Sum || 146.30 | 144.81 | -1% || | | | |
| Geomean || | | || | | +1% | |
+--------------++----------+---------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCC - multi-threaded, shuffled, 10 clients, 10 warehouses, 32 cores (low contention) Sum of avg. item runtimes: +0% || Geometric mean of throughput changes: -1%Configuration Overview - click to expand +Configuration Overview---------+----------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCC_a7abe4451af5dea62f4c67749d4356f60b0ce712_mt_lowcont.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCC_fcb37b4081805fcd3c4e1b99414436f9631730e3_mt_lowcont.json |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | a7abe4451af5dea62f4c67749d4356f60b0ce712-dirty | fcb37b4081805fcd3c4e1b99414436f9631730e3-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 10 | 10 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 32 | 32 |
| data_preparation_cores | 0 | 0 |
| date | 2024-10-02 08:13:37 | 2024-10-02 11:56:59 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 600000000000 | 600000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10 | 10 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [32] | [32] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------+ +--------------++----------+---------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+--------------++----------+---------+--------++----------+----------+--------+---------+
| Delivery || 95.61 | 95.38 | -0% || 12.69 | 12.71 | +0% | 0.0967 |
| unsucc.: || 1.13 | 1.01 | -10% || 1.49 | 1.52 | +2% | |
| New-Order || 48.48 | 48.74 | +1% || 146.63 | 146.00 | -0% | 0.0002 |
| unsucc.: || 4.61 | 4.30 | -7% || 14.08 | 13.50 | -4% | |
| Order-Status || 5.46 | 5.47 | +0% || 14.52 | 14.29 | -2% | 0.4087 |
| Payment || 10.71 | 10.80 | +1% || 124.85 | 124.11 | -1% | 0.0000 |
| unsucc.: || 2.67 | 2.68 | +1% || 28.37 | 28.21 | -1% | |
| Stock-Level || 7.49 | 7.50 | +0% || 14.25 | 14.21 | -0% | 0.7961 |
+--------------++----------+---------+--------++----------+----------+--------+---------+
| Sum || 167.75 | 167.88 | +0% || | | | |
| Geomean || | | || | | -1% | |
+--------------++----------+---------+--------++----------+----------+--------+---------+hyriseBenchmarkJoinOrder - single-threaded Sum of avg. item runtimes: +2% || Geometric mean of throughput changes: -3%Configuration Overview - click to expand +Configuration Overview---+-------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkJoinOrder_a7abe4451af5dea62f4c67749d4356f60b0ce712_st.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkJoinOrder_fcb37b4081805fcd3c4e1b99414436f9631730e3_st.json |
+-------------------------+-------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | a7abe4451af5dea62f4c67749d4356f60b0ce712-dirty | fcb37b4081805fcd3c4e1b99414436f9631730e3-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-10-02 08:23:47 | 2024-10-02 12:07:06 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False
D7AE
| False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+-------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| 10a || 113.54 | 114.44 | +1%˄ || 8.81 | 8.74 | -1%˄ | (run time too short) |
| 10b || 63.75 | 63.54 | -0%˄ || 15.69 | 15.74 | +0%˄ | (run time too short) |
| 10c || 300.48 | 305.39 | +2%˄ || 3.33 | 3.27 | -2%˄ | (run time too short) |
| 11a || 80.23 | 81.71 | +2%˄ || 12.46 | 12.24 | -2%˄ | (run time too short) |
| 11b || 77.93 | 79.24 | +2%˄ || 12.83 | 12.62 | -2%˄ | (run time too short) |
-| 11c || 22.90 | 24.62 | +8%˄ || 43.66 | 40.61 | -7%˄ | (run time too short) |
-| 11d || 20.61 | 22.40 | +9%˄ || 48.52 | 44.64 | -8%˄ | (run time too short) |
| 12a || 25.60 | 26.34 | +3%˄ || 39.05 | 37.97 | -3%˄ | (run time too short) |
-| 12b || 28.61 | 32.07 | +12%˄ || 34.95 | 31.18 | -11%˄ | (run time too short) |
+| 12c || 72.28 | 56.96 | -21%˄ || 13.83 | 17.55 | +27%˄ | (run time too short) |
+| 13a || 183.87 | 175.29 | -5%˄ || 5.44 | 5.70 | +5%˄ | (run time too short) |
| 13b || 213.71 | 218.27 | +2%˄ || 4.68 | 4.58 | -2%˄ | (run time too short) |
-| 13c || 34.69 | 37.75 | +9%˄ || 28.83 | 26.49 | -8%˄ | (run time too short) |
| 13d || 472.86 | 475.96 | +1%˄ || 2.11 | 2.10 | -1%˄ | (run time too short) |
| 14a || 87.01 | 88.25 | +1%˄ || 11.49 | 11.33 | -1%˄ | (run time too short) |
| 14b || 98.19 | 100.67 | +3%˄ || 10.18 | 9.93 | -2%˄ | (run time too short) |
| 14c || 193.73 | 196.80 | +2%˄ || 5.16 | 5.08 | -2%˄ | (run time too short) |
| 15a || 55.46 | 56.80 | +2%˄ || 18.03 | 17.60 | -2%˄ | (run time too short) |
| 15b || 56.56 | 57.65 | +2%˄ || 17.68 | 17.35 | -2%˄ | (run time too short) |
| 15c || 45.37 | 47.29 | +4%˄ || 22.04 | 21.15 | -4%˄ | (run time too short) |
-| 15d || 39.55 | 41.44 | +5%˄ || 25.29 | 24.13 | -5%˄ | (run time too short) |
| 16a || 1178.82 | 1206.81 | +2%˄ || 0.85 | 0.83 | -2%˄ | (run time too short) |
| 16b || 2235.23 | 2271.52 | +2% || 0.45 | 0.44 | -2% | 0.0000 |
| 16c || 1333.87 | 1365.15 | +2% || 0.75 | 0.73 | -2% | 0.0000 |
| 16d || 1303.98 | 1326.07 | +2% || 0.77 | 0.75 | -2% | 0.0000 |
| 17a || 365.07 | 371.70 | +2%˄ || 2.74 | 2.69 | -2%˄ | (run time too short) |
| 17b || 289.27 | 298.23 | +3%˄ || 3.46 | 3.35 | -3%˄ | (run time too short) |
| 17c || 271.26 | 281.16 | +4%˄ || 3.69 | 3.56 | -4%˄ | (run time too short) |
| 17d || 356.77 | 363.17 | +2%˄ || 2.80 | 2.75 | -2%˄ | (run time too short) |
| 17e || 1351.50 | 1373.27 | +2% || 0.74 | 0.73 | -2% | 0.0000 |
| 17f || 840.02 | 856.74 | +2%˄ || 1.19 | 1.17 | -2%˄ | (run time too short) |
| 18a || 143.40 | 147.40 | +3%˄ || 6.97 | 6.78 | -3%˄ | (run time too short) |
| 18b || 94.70 | 95.90 | +1%˄ || 10.56 | 10.43 | -1%˄ | (run time too short) |
| 18c || 196.56 | 199.49 | +1%˄ || 5.09 | 5.01 | -1%˄ | (run time too short) |
| 19a || 211.18 | 215.89 | +2%˄ || 4.74 | 4.63 | -2%˄ | (run time too short) |
| 19b || 175.09 | 178.41 | +2%˄ || 5.71 | 5.60 | -2%˄ | (run time too short) |
| 19c || 262.29 | 268.46 | +2%˄ || 3.81 | 3.72 | -2%˄ | (run time too short) |
| 19d || 623.59 | 630.23 | +1%˄ || 1.60 | 1.59 | -1%˄ | (run time too short) |
-| 1a || 8.76 | 9.59 | +10%˄ || 114.16 | 104.21 | -9%˄ | (run time too short) |
| 1b || 10.22 | 10.67 | +4%˄ || 97.86 | 93.72 | -4%˄ | (run time too short) |
| 1c || 13.39 | 13.41 | +0%˄ || 74.69 | 74.55 | -0%˄ | (run time too short) |
-| 1d || 8.27 | 9.15 | +11%˄ || 120.83 | 109.26 | -10%˄ | (run time too short) |
| 20a || 565.14 | 572.68 | +1%˄ || 1.77 | 1.75 | -1%˄ | (run time too short) |
| 20b || 612.15 | 619.40 | +1%˄ || 1.63 | 1.61 | -1%˄ | (run time too short) |
| 20c || 386.04 | 394.12 | +2%˄ || 2.59 | 2.54 | -2%˄ | (run time too short) |
| 21a || 93.77 | 95.20 | +2%˄ || 10.66 | 10.50 | -2%˄ | (run time too short) |
| 21b || 85.47 | 86.80 | +2%˄ || 11.70 | 11.52 | -2%˄ | (run time too short) |
| 21c || 95.36 | 97.16 | +2%˄ || 10.49 | 10.29 | -2%˄ | (run time too short) |
| 22a || 150.78 | 154.12 | +2%˄ || 6.63 | 6.49 | -2%˄ | (run time too short) |
| 22b || 138.82 | 140.49 | +1%˄ || 7.20 | 7.12 | -1%˄ | (run time too short) |
| 22c || 205.58 | 208.70 | +2%˄ || 4.86 | 4.79 | -1%˄ | (run time too short) |
| 22d || 320.02 | 323.87 | +1%˄ || 3.12 | 3.09 | -1%˄ | (run time too short) |
| 23a || 48.62 | 50.44 | +4%˄ || 20.56 | 19.83 | -4%˄ | (run time too short) |
| 23b || 51.19 | 52.95 | +3%˄ || 19.53 | 18.89 | -3%˄ | (run time too short) |
| 23c || 51.07 | 52.86 | +4%˄ || 19.58 | 18.92 | -3%˄ | (run time too short) |
| 24a || 220.65 | 227.05 | +3%˄ || 4.53 | 4.40 | -3%˄ | (run time too short) |
| 24b || 215.85 | 221.79 | +3%˄ || 4.63 | 4.51 | -3%˄ | (run time too short) |
+| 25a || 107.35 | 97.36 | -9%˄ || 9.31 | 10.27 | +10%˄ | (run time too short) |
| 25b || 61.89 | 64.22 | +4%˄ || 16.16 | 15.57 | -4%˄ | (run time too short) |
| 25c || 220.34 | 225.40 | +2%˄ || 4.54 | 4.44 | -2%˄ | (run time too short) |
| 26a || 144.33 | 149.57 | +4%˄ || 6.93 | 6.69 | -4%˄ | (run time too short) |
| 26b || 120.71 | 121.12 | +0%˄ || 8.28 | 8.26 | -0%˄ | (run time too short) |
| 26c || 250.80 | 260.07 | +4%˄ || 3.99 | 3.85 | -4%˄ | (run time too short) |
| 27a || 90.60 | 91.45 | +1%˄ || 11.04 | 10.93 | -1%˄ | (run time too short) |
-| 27b || 85.16 | 92.22 | +8%˄ || 11.74 | 10.84 | -8%˄ | (run time too short) |
| 27c || 99.62 | 97.20 | -2%˄ || 10.04 | 10.29 | +2%˄ | (run time too short) |
| 28a || 186.86 | 191.12 | +2%˄ || 5.35 | 5.23 | -2%˄ | (run time too short) |
| 28b || 59.98 | 61.46 | +2%˄ || 16.67 | 16.27 | -2%˄ | (run time too short) |
| 28c || 150.75 | 153.60 | +2%˄ || 6.63 | 6.51 | -2%˄ | (run time too short) |
| 29a || 190.39 | 196.34 | +3%˄ || 5.25 | 5.09 | -3%˄ | (run time too short) |
| 29b || 820.42 | 828.42 | +1%˄ || 1.22 | 1.21 | -1%˄ | (run time too short) |
| 29c || 221.73 | 228.87 | +3%˄ || 4.51 | 4.37 | -3%˄ | (run time too short) |
-| 2a || 24.59 | 26.20 | +7%˄ || 40.66 | 38.16 | -6%˄ | (run time too short) |
-| 2b || 22.79 | 24.40 | +7%˄ || 43.88 | 40.98 | -7%˄ | (run time too short) |
-| 2c || 19.68 | 21.25 | +8%˄ || 50.81 | 47.05 | -7%˄ | (run time too short) |
-| 2d || 46.21 | 48.37 | +5%˄ || 21.64 | 20.67 | -4%˄ | (run time too short) |
| 30a || 86.39 | 89.53 | +4%˄ || 11.57 | 11.17 | -3%˄ | (run time too short) |
| 30b || 90.11 | 92.71 | +3%˄ || 11.10 | 10.79 | -3%˄ | (run time too short) |
| 30c || 146.48 | 149.93 | +2%˄ || 6.83 | 6.67 | -2%˄ | (run time too short) |
| 31a || 76.28 | 79.36 | +4%˄ || 13.11 | 12.60 | -4%˄ | (run time too short) |
| 31b || 77.08 | 79.59 | +3%˄ || 12.97 | 12.56 | -3%˄ | (run time too short) |
| 31c || 87.28 | 90.34 | +4%˄ || 11.46 | 11.07 | -3%˄ | (run time too short) |
-| 32a || 12.20 | 13.74 | +13%˄ || 81.94 | 72.78 | -11%˄ | (run time too short) |
-| 32b || 26.73 | 28.09 | +5%˄ || 37.41 | 35.60 | -5%˄ | (run time too short) |
-| 33a || 28.94 | 30.56 | +6%˄ || 34.55 | 32.72 | -5%˄ | (run time too short) |
-| 33b || 19.51 | 21.15 | +8%˄ || 51.25 | 47.27 | -8%˄ | (run time too short) |
-| 33c || 34.56 | 36.13 | +5%˄ || 28.94 | 27.67 | -4%˄ | (run time too short) |
| 3a || 54.11 | 55.75 | +3%˄ || 18.48 | 17.94 | -3%˄ | (run time too short) |
-| 3b || 15.22 | 16.12 | +6%˄ || 65.68 | 62.03 | -6%˄ | (run time too short) |
| 3c || 206.40 | 208.55 | +1%˄ || 4.84 | 4.79 | -1%˄ | (run time too short) |
| 4a || 128.77 | 130.72 | +2%˄ || 7.77 | 7.65 | -1%˄ | (run time too short) |
-| 4b || 14.71 | 15.77 | +7%˄ || 68.00 | 63.41 | -7%˄ | (run time too short) |
| 4c || 180.67 | 183.66 | +2%˄ || 5.53 | 5.44 | -2%˄ | (run time too short) |
| 5a || 40.28 | 41.17 | +2%˄ || 24.82 | 24.29 | -2%˄ | (run time too short) |
| 5b || 44.75 | 45.27 | +1%˄ || 22.35 | 22.09 | -1%˄ | (run time too short) |
| 5c || 80.61 | 81.44 | +1%˄ || 12.40 | 12.28 | -1%˄ | (run time too short) |
| 6a || 146.89 | 150.97 | +3%˄ || 6.81 | 6.62 | -3%˄ | (run time too short) |
| 6b || 160.25 | 164.79 | +3%˄ || 6.24 | 6.07 | -3%˄ | (run time too short) |
| 6c || 139.67 | 143.54 | +3%˄ || 7.16 | 6.97 | -3%˄ | (run time too short) |
| 6d || 329.08 | 335.57 | +2%˄ || 3.04 | 2.98 | -2%˄ | (run time too short) |
| 6e || 145.62 | 149.77 | +3%˄ || 6.87 | 6.68 | -3%˄ | (run time too short) |
| 6f || 609.93 | 613.67 | +1%˄ || 1.64 | 1.63 | -1%˄ | (run time too short) |
-| 7a || 98.24 | 104.21 | +6%˄ || 10.18 | 9.60 | -6%˄ | (run time too short) |
-| 7b || 92.77 | 98.71 | +6%˄ || 10.78 | 10.13 | -6%˄ | (run time too short) |
| 7c || 517.08 | 528.91 | +2%˄ || 1.93 | 1.89 | -2%˄ | (run time too short) |
| 8a || 202.43 | 205.18 | +1%˄ || 4.94 | 4.87 | -1%˄ | (run time too short) |
| 8b || 194.00 | 195.97 | +1%˄ || 5.15 | 5.10 | -1%˄ | (run time too short) |
| 8c || 1676.97 | 1699.39 | +1% || 0.60 | 0.59 | -1% | 0.0000 |
| 8d || 286.98 | 287.78 | +0%˄ || 3.48 | 3.47 | -0%˄ | (run time too short) |
| 9a || 233.35 | 236.57 | +1%˄ || 4.29 | 4.23 | -1%˄ | (run time too short) |
| 9b || 147.41 | 149.25 | +1%˄ || 6.78 | 6.70 | -1%˄ | (run time too short) |
| 9c || 270.58 | 273.82 | +1%˄ || 3.70 | 3.65 | -1%˄ | (run time too short) |
| 9d || 386.63 | 388.18 | +0%˄ || 2.59 | 2.58 | -0%˄ | (run time too short) |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Sum || 26813.83 | 27287.43 | +2% || | | | |
| Geomean || | | || | | -3% | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkJoinOrder - multi-threaded, ordered, 1 client, 32 cores Sum of avg. item runtimes: +0% || Geometric mean of throughput changes: -2%Configuration Overview - click to expand +Configuration Overview---------+---------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkJoinOrder_a7abe4451af5dea62f4c67749d4356f60b0ce712_mt_ordered.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkJoinOrder_fcb37b4081805fcd3c4e1b99414436f9631730e3_mt_ordered.json |
+-------------------------------+---------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | a7abe4451af5dea62f4c67749d4356f60b0ce712-dirty | fcb37b4081805fcd3c4e1b99414436f9631730e3-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 32 | 32 |
| data_preparation_cores | 0 | 0 |
| date | 2024-10-02 08:47:22 | 2024-10-02 12:30:59 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [32] | [32] |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------------+---------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
-| 10a || 46.32 | 51.33 | +11%˄ || 21.57 | 19.47 | -10%˄ | (run time too short) |
| 10b || 22.93 | 23.67 | +3%˄ || 43.55 | 42.18 | -3%˄ | (run time too short) |
-| 10c || 124.25 | 135.35 | +9%˄ || 8.05 | 7.39 | -8%˄ | (run time too short) |
-| 11a || 26.52 | 27.84 | +5%˄ || 37.67 | 35.87 | -5%˄ | (run time too short) |
| 11b || 24.69 | 25.52 | +3%˄ || 40.47 | 39.13 | -3%˄ | (run time too short) |
-| 11c || 21.80 | 28.01 | +28%˄ || 45.82 | 35.66 | -22%˄ | (run time too short) |
-| 11d || 26.52 | 33.85 | +28%˄ || 37.68 | 29.51 | -22%˄ | (run time too short) |
-| 12a || 19.80 | 24.00 | +21%˄ || 50.43 | 41.60 | -18%˄ | (run time too short) |
-| 12b || 14.67 | 16.73 | +14%˄ || 68.06 | 59.65 | -12%˄ | (run time too short) |
-| 12c || 43.49 | 48.24 | +11%˄ || 22.98 | 20.72 | -10%˄ | (run time too short) |
-| 13a || 138.20 | 152.26 | +10%˄ || 7.23 | 6.57 | -9%˄ | (run time too short) |
-| 13b || 91.08 | 102.40 | +12%˄ || 10.98 | 9.76 | -11%˄ | (run time too short) |
-| 13c || 19.36 | 22.33 | +15%˄ || 51.59 | 44.70 | -13%˄ | (run time too short) |
| 13d || 353.96 | 364.73 | +3%˄ || 2.82 |
341A
2.74 | -3%˄ | (run time too short) |
| 14a || 64.38 | 64.97 | +1%˄ || 15.52 | 15.38 | -1%˄ | (run time too short) |
| 14b || 80.52 | 81.20 | +1%˄ || 12.41 | 12.31 | -1%˄ | (run time too short) |
| 14c || 184.92 | 188.60 | +2%˄ || 5.41 | 5.30 | -2%˄ | (run time too short) |
| 15a || 41.54 | 42.25 | +2%˄ || 24.05 | 23.64 | -2%˄ | (run time too short) |
| 15b || 36.45 | 36.57 | +0%˄ || 27.41 | 27.31 | -0%˄ | (run time too short) |
| 15c || 30.42 | 30.74 | +1%˄ || 32.84 | 32.50 | -1%˄ | (run time too short) |
| 15d || 36.41 | 36.95 | +1%˄ || 27.44 | 27.03 | -1%˄ | (run time too short) |
| 16a || 905.97 | 912.64 | +1%˄ || 1.10 | 1.10 | -1%˄ | (run time too short) |
| 16b || 2048.21 | 2048.43 | +0% || 0.49 | 0.49 | -0% | 0.9786 |
| 16c || 1075.53 | 1077.45 | +0%˄ || 0.93 | 0.93 | -0%˄ | (run time too short) |
| 16d || 1034.71 | 1027.87 | -1%˄ || 0.97 | 0.97 | +1%˄ | (run time too short) |
| 17a || 219.27 | 224.78 | +3%˄ || 4.56 | 4.45 | -2%˄ | (run time too short) |
| 17b || 191.53 | 186.59 | -3%˄ || 5.22 | 5.36 | +3%˄ | (run time too short) |
+| 17c || 171.97 | 164.52 | -4%˄ || 5.81 | 6.08 | +5%˄ | (run time too short) |
| 17d || 153.27 | 153.58 | +0%˄ || 6.52 | 6.51 | -0%˄ | (run time too short) |
| 17e || 845.07 | 841.79 | -0%˄ || 1.18 | 1.19 | +0%˄ | (run time too short) |
| 17f || 361.93 | 364.87 | +1%˄ || 2.76 | 2.74 | -1%˄ | (run time too short) |
| 18a || 76.20 | 77.56 | +2%˄ || 13.12 | 12.89 | -2%˄ | (run time too short) |
| 18b || 64.80 | 64.08 | -1%˄ || 15.42 | 15.60 | +1%˄ | (run time too short) |
+| 18c || 127.83 | 121.17 | -5%˄ || 7.82 | 8.25 | +5%˄ | (run time too short) |
| 19a || 133.16 | 132.35 | -1%˄ || 7.51 | 7.55 | +1%˄ | (run time too short) |
| 19b || 78.62 | 78.22 | -1%˄ || 12.71 | 12.78 | +1%˄ | (run time too short) |
| 19c || 151.66 | 151.64 | -0%˄ || 6.59 | 6.59 | +0%˄ | (run time too short) |
| 19d || 520.68 | 511.66 | -2%˄ || 1.92 | 1.95 | +2%˄ | (run time too short) |
| 1a || 8.04 | 8.26 | +3%˄ || 123.87 | 120.59 | -3%˄ | (run time too short) |
| 1b || 4.45 | 4.49 | +1%˄ || 223.29 | 221.40 | -1%˄ | (run time too short) |
| 1c || 4.93 | 4.77 | -3%˄ || 201.28 | 208.39 | +4%˄ | (run time too short) |
-| 1d || 6.41 | 6.71 | +5%˄ || 155.12 | 148.40 | -4%˄ | (run time too short) |
| 20a || 101.03 | 101.73 | +1%˄ || 9.89 | 9.83 | -1%˄ | (run time too short) |
-| 20b || 83.86 | 88.46 | +5%˄ || 11.92 | 11.30 | -5%˄ | (run time too short) |
| 20c || 93.69 | 95.09 | +1%˄ || 10.67 | 10.51 | -1%˄ | (run time too short) |
| 21a || 34.70 | 34.77 | +0%˄ || 28.78 | 28.72 | -0%˄ | (run time too short) |
| 21b || 29.71 | 29.80 | +0%˄ || 33.61 | 33.51 | -0%˄ | (run time too short) |
| 21c || 37.23 | 37.19 | -0%˄ || 26.83 | 26.86 | +0%˄ | (run time too short) |
| 22a || 73.26 | 71.01 | -3%˄ || 13.64 | 14.07 | +3%˄ | (run time too short) |
| 22b || 58.74 | 57.04 | -3%˄ || 17.01 | 17.52 | +3%˄ | (run time too short) |
| 22c || 125.23 | 128.13 | +2%˄ || 7.98 | 7.80 | -2%˄ | (run time too short) |
| 22d || 231.80 | 230.73 | -0%˄ || 4.31 | 4.33 | +0%˄ | (run time too short) |
| 23a || 21.36 | 21.30 | -0%˄ || 46.73 | 46.86 | +0%˄ | (run time too short) |
| 23b || 31.81 | 32.14 | +1%˄ || 31.40 | 31.08 | -1%˄ | (run time too short) |
| 23c || 22.57 | 22.50 | -0%˄ || 44.23 | 44.36 | +0%˄ | (run time too short) |
| 24a || 87.05 | 86.57 | -1%˄ || 11.48 | 11.54 | +1%˄ | (run time too short) |
| 24b || 80.50 | 81.24 | +1%˄ || 12.42 | 12.30 | -1%˄ | (run time too short) |
| 25a || 68.47 | 69.00 | +1%˄ || 14.60 | 14.48 | -1%˄ | (run time too short) |
| 25b || 39.11 | 39.03 | -0%˄ || 25.54 | 25.59 | +0%˄ | (run time too short) |
| 25c || 189.92 | 186.48 | -2%˄ || 5.26 | 5.36 | +2%˄ | (run time too short) |
| 26a || 96.70 | 98.70 | +2%˄ || 10.34 | 10.13 | -2%˄ | (run time too short) |
| 26b || 70.60 | 71.83 | +2%˄ || 14.16 | 13.91 | -2%˄ | (run time too short) |
| 26c || 145.48 | 143.22 | -2%˄ || 6.87 | 6.98 | +2%˄ | (run time too short) |
| 27a || 30.71 | 30.72 | +0%˄ || 32.52 | 32.51 | -0%˄ | (run time too short) |
| 27b || 29.65 | 30.14 | +2%˄ || 33.68 | 33.13 | -2%˄ | (run time too short) |
| 27c || 36.15 | 35.99 | -0%˄ || 27.63 | 27.75 | +0%˄ | (run time too short) |
| 28a || 141.77 | 140.85 | -1%˄ || 7.05 | 7.10 | +1%˄ | (run time too short) |
| 28b || 34.10 | 34.08 | -0%˄ || 29.29 | 29.31 | +0%˄ | (run time too short) |
| 28c || 115.02 | 114.85 | -0%˄ || 8.69 | 8.70 | +0%˄ | (run time too short) |
| 29a || 76.09 | 76.58 | +1%˄ || 13.13 | 13.05 | -1%˄ | (run time too short) |
| 29b || 142.58 | 147.81 | +4%˄ || 7.01 | 6.76 | -4%˄ | (run time too short) |
| 29c || 92.29 | 90.22 | -2%˄ || 10.83 | 11.08 | +2%˄ | (run time too short) |
| 2a || 27.87 | 28.47 | +2%˄ || 35.84 | 35.08 | -2%˄ | (run time too short) |
| 2b || 25.24 | 25.64 | +2%˄ || 39.57 | 38.95 | -2%˄ | (run time too short) |
| 2c || 18.12 | 18.65 | +3%˄ || 55.09 | 53.52 | -3%˄ | (run time too short) |
| 2d || 57.43 | 56.22 | -2%˄ || 17.40 | 17.78 | +2%˄ | (run time too short) |
| 30a || 59.26 | 59.18 | -0%˄ || 16.86 | 16.88 | +0%˄ | (run time too short) |
| 30b || 46.86 | 47.23 | +1%˄ || 21.32 | 21.15 | -1%˄ | (run time too short) |
| 30c || 133.83 | 134.57 | +1%˄ || 7.47 | 7.43 | -1%˄ | (run time too short) |
| 31a || 45.37 | 45.45 | +0%˄ || 22.02 | 21.98 | -0%˄ | (run time too short) |
| 31b || 40.31 | 40.03 | -1%˄ || 24.78 | 24.95 | +1%˄ | (run time too short) |
| 31c || 50.56 | 50.94 | +1%˄ || 19.76 | 19.62 | -1%˄ | (run time too short) |
-| 32a || 8.37 | 8.90 | +6%˄ || 119.00 | 111.98 | -6%˄ | (run time too short) |
| 32b || 36.40 | 35.67 | -2%˄ || 27.44 | 28.01 | +2%˄ | (run time too short) |
| 33a || 12.91 | 12.88 | -0%˄ || 77.21 | 77.37 | +0%˄ | (run time too short) |
| 33b || 11.00 | 11.04 | +0%˄ || 90.59 | 90.28 | -0%˄ | (run time too short) |
-| 33c || 20.07 | 21.30 | +6%˄ || 49.71 | 46.87 | -6%˄ | (run time too short) |
| 3a || 43.60 | 42.64 | -2%˄ || 22.91 | 23.43 | +2%˄ | (run time too short) |
| 3b || 8.46 | 8.52 | +1%˄ || 117.70 | 116.90 | -1%˄ | (run time too short) |
| 3c || 82.19 | 82.36 | +0%˄ || 12.16 | 12.14 | -0%˄ | (run time too short) |
| 4a || 76.84 | 78.60 | +2%˄ || 13.01 | 12.72 | -2%˄ | (run time too short) |
| 4b || 7.28 | 7.17 | -1%˄ || 136.82 | 138.81 | +1%˄ | (run time too short) |
| 4c || 97.12 | 99.06 | +2%˄ || 10.29 | 10.09 | -2%˄ | (run time too short) |
| 5a || 33.37 | 33.09 | -1%˄ || 29.94 | 30.18 | +1%˄ | (run time too short) |
| 5b || 25.02 | 24.71 | -1%˄ || 39.91 | 40.40 | +1%˄ | (run time too short) |
| 5c || 60.06 | 59.56 | -1%˄ || 16.64 | 16.78 | +1%˄ | (run time too short) |
-| 6a || 32.87 | 34.54 | +5%˄ || 30.39 | 28.92 | -5%˄ | (run time too short) |
| 6b || 58.80 | 59.68 | +1%˄ || 16.99 | 16.75 | -1%˄ | (run time too short) |
| 6c || 32.37 | 33.12 | +2%˄ || 30.85 | 30.16 | -2%˄ | (run time too short) |
| 6d || 171.28 | 165.19 | -4%˄ || 5.84 | 6.05 | +4%˄ | (run time too short) |
| 6e || 33.16 | 34.58 | +4%˄ || 30.12 | 28.89 | -4%˄ | (run time too short) |
| 6f || 503.59 | 502.59 | -0%˄ || 1.99 | 1.99 | +0%˄ | (run time too short) |
| 7a || 35.57 | 37.00 | +4%˄ || 28.08 | 27.00 | -4%˄ | (run time too short) |
| 7b || 35.01 | 36.58 | +4%˄ || 28.53 | 27.31 | -4%˄ | (run time too short) |
+| 7c || 325.97 | 309.59 | -5%˄ || 3.07 | 3.23 | +5%˄ | (run time too short) |
| 8a || 64.73 | 64.51 | -0%˄ || 15.44 | 15.49 | +0%˄ | (run time too short) |
| 8b || 61.85 | 61.51 | -1%˄ || 16.16 | 16.25 | +1%˄ | (run time too short) |
| 8c || 1291.93 | 1285.49 | -0% || 0.77 | 0.78 | +1% | 0.2650 |
| 8d || 242.10 | 244.96 | +1%˄ || 4.13 | 4.08 | -1%˄ | (run time too short) |
| 9a || 169.59 | 166.44 | -2%˄ || 5.90 | 6.01 | +2%˄ | (run time too short) |
| 9b || 91.17 | 90.41 | -1%˄ || 10.96 | 11.05 | +1%˄ | (run time too short) |
+| 9c || 170.57 | 159.91 | -6%˄ || 5.86 | 6.25 | +7%˄ | (run time too short) |
| 9d || 370.42 | 358.36 | -3%˄ || 2.70 | 2.79 | +3%˄ | (run time too short) |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Sum || 16772.19 | 16804.51 | +0% || | | | |
| Geomean || | | || | | -2% | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkJoinOrder - multi-threaded, shuffled, 32 clients, 32 cores Sum of avg. item runtimes: -2% || Geometric mean of throughput changes: +3%Configuration Overview - click to expand +Configuration Overview---------+-------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkJoinOrder_a7abe4451af5dea62f4c67749d4356f60b0ce712_mt.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkJoinOrder_fcb37b4081805fcd3c4e1b99414436f9631730e3_mt.json |
+-------------------------------+-------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | a7abe4451af5dea62f4c67749d4356f60b0ce712-dirty | fcb37b4081805fcd3c4e1b99414436f9631730e3-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 32 | 32 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 32 | 32 |
| data_preparation_cores | 0 | 0 |
| date | 2024-10-02 09:03:48 | 2024-10-02 12:47:27 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [32] | [32] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+-------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+---------+
+| 10a || 160.50 | 145.42 | -9% || 0.86 | 0.88 | +2% | 0.3438 |
-| 10b || 108.43 | 114.31 | +5% || 0.86 | 0.88 | +3% | 0.6876 |
| 10c || 377.38 | 376.62 | -0% || 0.86 | 0.88 | +3% | 0.9732 |
+| 11a || 93.27 | 73.46 | -21% || 0.86 | 0.88 | +3% | 0.1072 |
+| 11b || 110.68 | 88.54 | -20% || 0.86 | 0.88 | +2% | 0.2159 |
-| 11c || 97.68 | 124.90 | +28% || 0.86 | 0.88 | +3% | 0.0409 |
+| 11d || 88.66 | 74.25 | -16% || 0.86 | 0.88 | +3% | 0.2498 |
-| 12a || 129.12 | 154.14 | +19% || 0.86 | 0.88 | +3% | 0.1461 |
| 12b || 73.84 | 73.58 | -0% || 0.86 | 0.88 | +3% | 0.9825 |
-| 12c || 268.59 | 304.86 | +14% || 0.86 | 0.88 | +3% | 0.1216 |
-| 13a || 347.39 | 381.87 | +10% || 0.86 | 0.88 | +3% | 0.1337 |
-| 13b || 270.31 | 302.02 | +12% || 0.86 | 0.88 | +3% | 0.1883 |
-| 13c || 74.26 | 90.09 | +21% || 0.86 | 0.88 | +2% | 0.0952 |
| 13d || 635.47 | 651.90 | +3% || 0.86 | 0.88 | +3% | 0.5126 |
-| 14a || 273.01 | 301.12 | +10% || 0.86 | 0.88 | +3% | 0.1906 |
+| 14b || 302.25 | 273.78 | -9% || 0.86 | 0.88 | +3% | 0.1889 |
| 14c || 404.83 | 398.28 | -2% || 0.86 | 0.88 | +3% | 0.7794 |
| 15a || 101.72 | 101.23 | -0% || 0.86 | 0.88 | +3% | 0.9697 |
-| 15b || 96.21 | 124.14 | +29% || 0.86 | 0.88 | +3% | 0.0604 |
-| 15c || 101.77 | 111.54 | +10% || 0.86 | 0.88 | +3% | 0.4280 |
-| 15d || 114.02 | 145.59 | +28% || 0.86 | 0.88 | +3% | 0.0174 |
+| 16a || 1156.29 | 1090.86 | -6% || 0.86 | 0.88 | +3% | 0.0483 |
| 16b || 2241.67 | 2173.76 | -3% || 0.86 | 0.88 | +3% | 0.0577 |
| 16c || 1347.21 | 1304.40 | -3% || 0.86 | 0.88 | +3% | 0.2576 |
| 16d || 1292.34 | 1249.47 | -3% || 0.86 | 0.88 | +3% | 0.1873 |
| 17a || 591.89 | 595.29 | +1% || 0.86 | 0.88 | +3% | 0.9092 |
+| 17b || 481.43 | 457.08 | -5% || 0.86 | 0.88 | +3% | 0.3453 |
+| 17c || 444.49 | 403.61 | -9% || 0.86 | 0.88 | +3% | 0.1084 |
| 17d || 457.18 | 447.86 | -2% || 0.86 | 0.88 | +3% | 0.7534 |
| 17e || 1182.13 | 1150.49 | -3% || 0.86 | 0.88 | +3% | 0.3030 |
| 17f || 844.16 | 811.11 | -4% || 0.86 | 0.88 | +3% | 0.3183 |
+| 18a || 235.08 | 196.40 | -16% || 0.86 | 0.88 | +3% | 0.1072 |
+| 18b || 277.48 | 239.09 | -14% || 0.86 | 0.88 | +2% | 0.0946 |
+| 18c || 469.80 | 405.12 | -14% || 0.86 | 0.88 | +2% | 0.0198 |
| 19a || 378.01 | 390.63 | +3% || 0.86 | 0.88 | +3% | 0.6086 |
| 19b || 296.08 | 293.51 | -1% || 0.86 | 0.88 | +2% | 0.9155 |
+| 19c || 493.68 | 461.89 | -6% || 0.86 | 0.88 | +2% | 0.3163 |
+| 19d || 1073.73 | 941.89 | -12% || 0.86 | 0.88 | +3% | 0.0002 |
+| 1a || 40.77 | 38.70 | -5% || 0.86 | 0.88 | +3% | 0.7773 |
-| 1b || 35.11 | 46.03 | +31% || 0.86 | 0.88 | +3% | 0.3485 |
| 1c || 43.11 | 43.46 | +1% || 0.86 | 0.88 | +3% | 0.9754 |
-| 1d || 21.93 | 24.26 | +11% || 0.86 | 0.88 | +2% | 0.5656 |
| 20a || 330.04 | 323.33 | -2% || 0.86 | 0.88 | +3% | 0.7602 |
| 20b || 284.98 | 295.65 | +4% || 0.86 | 0.88 | +3% | 0.6123 |
-| 20c || 297.87 | 315.97 | +6% || 0.86 | 0.88 | +3% | 0.4365 |
+| 21a || 153.21 | 137.10 | -11% || 0.86 | 0.88 | +3% | 0.3778 |
| 21b || 100.46 | 102.86 | +2% || 0.86 | 0.88 | +3% | 0.8516 |
| 21c || 138.34 | 134.11 | -3% || 0.86 | 0.88 | +2% | 0.8016 |
-| 22a || 367.90 | 394.81 | +7% || 0.86 | 0.88 | +3% | 0.3444 |
| 22b || 286.55 | 278.05 | -3% || 0.86 | 0.88 | +2% | 0.6862 |
| 22c || 471.65 | 473.50 | +0% || 0.86 | 0.88 | +3% | 0.9485 |
+| 22d || 629.26 | 568.71 | -10% || 0.86 | 0.88 | +3% | 0.0451 |
-| 23a || 110.89 | 118.23 | +7% || 0.86 | 0.88 | +3% | 0.5290 |
+| 23b || 97.36 | 86.44 | -11% || 0.86 | 0.88 | +3% | 0.3001 |
-| 23c || 123.88 | 152.27 | +23% || 0.86 | 0.88 | +3% | 0.0812 |
+| 24a || 335.11 | 294.30 | -12% || 0.86 | 0.88 | +3% | 0.1485 |
+| 24b || 236.07 | 207.56 | -12% || 0.86 | 0.88 | +3% | 0.2048 |
-| 25a || 299.53 | 324.03 | +8% || 0.86 | 0.88 | +2% | 0.3377 |
+| 25b || 194.34 | 118.26 | -39% || 0.86 | 0.88 | +3% | 0.0001 |
+| 25c || 615.00 | 585.24 | -5% || 0.86 | 0.88 | +3% | 0.3326 |
-| 26a || 291.11 | 327.67 | +13% || 0.86 | 0.88 | +2% | 0.0817 |
-| 26b || 163.33 | 199.90 | +22% || 0.86 | 0.88 | +3% | 0.0247 |
| 26c || 432.79 | 452.07 | +4% || 0.86 | 0.88 | +2% | 0.4550 |
-| 27a || 116.37 | 130.23 | +12% || 0.86 | 0.88 | +3% | 0.3386 |
| 27b || 124.37 | 126.46 | +2% || 0.86 | 0.88 | +3% | 0.8929 |
+| 27c || 139.00 | 116.80 | -16% || 0.86 | 0.88 | +3% | 0.1275 |
| 28a || 492.79 | 479.15 | -3% || 0.86 | 0.88 | +3% | 0.6670 |
| 28b || 195.70 | 192.26 | -2% || 0.86 | 0.88 | +3% | 0.8589 |
-| 28c || 395.59 | 460.72 | +16% || 0.86 | 0.88 | +3% | 0.0137 |
+| 29a || 240.18 | 160.53 | -33% || 0.86 | 0.88 | +2% | 0.0000 |
+| 29b || 305.22 | 270.78 | -11% || 0.86 | 0.88 | +3% | 0.0931 |
+| 29c || 284.07 | 244.50 | -14% || 0.86 | 0.88 | +3% | 0.0876 |
-| 2a || 103.95 | 126.86 | +22% || 0.86 | 0.88 | +3% | 0.1288 |
-| 2b || 95.93 | 114.13 | +19% || 0.86 | 0.88 | +3% | 0.1986 |
| 2c || 68.16 | 67.28 | -1% || 0.86 | 0.88 | +3% | 0.9123 |
-| 2d || 159.88 | 195.86 | +23% || 0.86 | 0.88 | +3% | 0.0490 |
| 30a || 254.75 | 253.24 | -1% || 0.86 | 0.88 | +2% | 0.9475 |
+| 30b || 246.47 | 195.62 | -21% || 0.86 | 0.88 | +3% | 0.0130 |
| 30c || 459.00 | 473.02 | +3% || 0.86 | 0.88 | +3% | 0.6175 |
+| 31a || 202.49 | 168.66 | -17% || 0.86 | 0.88 | +2% | 0.1049 |
+| 31b || 201.05 | 143.68 | -29% || 0.86 | 0.88 | +3% | 0.0042 |
+| 31c || 228.35 | 199.74 | -13% || 0.86 | 0.88 | +3% | 0.1521 |
-| 32a || 37.91 | 52.19 | +38% || 0.86 | 0.88 | +3% | 0.1017 |
-| 32b || 110.87 | 123.06 | +11% || 0.86 | 0.88 | +3% | 0.2983 |
-| 33a || 92.53 | 97.57 | +5% || 0.86 | 0.88 | +3% | 0.6957 |
-| 33b || 76.46 | 93.36 | +22% || 0.86 | 0.88 | +3% | 0.2108 |
-| 33c || 138.41 | 152.25 | +10% || 0.86 | 0.88 | +2% | 0.4961 |
| 3a || 161.14 | 161.74 | +0% || 0.86 | 0.88 | +3% | 0.9699 |
+| 3b || 59.97 | 43.20 | -28% || 0.86 | 0.88 | +3% | 0.0358 |
+| 3c || 338.81 | 254.21 | -25% || 0.86 | 0.88 | +3% | 0.0003 |
-| 4a || 187.32 | 233.08 | +24% || 0.86 | 0.88 | +3% | 0.0187 |
-| 4b || 43.39 | 59.39 | +37% || 0.86 | 0.88 | +3% | 0.2178 |
-| 4c || 220.08 | 256.47 | +17% || 0.86 | 0.88 | +3% | 0.0791 |
+| 5a || 172.11 | 146.44 | -15% || 0.86 | 0.88 | +3% | 0.1777 |
+| 5b || 123.30 | 100.11 | -19% || 0.86 | 0.88 | +3% | 0.1226 |
+| 5c || 239.41 | 203.96 | -15% || 0.86 | 0.88 | +3% | 0.1145 |
| 6a || 119.46 | 118.88 | -0% || 0.86 | 0.88 | +3% | 0.9673 |
| 6b || 131.45 | 127.49 | -3% || 0.86 | 0.88 | +3% | 0.7469 |
-| 6c || 77.58 | 95.53 | +23% || 0.86 | 0.88 | +3% | 0.0597 |
| 6d || 389.66 | 381.05 | -2% || 0.86 | 0.88 | +3% | 0.7308 |
| 6e || 114.76 | 119.05 | +4% || 0.86 | 0.88 | +2% | 0.7572 |
+| 6f || 886.84 | 842.36 | -5% || 0.86 | 0.88 | +2% | 0.0926 |
-| 7a || 130.04 | 136.06 | +5% || 0.86 | 0.88 | +3% | 0.6758 |
-| 7b || 131.97 | 161.51 | +22% || 0.86 | 0.88 | +3% | 0.0608 |
+| 7c || 771.73 | 729.90 | -5% || 0.86 | 0.88 | +2% | 0.1442 |
-| 8a || 153.55 | 161.07 | +5% || 0.86 | 0.88 | +3% | 0.6913 |
+| 8b || 135.89 | 103.04 | -24% || 0.86 | 0.88 | +3% | 0.0396 |
| 8c || 1646.59 | 1717.66 | +4% || 0.86 | 0.88 | +3% | 0.0357 |
| 8d || 478.96 | 483.30 | +1% || 0.86 | 0.88 | +3% | 0.8356 |
+| 9a || 481.32 | 445.00 | -8% || 0.86 | 0.88 | +3% | 0.2038 |
+| 9b || 366.94 | 324.91 | -11% || 0.86 | 0.88 | +3% | 0.0993 |
| 9c || 455.83 | 440.31 | -3% || 0.86 | 0.88 | +3% | 0.5471 |
+| 9d || 796.04 | 712.58 | -10% || 0.86 | 0.88 | +3% | 0.0066 |
+---------++----------+----------+--------++----------+----------+--------+---------+
| Sum || 37176.28 | 36262.82 | -2% || | | | |
| Geomean || | | || | | +3% | |
+---------++----------+----------+--------++----------+----------+--------+---------+hyriseBenchmarkStarSchema - single-threaded Sum of avg. item runtimes: +2% || Geometric mean of throughput changes: -3%Configuration Overview - click to expand +Configuration Overview---+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkStarSchema_a7abe4451af5dea62f4c67749d4356f60b0ce712_st.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkStarSchema_fcb37b4081805fcd3c4e1b99414436f9631730e3_st.json |
+-------------------------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | a7abe4451af5dea62f4c67749d4356f60b0ce712-dirty | fcb37b4081805fcd3c4e1b99414436f9631730e3-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-10-02 09:24:30 | 2024-10-02 13:08:10 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+ +---------++----------+---------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| 1.1 || 282.47 | 288.08 | +2%˄ || 3.54 | 3.47 | -2%˄ | (run time too short) |
| 1.2 || 145.86 | 144.02 | -1%˄ || 6.86 | 6.94 | +1%˄ | (run time too short) |
| 1.3 || 136.27 | 139.33 | +2%˄ || 7.34 | 7.18 | -2%˄ | (run time too short) |
| 2.1 || 416.30 | 422.65 | +2%˄ || 2.40 | 2.37 | -2%˄ | (run time too short) |
| 2.2 || 220.65 | 213.79 | -3%˄ || 4.53 | 4.68 | +3%˄ | (run time too short) |
| 2.3 || 140.49 | 143.77 | +2%˄ || 7.12 | 6.96 | -2%˄ | (run time too short) |
| 3.1 || 2529.44 | 2580.83 | +2% || 0.40 | 0.39 | -2% | 0.0044 |
| 3.2 || 238.58 | 248.41 | +4%˄ || 4.19 | 4.03 | -4%˄ | (run time too short) |
-| 3.3 || 113.97 | 123.63 | +8%˄ || 8.77 | 8.09 | -8%˄ | (run time too short) |
-| 3.4 || 109.70 | 119.63 | +9%˄ || 9.12 | 8.36 | -8%˄ | (run time too short) |
| 4.1 || 2304.37 | 2335.47 | +1% || 0.43 | 0.43 | -1% | 0.0411 |
| 4.2 || 734.06 | 753.61 | +3%˄ || 1.36 | 1.33 | -3%˄ | (run time too short) |
-| 4.3 || 214.41 | 224.37 | +5%˄ || 4.66 | 4.46 | -4%˄ | (run time too short) |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| Sum || 7586.55 | 7737.59 | +2% || | | | |
| Geomean || | | || | | -3% | |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+---------+--------++----------+----------+--------+----------------------+hyriseBenchmarkStarSchema - multi-threaded, ordered, 1 client, 32 cores Sum of avg. item runtimes: -1% || Geometric mean of throughput changes: +2%Configuration Overview - click to expand +Configuration Overview---------+----------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkStarSchema_a7abe4451af5dea62f4c67749d4356f60b0ce712_mt_ordered.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkStarSchema_fcb37b4081805fcd3c4e1b99414436f9631730e3_mt_ordered.json |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | a7abe4451af5dea62f4c67749d4356f60b0ce712-dirty | fcb37b4081805fcd3c4e1b99414436f9631730e3-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 32
10000
| 32 |
| data_preparation_cores | 0 | 0 |
| date | 2024-10-02 09:29:34 | 2024-10-02 13:13:17 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [32] | [32] |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------+ +---------++----------+---------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| 1.1 || 108.00 | 104.52 | -3%˄ || 9.26 | 9.56 | +3%˄ | (run time too short) |
| 1.2 || 83.02 | 82.69 | -0%˄ || 12.04 | 12.09 | +0%˄ | (run time too short) |
+| 1.3 || 84.68 | 80.24 | -5%˄ || 11.80 | 12.46 | +6%˄ | (run time too short) |
| 2.1 || 355.67 | 343.41 | -3%˄ || 2.81 | 2.91 | +4%˄ | (run time too short) |
| 2.2 || 175.88 | 177.72 | +1%˄ || 5.68 | 5.63 | -1%˄ | (run time too short) |
+| 2.3 || 75.32 | 69.56 | -8%˄ || 13.27 | 14.37 | +8%˄ | (run time too short) |
| 3.1 || 930.27 | 928.23 | -0%˄ || 1.07 | 1.08 | +0%˄ | (run time too short) |
| 3.2 || 172.21 | 169.12 | -2%˄ || 5.81 | 5.91 | +2%˄ | (run time too short) |
| 3.3 || 96.57 | 99.19 | +3%˄ || 10.35 | 10.08 | -3%˄ | (run time too short) |
| 3.4 || 92.37 | 94.54 | +2%˄ || 10.82 | 10.57 | -2%˄ | (run time too short) |
| 4.1 || 927.55 | 925.21 | -0%˄ || 1.08 | 1.08 | +0%˄ | (run time too short) |
| 4.2 || 426.49 | 415.10 | -3%˄ || 2.34 | 2.41 | +3%˄ | (run time too short) |
| 4.3 || 142.91 | 143.04 | +0%˄ || 7.00 | 6.99 | -0%˄ | (run time too short) |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| Sum || 3670.96 | 3632.57 | -1% || | | | |
| Geomean || | | || | | +2% | |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+---------+--------++----------+----------+--------+----------------------+hyriseBenchmarkStarSchema - multi-threaded, shuffled, 32 clients, 32 cores Sum of avg. item runtimes: -3% || Geometric mean of throughput changes: +3%Configuration Overview - click to expand +Configuration Overview---------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkStarSchema_a7abe4451af5dea62f4c67749d4356f60b0ce712_mt.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkStarSchema_fcb37b4081805fcd3c4e1b99414436f9631730e3_mt.json |
+-------------------------------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | a7abe4451af5dea62f4c67749d4356f60b0ce712-dirty | fcb37b4081805fcd3c4e1b99414436f9631730e3-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 32 | 32 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 32 | 32 |
| data_preparation_cores | 0 | 0 |
| date | 2024-10-02 09:33:25 | 2024-10-02 13:17:06 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [32] | [32] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+---------+
+| 1.1 || 514.60 | 457.35 | -11% || 3.07 | 3.17 | +3% | 0.0000 |
+| 1.2 || 296.07 | 266.61 | -10% || 3.07 | 3.17 | +3% | 0.0055 |
+| 1.3 || 269.51 | 254.26 | -6% || 3.07 | 3.17 | +3% | 0.0924 |
+| 2.1 || 1268.94 | 1010.49 | -20% || 3.07 | 3.16 | +3% | 0.0000 |
+| 2.2 || 672.82 | 575.19 | -15% || 3.07 | 3.17 | +3% | 0.0000 |
-| 2.3 || 235.95 | 277.89 | +18% || 3.07 | 3.17 | +3% | 0.0002 |
| 3.1 || 2020.91 | 2096.65 | +4% || 3.07 | 3.16 | +3% | 0.0018 |
| 3.2 || 602.73 | 594.53 | -1% || 3.07 | 3.16 | +3% | 0.6144 |
| 3.3 || 319.51 | 313.32 | -2% || 3.07 | 3.16 | +3% | 0.6070 |
+| 3.4 || 318.00 | 291.47 | -8% || 3.07 | 3.17 | +3% | 0.0459 |
| 4.1 || 1833.74 | 1907.40 | +4% || 3.07 | 3.16 | +3% | 0.0087 |
| 4.2 || 1564.36 | 1516.49 | -3% || 3.07 | 3.16 | +3% | 0.0830 |
-| 4.3 || 479.69 | 534.83 | +11% || 3.07 | 3.17 | +3% | 0.0008 |
+---------++----------+----------+--------++----------+----------+--------+---------+
| Sum || 10396.84 | 10096.49 | -3% || | | | |
| Geomean || | | || | | +3% | |
+---------++----------+----------+--------++----------+----------+--------+---------+ |
AMDSystem cx19 - click to expand
Commit Info and Build Time
hyriseBenchmarkTPCH - single-threaded, SF 10.0 Sum of avg. item runtimes: -0% || Geometric mean of throughput changes: +0%Configuration Overview - click to expand +Configuration Overview----+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCH_a7abe4451af5dea62f4c67749d4356f60b0ce712_st.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCH_fcb37b4081805fcd3c4e1b99414436f9631730e3_st.json |
+--------------------------+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+
| GIT-HASH | a7abe4451af5dea62f4c67749d4356f60b0ce712-dirty | fcb37b4081805fcd3c4e1b99414436f9631730e3-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-10-02 08:31:17 | 2024-10-02 12:06:58 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+--------------------------+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+ +----------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| TPC-H 01 || 5814.13 | 5698.52 | -2% || 0.17 | 0.18 | +2% | 0.0233 |
| TPC-H 02 || 39.98 | 39.63 | -1%˄ || 25.01 | 25.20 | +1%˄ | (run time too short) |
| TPC-H 03 || 1392.08 | 1395.03 | +0% || 0.72 | 0.72 | -0% | 0.6328 |
| TPC-H 04 || 1492.06 | 1505.01 | +1% || 0.67 | 0.66 | -1% | 0.0547 |
| TPC-H 05 || 2261.59 | 2284.96 | +1% || 0.44 | 0.44 | -1% | 0.0000 |
| TPC-H 06 || 189.12 | 190.35 | +1%˄ || 5.29 | 5.25 | -1%˄ | (run time too short) |
| TPC-H 07 || 730.47 | 740.69 | +1%˄ || 1.37 | 1.35 | -1%˄ | (run time too short) |
| TPC-H 08 || 556.57 | 564.50 | +1%˄ || 1.80 | 1.77 | -1%˄ | (run time too short) |
| TPC-H 09 || 5780.75 | 5791.50 | +0% || 0.17 | 0.17 | -0% | 0.5315 |
| TPC-H 10 || 1361.01 | 1367.76 | +0% || 0.73 | 0.73 | -1% | 0.1476 |
+| TPC-H 11 || 52.82 | 50.41 | -5%˄ || 18.93 | 19.83 | +5%˄ | (run time too short) |
| TPC-H 12 || 961.47 | 953.24 | -1%˄ || 1.04 | 1.05 | +1%˄ | (run time too short) |
| TPC-H 13 || 5456.90 | 5513.87 | +1% || 0.18 | 0.18 | -1% | 0.0077 |
| TPC-H 14 || 479.91 | 478.41 | -0%˄ || 2.08 | 2.09 | +0%˄ | (run time too short) |
| TPC-H 15 || 186.15 | 185.91 | -0%˄ || 5.37 | 5.38 | +0%˄ | (run time too short) |
| TPC-H 16 || 518.43 | 519.56 | +0%˄ || 1.93 | 1.92 | -0%˄ | (run time too short) |
| TPC-H 17 || 221.88 | 223.37 | +1%˄ || 4.51 | 4.48 | -1%˄ | (run time too short) |
+| TPC-H 18 || 1666.84 | 1589.33 | -5% || 0.60 | 0.63 | +5% | 0.0026 |
| TPC-H 19 || 223.70 | 221.60 | -1%˄ || 4.47 | 4.51 | +1%˄ | (run time too short) |
| TPC-H 20 || 505.24 | 512.95 | +2%˄ || 1.98 | 1.95 | -2%˄ | (run time too short) |
| TPC-H 21 || 4272.25 | 4306.18 | +1% || 0.23 | 0.23 | -1% | 0.0621 |
| TPC-H 22 || 483.52 | 491.00 | +2%˄ || 2.07 | 2.04 | -2%˄ | (run time too short) |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| Sum || 34646.86 | 34623.78 | -0% || | | | |
| Geomean || | | || | | +0% | |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+----------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCH - single-threaded, SF 0.01 Sum of avg. item runtimes: +3% || Geometric mean of throughput changes: +0%Configuration Overview - click to expand +Configuration Overview----+----------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCH_a7abe4451af5dea62f4c67749d4356f60b0ce712_st_s01.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCH_fcb37b4081805fcd3c4e1b99414436f9631730e3_st_s01.json |
+--------------------------+----------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------+
| GIT-HASH | a7abe4451af5dea62f4c67749d4356f60b0ce712-dirty | fcb37b4081805fcd3c4e1b99414436f9631730e3-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-10-02 08:47:24 | 2024-10-02 12:22:57 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000
10000
| 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 0.009999999776482582 | 0.009999999776482582 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+--------------------------+----------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------+ +----------++----------+---------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+----------++----------+---------+--------++----------+----------+--------+----------------------+
+| TPC-H 01 || 5.71 | 5.38 | -6%˄ || 175.19 | 185.92 | +6%˄ | (run time too short) |
-| TPC-H 02 || 3.36 | 3.66 | +9%˄ || 297.89 | 272.95 | -8%˄ | (run time too short) |
| TPC-H 03 || 0.60 | 0.60 | +0%˄ || 1656.44 | 1654.02 | -0%˄ | (run time too short) |
| TPC-H 04 || 0.38 | 0.36 | -3%˄ || 2652.13 | 2748.06 | +4%˄ | (run time too short) |
| TPC-H 05 || 0.95 | 0.94 | -1%˄ || 1055.92 | 1063.07 | +1%˄ | (run time too short) |
| TPC-H 06 || 0.21 | 0.21 | -1%˄ || 4718.44 | 4753.90 | +1%˄ | (run time too short) |
-| TPC-H 07 || 8.93 | 10.19 | +14%˄ || 111.95 | 98.09 | -12%˄ | (run time too short) |
| TPC-H 08 || 13.44 | 13.82 | +3%˄ || 74.38 | 72.36 | -3%˄ | (run time too short) |
-| TPC-H 09 || 3.30 | 3.49 | +6%˄ || 302.52 | 286.73 | -5%˄ | (run time too short) |
| TPC-H 10 || 0.65 | 0.65 | -1%˄ || 1530.38 | 1542.85 | +1%˄ | (run time too short) |
| TPC-H 11 || 0.17 | 0.17 | -1%˄ || 5874.75 | 5940.03 | +1%˄ | (run time too short) |
+| TPC-H 12 || 0.65 | 0.62 | -5%˄ || 1547.32 | 1621.20 | +5%˄ | (run time too short) |
| TPC-H 13 || 2.02 | 2.03 | +0%˄ || 494.61 | 493.48 | -0%˄ | (run time too short) |
| TPC-H 14 || 0.30 | 0.29 | -2%˄ || 3362.74 | 3429.59 | +2%˄ | (run time too short) |
| TPC-H 15 || 1.13 | 1.11 | -2%˄ || 886.20 | 900.90 | +2%˄ | (run time too short) |
| TPC-H 16 || 1.93 | 1.91 | -1%˄ || 516.64 | 521.99 | +1%˄ | (run time too short) |
+| TPC-H 17 || 0.68 | 0.60 | -12%˄ || 1465.41 | 1659.81 | +13%˄ | (run time too short) |
| TPC-H 18 || 1.18 | 1.17 | -0%˄ || 847.32 | 851.62 | +1%˄ | (run time too short) |
| TPC-H 19 || 4.57 | 4.51 | -1%˄ || 218.95 | 221.79 | +1%˄ | (run time too short) |
| TPC-H 20 || 2.53 | 2.60 | +2%˄ || 394.27 | 384.84 | -2%˄ | (run time too short) |
| TPC-H 21 || 0.93 | 0.97 | +4%˄ || 1068.37 | 1028.06 | -4%˄ | (run time too short) |
| TPC-H 22 || 1.10 | 1.09 | -1%˄ || 908.52 | 920.12 | +1%˄ | (run time too short) |
+----------++----------+---------+--------++----------+----------+--------+----------------------+
| Sum || 54.72 | 56.36 | +3% || | | | |
| Geomean || | | || | | +0% | |
+----------++----------+---------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+----------++----------+---------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCH - multi-threaded, ordered, 1 client, 64 cores, SF 10.0 Sum of avg. item runtimes: +0% || Geometric mean of throughput changes: +1%Configuration Overview - click to expand +Configuration Overview---------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCH_a7abe4451af5dea62f4c67749d4356f60b0ce712_mt_ordered.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCH_fcb37b4081805fcd3c4e1b99414436f9631730e3_mt_ordered.json |
+-------------------------------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | a7abe4451af5dea62f4c67749d4356f60b0ce712-dirty | fcb37b4081805fcd3c4e1b99414436f9631730e3-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2024-10-02 08:47:49 | 2024-10-02 12:23:22 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+ +----------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| TPC-H 01 || 4594.93 | 4627.68 | +1% || 0.22 | 0.22 | -1% | 0.6288 |
| TPC-H 02 || 30.02 | 29.53 | -2%˄ || 33.29 | 33.84 | +2%˄ | (run time too short) |
| TPC-H 03 || 416.44 | 414.04 | -1%˄ || 2.40 | 2.41 | +1%˄ | (run time too short) |
| TPC-H 04 || 457.72 | 449.38 | -2%˄ || 2.18 | 2.23 | +2%˄ | (run time too short) |
| TPC-H 05 || 379.47 | 379.14 | -0%˄ || 2.63 | 2.64 | +0%˄ | (run time too short) |
| TPC-H 06 || 37.07 | 35.60 | -4%˄ || 26.95 | 28.07 | +4%˄ | (run time too short) |
| TPC-H 07 || 182.22 | 181.48 | -0%˄ || 5.49 | 5.51 | +0%˄ | (run time too short) |
| TPC-H 08 || 154.20 | 154.37 | +0%˄ || 6.48 | 6.48 | -0%˄ | (run time too short) |
| TPC-H 09 || 1706.20 | 1703.84 | -0% || 0.59 | 0.59 | +0% | 0.8170 |
| TPC-H 10 || 432.85 | 434.74 | +0%˄ || 2.31 | 2.30 | -0%˄ | (run time too short) |
| TPC-H 11 || 36.06 | 36.43 | +1%˄ || 27.70 | 27.43 | -1%˄ | (run time too short) |
| TPC-H 12 || 356.71 | 350.86 | -2%˄ || 2.80 | 2.85 | +2%˄ | (run time too short) |
| TPC-H 13 || 2824.10 | 2845.95 | +1% || 0.35 | 0.35 | -1% | 0.1068 |
| TPC-H 14 || 92.62 | 92.18 | -0%˄ || 10.79 | 10.84 | +0%˄ | (run time too short) |
+| TPC-H 15 || 117.27 | 110.69 | -6%˄ || 8.53 | 9.03 | +6%˄ | (run time too short) |
| TPC-H 16 || 417.26 | 421.72 | +1%˄ || 2.40 | 2.37 | -1%˄ | (run time too short) |
+| TPC-H 17 || 60.28 | 55.94 | -7%˄ || 16.58 | 17.86 | +8%˄ | (run time too short) |
| TPC-H 18 || 1583.78 | 1580.18 | -0% || 0.63 | 0.63 | +0% | 0.8398 |
| TPC-H 19 || 61.40 | 60.99 | -1%˄ || 16.28 | 16.39 | +1%˄ | (run time too short) |
| TPC-H 20 || 154.23 | 150.53 | -2%˄ || 6.48 | 6.64 | +2%˄ | (run time too short) |
| TPC-H 21 || 775.40 | 786.79 | +1%˄ || 1.29 | 1.27 | -1%˄ | (run time too short) |
| TPC-H 22 || 98.74 | 96.76 | -2%˄ || 10.12 | 10.33 | +2%˄ | (run time too short) |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| Sum || 14968.96 | 14998.80 | +0% || | | | |
| Geomean || | | || | | +1% | |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+----------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCH - multi-threaded, shuffled, 64 clients, 64 cores, SF 10.0 Sum of avg. item runtimes: -2% || Geometric mean of throughput changes: +2%Configuration Overview - click to expand +Configuration Overview---------+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCH_a7abe4451af5dea62f4c67749d4356f60b0ce712_mt.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCH_fcb37b4081805fcd3c4e1b99414436f9631730e3_mt.json |
+-------------------------------+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+
| GIT-HASH | a7abe4451af5dea62f4c67749d4356f60b0ce712-dirty | fcb37b4081805fcd3c4e1b99414436f9631730e3-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| clustering | None | None |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2024-10-02 08:58:14 | 2024-10-02 12:33:43 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+ +----------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+----------++----------+----------+--------++----------+----------+--------+---------+
| TPC-H 01 || 6065.11 | 6108.07 | +1% || 1.04 | 1.06 | +2% | 0.5506 |
-| TPC-H 02 || 505.81 | 779.91 | +54% || 1.05 | 1.07 | +2% | 0.0005 |
-| TPC-H 03 || 2929.96 | 3289.18 | +12% || 1.05 | 1.06 | +2% | 0.0145 |
+| TPC-H 04 || 2473.20 | 2337.68 | -5% || 1.05 | 1.06 | +2% | 0.2817 |
| TPC-H 05 || 4099.50 | 4268.80 | +4% || 1.05 | 1.06 | +2% | 0.3336 |
+| TPC-H 06 || 911.35 | 554.02 | -39% || 1.05 | 1.06 | +2% | 0.0000 |
+| TPC-H 07 || 3233.38 | 3014.60 | -7% || 1.04 | 1.06 | +2% | 0.1587 |
| TPC-H 08 || 2559.42 | 2539.15 | -1% || 1.05 | 1.06 | +2% | 0.8909 |
+| TPC-H 09 || 6669.25 | 6139.54 | -8% || 1.04 | 1.06 | +2% | 0.0059 |
| TPC-H 10 || 3518.21 | 3550.97 | +1% || 1.05 | 1.06 | +1% | 0.8426 |
-| TPC-H 11 || 541.28 | 678.77 | +25% || 1.05 | 1.06 | +2% | 0.0784 |
+| TPC-H 12 || 2575.79 | 2457.57 | -5% || 1.04 | 1.06 | +2% | 0.3005 |
| TPC-H 13 || 5951.85 | 6015.40 | +1% || 1.04 | 1.06 | +2% | 0.5867 |
+| TPC-H 14 || 1187.38 | 1039.49 | -12% || 1.05 | 1.06 | +2% | 0.0958 |
+| TPC-H 15 || 729.99 | 617.53 | -15% || 1.05 | 1.07 | +2% | 0.0378 |
-| TPC-H 16 || 2387.56 | 2509.21 | +5% || 1.05 | 1.06 | +2% | 0.3242 |
+| TPC-H 17 || 995.02 | 932.18 | -6% || 1.05 | 1.06 | +2% | 0.5166 |
| TPC-H 18 || 3586.90 | 3497.94 | -2% || 1.04 | 1.06 | +2% | 0.3317 |
-| TPC-H 19 || 1172.73 | 1315.43 | +12% || 1.05 | 1.06 | +2% | 0.2085 |
| TPC-H 20 || 1814.75 | 1821.99 | +0% || 1.04 | 1.06 | +2% | 0.9469 |
+| TPC-H 21 || 5767.33 | 5159.55 | -11% || 1.04 | 1.06 | +1% | 0.0033 |
| TPC-H 22 || 1145.97 | 1097.64 | -4% || 1.05 | 1.06 | +2% | 0.5720 |
+----------++----------+----------+--------++----------+----------+--------+---------+
| Sum || 60821.74 | 59724.63 | -2% || | | | |
| Geomean || | | || | | +2% | |
+----------++----------+----------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCDS - single-threaded Sum of avg. item runtimes: +0% || Geometric mean of throughput changes: +1%Configuration Overview - click to expand +Configuration Overview---+-------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCDS_a7abe4451af5dea62f4c67749d4356f60b0ce712_st.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCDS_fcb37b4081805fcd3c4e1b99414436f9631730e3_st.json |
+-------------------------+-------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------+
| GIT-HASH | a7abe4451af5dea62f4c67749d4356f60b0ce712-dirty | fcb37b4081805fcd3c4e1b99414436f9631730e3-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-10-02 09:20:07 | 2024-10-02 12:55:33 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+-------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| 01 || 220.06 | 220.67 | +0%˄ || 4.54 | 4.53 | -0%˄ | (run time too short) |
| 03 || 68.16 | 67.68 | -1%˄ || 14.67 | 14.78 | +1%˄ | (run time too short) |
| 06 || 194.93 | 194.57 | -0%˄ || 5.13 | 5.14 | +0%˄ | (run time too short) |
| 07 || 275.45 | 276.89 | +1%˄ || 3.63 | 3.61 | -1%˄ | (run time too short) |
| 09 || 712.60 | 708.93 | -1%˄ || 1.40 | 1.41 | +1%˄ | (run time too short) |
| 10 || 132.70 | 129.69 | -2%˄ || 7.54 | 7.71 | +2%˄ | (run time too short) |
| 13 || 466.86 | 469.52 | +1%˄ || 2.14 | 2.13 | -1%˄ | (run time too short) |
| 15 || 118.05 | 116.57 | -1%˄ || 8.47 | 8.58 | +1%˄ | (run time too short) |
| 16 || 62.39 | 62.12 | -0%˄ || 16.03 | 16.10 | +0%˄ | (run time too short) |
| 17 || 325.63 | 319.00 | -2%˄ || 3.07 | 3.13 | +2%˄ | (run time too short) |
| 19 || 104.41 | 100.71 | -4%˄ || 9.58 | 9.93 | +4%˄ | (run time too short) |
| 25 || 172.24 | 168.87 | -2%˄ || 5.81 | 5.92 | +2%˄ | (run time too short) |
| 26 || 121.37 | 120.04 | -1%˄ || 8.24 | 8.33 | +1%˄ | (run time too short) |
| 28 || 569.30 | 562.27 | -1%˄ || 1.76 | 1.78 | +1%˄ | (run time too short) |
| 29 || 477.86 | 472.76 | -1%˄ || 2.09 | 2.12 | +1%˄ | (run time too short) |
| 31 || 1303.48 | 1295.17 | -1% || 0.77 | 0.77 | +1% | 0.0000 |
| 32 || 32.75 | 32.14 | -2%˄ || 30.53 | 31.11 | +2%˄ | (run time too short) |
| 34 || 153.84 | 149.16 | -3%˄ || 6.50 | 6.70 | +3%˄ | (run time too short) |
| 35 || 605.10 | 600.14 | -1%˄ || 1.65 | 1.67 | +1%˄ | (run time too short) |
| 37 || 765.83 | 780.65 | +2%˄ || 1.31 | 1.28 | -2%˄ | (run time too short) |
| 39a || 1619.20 | 1674.10 | +3% || 0.62 | 0.60 | -3% | 0.0000 |
| 39b || 1608.03 | 1655.97 | +3% || 0.62 | 0.60 | -3% | 0.0000 |
| 41 || 269.71 | 269.51 | -0%˄ || 3.71 | 3.71 | +0%˄ | (run time too short) |
| 42 || 84.53 | 81.01 | -4%˄ || 11.83 | 12.34 | +4%˄ | (run time too short) |
| 43 || 900.35 | 894.94 | -1%˄ || 1.11 | 1.12 | +1%˄ | (run time too short) |
| 45 || 121.94 | 121.39 | -0%˄ || 8.20 | 8.24 | +0%˄ | (run time too short) |
| 48 || 1059.05 | 1050.05 | -1%˄ || 0.94 | 0.95 | +1%˄ | (run time too short) |
| 50 || 126.56 | 123.15 | -3%˄ || 7.90 | 8.12 | +3%˄ | (run time too short) |
| 52 || 82.93 | 82.09 | -1%˄ || 12.06 | 12.18 | +1%˄ | (run time too short) |
| 55 || 78.25 | 77.13 | -1%˄ || 12.78 | 12.96 | +1%˄ | (run time too short) |
| 62 || 556.56 | 557.17 | +0%˄ || 1.80 | 1.79 | -0%˄ | (run time too short) |
| 65 || 1781.78 | 1787.83 | +0% || 0.56 | 0.56 | -0% | 0.1002 |
| 69 || 147.86 | 146.51 | -1%˄ || 6.76 | 6.83 | +1%˄ | (run time too short) |
| 73 || 81.71 | 80.25 | -2%˄ || 12.24 | 12.46 | +2%˄ | (run time too short) |
| 79 || 489.96 | 487.56 | -0%˄ || 2.04 | 2.05 | +0%˄ | (run time too short) |
| 81 || 148.38 | 149.33 | +1%˄ || 6.74 | 6.70 | -1%˄ | (run time too short) |
| 82 || 816.89 | 821.75 | +1%˄ || 1.22 | 1.22 | -1%˄ | (run time too short) |
| 83 || 40.64 | 40.95 | +1%˄ || 24.61 | 24.42 | -1%˄ | (run time too short) |
| 84 || 13.95 | 13.83 | -1%˄ || 71.65 | 72.30 | +1%˄ | (run time too short) |
| 85 || 156.50 | 155.67 | -1%˄ || 6.39 | 6.42 | +1%˄ | (run time too short) |
| 88 || 670.55 | 661.51 | -1%˄ || 1.49 | 1.51 | +1%˄ | (run time too short) |
| 91 || 17.63 | 17.21 | -2%˄ || 56.66 | 58.09 | +3%˄ | (run time too short) |
| 92 || 37.25 | 37.34 | +0%˄ || 26.84 | 26.78 | -0%˄ | (run time too short) |
| 93 || 3765.44 | 3740.53 | -1% || 0.27 | 0.27 | +1% | 0.0084 |
| 94 || 40.69 | 39.85 | -2%˄ || 24.57 | 25.09 | +2%˄ | (run time too short) |
| 95 || 4493.98 | 4616.29 | +3% || 0.22 | 0.22 | -3% | 0.0021 |
| 96 || 62.33 | 61.48 | -1%˄ || 16.04 | 16.26 | +1%˄ | (run time too short) |
| 97 || 3898.69 | 3890.77 | -0% || 0.26 | 0.26 | +0% | 0.6342 |
| 99 || 1047.90 | 1044.52 | -0%˄ || 0.95 | 0.96 | +0%˄ | (run time too short) |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Sum || 31102.25 | 31227.26 | +0% || | | | |
| Geomean || | | || | | +1% | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCDS - multi-threaded, ordered, 1 client, 64 cores Sum of avg. item runtimes: +0% || Geometric mean of throughput changes: +1%Configuration Overview - click to expand +Configuration Overview---------+---------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCDS_a7abe4451af5dea62f4c67749d4356f60b0ce712_mt_ordered.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCDS_fcb37b4081805fcd3c4e1b99414436f9631730e3_mt_ordered.json |
+-------------------------------+---------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | a7abe4451af5dea62f4c67749d4356f60b0ce712-dirty | fcb37b4081805fcd3c4e1b99414436f9631730e3-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2024-10-02 09:39:32 | 2024-10-02 13:14:54 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------------+---------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
+| 01 || 179.36 | 167.52 | -7%˄ || 5.57 | 5.97 | +7%˄ | (run time too short) |
| 03 || 21.69 | 21.21 | -2%˄ || 46.04 | 47.09 | +2%˄ | (run time too short) |
| 06 || 111.38 | 110.56 | -1%˄ || 8.98 | 9.04 | +1%˄ | (run time too short) |
| 07 || 136.27 | 135.73 | -0%˄ || 7.34 | 7.37 | +0%˄ | (run time too short) |
| 09 || 74.77 | 74.41 | -0%˄ || 13.37 | 13.43 | +0%˄ | (run time too short) |
| 10 || 23.31 | 22.86 | -2%˄ || 42.85 | 43.69 | +2%˄ | (run time too short) |
| 13 || 179.88 | 178.31 | -1%˄ || 5.56 | 5.61 | +1%˄ | (run time too short) |
| 15 || 41.66 | 41.83 | +0%˄ || 23.99 | 23.89 | -0%˄ | (run time too short) |
| 16 || 20.59 | 20.31 | -1%˄ || 48.51 | 49.17 | +1%˄ | (run time too short) |
| 17 || 92.66 | 92.73 | +0%˄ || 10.79 | 10.78 | -0%˄ | (run time too short) |
| 19 || 47.47 | 46.90 | -1%˄ || 21.05 | 21.31 | +1%˄ | (run time too short) |
| 25 || 70.41 | 70.01 | -1%˄ || 14.20 | 14.28 | +1%˄ | (run time too short) |
| 26 || 70.09 | 69.78 | -0%˄ || 14.26 | 14.32 | +0%˄ | (run time too short) |
| 28 || 98.69 | 99.29 | +1%˄ || 10.13 | 10.07 | -1%˄ | (run time too short) |
| 29 || 247.29 | 241.31 | -2%˄ || 4.04 | 4.14 | +2%˄ | (run time too short) |
| 31 || 369.84 | 368.51 | -0%˄ || 2.70 | 2.71 | +0%˄ | (run time too short) |
| 32 || 17.13 | 17.09 | -0%˄ || 58.28 | 58.44 | +0%˄ | (run time too short) |
| 34 || 57.89 | 56.87 | -2%˄ || 17.26 | 17.57 | +2%˄ | (run time too short) |
| 35 || 294.52 | 296.46 | +1%˄ || 3.39 | 3.37 | -1%˄ | (run time too short) |
| 37 || 129.16 | 129.28 | +0%˄ || 7.74 | 7.73 | -0%˄ | (run time too short) |
| 39a || 638.99 | 635.48 | -1%˄ || 1.56 | 1.57 | +1%˄ | (run time too short) |
-| 39b || 593.70 | 653.51 | +10%˄ || 1.68 | 1.53 | -9%˄ | (run time too short) |
| 41 || 290.16 | 287.23 | -1%˄ || 3.45 | 3.48 | +1%˄ | (run time too short) |
| 42 || 33.14 | 33.03 | -0%˄ || 30.15 | 30.25 | +0%˄ | (run time too short) |
| 43 || 316.16 | 314.81 | -0%˄ || 3.16 | 3.18 | +0%˄ | (run time too short) |
| 45 || 35.76 | 35.11 | -2%˄ || 27.94 | 28.46 | +2%˄ | (run time too short) |
| 48 || 301.62 | 302.03 | +0%˄ || 3.32 | 3.31 | -0%˄ | (run time too short) |
| 50 || 73.86 | 71.60 | -3%˄ || 13.53 | 13.96 | +3%˄ | (run time too short) |
| 52 || 35.09 | 34.75 | -1%˄ || 28.47 | 28.76 | +1%˄ | (run time too short) |
| 55 || 30.66 | 30.09 | -2%˄ || 32.58 | 33.21 | +2%˄ | (run time too short) |
| 62 || 286.65 | 278.44 | -3%˄ || 3.49 | 3.59 | +3%˄ | (run time too short) |
| 65 || 1342.83 | 1336.77 | -0% || 0.74 | 0.75 | +0% | 0.3191 |
| 69 || 44.85 | 44.82 | -0%˄ || 22.28 | 22.30 | +0%˄ | (run time too short) |
| 73 || 36.01 | 35.06 | -3%˄ || 27.75 | 28.50 | +3%˄ | (run time too short) |
| 79 || 389.00 | 388.83 | -0%˄ || 2.57 | 2.57 | +0%˄ | (run time too short) |
| 81 || 120.01 | 121.15 | +1%˄ || 8.33 | 8.25 | -1%˄ | (run time too short) |
| 82 || 147.78 | 147.92 | +0%˄ || 6.77 | 6.76 | -0%˄ | (run time too short) |
| 83 || 26.18 | 26.47 | +1%˄ || 38.16 | 37.74 | -1%˄ | (run time too short) |
| 84 || 5.87 | 5.91 | +1%˄ || 169.92 | 168.52 | -1%˄ | (run time too short) |
| 85 || 40.10 | 40.40 | +1%˄ || 24.92 | 24.73 | -1%˄ | (run time too short) |
| 88 || 60.76 | 58.31 | -4%˄ || 16.45 | 17.14 | +4%˄ | (run time too short) |
| 91 || 8.83 | 8.90 | +1%˄ || 112.88 | 112.05 | -1%˄ | (run time too short) |
| 92 || 30.74 | 30.00 | -2%˄ || 32.50 | 33.31 | +2%˄ | (run time too short) |
| 93 || 585.00 | 569.15 | -3%˄ || 1.71 | 1.76 | +3%˄ | (run time too short) |
| 94 || 19.13 | 19.44 | +2%˄ || 52.19 | 51.38 | -2%˄ | (run time too short) |
| 95 || 582.83 | 582.41 | -0%˄ || 1.72 | 1.72 | +0%˄ | (run time too short) |
| 96 || 28.38 | 27.50 | -3%˄ || 35.20 | 36.33 | +3%˄ | (run time too short) |
| 97 || 1196.56 | 1201.63 | +0%˄ || 0.84 | 0.83 | -0%˄ | 0.5454 |
| 99 || 497.23 | 504.41 | +1%˄ || 2.01 | 1.98 | -1%˄ | (run time too short) |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Sum || 10081.94 | 10086.11 | +0% || | | | |
| Geomean || | | || | | +1% | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCDS - multi-threaded, shuffled, 64 clients, 64 cores Sum of avg. item runtimes: -2% || Geometric mean of throughput changes: +2%Configuration Overview - click to expand +Configuration Overview---------+-------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCDS_a7abe4451af5dea62f4c67749d4356f60b0ce712_mt.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCDS_fcb37b4081805fcd3c4e1b99414436f9631730e3_mt.json |
+-------------------------------+-------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------+
| GIT-HASH | a7abe4451af5dea62f4c67749d4356f60b0ce712-dirty | fcb37b4081805fcd3c4e1b99414436f9631730e3-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2024-10-02 09:49:39 | 2024-10-02 13:24:59 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+-------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+---------+
-| 01 || 860.67 | 960.68 | +12% || 1.00 | 1.01 | +1% | 0.1110 |
+| 03 || 322.74 | 300.74 | -7% || 1.00 | 1.02 | +2% | 0.5224 |
-| 06 || 888.56 | 1050.83 | +18% || 1.00 | 1.02 | +2% | 0.0128 |
-| 07 || 960.10 | 1082.36 | +13% || 1.00 | 1.02 | +2% | 0.0560 |
+| 09 || 894.07 | 667.66 | -25% || 1.00 | 1.02 | +2% | 0.0003 |
-| 10 || 744.40 | 842.10 | +13% || 1.00 | 1.02 | +2% | 0.1431 |
+| 13 || 1954.73 | 1864.80 | -5% || 1.00 | 1.02 | +2% | 0.3569 |
-| 15 || 548.83 | 592.07 | +8% || 1.00 | 1.02 | +2% | 0.3694 |
-| 16 || 455.19 | 574.90 | +26% || 1.00 | 1.02 | +2% | 0.0095 |
| 17 || 1367.79 | 1386.91 | +1% || 1.00 | 1.02 | +2% | 0.7981 |
| 19 || 720.86 | 747.29 | +4% || 1.00 | 1.02 | +2% | 0.6396 |
| 25 || 1083.63 | 1106.60 | +2% || 1.00 | 1.02 | +2% | 0.7650 |
| 26 || 600.43 | 602.80 | +0% || 1.00 | 1.02 | +2% | 0.9627 |
+| 28 || 1614.37 | 1053.85 | -35% || 1.00 | 1.02 | +2% | 0.0000 |
+| 29 || 1765.14 | 1653.98 | -6% || 1.00 | 1.02 | +2% | 0.1642 |
| 31 || 2623.90 | 2652.66 | +1% || 1.00 | 1.02 | +2% | 0.8004 |
+| 32 || 206.22 | 194.79 | -6% || 1.00 | 1.02 | +2% | 0.6967 |
+| 34 || 780.23 | 653.60 | -16% || 1.00 | 1.02 | +2% | 0.0190 |
| 35 || 2235.33 | 2328.17 | +4% || 1.00 | 1.01 | +1% | 0.3574 |
+| 37 || 846.81 | 744.60 | -12% || 1.00 | 1.02 | +2% | 0.0159 |
| 39a || 3076.08 | 2956.31 | -4% || 1.00 | 1.02 | +2% | 0.2140 |
| 39b || 2906.40 | 2835.60 | -2% || 1.00 | 1.02 | +2% | 0.4457 |
-| 41 || 2025.60 | 4053.93 | +100% || 1.00 | 1.01 | +1% | 0.0000 |
+| 42 || 514.08 | 416.36 | -19% || 1.00 | 1.02 | +2% | 0.0180 |
+| 43 || 1527.91 | 1443.87 | -6% || 1.00 | 1.02 | +2% | 0.2431 |
-| 45 || 778.69 | 814.39 | +5% || 1.00 | 1.02 | +2% | 0.5672 |
| 48 || 2805.09 | 2691.56 | -4% || 1.00 | 1.02 | +2% | 0.3073 |
+| 50 || 1088.62 | 854.98 | -21% || 1.00 | 1.02 | +2% | 0.0002 |
+| 52 || 468.90 | 417.28 | -11% || 1.00 | 1.02 | +2% | 0.1892 |
+| 55 || 469.72 | 415.63 | -12% || 1.00 | 1.02 | +2% | 0.1758 |
+| 62 || 1069.37 | 987.55 | -8% || 1.00 | 1.02 | +2% | 0.1413 |
| 65 || 4473.90 | 4335.94 | -3% || 1.00 | 1.01 | +2% | 0.0614 |
-| 69 || 1122.62 | 1200.08 | +7% || 1.00 | 1.02 | +2% | 0.3631 |
+| 73 || 550.22 | 489.48 | -11% || 1.00 | 1.02 | +2% | 0.1912 |
+| 79 || 1618.86 | 1394.96 | -14% || 1.00 | 1.02 | +2% | 0.0007 |
-| 81 || 731.70 | 959.50 | +31% || 1.00 | 1.02 | +2% | 0.0001 |
| 82 || 1041.68 | 1014.29 | -3% || 1.00 | 1.01 | +1% | 0.6414 |
-| 83 || 375.29 | 423.69 | +13% || 1.00 | 1.02 | +2% | 0.3312 |
-| 84 || 138.69 | 166.52 | +20% || 1.00 | 1.02 | +2% | 0.3371 |
-| 85 || 889.98 | 987.80 | +11% || 1.00 | 1.02 | +2% | 0.1430 |
+| 88 || 2775.88 | 1959.71 | -29% || 1.00 | 1.02 | +2% | 0.0000 |
-| 91 || 210.29 | 319.77 | +52% || 1.00 | 1.02 | +2% | 0.0243 |
+| 92 || 359.41 | 260.53 | -28% || 1.00 | 1.02 | +2% | 0.0156 |
+| 93 || 2254.10 | 1960.77 | -13% || 1.00 | 1.02 | +2% | 0.0001 |
| 94 || 479.31 | 482.77 | +1% || 1.00 | 1.02 | +2% | 0.9447 |
+| 95 || 2305.17 | 2125.36 | -8% || 1.00 | 1.02 | +2% | 0.0574 |
+| 96 || 448.02 | 349.90 | -22% || 1.00 | 1.02 | +2% | 0.0139 |
+| 97 || 4470.68 | 4075.64 | -9% || 1.00 | 1.01 | +2% | 0.0001 |
| 99 || 1401.31 | 1359.50 | -3% || 1.00 | 1.02 | +2% | 0.4743 |
+---------++----------+----------+--------++----------+----------+--------+---------+
| Sum || 63851.57 | 62815.06 | -2% || | | | |
| Geomean || | | || | | +2% | |
+---------++----------+----------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCC - single-threaded Sum of avg. item runtimes: -0% || Geometric mean of throughput changes: -1%Configuration Overview - click to expand +Configuration Overview---+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCC_a7abe4451af5dea62f4c67749d4356f60b0ce712_st.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCC_fcb37b4081805fcd3c4e1b99414436f9631730e3_st.json |
+-------------------------+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+
| GIT-HASH | a7abe4451af5dea62f4c67749d4356f60b0ce712-dirty | fcb37b4081805fcd3c4e1b99414436f9631730e3-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-10-02 10:10:19 | 2024-10-02 13:45:37 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10 | 10 |
| time_unit | ns | ns
10000
|
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+ +--------------++----------+---------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+--------------++----------+---------+--------++----------+----------+--------+---------+
+| Delivery || 25.92 | 25.86 | -0% || 5.08 | 5.52 | +9% | 0.2942 |
| New-Order || 12.15 | 12.12 | -0% || 59.49 | 59.01 | -1% | 0.6931 |
| Order-Status || 1.15 | 1.15 | -1% || 5.13 | 4.93 | -4% | 0.2741 |
| Payment || 2.23 | 2.22 | -0% || 56.79 | 56.14 | -1% | 0.0999 |
-| Stock-Level || 1.96 | 1.95 | -1% || 5.23 | 4.78 | -9% | 0.2811 |
+--------------++----------+---------+--------++----------+----------+--------+---------+
| Sum || 43.43 | 43.30 | -0% || | | | |
| Geomean || | | || | | -1% | |
+--------------++----------+---------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCC - multi-threaded, shuffled, 64 clients, 10 warehouses, 64 cores (high contention) Sum of avg. item runtimes: -1% || Geometric mean of throughput changes: +0%Configuration Overview - click to expand +Configuration Overview---------+---------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCC_a7abe4451af5dea62f4c67749d4356f60b0ce712_mt_highcont.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCC_fcb37b4081805fcd3c4e1b99414436f9631730e3_mt_highcont.json |
+-------------------------------+---------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | a7abe4451af5dea62f4c67749d4356f60b0ce712-dirty | fcb37b4081805fcd3c4e1b99414436f9631730e3-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2024-10-02 10:11:30 | 2024-10-02 13:46:48 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 600000000000 | 600000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10 | 10 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+---------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------+ +--------------++----------+---------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+--------------++----------+---------+--------++----------+----------+--------+---------+
| Delivery || 150.20 | 149.07 | -1% || 40.78 | 40.95 | +0% | 0.0606 |
| unsucc.: || 2.91 | 3.03 | +4% || 61.51 | 61.82 | +1% | |
| New-Order || 76.06 | 75.02 | -1% || 577.37 | 582.68 | +1% | 0.0000 |
| unsucc.: || 7.46 | 7.62 | +2% || 581.16 | 575.85 | -1% | |
| Order-Status || 7.71 | 7.48 | -3% || 102.95 | 102.76 | -0% | 0.0088 |
| Payment || 12.19 | 12.19 | +0% || 297.04 | 296.47 | -0% | 0.9862 |
| unsucc.: || 4.59 | 4.81 | +5% || 807.75 | 808.92 | +0% | |
| Stock-Level || 12.18 | 12.28 | +1% || 102.51 | 103.11 | +1% | 0.4705 |
+--------------++----------+---------+--------++----------+----------+--------+---------+
| Sum || 258.32 | 256.04 | -1% || | | | |
| Geomean || | | || | | +0% | |
+--------------++----------+---------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCC - multi-threaded, shuffled, 10 clients, 10 warehouses, 64 cores (low contention) Sum of avg. item runtimes: -0% || Geometric mean of throughput changes: +1%Configuration Overview - click to expand +Configuration Overview---------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCC_a7abe4451af5dea62f4c67749d4356f60b0ce712_mt_lowcont.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCC_fcb37b4081805fcd3c4e1b99414436f9631730e3_mt_lowcont.json |
+-------------------------------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | a7abe4451af5dea62f4c67749d4356f60b0ce712-dirty | fcb37b4081805fcd3c4e1b99414436f9631730e3-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 10 | 10 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2024-10-02 10:21:43 | 2024-10-02 13:57:01 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 600000000000 | 600000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10 | 10 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+ +--------------++----------+---------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+--------------++----------+---------+--------++----------+----------+--------+---------+
| Delivery || 45.55 | 45.63 | +0% || 27.32 | 27.81 | +2% | 0.1648 |
| unsucc.: || 0.66 | 0.62 | -5% || 3.43 | 3.60 | +5% | |
| New-Order || 22.46 | 22.25 | -1% || 320.27 | 321.74 | +0% | 0.0000 |
| unsucc.: || 1.92 | 1.96 | +2% || 29.56 | 29.46 | -0% | |
| Order-Status || 2.44 | 2.42 | -1% || 30.96 | 31.36 | +1% | 0.0001 |
| Payment || 4.48 | 4.46 | -0% || 274.76 | 277.66 | +1% | 0.0000 |
| unsucc.: || 1.25 | 1.24 | -1% || 58.72 | 58.75 | +0% | |
| Stock-Level || 3.51 | 3.50 | -0% || 30.72 | 31.51 | +3% | 0.2306 |
+--------------++----------+---------+--------++----------+----------+--------+---------+
| Sum || 78.45 | 78.27 | -0% || | | | |
| Geomean || | | || | | +1% | |
+--------------++----------+---------+--------++----------+----------+--------+---------+hyriseBenchmarkJoinOrder - single-threaded Sum of avg. item runtimes: +1% || Geometric mean of throughput changes: -2%Configuration Overview - click to expand +Configuration Overview---+-----------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkJoinOrder_a7abe4451af5dea62f4c67749d4356f60b0ce712_st.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkJoinOrder_fcb37b4081805fcd3c4e1b99414436f9631730e3_st.json |
+-------------------------+-----------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------+
| GIT-HASH | a7abe4451af5dea62f4c67749d4356f60b0ce712-dirty | fcb37b4081805fcd3c4e1b99414436f9631730e3-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-10-02 10:31:51 | 2024-10-02 14:07:10 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+-----------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| 10a || 113.81 | 114.23 | +0%˄ || 8.79 | 8.75 | -0%˄ | (run time too short) |
| 10b || 70.67 | 68.51 | -3%˄ || 14.15 | 14.60 | +3%˄ | (run time too short) |
| 10c || 327.55 | 326.07 | -0%˄ || 3.05 | 3.07 | +0%˄ | (run time too short) |
| 11a || 92.03 | 91.73 | -0%˄ || 10.87 | 10.90 | +0%˄ | (run time too short) |
| 11b || 87.26 | 87.16 | -0%˄ || 11.46 | 11.47 | +0%˄ | (run time too short) |
| 11c || 27.84 | 27.24 | -2%˄ || 35.91 | 36.71 | +2%˄ | (run time too short) |
| 11d || 24.47 | 23.60 | -4%˄ || 40.86 | 42.37 | +4%˄ | (run time too short) |
| 12a || 31.53 | 31.41 | -0%˄ || 31.71 | 31.83 | +0%˄ | (run time too short) |
| 12b || 29.21 | 28.11 | -4%˄ || 34.23 | 35.57 | +4%˄ | (run time too short) |
| 12c || 72.18 | 71.90 | -0%˄ || 13.85 | 13.91 | +0%˄ | (run time too short) |
| 13a || 185.23 | 182.88 | -1%˄ || 5.40 | 5.47 | +1%˄ | (run time too short) |
| 13b || 236.74 | 236.05 | -0%˄ || 4.22 | 4.24 | +0%˄ | (run time too short) |
| 13c || 32.89 | 32.05 | -3%˄ || 30.41 | 31.20 | +3%˄ | (run time too short) |
| 13d || 502.36 | 500.20 | -0%˄ || 1.99 | 2.00 | +0%˄ | (run time too short) |
| 14a || 100.16 | 100.26 | +0%˄ || 9.98 | 9.97 | -0%˄ | (run time too short) |
| 14b || 108.22 | 107.64 | -1%˄ || 9.24 | 9.29 | +1%˄ | (run time too short) |
| 14c || 214.91 | 216.67 | +1%˄ || 4.65 | 4.62 | -1%˄ | (run time too short) |
| 15a || 55.49 | 55.35 | -0%˄ || 18.02 | 18.07 | +0%˄ | (run time too short) |
| 15b || 58.47 | 58.34 | -0%˄ || 17.10 | 17.14 | +0%˄ | (run time too short) |
| 15c || 44.69 | 44.22 | -1%˄ || 22.38 | 22.61 | +1%˄ | (run time too short) |
| 15d || 42.03 | 41.80 | -1%˄ || 23.79 | 23.92 | +1%˄ | (run time too short) |
| 16a || 1340.08 | 1337.10 | -0% || 0.75 | 0.75 | +0% | 0.2508 |
| 16b || 2462.69 | 2464.83 | +0% || 0.41 | 0.41 | -0% | 0.7020 |
| 16c || 1510.46 | 1502.97 | -0% || 0.66 | 0.67 | +0% | 0.0013 |
| 16d || 1470.84 | 1463.71 | -0% || 0.68 | 0.68 | +0% | 0.0016 |
| 17a || 459.54 | 450.05 | -2%˄ || 2.18 | 2.22 | +2%˄ | (run time too short) |
| 17b || 369.83 | 361.05 | -2%˄ || 2.70 | 2.77 | +2%˄ | (run time too short) |
| 17c || 351.21 | 341.40 | -3%˄ || 2.85 | 2.93 | +3%˄ | (run time too short) |
| 17d || 420.03 | 409.04 | -3%˄ || 2.38 | 2.44 | +3%˄ | (run time too short) |
| 17e || 1549.88 | 1556.63 | +0% || 0.65 | 0.64 | -0% | 0.0123 |
| 17f || 905.94 | 900.79 | -1%˄ || 1.10 | 1.11 | +1%˄ | (run time too short) |
| 18a || 135.95 | 135.24 | -1%˄ || 7.36 | 7.39 | +1%˄ | (run time too short) |
| 18b || 105.89 | 106.60 | +1%˄ || 9.44 | 9.38 | -1%˄ | (run time too short) |
| 18c || 214.44 | 214.26 | -0%˄ || 4.66 | 4.67 | +0%˄ | (run time too short) |
| 19a || 211.12 | 210.69 | -0%˄ || 4.74 | 4.75 | +0%˄ | (run time too short) |
| 19b || 175.83 | 175.91 | +0%˄ || 5.69 | 5.68 | -0%˄ | (run time too short) |
| 19c || 255.34 | 254.37 | -0%˄ || 3.92 | 3.93 | +0%˄ | (run time too short) |
| 19d || 670.75 | 670.86 | +0%˄ || 1.49 | 1.49 | -0%˄ | (run time too short) |
| 1a || 10.35 | 10.20 | -1%˄ || 96.59 | 97.98 | +1%˄ | (run time too short) |
| 1b || 16.13 | 15.97 | -1%˄ || 61.97 | 62.60 | +1%˄ | (run time too short) |
| 1c || 16.93 | 16.95 | +0%˄ || 59.07 | 58.97 | -0%˄ | (run time too short) |
| 1d || 9.68 | 9.60 | -1%˄ || 103.30 | 104.18 | +1%˄ | (run time too short) |
| 20a || 532.56 | 526.02 | -1%˄ || 1.88 | 1.90 | +1%˄ | (run time too short) |
| 20b || 564.94 | 559.72 | -1%˄ || 1.77 | 1.79 | +1%˄ | (run time too short) |
| 20c || 384.16 | 380.04 | -1%˄ || 2.60 | 2.63 | +1%˄ | (run time too short) |
| 21a || 102.88 | 102.82 | -0%˄ || 9.72 | 9.73 | +0%˄ | (run time too short) |
| 21b || 95.12 | 95.23 | +0%˄ || 10.51 | 10.50 | -0%˄ | (run time too short) |
| 21c || 99.78 | 99.95 | +0%˄ || 10.02 | 10.00 | -0%˄ | (run time too short) |
| 22a || 169.95 | 170.46 | +0%˄ || 5.88 | 5.87 | -0%˄ | (run time too short) |
| 22b || 152.37 | 152.99 | +0%˄ || 6.56 | 6.54 | -0%˄ | (run time too short) |
| 22c || 230.28 | 231.90 | +1%˄ || 4.34 | 4.31 | -1%˄ | (run time too short) |
| 22d || 356.57 | 358.68 | +1%˄ || 2.80 | 2.79 | -1%˄ | (run time too short) |
| 23a || 48.37 | 47.78 | -1%˄ || 20.67 | 20.93 | +1%˄ | (run time too short) |
| 23b || 55.09 | 55.02 | -0%
10000
˄ || 18.15 | 18.17 | +0%˄ | (run time too short) |
| 23c || 51.73 | 50.94 | -2%˄ || 19.33 | 19.63 | +2%˄ | (run time too short) |
| 24a || 205.94 | 204.69 | -1%˄ || 4.86 | 4.89 | +1%˄ | (run time too short) |
| 24b || 193.47 | 193.09 | -0%˄ || 5.17 | 5.18 | +0%˄ | (run time too short) |
| 25a || 103.85 | 104.56 | +1%˄ || 9.63 | 9.56 | -1%˄ | (run time too short) |
| 25b || 63.66 | 63.66 | -0%˄ || 15.71 | 15.71 | +0%˄ | (run time too short) |
| 25c || 237.05 | 238.82 | +1%˄ || 4.22 | 4.19 | -1%˄ | (run time too short) |
| 26a || 177.74 | 175.59 | -1%˄ || 5.63 | 5.70 | +1%˄ | (run time too short) |
| 26b || 148.60 | 147.48 | -1%˄ || 6.73 | 6.78 | +1%˄ | (run time too short) |
-| 26c || 323.20 | 344.96 | +7%˄ || 3.09 | 2.90 | -6%˄ | (run time too short) |
| 27a || 97.19 | 100.97 | +4%˄ || 10.29 | 9.90 | -4%˄ | (run time too short) |
-| 27b || 85.76 | 89.92 | +5%˄ || 11.66 | 11.12 | -5%˄ | (run time too short) |
-| 27c || 99.94 | 105.02 | +5%˄ || 10.01 | 9.52 | -5%˄ | (run time too short) |
| 28a || 195.91 | 202.91 | +4%˄ || 5.10 | 4.93 | -3%˄ | (run time too short) |
-| 28b || 72.28 | 75.86 | +5%˄ || 13.83 | 13.18 | -5%˄ | (run time too short) |
| 28c || 171.63 | 179.25 | +4%˄ || 5.83 | 5.58 | -4%˄ | (run time too short) |
-| 29a || 167.99 | 189.79 | +13%˄ || 5.95 | 5.27 | -11%˄ | (run time too short) |
| 29b || 781.32 | 795.96 | +2%˄ || 1.28 | 1.26 | -2%˄ | (run time too short) |
-| 29c || 208.55 | 233.63 | +12%˄ || 4.79 | 4.28 | -11%˄ | (run time too short) |
| 2a || 30.52 | 30.66 | +0%˄ || 32.76 | 32.62 | -0%˄ | (run time too short) |
| 2b || 28.15 | 28.15 | -0%˄ || 35.52 | 35.52 | +0%˄ | (run time too short) |
| 2c || 23.75 | 23.72 | -0%˄ || 42.10 | 42.15 | +0%˄ | (run time too short) |
| 2d || 57.98 | 57.62 | -1%˄ || 17.25 | 17.35 | +1%˄ | (run time too short) |
-| 30a || 88.79 | 97.60 | +10%˄ || 11.26 | 10.25 | -9%˄ | (run time too short) |
-| 30b || 91.57 | 98.45 | +8%˄ || 10.92 | 10.16 | -7%˄ | (run time too short) |
-| 30c || 156.77 | 167.98 | +7%˄ || 6.38 | 5.95 | -7%˄ | (run time too short) |
-| 31a || 78.32 | 86.47 | +10%˄ || 12.77 | 11.56 | -9%˄ | (run time too short) |
-| 31b || 76.43 | 85.13 | +11%˄ || 13.08 | 11.75 | -10%˄ | (run time too short) |
-| 31c || 87.72 | 98.51 | +12%˄ || 11.40 | 10.15 | -11%˄ | (run time too short) |
| 32a || 15.63 | 16.22 | +4%˄ || 63.96 | 61.66 | -4%˄ | (run time too short) |
| 32b || 37.73 | 37.39 | -1%˄ || 26.50 | 26.74 | +1%˄ | (run time too short) |
-| 33a || 34.76 | 36.35 | +5%˄ || 28.76 | 27.51 | -4%˄ | (run time too short) |
-| 33b || 21.90 | 23.25 | +6%˄ || 45.66 | 43.00 | -6%˄ | (run time too short) |
| 33c || 45.45 | 46.52 | +2%˄ || 22.00 | 21.49 | -2%˄ | (run time too short) |
-| 3a || 68.47 | 73.20 | +7%˄ || 14.60 | 13.66 | -6%˄ | (run time too short) |
-| 3b || 18.84 | 20.01 | +6%˄ || 53.06 | 49.97 | -6%˄ | (run time too short) |
| 3c || 220.61 | 228.18 | +3%˄ || 4.53 | 4.38 | -3%˄ | (run time too short) |
| 4a || 151.11 | 154.02 | +2%˄ || 6.62 | 6.49 | -2%˄ | (run time too short) |
| 4b || 18.00 | 18.59 | +3%˄ || 55.55 | 53.79 | -3%˄ | (run time too short) |
| 4c || 191.74 | 193.18 | +1%˄ || 5.22 | 5.18 | -1%˄ | (run time too short) |
-| 5a || 50.79 | 55.61 | +9%˄ || 19.69 | 17.98 | -9%˄ | (run time too short) |
| 5b || 51.25 | 52.66 | +3%˄ || 19.51 | 18.99 | -3%˄ | (run time too short) |
-| 5c || 88.46 | 94.39 | +7%˄ || 11.30 | 10.59 | -6%˄ | (run time too short) |
| 6a || 157.53 | 159.75 | +1%˄ || 6.35 | 6.26 | -1%˄ | (run time too short) |
| 6b || 168.51 | 170.76 | +1%˄ || 5.93 | 5.86 | -1%˄ | (run time too short) |
| 6c || 147.02 | 149.55 | +2%˄ || 6.80 | 6.69 | -2%˄ | (run time too short) |
| 6d || 368.89 | 365.51 | -1%˄ || 2.71 | 2.74 | +1%˄ | (run time too short) |
| 6e || 152.72 | 155.20 | +2%˄ || 6.55 | 6.44 | -2%˄ | (run time too short) |
| 6f || 687.29 | 686.13 | -0%˄ || 1.45 | 1.46 | +0%˄ | (run time too short) |
| 7a || 89.20 | 92.42 | +4%˄ || 11.21 | 10.82 | -3%˄ | (run time too short) |
| 7b || 82.63 | 85.81 | +4%˄ || 12.10 | 11.65 | -4%˄ | (run time too short) |
| 7c || 551.14 | 548.84 | -0%˄ || 1.81 | 1.82 | +0%˄ | (run time too short) |
-| 8a || 178.22 | 187.49 | +5%˄ || 5.61 | 5.33 | -5%˄ | (run time too short) |
-| 8b || 166.20 | 175.98 | +6%˄ || 6.02 | 5.68 | -6%˄ | (run time too short) |
| 8c || 1786.68 | 1797.01 | +1% || 0.56 | 0.56 | -1% | 0.0000 |
| 8d || 298.03 | 301.68 | +1%˄ || 3.36 | 3.31 | -1%˄ | (run time too short) |
-| 9a || 246.09 | 269.93 | +10%˄ || 4.06 | 3.70 | -9%˄ | (run time too short) |
-| 9b || 157.02 | 166.72 | +6%˄ || 6.37 | 6.00 | -6%˄ | (run time too short) |
-| 9c || 270.74 | 293.97 | +9%˄ || 3.69 | 3.40 | -8%˄ | (run time too short) |
-| 9d || 427.95 | 451.53 | +6%˄ || 2.34 | 2.21 | -5%˄ | (run time too short) |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Sum || 28969.12 | 29213.48 | +1% || | | | |
| Geomean || | | || | | -2% | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkJoinOrder - multi-threaded, ordered, 1 client, 64 cores Sum of avg. item runtimes: +0% || Geometric mean of throughput changes: -0%Configuration Overview - click to expand +Configuration Overview---------+-------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkJoinOrder_a7abe4451af5dea62f4c67749d4356f60b0ce712_mt_ordered.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkJoinOrder_fcb37b4081805fcd3c4e1b99414436f9631730e3_mt_ordered.json |
+-------------------------------+-------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | a7abe4451af5dea62f4c67749d4356f60b0ce712-dirty | fcb37b4081805fcd3c4e1b99414436f9631730e3-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2024-10-02 10:56:21 | 2024-10-02 14:31:49 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------------+-------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| 10a || 21.71 | 21.76 | +0%˄ || 46.00 | 45.90 | -0%˄ | (run time too short) |
| 10b || 10.12 | 10.02 | -1%˄ || 98.56 | 99.57 | +1%˄ | (run time too short) |
| 10c || 71.34 | 70.81 | -1%˄ || 14.01 | 14.11 | +1%˄ | (run time too short) |
| 11a || 13.16 | 13.43 | +2%˄ || 75.81 | 74.34 | -2%˄ | (run time too short) |
| 11b || 11.55 | 11.27 | -2%˄ || 86.39 | 88.56 | +3%˄ | (run time too short) |
| 11c || 14.54 | 14.36 | -1%˄ || 68.65 | 69.50 | +1%˄ | (run time too short) |
| 11d || 14.71 | 14.67 | -0%˄ || 67.86 | 68.07 | +0%˄ | (run time too short) |
-| 12a || 13.97 | 14.68 | +5%˄ || 71.47 | 68.01 | -5%˄ | (run time too short) |
| 12b || 7.71 | 7.98 | +3%˄ || 129.25 | 124.89 | -3%˄ | (run time too short) |
| 12c || 33.02 | 34.31 | +4%˄ || 30.25 | 29.12 | -4%˄ | (run time too short) |
| 13a || 96.67 | 98.35 | +2%˄ || 10.34 | 10.16 | -2%˄ | (run time too short) |
| 13b || 56.62 | 56.53 | -0%˄ || 17.65 | 17.68 | +0%˄ | (run time too short) |
| 13c || 10.26 | 10.07 | -2%˄ || 97.20 | 99.07 | +2%˄ | (run time too short) |
| 13d || 279.55 | 283.20 | +1%˄ || 3.58 | 3.53 | -1%˄ | (run time too short) |
| 14a || 36.49 | 37.56 | +3%˄ || 27.38 | 26.60 | -3%˄ | (run time too short) |
| 14b || 43.94 | 45.06 | +3%˄ || 22.74 | 22.17 | -3%˄ | (run time too short) |
| 14c || 93.61 | 97.22 | +4%˄ || 10.68 | 10.28 | -4%˄ | (run time too short) |
| 15a || 18.22 | 18.13 | -0%˄ || 54.80 | 55.07 | +0%˄ | (run time too short) |
| 15b || 14.63 | 14.63 | -0%˄ || 68.21 | 68.22 | +0%˄ | (run time too short) |
| 15c || 14.04 | 13.79 | -2%˄ || 71.11 | 72.39 | +2%˄ | (run time too short) |
| 15d || 17.06 | 16.83 | -1%˄ || 58.52 | 59.34 | +1%˄ | (run time too short) |
| 16a || 502.36 | 502.78 | +0%˄ || 1.99 | 1.99 | -0%˄ | (run time too short) |
| 16b || 1434.08 | 1439.20 | +0% || 0.70 | 0.69 | -0% | 0.4609 |
| 16c || 627.97 | 624.14 | -1%˄ || 1.59 | 1.60 | +1%˄ | (run time too short) |
| 16d || 601.92 | 601.98 | +0%˄ || 1.66 | 1.66 | -0%˄ | (run time too short) |
| 17a || 135.79 | 137.15 | +1%˄ || 7.36 | 7.29 | -1%˄ | (run time too short) |
| 17b || 109.01 | 109.43 | +0%˄ || 9.17 | 9.14 | -0%˄ | (run time too short) |
| 17c || 92.13 | 90.35 | -2%˄ || 10.85 | 11.06 | +2%˄ | (run time too short) |
| 17d || 85.44 | 84.98 | -1%˄ || 11.70 | 11.76 | +1%˄ | (run time too short) |
| 17e || 580.43 | 581.92 | +0%˄ || 1.72 | 1.72 | -0%˄ | (run time too short) |
| 17f || 250.04 | 252.71 | +1%˄ || 4.00 | 3.96 | -1%˄ | (run time too short) |
| 18a || 32.41 | 32.50 | +0%˄ || 30.82 | 30.74 | -0%˄ | (run time too short) |
-| 18b || 33.86 | 37.20 | +10%˄ || 29.50 | 26.86 | -9%˄ | (run time too short) |
| 18c || 95.46 | 99.09 | +4%˄ || 10.47 | 10.09 | -4%˄ | (run time too short) |
| 19a || 65.52 | 64.30 | -2%˄ || 15.25 | 15.54 | +2%˄ | (run time too short) |
| 19b || 41.59 | 40.73 | -2%˄ || 24.02 | 24.53 | +2%˄ | (run time too short) |
| 19c || 76.11 | 76.31 | +0%˄ || 13.13 | 13.10 | -0%˄ | (run time too short) |
| 19d || 418.57 | 418.08 | -0%˄ || 2.39 | 2.39 | +0%˄ | (run time too short) |
| 1a || 4.12 | 4.06 | -1%˄ || 241.33 | 244.84 | +1%˄ | (run time too short) |
| 1b || 2.60 | 2.66 | +2%˄ || 381.65 | 372.63 | -2%˄ | (run time too short) |
| 1c || 2.40 | 2.38 | -1%˄ || 413.52 | 416.81 | +1%˄ | (run time too short) |
| 1d || 3.27 | 3.31 | +1%˄ || 304.26 | 300.60 | -1%˄ | (run time too short) |
| 20a || 49.68 | 49.21 | -1%˄ || 20.11 | 20.31 | +1%˄ | (run time too short) |
| 20b || 42.08 | 41.29 | -2%˄ || 23.74 | 24.20 | +2%˄ | (run time too short) |
| 20c || 51.91 | 51.71 | -0%˄ || 19.25 | 19.33 | +0%˄ | (run time too short) |
| 21a || 15.85 | 15.80 | -0%˄ || 62.97 | 63.17 | +0%˄ | (run time too short) |
| 21b || 13.71 | 13.49 | -2%˄ || 72.78 | 73.99 | +2%˄ | (run time too short) |
| 21c || 17.14 | 16.77 | -2%˄ || 58.23 | 59.52 | +2%˄ | (run time too short) |
-| 22a || 46.20 | 48.33 | +5%˄ || 21.63 | 20.68 | -4%˄ | (run time too short) |
| 22b || 34.84 | 34.82 | -0%˄ || 28.67 | 28.69 | +0%˄ | (run time too short) |
| 22c || 80.72 | 81.56 | +1%˄ || 12.38 | 12.26 | -1%˄ | (run time too short) |
| 22d || 144.06 | 142.70 | -1%˄ || 6.94 | 7.01 | +1%˄ | (run time too short) |
| 23a || 10.82 | 10.79 | -0%˄ || 92.22 | 92.50 | +0%˄ | (run time too short) |
| 23b || 16.46 | 16.46 | +0%˄ || 60.66 | 60.64 | -0%˄ | (run time too short) |
| 23c || 12.30 | 12.18 | -1%˄ || 81.14 | 81.91 | +1%˄ | (run time too short) |
| 24a || 37.94 | 38.06 | +0%˄ || 26.33 | 26.25 | -0%˄ | (run time too short) |
| 24b || 38.40 | 38.21 | -0%˄ || 26.02 | 26.15 | +0%˄ | (run time too short) |
| 25a || 38.13 | 38.72 | +2%˄ || 26.21 | 25.80 | -2%˄ | (run time too short) |
| 25b || 20.33 | 20.41 | +0%˄ || 49.11 | 48.92 | -0%˄ | (run time too short) |
| 25c || 116.25 | 120.59 | +4%˄ || 8.60 | 8.29 | -4%˄ | (run time too short) |
| 26a || 55.41 | 55.26 | -0%˄ || 18.04 | 18.09 | +0%˄ | (run time too short) |
| 26b || 40.75 | 40.99 | +1%˄ || 24.52 | 24.38 | -1%˄ | (run time too short) |
| 26c || 89.98 | 89.69 | -0%˄ || 11.11 | 11.14 | +0%˄ | (run time too short) |
| 27a || 13.77 | 13.84 | +0%˄ || 72.48 | 72.14 | -0%˄ | (run time too short) |
| 27b || 13.29 | 13.48 | +1%˄ || 75.12 | 74.06 | -1%˄ | (run time too short) |
| 27c || 16.65 | 16.34 | -2%˄ || 59.95 | 61.11 | +2%˄ | (run time too short) |
| 28a || 80.56 | 81.35 | +1%˄ || 12.41 | 12.29 | -1%˄ | (run time too short) |
| 28b || 18.40 | 18.41 | +0%˄ || 54.28 | 54.23 | -0%˄ | (run time too short) |
| 28c || 69.19 | 70.24 | +2%˄ || 14.45 | 14.23 | -1%˄ | (run time too short) |
| 29a || 33.36 | 32.09 | -4%˄ || 29.95 | 31.13 | +4%˄ | (run time too short) |
+| 29b || 99.49 | 87.15 | -12%˄ || 10.05 | 11.47 | +14%˄ | (run time too short) |
| 29c || 39.40 | 39.27 | -0%˄ || 25.36 | 25.44 | +0%˄ | (run time too short) |
| 2a || 15.14 | 14.90 | -2%˄ || 65.97 | 67.03 | +2%˄ | (run time too short) |
| 2b || 13.42 | 13.15 | -2%˄ || 74.41 | 75.94 | +2%˄ | (run time too short) |
| 2c || 9.35 | 9.31 | -0%˄ || 106.65 | 107.15 | +0%˄ | (run time too short) |
| 2d || 36.12 | 35.95 | -0%˄ || 27.66 | 27.79 | +0%˄ | (run time too short) |
| 30a || 32.18 | 33.61 | +4%˄ || 31.04 | 29.73 | -4%˄ | (run time too short) |
-| 30b || 24.86 | 26.50 | +7%˄ || 40.17 | 37.68 | -6%˄ | (run time too short) |
-| 30c || 74.58 | 78.93 | +6%˄ || 13.40 | 12.66 | -6%˄ | (run time too short) |
| 31a || 24.11 | 24.58 | +2%˄ || 41.42 | 40.63 | -2%˄ | (run time too short) |
| 31b || 21.69 | 22.18 | +2%˄ || 46.03 | 45.02 | -2%˄ | (run time too short) |
| 31c || 27.47 | 28.50 | +4%˄ || 36.36 | 35.05 | -4%˄ | (run time too short) |
| 32a || 4.33 | 4.36 | +1%˄ || 229.68 | 228.34 | -1%˄ | (run time too short) |
| 32b || 20.53 | 20.50 | -0%˄ || 48.65 | 48.72 | +0%˄ | (run time too short) |
| 33a || 6.93 | 6.98 | +1%˄ || 143.71 | 142.82 | -1%˄ | (run time too short) |
| 33b || 5.46 | 5.55 | +2%˄ || 182.27 | 179.50 | -2%˄ | (run time too short) |
| 33c || 11.15 | 11.24 | +1%˄ || 89.50 | 88.73 | -1%˄ | (run time too short) |
| 3a || 26.03 | 26.43 | +2%˄ || 38.38 | 37.79 | -2%˄ | (run time too short) |
| 3b || 4.17 | 4.07 | -2%˄ || 238.54 | 244.33 | +2%˄ | (run time too short) |
| 3c || 48.11 | 49.73 | +3%˄ || 20.77 | 20.09 | -3%˄ | (run time too short) |
| 4a || 40.67 | 41.78 | +3%˄ || 24.57 | 23.92 | -3%˄ | (run time too short) |
| 4b || 3.44 | 3.47 | +1%˄ || 288.72 | 286.71 | -1%˄ | (run time too short) |
| 4c || 51.97 | 53.15 | +2%˄ || 19.23 | 18.80 | -2%˄ | (run time too short) |
| 5a || 16.29 | 16.65 | +2%˄ || 61.30 | 59.96 | -2%˄ | (run time too short) |
| 5b || 12.27 | 12.51 | +2%˄ || 81.35 | 79.75 | -2%˄ | (run time too short) |
-| 5c || 29.99 | 31.64 | +6%˄ || 33.31 | 31.57 | -5%˄ | (run time too short) |
| 6a || 18.18 | 18.08 | -1%˄ || 54.91 | 55.21 | +1%˄ | (run time too short) |
| 6b || 32.02 | 32.11 | +0%˄ || 31.20 | 31.11 | -0%˄ | (run time too short) |
| 6c || 16.72 | 16.45 | -2%˄ || 59.69 | 60.67 | +2%˄ | (run time too short) |
| 6d || 90.13 | 89.00 | -1%˄ || 11.09 | 11.23 | +1%˄ | (run time too short) |
| 6e || 18.45 | 18.49 | +0%˄ || 54.12 | 54.00 | -0%˄ | (run time too short) |
| 6f || 384.12 | 383.54 | -0%˄ || 2.60 | 2.61 | +0%˄ | (run time too short) |
| 7a || 17.30 | 17.32 | +0%˄ || 57.72 | 57.66 | -0%˄ | (run time too short) |
| 7b || 17.59 | 17.94 | +2%˄ || 56.76 | 55.66 | -2%˄ | (run time too short) |
| 7c || 196.30 | 195.52 | -0%˄ || 5.09 | 5.11 | +0%˄ | (run time too short) |
| 8a || 20.00 | 19.96 | -0%˄ || 49.92 | 50.03 | +0%˄ | (run time too short) |
| 8b || 18.87 | 18.69 | -1%˄ || 52.89 | 53.42 | +1%˄ | (run time too short) |
| 8c || 922.67 | 926.08 | +0%˄ || 1.08 | 1.08 | -0%˄ | (run time too short) |
| 8d || 165.47 | 167.08 | +1%˄ || 6.04 | 5.98 | -1%˄ | (run time too short) |
| 9a || 90.62 | 90.30 | -0%˄ || 11.03 | 11.07 | +0%˄ | (run time too short) |
| 9b || 52.69 | 52.11 | -1%˄ || 18.97 | 19.18 | +1%˄ | (run time too short) |
| 9c || 92.63 | 91.79 | -1%˄ || 10.79 | 10.89 | +1%˄ | (run time too short) |
| 9d || 281.21 | 283.18 | +1%˄ || 3.56 | 3.53 | -1%˄ | (run time too short) |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Sum || 10440.34 | 10472.46 | +0% || | | | |
| Geomean || | | || | | -0% | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkJoinOrder - multi-threaded, shuffled, 64 clients, 64 cores Sum of avg. item runtimes: -4% || Geometric mean of throughput changes: +4%Configuration Overview - click to expand +Configuration Overview---------+-----------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkJoinOrder_a7abe4451af5dea62f4c67749d4356f60b0ce712_mt.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkJoinOrder_fcb37b4081805fcd3c4e1b99414436f9631730e3_mt.json |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------+
| GIT-HASH | a7abe4451af5dea62f4c67749d4356f60b0ce712-dirty | fcb37b4081805fcd3c4e1b99414436f9631730e3-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2024-10-02 11:07:52 | 2024-10-02 14:43:18 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+---------+
+| 10a || 219.07 | 232.30 | +6% || 1.17 | 1.23 | +5% | 0.5036 |
+| 10b || 165.27 | 131.61 | -20% || 1.17 | 1.23 | +4% | 0.0676 |
+| 10c || 609.72 | 580.53 | -5% || 1.17 | 1.23 | +4% | 0.3233 |
+| 11a || 143.80 | 124.84 | -13% || 1.18 | 1.23 | +4% | 0.2230 |
| 11b || 120.30 | 117.76 | -2% || 1.17 | 1.23 | +4% | 0.8687 |
-| 11c || 134.24 | 161.08 | +20% || 1.17 | 1.23 | +4% | 0.0682 |
+| 11d || 97.90 | 86.64 | -11% || 1.17 | 1.23 | +4% | 0.2441 |
-| 12a || 151.13 | 196.03 | +30% || 1.17 | 1.23 | +4% | 0.0125 |
+| 12b || 98.67 | 80.84 | -18% || 1.17 | 1.23 | +4% | 0.1497 |
-| 12c || 353.10 | 426.57 | +21% || 1.17 | 1.23 | +4% | 0.0052 |
| 13a || 546.32 | 543.95 | -0% || 1.17 | 1.23 | +4% | 0.9366 |
| 13b || 397.16 | 400.15 | +1% || 1.17 | 1.23 | +4% | 0.9154 |
-| 13c || 102.25 | 113.16 | +11% || 1.17 | 1.23 | +4% | 0.3531 |
+| 13d || 968.68 | 1039.36 | +7% || 1.17 | 1.23 | +5% | 0.0565 |
+| 14a || 481.50 | 449.42 | -7% || 1.17 | 1.23 | +4% | 0.2850 |
+| 14b || 438.90 | 418.77 | -5% || 1.17 | 1.23 | +5% | 0.4702 |
| 14c || 598.03 | 622.07 | +4% || 1.17 | 1.23 | +4% | 0.4537 |
-| 15a || 118.98 | 132.34 | +11% || 1.17 | 1.23 | +4% | 0.3359 |
+| 15b || 122.89 | 100.47 | -18% || 1.17 | 1.23 | +5% | 0.0819 |
+| 15c || 156.59 | 139.32 | -11% || 1.18 | 1.23 | +4% | 0.2461 |
-| 15d || 166.06 | 202.11 | +22% || 1.17 | 1.23 | +4% | 0.0489 |
| 16a || 1656.12 | 1653.97 | -0% || 1.17 | 1.23 | +4% | 0.9565 |
| 16b || 3138.58 | 3021.15 | -4% || 1.17 | 1.22 | +4% | 0.0077 |
+| 16c || 1902.72 | 1915.06 | +1% || 1.17 | 1.23 | +5% | 0.7680 |
+| 16d || 1837.28 | 1853.09 | +1% || 1.17 | 1.23 | +5% | 0.6856 |
+| 17a || 903.17 | 948.55 | +5% || 1.17 | 1.23 | +5% | 0.2392 |
+| 17b || 705.95 | 734.35 | +4% || 1.17 | 1.23 | +5% | 0.3739 |
| 17c || 616.66 | 640.62 | +4% || 1.17 | 1.23 | +4% | 0.4353 |
+| 17d || 640.63 | 629.59 | -2% || 1.17 | 1.23 | +5% | 0.7214 |
+| 17e || 1760.79 | 1731.48 | -2% || 1.17 | 1.22 | +5% | 0.4903 |
| 17f || 1197.53 | 1213.31 | +1% || 1.17 | 1.23 | +4% | 0.6901 |
+| 18a || 294.87 | 277.62 | -6% || 1.17 | 1.23 | +4% | 0.4683 |
+| 18b || 413.90 | 313.38 | -24% || 1.17 | 1.23 | +4% | 0.0001 |
+| 18c || 723.17 | 648.73 | -10% || 1.17 | 1.23 | +5% | 0.0469 |
+| 19a || 632.39 | 522.86 | -17% || 1.17 | 1.22 | +4% | 0.0010 |
+| 19b || 437.51 | 392.85 | -10% || 1.17 | 1.23 | +4% | 0.1120 |
+| 19c || 692.34 | 612.06 | -12% || 1.17 | 1.23 | +5% | 0.0214 |
+| 19d || 1445.08 | 1332.10 | -8% || 1.17 | 1.23 | +5% | 0.0046 |
+| 1a || 45.22 | 54.39 | +20% || 1.17 | 1.23 | +5% | 0.3321 |
+| 1b || 50.51 | 42.15 | -17% || 1.17 | 1.23 | +5% | 0.2782 |
+| 1c || 59.73 | 49.55 | -17% || 1.17 | 1.23 | +5% | 0.3001 |
+| 1d || 42.40 | 32.27 | -24% || 1.17 | 1.23 | +5% | 0.1361 |
| 20a || 490.63 | 472.99 | -4% || 1.17 | 1.23 | +4% | 0.5490 |
-| 20b || 405.65 | 426.39 | +5% || 1.18 | 1.23 | +4% | 0.4203 |
+| 20c || 411.90 | 390.34 | -5% || 1.17 | 1.23 | +5% | 0.3417 |
+| 21a || 215.65 | 154.11 | -29% || 1.17 | 1.23 | +5% | 0.0035 |
+| 21b || 139.39 | 129.76 | -7% || 1.17 | 1.23 | +4% | 0.5296 |
+| 21c || 226.56 | 163.00 | -28% || 1.17 | 1.23 | +4% | 0.0036 |
| 22a || 510.35 | 518.26 | +2% || 1.17 | 1.22 | +4% | 0.7940 |
| 22b || 452.00 | 436.68 | -3% || 1.17 | 1.23 | +4% | 0.6158 |
+| 22c || 689.67 | 694.04 | +1% || 1.17 | 1.23 | +5% | 0.9037 |
| 22d || 988.57 | 971.01 | -2% || 1.17 | 1.23 | +4% | 0.6602 |
+| 23a || 164.91 | 215.31 | +31% || 1.17 | 1.23 | +5% | 0.0170 |
| 23b || 134.68 | 129.51 | -4% || 1.17 | 1.23 | +4% | 0.7057 |
-| 23c || 175.01 | 195.69 | +12% || 1.17 | 1.23 | +4% | 0.3104 |
+| 24a || 465.08 | 371.80 | -20% || 1.17 | 1.23 | +5% | 0.0024 |
+| 24b || 322.51 | 250.12 | -22% || 1.17 | 1.23 | +5% | 0.0028 |
+| 25a || 477.07 | 446.78 | -6% || 1.17 | 1.23 | +5% | 0.3386 |
+| 25b || 277.00 | 181.70 | -34% || 1.17 | 1.23 | +4% | 0.0000 |
+| 25c || 1001.46 | 864.41 | -14% || 1.17 | 1.23 | +5% | 0.0010 |
| 26a || 457.23 | 474.38 | +4% || 1.17 | 1.23 | +4% | 0.5470 |
-| 26b || 282.56 | 296.13 | +5% || 1.17 | 1.23 | +4% | 0.5409 |
| 26c || 659.40 | 634.72 | -4% || 1.17 | 1.23 | +4% | 0.4094 |
+| 27a || 202.52 | 162.05 | -20% || 1.17 | 1.23 | +4% | 0.0293 |
+| 27b || 197.74 | 167.34 | -15% || 1.17 | 1.23 | +4% | 0.1340 |
+| 27c || 240.16 | 189.98 | -21% || 1.17 | 1.23 | +5% | 0.0235 |
+| 28a || 794.77 | 691.26 | -13% || 1.17 | 1.23 | +5% | 0.0063 |
| 28b || 265.30 | 258.61 | -3% || 1.17 | 1.23 | +4% | 0.7578 |
| 28c || 687.18 | 715.94 | +4% || 1.17 | 1.23 | +4% | 0.4444 |
+| 29a || 315.41 | 251.05 | -20% || 1.17 | 1.23 | +4% | 0.0048 |
+| 29b || 389.87 | 324.46 | -17% || 1.17 | 1.23 | +4% | 0.0060 |
+| 29c || 422.97 | 327.61 | -23% || 1.17 | 1.23 | +5% | 0.0009 |
+| 2a || 140.60 | 168.05 | +20% || 1.17 | 1.23 | +5% | 0.0795 |
-| 2b || 130.47 | 151.69 | +16% || 1.17 | 1.23 | +4% | 0.1398 |
+| 2c || 106.96 | 96.86 | -9% || 1.17 | 1.23 | +5% | 0.4303 |
-| 2d || 226.53 | 281.41 | +24% || 1.17 | 1.23 | +4% | 0.0024 |
+| 30a || 414.95 | 345.53 | -17% || 1.17 | 1.23 | +4% | 0.0150 |
+| 30b || 388.78 | 295.84 | -24% || 1.17 | 1.23 | +5% | 0.0011 |
+| 30c || 732.74 | 661.50 | -10% || 1.17 | 1.23 | +4% | 0.0382 |
+| 31a || 333.82 | 255.08 | -24% || 1.18 | 1.23 | +4% | 0.0047 |
+| 31b || 286.20 | 190.95 | -33% || 1.17 | 1.23 | +5% | 0.0000 |
+| 31c || 376.89 | 264.67 | -30% || 1.17 | 1.23 | +4% | 0.0000 |
+| 32a || 56.20 | 42.63 | -24% || 1.17 | 1.23 | +5% | 0.0924 |
-| 32b || 164.62 | 174.29 | +6% || 1.17 | 1.23 | +4% | 0.4936 |
| 33a || 128.95 | 123.31 | -4% || 1.17 | 1.23 | +4% | 0.7063 |
+| 33b || 86.88 | 88.32 | +2% || 1.17 | 1.23 | +5% | 0.8920 |
-| 33c || 165.76 | 191.74 | +16% || 1.17 | 1.23 | +4% | 0.2066 |
+| 3a || 325.43 | 250.31 | -23% || 1.17 | 1.23 | +4% | 0.0035 |
+| 3b || 99.87 | 73.21 | -27% || 1.17 | 1.23 | +5% | 0.0860 |
+| 3c || 463.61 | 413.37 | -11% || 1.18 | 1.23 | +4% | 0.0710 |
-| 4a || 296.30 | 354.03 | +19% || 1.17 | 1.23 | +4% | 0.0259 |
+| 4b || 78.11 | 66.98 | -14% || 1.17 | 1.23 | +4% | 0.3792 |
-| 4c || 313.17 | 391.61 | +25% || 1.17 | 1.23 | +4% | 0.0007 |
+| 5a || 255.31 | 161.95 | -37% || 1.17 | 1.23 | +5% | 0.0000 |
+| 5b || 166.89 | 158.47 | -5% || 1.17 | 1.23 | +5% | 0.6695 |
+| 5c || 362.14 | 289.80 | -20% || 1.17 | 1.23 | +5% | 0.0098 |
| 6a || 166.04 | 166.47 | +0% || 1.17 | 1.23 | +4% | 0.9784 |
+| 6b || 195.88 | 190.80 | -3% || 1.17 | 1.23 | +5% | 0.7140 |
| 6c || 127.63 | 131.81 | +3% || 1.17 | 1.23 | +4% | 0.7306 |
-| 6d || 562.66 | 588.09 | +5% || 1.17 | 1.23 | +4% | 0.3838 |
+| 6e || 154.83 | 151.71 | -2% || 1.17 | 1.23 | +5% | 0.8232 |
+| 6f || 1238.39 | 1181.76 | -5% || 1.17 | 1.23 | +4% | 0.0941 |
-| 7a || 191.59 | 201.41 | +5% || 1.17 | 1.23 | +4% | 0.6222 |
-| 7b || 159.97 | 173.44 | +8% || 1.17 | 1.23 | +4% | 0.4115 |
+| 7c || 1061.69 | 1017.34 | -4% || 1.17 | 1.23 | +5% | 0.2030 |
| 8a || 215.26 | 214.19 | -0% || 1.17 | 1.23 | +4% | 0.9587 |
+| 8b || 150.32 | 126.60 | -16% || 1.17 | 1.23 | +4% | 0.1599 |
+| 8c || 2368.73 | 2421.89 | +2% || 1.17 | 1.22 | +5% | 0.2444 |
-| 8d || 689.16 | 742.66 | +8% || 1.17 | 1.22 | +4% | 0.0976 |
+| 9a || 755.77 | 624.00 | -17% || 1.17 | 1.23 | +4% | 0.0003 |
| 9b || 506.91 | 490.23 | -3% || 1.17 | 1.23 | +4% | 0.5900 |
+| 9c || 720.16 | 647.99 | -10% || 1.17 | 1.23 | +4% | 0.0281 |
+| 9d || 1180.43 | 1081.37 | -8% || 1.17 | 1.23 | +5% | 0.0241 |
+---------++----------+----------+--------++----------+----------+--------+---------+
| Sum || 54396.89 | 52067.25 | -4% || | | | |
| Geomean || | | || | | +4% | |
+---------++----------+----------+--------++----------+----------+--------+---------+hyriseBenchmarkStarSchema - single-threaded Sum of avg. item runtimes: -2% || Geometric mean of throughput changes: +4%Configuration Overview - click to expand +Configuration Overview---+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkStarSchema_a7abe4451af5dea62f4c67749d4356f60b0ce712_st.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkStarSchema_fcb37b4081805fcd3c4e1b99414436f9631730e3_st.json |
+-------------------------+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | a7abe4451af5dea62f4c67749d4356f60b0ce712-dirty | fcb37b4081805fcd3c4e1b99414436f9631730e3-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-10-02 11:28:28 | 2024-10-02 15:03:55 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+ +---------++----------+---------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
+| 1.1 || 423.29 | 403.66 | -5%˄ || 2.36 | 2.48 | +5%˄ | (run time too short) |
+| 1.2 || 245.51 | 220.92 | -10%˄ || 4.07 | 4.53 | +11%˄ | (run time too short) |
+| 1.3 || 235.44 | 213.39 | -9%˄ || 4.25 | 4.69 | +10%˄ | (run time too short) |
| 2.1 || 530.84 | 510.89 | -4%˄ || 1.88 | 1.96 | +4%˄ | (run time too short) |
| 2.2 || 292.73 | 296.73 | +1%˄ || 3.42 | 3.37 | -1%˄ | (run time too short) |
| 2.3 || 184.67 | 188.35 | +2%˄ || 5.42 | 5.31 | -2%˄ | (run time too short) |
| 3.1 || 2576.30 | 2582.49 | +0% || 0.39 | 0.39 | -0% | 0.7281 |
+| 3.2 || 309.61 | 287.84 | -7%˄ || 3.23 | 3.47 | +8%˄ | (run time too short) |
+| 3.3 || 130.71 | 123.99 | -5%˄ || 7.65 | 8.06 | +5%˄ | (run time too short) |
+| 3.4 || 124.75 | 116.94 | -6%˄ || 8.02 | 8.55 | +7%˄ | (run time too short) |
| 4.1 || 2465.37 | 2451.43 | -1% || 0.41 | 0.41 | +1% | 0.2856 |
| 4.2 || 792.06 | 785.10 | -1%˄ || 1.26 | 1.27 | +1%˄ | (run time too short) |
+| 4.3 || 243.00 | 222.01 | -9%˄ || 4.12 | 4.50 | +9%˄ | (run time too short) |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| Sum || 8554.27 | 8403.74 | -2% || | | | |
| Geomean || | | || | | +4% | |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+---------+--------++----------+----------+--------+----------------------+hyriseBenchmarkStarSchema - multi-threaded, ordered, 1 client, 64 cores Sum of avg. item runtimes: -1% || Geometric mean of throughput changes: +1%Configuration Overview - click to expand +Configuration Overview---------+--------------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkStarSchema_a7abe4451af5dea62f4c67749d4356f60b0ce712_mt_ordered.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkStarSchema_fcb37b4081805fcd3c4e1b99414436f9631730e3_mt_ordered.json |
+-------------------------------+--------------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | a7abe4451af5dea62f4c67749d4356f60b0ce712-dirty | fcb37b4081805fcd3c4e1b99414436f9631730e3-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2024-10-02 11:34:09 | 2024-10-02 15:09:28 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------------+--------------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------+ +---------++----------+---------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| 1.1 || 74.49 | 73.79 | -1%˄ || 13.42 | 13.55 | +1%˄ | (run time too short) |
| 1.2 || 49.64 | 48.66 | -2%˄ || 20.13 | 20.54 | +2%˄ | (run time too short) |
| 1.3 || 47.56 | 46.57 | -2%˄ || 21.01 | 21.46 | +2%˄ | (run time too short) |
| 2.1 || 233.42 | 231.02 | -1%˄ || 4.28 | 4.33 | +1%˄ | (run time too short) |
| 2.2 || 115.62 | 114.10 | -1%˄ || 8.65 | 8.76 | +1%˄ | (run time too short) |
| 2.3 || 40.32 | 40.20 | -0%˄ || 24.79 | 24.86 | +0%˄ | (run time too short) |
| 3.1 || 632.58 | 639.36 | +1%˄ || 1.58 | 1.56 | -1%˄ | (run time too short) |
| 3.2 || 111.93 | 110.78 | -1%˄ || 8.93 | 9.02 | +1%˄ | (run time too short) |
| 3.3 || 53.55 | 52.48 | -2%˄ || 18.66 | 19.05 | +2%˄ | (run time too short) |
| 3.4 || 47.08 | 46.43 | -1%˄ || 21.23 | 21.53 | +1%˄ | (run time too short) |
| 4.1 || 508.28 | 501.34 | -1%˄ || 1.97 | 1.99 | +1%˄ | (run time too short) |
| 4.2 || 233.42 | 230.05 | -1%˄ || 4.28 | 4.35 | +1%˄ | (run time too short) |
| 4.3 || 70.33 | 68.36 | -3%˄ || 14.21 | 14.62 | +3%˄ | (run time too short) |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| Sum || 2218.22 | 2203.13 | -1% || | | | |
| Geomean || | | || | | +1% | |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+---------+--------++----------+----------+--------+----------------------+hyriseBenchmarkStarSchema - multi-threaded, shuffled, 64 clients, 64 cores Sum of avg. item runtimes: -4% || Geometric mean of throughput changes: +4%Configuration Overview - click to expand +Configuration Overview---------+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkStarSchema_a7abe4451af5dea62f4c67749d4356f60b0ce712_mt.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkStarSchema_fcb37b4081805fcd3c4e1b99414436f9631730e3_mt.json |
+-------------------------------+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | a7abe4451af5dea62f4c67749d4356f60b0ce712-dirty | fcb37b4081805fcd3c4e1b99414436f9631730e3-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2024-10-02 11:36:44 | 2024-10-02 15:12:00 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns
8000
| ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+---------+
+| 1.1 || 861.42 | 724.11 | -16% || 3.71 | 3.86 | +4% | 0.0000 |
+| 1.2 || 468.38 | 416.34 | -11% || 3.72 | 3.86 | +4% | 0.0000 |
+| 1.3 || 436.43 | 371.68 | -15% || 3.72 | 3.86 | +4% | 0.0000 |
+| 2.1 || 2084.94 | 1582.69 | -24% || 3.71 | 3.85 | +4% | 0.0000 |
+| 2.2 || 1135.28 | 1004.16 | -12% || 3.71 | 3.86 | +4% | 0.0000 |
-| 2.3 || 389.88 | 456.82 | +17% || 3.72 | 3.86 | +4% | 0.0000 |
| 3.1 || 3389.40 | 3274.67 | -3% || 3.71 | 3.85 | +4% | 0.0004 |
| 3.2 || 1010.21 | 1027.08 | +2% || 3.72 | 3.85 | +4% | 0.4781 |
+| 3.3 || 472.62 | 434.78 | -8% || 3.72 | 3.86 | +4% | 0.0082 |
+| 3.4 || 459.51 | 433.94 | -6% || 3.71 | 3.86 | +4% | 0.0928 |
-| 4.1 || 3209.72 | 3525.19 | +10% || 3.71 | 3.84 | +4% | 0.0000 |
| 4.2 || 2506.18 | 2532.80 | +1% || 3.71 | 3.85 | +4% | 0.4771 |
| 4.3 || 769.90 | 783.28 | +2% || 3.72 | 3.85 | +4% | 0.5243 |
+---------++----------+----------+--------++----------+----------+--------+---------+
| Sum || 17193.88 | 16567.55 | -4% || | | | |
| Geomean || | | || | | +4% | |
+---------++----------+----------+--------++----------+----------+--------+---------+ |
dey4ss
reviewed
Oct 9, 2024
| @@ -88,6 +84,9 @@ class AbstractScheduler : public Noncopyable { | |||
| void schedule_and_wait_for_tasks(const std::vector<std::shared_ptr<AbstractTask>>& tasks); | |||
There was a problem hiding this comment.
Could you please add some more general comments here: schedule being asynchronous vs. schedule_and_wait_for_tasks being synchronous, when to use which method(s) (AbstractTask::schedule vs schedule vs schedule + wait_for_tasks vs schedule_and_wait_for_tasks), a note on the different signatures and why we have that, ...
There was a problem hiding this comment.
Done, can you take a look?
There was a problem hiding this comment.
Given the following:
const auto task = std::make_shared<JobTask>(...);I'm still not sure if I should use
task->schedule();or
Hyrise::get().scheduler()->schedule(task);(There is an assertion later that tells me what to use.)
Don't know if we should make the scheduler's
schedule() method private and add AbstractTask as a friend.
There was a problem hiding this comment.
Maybe we want to say sth explicitly about spinning background tasks (e.g., wrap everything into a single JobTask and call its schedule method)?
| @@ -58,4 +61,29 @@ TEST_F(HyriseTest, GetAndResetHyrise) { | |||
| EXPECT_EQ(hyrise.transaction_manager.last_commit_id(), CommitID{1}); | |||
| } | |||
|
|
|||
| TEST_F(HyriseTest, ChangingSchedulers) { | |||
There was a problem hiding this comment.
Make it more excplicit by checking the counter not only at the end?
There was a problem hiding this comment.
I don't know what you mean. We cannot be sure when and in which order the counter is incremented, right?
There was a problem hiding this comment.
Whenever we set a new scheduler, the old one should be finished, right? Thus, I'd expect the counter to be incremented after each call of Hyrise::get().set_scheduler(...)
Co-authored-by: Daniel Lindner <27929897+dey4ss@users.noreply.github.com>
Co-authored-by: Daniel Lindner <27929897+dey4ss@users.noreply.github.com>
Co-authored-by: Daniel Lindner <27929897+dey4ss@users.noreply.github.com>
Co-authored-by: Daniel Lindner <27929897+dey4ss@users.noreply.github.com>
dey4ss
approved these changes
Jan 6, 2025
| @@ -115,15 +114,13 @@ void AbstractTask::schedule(NodeID preferred_node_id) { | |||
| } | |||
There was a problem hiding this comment.
Can only mark here: change _done_condition_variable to _task_done variable in L 105/106.
| @@ -88,6 +84,9 @@ class AbstractScheduler : public Noncopyable { | |||
| void schedule_and_wait_for_tasks(const std::vector<std::shared_ptr<AbstractTask>>& tasks); | |||
There was a problem hiding this comment.
Given the following:
const auto task = std::make_shared<JobTask>(...);I'm still not sure if I should use
task->schedule();or
Hyrise::get().scheduler()->schedule(task);(There is an assertion later that tells me what to use.)
Don't know if we should make the scheduler's
schedule() method private and add AbstractTask as a friend.
| @@ -71,26 +71,41 @@ class AbstractScheduler : public Noncopyable { | |||
|
|
|||
There was a problem hiding this comment.
can only mark here: check the grammar of the previous comments
Co-authored-by: Daniel Lindner <27929897+dey4ss@users.noreply.github.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This PR changes the task grouping in the scheduler. Since #2639 has too many moving parts, this PR extracts one of the changes.
Previously, we iterated a given set of tasks and set "next" task as a predecessor of the current task. Meaning, we basically started processing a list of tasks from the end. Now, we iterate backwards and do basically the same just reversed.
Further, we copy less tasks (which are shared_ptrs for reasons not obvious to me) and use offsets instead.
The stored successors of each task are no longer shared_ptrs but only as reference to those shared pointers (via
std::reference_wrapper). Without this change, cleaning up task lists can be problematic with LLVM as libc++ cleans up backwards (thus tasks cannot be easily removed when previous tasks refer to them).Todos:
clear_successors