Default Encoding #2696
Open
Default Encoding #2696
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Greenscreen23
commented
Apr 18, 2025
Bouncner
reviewed
Apr 27, 2025
| } | ||
|
|
||
| const auto column_is_unique = table->column_is_unique(column_id); |
There was a problem hiding this comment.
Note to me: check if I actually like that?
Bouncner
reviewed
Apr 29, 2025
|
I haven't digged deeper, but it looks like TPC-H default runs still use Dict encoding. |
I deleted all |
There was another bug in the FixedStringVector that could have caused this. Let's see if it is fine like this. |
Bouncner
reviewed
Jun 5, 2025
src/test/lib/storage/fixed_string_dictionary_segment/fixed_string_vector_test.cpp
Outdated
Show resolved
Hide resolved
src/lib/storage/fixed_string_dictionary_segment/fixed_string_vector.hpp
Outdated
Show resolved
Hide resolved
|
Performance is mostly nice, as expected. But I think I'd like to better understand why we are so slow in some ST benchmarks. Next comment will discuss table sizes. System cx17 - click to expand
Commit Info and Build Time
hyriseBenchmarkTPCH - single-threaded, SF 10.0 Sum of avg. item runtimes: -15% || Geometric mean of throughput changes: +12%Configuration Overview - click to expand +Configuration Overview----+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCH_0bcfa0250faed47181d2591d19daefc98bfcd5a4_st.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCH_704bc3145cfcc51bcb4cbda8ae7ee2387e67fc94_st.json |
+--------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4-dirty | 704bc3145cfcc51bcb4cbda8ae7ee2387e67fc94-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release
A3E2
| release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 12:04:57 | 2025-06-06 07:20:13 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+--------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+ +----------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
-| TPC-H 01 || 5528.68 | 6005.02 | +9% || 0.17 | 0.15 | -10% | (run time too short) |
| TPC-H 02 || 40.56 | 41.26 | +2%˄ || 24.66 | 24.24 | -2%˄ | (run time too short) |
| TPC-H 03 || 1263.52 | 1268.19 | +0% || 0.78 | 0.78 | +0% | 0.3933 |
-| TPC-H 04 || 1382.00 | 1495.25 | +8% || 0.72 | 0.67 | -7% | 0.0000 |
+| TPC-H 05 || 2273.47 | 1930.21 | -15% || 0.43 | 0.52 | +19% | 0.0000 |
| TPC-H 06 || 170.52 | 169.22 | -1%˄ || 5.86 | 5.91 | +1%˄ | (run time too short) |
+| TPC-H 07 || 703.81 | 599.82 | -15%˄ || 1.42 | 1.67 | +17%˄ | (run time too short) |
+| TPC-H 08 || 537.71 | 429.62 | -20%˄ || 1.86 | 2.33 | +25%˄ | (run time too short) |
+| TPC-H 09 || 6533.99 | 4863.47 | -26% || 0.15 | 0.20 | +33% | (run time too short) |
+| TPC-H 10 || 1386.61 | 1284.31 | -7% || 0.72 | 0.77 | +7% | 0.0000 |
-| TPC-H 11 || 50.89 | 53.65 | +5%˄ || 19.65 | 18.64 | -5%˄ | (run time too short) |
+| TPC-H 12 || 942.18 | 878.99 | -7%˄ || 1.06 | 1.14 | +7%˄ | (run time too short) |
+| TPC-H 13 || 7360.10 | 4687.63 | -36% || 0.13 | 0.20 | +50% | (run time too short) |
+| TPC-H 14 || 492.69 | 458.72 | -7%˄ || 2.03 | 2.18 | +7%˄ | (run time too short) |
+| TPC-H 15 || 183.11 | 161.15 | -12%˄ || 5.46 | 6.21 | +14%˄ | (run time too short) |
| TPC-H 16 || 530.69 | 550.42 | +4%˄ || 1.88 | 1.82 | -4%˄ | (run time too short) |
+| TPC-H 17 || 220.02 | 138.96 | -37%˄ || 4.55 | 7.20 | +58%˄ | (run time too short) |
-| TPC-H 18 || 1568.85 | 1702.04 | +8% || 0.63 | 0.58 | -8% | 0.0000 |
| TPC-H 19 || 230.76 | 223.27 | -3%˄ || 4.33 | 4.48 | +3%˄ | (run time too short) |
+| TPC-H 20 || 392.62 | 274.59 | -30%˄ || 2.55 | 3.64 | +43%˄ | (run time too short) |
+| TPC-H 21 || 4267.09 | 3467.82 | -19% || 0.23 | 0.28 | +21% | (run time too short) |
+| TPC-H 22 || 482.40 | 380.38 | -21%˄ || 2.07 | 2.63 | +27%˄ | (run time too short) |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
+| Sum || 36542.26 | 31063.98 | -15% || | | | |
+| Geomean || | | || | | +12% | |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+----------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCH - single-threaded, SF 0.01 Sum of avg. item runtimes: -1% || Geometric mean of throughput changes: -2%Configuration Overview - click to expand +Configuration Overview----+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCH_0bcfa0250faed47181d2591d19daefc98bfcd5a4_st_s01.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCH_704bc3145cfcc51bcb4cbda8ae7ee2387e67fc94_st_s01.json |
+--------------------------+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4-dirty | 704bc3145cfcc51bcb4cbda8ae7ee2387e67fc94-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 12:21:50 | 2025-06-06 07:35:14 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 0.009999999776482582 | 0.009999999776482582 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+--------------------------+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+ +----------++----------+---------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+----------++----------+---------+--------++----------+----------+--------+----------------------+
-| TPC-H 01 || 5.24 | 5.62 | +7%˄ || 190.64 | 177.86 | -7%˄ | (run time too short) |
-| TPC-H 02 || 3.19 | 3.53 | +11%˄ || 313.71 | 282.98 | -10%˄ | (run time too short) |
| TPC-H 03 || 0.58 | 0.58 | -0%˄ || 1721.40 | 1723.83 | +0%˄ | (run time too short) |
-| TPC-H 04 || 0.37 | 0.42 | +14%˄ || 2675.72 | 2356.64 | -12%˄ | (run time too short) |
-| TPC-H 05 || 0.95 | 1.01 | +6%˄ || 1050.28 | 989.41 | -6%˄ | (run time too short) |
| TPC-H 06 || 0.19 | 0.20 | +1%˄ || 5138.39 | 5092.23 | -1%˄ | (run time too short) |
+| TPC-H 07 || 9.60 | 8.71 | -9%˄ || 104.11 | 114.82 | +10%˄ | (run time too short) |
| TPC-H 08 || 12.91 | 13.25 | +3%˄ || 77.45 | 75.46 | -3%˄ | (run time too short) |
+| TPC-H 09 || 3.96 | 3.19 | -19%˄ || 252.38 | 313.01 | +24%˄ | (run time too short) |
| TPC-H 10 || 0.70 | 0.69 | -1%˄ || 1434.57 | 1453.39 | +1%˄ | (run time too short) |
| TPC-H 11 || 0.17 | 0.17 | +1%˄ || 5771.75 | 5698.91 | -1%˄ | (run time too short) |
| TPC-H 12 || 0.62 | 0.63 | +3%˄ || 1615.42 | 1573.99 | -3%˄ | (run time too short) |
| TPC-H 13 || 2.15 | 2.18 | +2%˄ || 465.29 | 458.16 | -2%˄ | (run time too short) |
| TPC-H 14 || 0.29 | 0.30 | +3%˄ || 3401.75 | 3302.18 | -3%˄ | (run time too short) |
| TPC-H 15 || 1.07 | 1.08 | +1%˄ || 929.03 | 922.97 | -1%˄ | (run time too short) |
| TPC-H 16 || 1.92 | 1.97 | +3%˄ || 520.95 | 506.84 | -3%˄ | (run time too short) |
-| TPC-H 17 || 0.46 | 0.75 | +63%˄ || 2178.75 | 1334.06 | -39%˄ | (run time too short) |
+| TPC-H 18 || 1.32 | 1.19 | -10%˄ || 758.50 | 840.44 | +11%˄ | (run time too short) |
| TPC-H 19 || 4.51 | 4.45 | -1%˄ || 221.63 | 224.58 | +1%˄ | (run time too short) |
| TPC-H 20 || 2.38 | 2.37 | -0%˄ || 420.72 | 422.35 | +0%˄ | (run time too short) |
| TPC-H 21 || 1.11 | 1.08 | -3%˄ || 901.66 | 925.02 | +3%˄ | (run time too short) |
| TPC-H 22 || 1.06 | 1.08 | +2%˄ || 939.30 | 923.78 | -2%˄ | (run time too short) |
+----------++----------+---------+--------++----------+----------+--------+----------------------+
| Sum || 54.76 | 54.46 | -1% || | | | |
| Geomean || | | || | | -2% | |
+----------++----------+---------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+----------++----------+---------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCH - multi-threaded, ordered, 1 client, 64 cores, SF 10.0 Sum of avg. item runtimes: -13% || Geometric mean of throughput changes: +10%Configuration Overview - click to expand +Configuration Overview---------+----------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCH_0bcfa0250faed47181d2591d19daefc98bfcd5a4_mt_ordered.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCH_704bc3145cfcc51bcb4cbda8ae7ee2387e67fc94_mt_ordered.json |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4-dirty | 704bc3145cfcc51bcb4cbda8ae7ee2387e67fc94-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535
F438
| 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 12:22:17 | 2025-06-06 07:35:39 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------+ +----------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
-| TPC-H 01 || 4647.84 | 4882.89 | +5% || 0.20 | 0.20 | +0% | (run time too short) |
+| TPC-H 02 || 58.37 | 52.66 | -10%˄ || 17.12 | 18.98 | +11%˄ | (run time too short) |
| TPC-H 03 || 664.16 | 646.71 | -3%˄ || 1.51 | 1.55 | +3%˄ | (run time too short) |
| TPC-H 04 || 653.10 | 642.17 | -2%˄ || 1.53 | 1.56 | +2%˄ | (run time too short) |
+| TPC-H 05 || 614.53 | 523.75 | -15%˄ || 1.63 | 1.91 | +17%˄ | (run time too short) |
| TPC-H 06 || 64.23 | 63.63 | -1%˄ || 15.56 | 15.70 | +1%˄ | (run time too short) |
| TPC-H 07 || 248.96 | 243.81 | -2%˄ || 4.02 | 4.10 | +2%˄ | (run time too short) |
+| TPC-H 08 || 234.85 | 216.64 | -8%˄ || 4.26 | 4.61 | +8%˄ | (run time too short) |
+| TPC-H 09 || 2207.70 | 1882.03 | -15% || 0.45 | 0.52 | +15% | (run time too short) |
+| TPC-H 10 || 643.54 | 593.33 | -8%˄ || 1.55 | 1.69 | +8%˄ | (run time too short) |
| TPC-H 11 || 88.09 | 88.09 | +0%˄ || 11.35 | 11.35 | -0%˄ | (run time too short) |
+| TPC-H 12 || 502.42 | 465.08 | -7%˄ || 1.99 | 2.15 | +8%˄ | (run time too short) |
+| TPC-H 13 || 3827.23 | 1966.37 | -49% || 0.25 | 0.50 | +100% | (run time too short) |
| TPC-H 14 || 150.42 | 155.18 | +3%˄ || 6.65 | 6.44 | -3%˄ | (run time too short) |
+| TPC-H 15 || 147.53 | 126.77 | -14%˄ || 6.78 | 7.89 | +16%˄ | (run time too short) |
| TPC-H 16 || 580.92 | 570.35 | -2%˄ || 1.72 | 1.75 | +2%˄ | (run time too short) |
+| TPC-H 17 || 88.43 | 71.97 | -19%˄ || 11.30 | 13.89 | +23%˄ | (run time too short) |
| TPC-H 18 || 1745.15 | 1706.65 | -2% || 0.57 | 0.58 | +3% | 0.0541 |
| TPC-H 19 || 109.64 | 113.86 | +4%˄ || 9.12 | 8.78 | -4%˄ | (run time too short) |
+| TPC-H 20 || 193.82 | 176.60 | -9%˄ || 5.16 | 5.66 | +10%˄ | (run time too short) |
+| TPC-H 21 || 1120.78 | 1006.30 | -10%˄ || 0.89 | 0.99 | +11%˄ | (run time too short) |
+| TPC-H 22 || 161.23 | 136.52 | -15%˄ || 6.20 | 7.32 | +18%˄ | (run time too short) |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
+| Sum || 18752.92 | 16331.39 | -13% || | | | |
+| Geomean || | | || | | +10% | |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+----------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCH - multi-threaded, shuffled, 64 clients, 64 cores, SF 10.0 Sum of avg. item runtimes: -11% || Geometric mean of throughput changes: +12%Configuration Overview - click to expand +Configuration Overview---------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCH_0bcfa0250faed47181d2591d19daefc98bfcd5a4_mt.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCH_704bc3145cfcc51bcb4cbda8ae7ee2387e67fc94_mt.json |
+-------------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4-dirty | 704bc3145cfcc51bcb4cbda8ae7ee2387e67fc94-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| clustering | None | None |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 12:34:06 | 2025-06-06 07:46:56 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+ +----------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+----------++----------+----------+--------++----------+----------+--------+---------+
+| TPC-H 01 || 6094.00 | 6370.96 | +5% || 1.03 | 1.16 | +12% | 0.0000 |
+| TPC-H 02 || 470.12 | 440.27 | -6% || 1.04 | 1.16 | +12% | 0.5709 |
+| TPC-H 03 || 2815.11 | 2623.59 | -7% || 1.04 | 1.16 | +12% | 0.1324 |
+| TPC-H 04 || 2293.11 | 2228.19 | -3% || 1.04 | 1.16 | +12% | 0.5688 |
+| TPC-H 05 || 4194.02 | 3983.72 | -5% || 1.03 | 1.16 | +12% | 0.2203 |
+| TPC-H 06 || 784.96 | 734.66 | -6% || 1.04 | 1.17 | +12% | 0.4826 |
+| TPC-H 07 || 3379.16 | 2873.79 | -15% || 1.03 | 1.16 | +12% | 0.0008 |
+| TPC-H 08 || 2547.08 | 2087.30 | -18% || 1.03 | 1.16 | +12% | 0.0008 |
+| TPC-H 09 || 6472.87 | 5691.94 | -12% || 1.03 | 1.16 | +12% | 0.0000 |
+| TPC-H 10 || 3425.93 | 3137.08 | -8% || 1.03 | 1.16 | +12% | 0.0367 |
+| TPC-H 11 || 494.08 | 423.13 | -14% || 1.04 | 1.16 | +12% | 0.1437 |
+| TPC-H 12 || 2681.55 | 2391.03 | -11% || 1.03 | 1.16 | +12% | 0.0149 |
+| TPC-H 13 || 7630.22 | 4885.81 | -36% || 1.03 | 1.16 | +13% | 0.0000 |
+| TPC-H 14 || 1096.15 | 1093.04 | -0% || 1.04 | 1.16 | +12% | 0.9694 |
+| TPC-H 15 || 682.01 | 604.72 | -11% || 1.04 | 1.16 | +12% | 0.1451 |
+| TPC-H 16 || 2536.14 | 2244.17 | -12% || 1.04 | 1.16 | +12% | 0.0168 |
+| TPC-H 17 || 850.76 | 743.89 | -13% || 1.04 | 1.16 | +12% | 0.1395 |
+| TPC-H 18 || 3630.39 | 3646.37 | +0% || 1.03 | 1.16 | +12% | 0.8580 |
+| TPC-H 19 || 1140.60 | 1121.19 | -2% || 1.03 | 1.16 | +12% | 0.8268 |
+| TPC-H 20 || 1760.96 | 1483.94 | -16% || 1.04 | 1.16 | +12% | 0.0050 |
+| TPC-H 21 || 5284.28 | 4884.18 | -8% || 1.03 | 1.16 | +12% | 0.0232 |
+| TPC-H 22 || 1110.97 | 993.93 | -11% || 1.04 | 1.16 | +12% | 0.1517 |
+----------++----------+----------+--------++----------+----------+--------+---------+
+| Sum || 61374.47 | 54686.88 | -11% || | | | |
+| Geomean || | | || | | +12% | |
+----------++----------+----------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCDS - single-threaded Sum of avg. item runtimes: +5% || Geometric mean of throughput changes: -10%Configuration Overview - click to expand +Configuration Overview---+---------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCDS_0bcfa0250faed47181d2591d19daefc98bfcd5a4_st.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCDS_704bc3145cfcc51bcb4cbda8ae7ee2387e67fc94_st.json |
+-------------------------+---------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4-dirty | 704bc3145cfcc51bcb4cbda8ae7ee2387e67fc94-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 12:55:34 | 2025-06-06 08:08:23 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+---------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
+| 01 || 224.59 | 205.76 | -8%˄ || 4.45 | 4.86 | +9%˄ | (run time too short) |
+| 03 || 62.68 | 57.33 | -9%˄ || 15.95 | 17.44 | +9%˄ | (run time too short) |
+| 06 || 198.18 | 188.60 | -5%˄ || 5.05 | 5.30 | +5%˄ | (run time too short) |
-| 07 || 253.36 | 279.28 | +10%˄ || 3.95 | 3.58 | -9%˄ | (run time too short) |
-| 09 || 720.91 | 1370.75 | +90%˄ || 1.39 | 0.72 | -48%˄ | (run time too short) |
-| 10 || 120.63 | 161.78 | +34%˄ || 8.29 | 6.18 | -25%˄ | (run time too short) |
-| 13 || 464.50 | 513.05 | +10%˄ || 2.15 | 1.95 | -9%˄ | (run time too short) |
-| 15 || 124.21 | 133.69 | +8%˄ || 8.05 | 7.48 | -7%˄ | (run time too short) |
-| 16 || 55.91 | 76.54 | +37%˄ || 17.88 | 13.07 | -27%˄ | (run time too short) |
+| 17 || 323.16 | 300.29 | -7%˄ || 3.09 | 3.33 | +8%˄ | (run time too short) |
-| 19 || 97.81 | 112.81 | +15%˄ || 10.22 | 8.86 | -13%˄ | (run time too short) |
-| 25 || 167.80 | 181.29 | +8%˄ || 5.96 | 5.52 | -7%˄ | (run time too short) |
-| 26 || 114.68 | 127.71 | +11%˄ || 8.72 | 7.83 | -10%˄ | (run time too short) |
-| 28 || 574.95 | 1176.53 | +105%˄ || 1.74 | 0.85 | -51%˄ | (run time too short) |
| 29 || 484.05 | 472.25 | -2%˄ || 2.07 | 2.12 | +2%˄ | (run time too short) |
-| 31 || 1316.64 | 1437.44 | +9% || 0.75 | 0.68 | -9% | (run time too short) |
-| 32 || 30.32 | 40.72 | +34%˄ || 32.98 | 24.56 | -26%˄ | (run time too short) |
-| 34 || 140.58 | 167.50 | +19%˄ || 7.11 | 5.97 | -16%˄ | (run time too short) |
-| 35 || 604.65 | 647.37 | +7%˄ || 1.65 | 1.54 | -7%˄ | (run time too short) |
-| 37 || 653.81 | 1227.69 | +88%˄ || 1.53 | 0.80 | -48%˄ | (run time too short) |
-| 39a || 1704.00 | 1859.91 | +9% || 0.58 | 0.53 | -9% | 0.0000 |
-| 39b || 1682.21 | 1861.56 | +11% || 0.58 | 0.53 | -9% | (run time too short) |
| 41 || 281.49 | 286.47 | +2%˄ || 3.55 | 3.49 | -2%˄ | (run time too short) |
-| 42 || 78.54 | 92.67 | +18%˄ || 12.73 | 10.79 | -15%˄ | (run time too short) |
-| 43 || 974.60 | 1034.23 | +6%˄ || 1.03 | 0.97 | -6%˄ | (run time too short) |
+| 45 || 126.38 | 107.34 | -15%˄ || 7.91 | 9.32 | +18%˄ | (run time too short) |
| 48 || 1164.93 | 1186.76 | +2%˄ || 0.86 | 0.84 | -2%˄ | (run time too short) |
| 50 || 125.44 | 130.37 | +4%˄ || 7.97 | 7.67 | -4%˄ | (run time too short) |
-| 52 || 79.38 | 93.08 | +17%˄ || 12.60 | 10.74 | -15%˄ | (run time too short) |
-| 55 || 74.51 | 88.48 | +19%˄ || 13.42 | 11.30 | -16%˄ | (run time too short) |
| 62 || 554.59 | 576.69 | +4%˄ || 1.80 | 1.73 | -4%˄ | (run time too short) |
| 65 || 1924.75 | 1874.04 | -3% || 0.52 | 0.53 | +3% | 0.0000 |
-| 69 || 139.66 | 170.22 | +22%˄ || 7.16 | 5.87 | -18%˄ | (run time too short) |
-| 73 || 77.37 | 98.41 | +27%˄ || 12.92 | 10.16 | -21%˄ | (run time too short) |
| 79 || 491.32 | 508.66 | +4%˄ || 2.04 | 1.97 | -3%˄ | (run time too short) |
| 81 || 155.98 | 150.42 | -4%˄ || 6.41 | 6.65 | +4%˄ | (run time too short) |
-| 82 || 700.59 | 1255.98 | +79%˄ || 1.43 | 0.78 | -45%˄ | (run time too short) |
+| 83 || 38.43 | 36.11 | -6%˄ || 26.02 | 27.69 | +6%˄ | (run time too short) |
+| 84 || 13.88 | 12.36 | -11%˄ || 72.03 | 80.89 | +12%˄ | (run time too short) |
| 85 || 161.74 | 163.30 | +1%˄ || 6.18 | 6.12 | -1%˄ | (run time too short) |
-| 88 || 638.78 | 798.86 | +25%˄ || 1.57 | 1.25 | -20%˄ | (run time too short) |
| 91 || 17.79 | 17.29 | -3%˄ || 56.21 | 57.83 | +3%˄ | (run time too short) |
+| 92 || 35.59 | 33.45 | -6%˄ || 28.09 | 29.90 | +6%˄ | (run time too short) |
+| 93 || 3751.76 | 2395.99 | -36% || 0.25 | 0.42 | +67% | (run time too short) |
-| 94 || 35.40 | 45.52 | +29%˄ || 28.25 | 21.97 | -22%˄ | (run time too short) |
| 95 || 5159.89 | 5203.35 | +1% || 0.18 | 0.18 | +0% | (run time too short) |
-| 96 || 60.98 | 78.86 | +29%˄ || 16.40 | 12.68 | -23%˄ | (run time too short) |
+| 97 || 4040.15 | 3552.85 | -12% || 0.23 | 0.27 | +14% | (run time too short) |
| 99 || 1085.28 | 1125.71 | +4%˄ || 0.92 | 0.89 | -4%˄ | (run time too short) |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
-| Sum || 32108.83 | 33717.27 | +5% || | | | |
-| Geomean || | | || | | -10% | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCDS - multi-threaded, ordered, 1 client, 64 cores Sum of avg. item runtimes: -1% || Geometric mean of throughput changes: -1%Configuration Overview - click to expand +Configuration Overview---------+-----------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCDS_0bcfa0250faed47181d2591d19daefc98bfcd5a4_mt_ordered.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCDS_704bc3145cfcc51bcb4cbda8ae7ee2387e67fc94_mt_ordered.json |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4-dirty | 704bc3145cfcc51bcb4cbda8ae7ee2387e67fc94-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 13:16:21 | 2025-06-06 08:31:30 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
+| 01 || 241.09 | 226.55 | -6%˄ || 4.15 | 4.41 | +6%˄ | (run time too short) |
+| 03 || 33.52 | 31.93 | -5%˄ || 29.80 | 31.28 | +5%˄ | (run time too short) |
+| 06 || 192.36 | 172.75 | -10%˄ || 5.20 | 5.79 | +11%˄ | (run time too short) |
| 07 || 191.04 | 188.62 | -1%˄ || 5.23 | 5.30 | +1%˄ | (run time too short) |
-| 09 || 112.75 | 153.59 | +36%˄ || 8.87 | 6.51 | -27%˄ | (run time too short) |
-| 10 || 36.49 | 40.91 | +12%˄ || 27.37 | 24.42 | -11%˄ | (run time too short) |
| 13 || 257.93 | 250.60 | -3%˄ || 3.88 | 3.99 | +3%˄ | (run time too short) |
| 15 || 75.62 | 76.48 | +1%˄ || 13.22 | 13.07 | -1%˄ | (run time too short) |
-| 16 || 30.90 | 33.15 | +7%˄ || 32.32 | 30.13 | -7%˄ | (run time too short) |
+| 17 || 143.10 | 122.43 | -14%˄ || 6.99 | 8.17 | +17%˄ | (run time too short) |
-| 19 || 68.54 | 74.37 | +9%˄ || 14.58 | 13.44 | -8%˄ | (run time too short) |
+| 25 || 102.63 | 90.70 | -12%˄ || 9.74 | 11.02 | +13%˄ | (run time too short) |
+| 26 || 87.87 | 82.57 | -6%˄ || 11.38 | 12.11 | +6%˄ | (run time too short) |
-| 28 || 147.32 | 159.24 | +8%˄ || 6.79 | 6.28 | -7%˄ | (run time too short) |
+| 29 || 458.69 | 423.59 | -8%˄ || 2.18 | 2.36 | +8%˄ | (run time too short) |
-| 31 || 477.48 | 501.40 | +5%˄ || 2.09 | 1.99 | -5%˄ | (run time too short) |
| 32 || 34.03 | 32.84 | -4%˄ || 29.35 | 30.42 | +4%˄ | (run time too short) |
| 34 || 94.61 | 97.19 | +3%˄ || 10.57 | 10.28 | -3%˄ | (run time too short) |
| 35 || 388.22 | 380.37 | -2%˄ || 2.58 | 2.63 | +2%˄ | (run time too short) |
-| 37 || 197.37 | 255.35 | +29%˄ || 5.07 | 3.92 | -23%˄ | (run time too short) |
| 39a || 767.67 | 770.86 | +0%˄ || 1.30 | 1.30 | -0%˄ | (run time too short) |
| 39b || 744.15 | 745.58 | +0%˄ || 1.34 | 1.34 | -0%˄ | (run time too short) |
| 41 || 365.65 | 365.91 | +0%˄ || 2.73 | 2.73 | -0%˄ | (run time too short) |
-| 42 || 49.54 | 53.27 | +8%˄ || 20.17 | 18.76 | -7%˄ | (run time too short) |
| 43 || 446.83 | 462.28 | +3%˄ || 2.24 | 2.16 | -3%˄ | (run time too short) |
| 45 || 54.19 | 52.70 | -3%˄ || 18.44 | 18.96 | +3%˄ | (run time too short) |
| 48 || 536.30 | 528.72 | -1%˄ || 1.86 | 1.89 | +1%˄ | (run time too short) |
-| 50 || 102.96 | 107.73 | +5%˄ || 9.71 | 9.28 | -4%˄ | (run time too short) |
-| 52 || 51.71 | 55.82 | +8%˄ || 19.33 | 17.90 | -7%˄ | (run time too short) |
-| 55 || 44.58 | 49.20 | +10%˄ || 22.41 | 20.31 | -9%˄ | (run time too short) |
| 62 || 348.42 | 349.30 | +0%˄ || 2.87 | 2.86 | -0%˄ | (run time too short) |
| 65 || 1487.32 | 1472.47 | -1% || 0.67 | 0.67 | +0% | (run time too short) |
| 69 || 71.95 | 74.93 | +4%˄ || 13.89 | 13.34 | -4%˄ | (run time too short) |
-| 73 || 54.34 | 59.01 | +9%˄ || 18.39 | 16.94 | -8%˄ | (run time too short) |
| 79 || 482.39 | 477.67 | -1%˄ || 2.07 | 2.09 | +1%˄ | (run time too short) |
| 81 || 192.05 | 187.82 | -2%˄ || 5.21 | 5.32 | +2%˄ | (run time too short) |
-| 82 || 224.64 | 280.75 | +25%˄ || 4.45 | 3.56 | -20%˄ | (run time too short) |
+| 83 || 46.69 | 43.88 | -6%˄ || 21.40 | 22.77 | +6%˄ | (run time too short) |
+| 84 || 10.09 | 9.34 | -7%˄ || 98.82 | 106.77 | +8%˄ | (run time too short) |
+| 85 || 71.04 | 67.45 | -5%˄ || 14.07 | 14.82 | +5%˄ | (run time too short) |
-| 88 || 82.46 | 87.89 | +7%˄ || 12.12 | 11.37 | -6%˄ | (run time too short) |
+| 91 || 18.25 | 16.87 | -8%˄ || 54.68 | 59.15 | +8%˄ | (run time too short) |
+| 92 || 43.78 | 39.45 | -10%˄ || 22.82 | 25.33 | +11%˄ | (run time too short) |
+| 93 || 753.37 | 550.95 | -27%˄ || 1.33 | 1.81 | +37%˄ | (run time too short) |
-| 94 || 30.53 | 32.15 | +5%˄ || 32.71 | 31.07 | -5%˄ | (run time too short) |
| 95 || 712.51 | 713.44 | +0%˄ || 1.40 | 1.40 | -0%˄ | (run time too short) |
-| 96 || 46.38 | 49.94 | +8%˄ || 21.54 | 20.01 | -7%˄ | (run time too short) |
+| 97 || 1373.25 | 1304.19 | -5% || 0.72 | 0.77 | +7% | 0.0000 |
-| 99 || 574.74 | 651.40 | +13%˄ || 1.74 | 1.54 | -12%˄ | (run time too short) |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Sum || 13159.36 | 13055.59 | -1% || | | | |
| Geomean || | | || | | -1% | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCDS - multi-threaded, shuffled, 64 clients, 64 cores Sum of avg. item runtimes: -1% || Geometric mean of throughput changes: +1%Configuration Overview - click to expand +Configuration Overview---------+---------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCDS_0bcfa0250faed47181d2591d19daefc98bfcd5a4_mt.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCDS_704bc3145cfcc51bcb4cbda8ae7ee2387e67fc94_mt.json |
+-------------------------------+---------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4-dirty | 704bc3145cfcc51bcb4cbda8ae7ee2387e67fc94-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 13:28:30 | 2025-06-06 08:43:36 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+---------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+---------+
+| 01 || 857.64 | 715.49 | -17% || 1.00 | 1.01 | +1% | 0.0074 |
+| 03 || 302.59 | 271.87 | -10% || 1.00 | 1.01 | +1% | 0.3074 |
+| 06 || 933.97 | 851.12 | -9% || 1.00 | 1.01 | +1% | 0.1709 |
+| 07 || 1070.54 | 895.64 | -16% || 1.00 | 1.01 | +1% | 0.0043 |
-| 09 || 892.05 | 1108.93 | +24% || 1.00 | 1.01 | +1% | 0.0025 |
| 10 || 810.43 | 839.26 | +4% || 1.00 | 1.01 | +1% | 0.6769 |
+| 13 || 1758.12 | 1646.70 | -6% || 1.00 | 1.01 | +1% | 0.1290 |
| 15 || 529.36 | 508.31 | -4% || 1.00 | 1.01 | +1% | 0.6182 |
+| 16 || 505.42 | 474.75 | -6% || 1.00 | 1.01 | +1% | 0.5267 |
| 17 || 1456.84 | 1424.12 | -2% || 1.00 | 1.01 | +1% | 0.7022 |
+| 19 || 684.03 | 635.35 | -7% || 1.00 | 1.01 | +1% | 0.3553 |
| 25 || 1067.12 | 1035.53 | -3% || 1.00 | 1.01 | +1% | 0.6536 |
+| 26 || 517.34 | 473.21 | -9% || 1.00 | 1.01 | +1% | 0.2143 |
-| 28 || 1513.45 | 1849.16 | +22% || 1.00 | 1.01 | +1% | 0.0006 |
| 29 || 1867.95 | 1879.64 | +1% || 1.00 | 1.01 | +1% | 0.8963 |
-| 31 || 2665.98 | 2816.25 | +6% || 1.00 | 1.01 | +1% | 0.1941 |
| 32 || 188.89 | 188.46 | -0% || 1.00 | 1.01 | +1% | 0.9852 |
| 34 || 793.81 | 799.69 | +1% || 1.00 | 1.01 | +1% | 0.9121 |
+| 35 || 2277.05 | 2122.63 | -7% || 1.00 | 1.01 | +1% | 0.0825 |
-| 37 || 958.69 | 1062.38 | +11% || 1.00 | 1.01 | +1% | 0.0894 |
| 39a || 2877.21 | 2905.46 | +1% || 1.00 | 1.01 | +1% | 0.7555 |
| 39b || 2838.66 | 2950.73 | +4% || 1.00 | 1.01 | +1% | 0.2106 |
+| 41 || 2118.50 | 1952.42 | -8% || 1.00 | 1.01 | +1% | 0.0820 |
+| 42 || 549.85 | 469.36 | -15% || 1.00 | 1.01 | +1% | 0.0562 |
| 43 || 1634.02 | 1681.15 | +3% || 1.00 | 1.01 | +1% | 0.5139 |
+| 45 || 832.95 | 779.60 | -6% || 1.00 | 1.01 | +1% | 0.3614 |
| 48 || 2839.71 | 2805.85 | -1% || 1.00 | 1.01 | +1% | 0.7629 |
| 50 || 1125.65 | 1108.02 | -2% || 1.00 | 1.01 | +1% | 0.7920 |
+| 52 || 561.00 | 524.74 | -6% || 1.00 | 1.01 | +1% | 0.4563 |
-| 55 || 454.83 | 483.01 | +6% || 1.00 | 1.01 | +1% | 0.4560 |
-| 62 || 1040.44 | 1190.65 | +14% || 1.00 | 1.01 | +1% | 0.0056 |
| 65 || 4417.71 | 4379.75 | -1% || 1.00 | 1.01 | +1% | 0.5899 |
| 69 || 1045.11 | 1073.05 | +3% || 1.00 | 1.01 | +1% | 0.7097 |
+| 73 || 591.78 | 479.21 | -19% || 1.00 | 1.01 | +1% | 0.0107 |
| 79 || 1648.38 | 1643.27 | -0% || 1.00 | 1.01 | +1% | 0.9401 |
+| 81 || 619.10 | 581.88 | -6% || 1.00 | 1.01 | +1% | 0.4125 |
-| 82 || 1013.07 | 1111.85 | +10% || 1.00 | 1.01 | +1% | 0.0686 |
+| 83 || 349.02 | 267.02 | -23% || 1.00 | 1.02 | +1% | 0.0362 |
+| 84 || 131.22 | 100.61 | -23% || 1.00 | 1.01 | +1% | 0.1009 |
+| 85 || 898.51 | 839.10 | -7% || 1.00 | 1.01 | +1% | 0.3303 |
-| 88 || 2663.77 | 2841.32 | +7% || 1.00 | 1.01 | +1% | 0.1410 |
+| 91 || 214.04 | 203.12 | -5% || 1.00 | 1.01 | +1% | 0.7269 |
| 92 || 287.15 | 275.10 | -4% || 1.00 | 1.01 | +1% | 0.7229 |
+| 93 || 2283.35 | 1731.78 | -24% || 1.00 | 1.01 | +1% | 0.0000 |
| 94 || 470.70 | 487.49 | +4% || 1.00 | 1.01 | +1% | 0.7369 |
| 95 || 2204.25 | 2249.94 | +2% || 1.00 | 1.01 | +1% | 0.5584 |
-| 96 || 416.60 | 448.23 | +8% || 1.00 | 1.01 | +1% | 0.4059 |
+| 97 || 4515.32 | 4196.93 | -7% || 1.00 | 1.01 | +1% | 0.0017 |
-| 99 || 1444.88 | 1569.35 | +9% || 1.00 | 1.01 | +1% | 0.0468 |
+---------++----------+----------+--------++----------+----------+--------+---------+
| Sum || 63738.05 | 62928.47 | -1% || | | | |
| Geomean || | | || | | +1% | |
+---------++----------+----------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCC - single-threaded Sum of avg. item runtimes: +14% || Geometric mean of throughput changes: -10%Configuration Overview - click to expand +Configuration Overview---+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCC_0bcfa0250faed47181d2591d19daefc98bfcd5a4_st.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCC_704bc3145cfcc51bcb4cbda8ae7ee2387e67fc94_st.json |
+-------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4-dirty | 704bc3145cfcc51bcb4cbda8ae7ee2387e67fc94-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 13:48:45 | 2025-06-06 09:03:54 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10 | 10 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+ +--------------++----------+---------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+--------------++----------+---------+--------++----------+----------+--------+---------+
-| Delivery || 25.50 | 29.09 | +14% || 4.85 | 4.72 | -3% | 0.0000 |
-| New-Order || 12.07 | 13.83 | +15% || 60.41 | 52.92 | -12% | 0.0000 |
-| Order-Status || 1.16 | 1.41 | +22% || 5.46 | 4.75 | -13% | 0.0000 |
-| Payment || 2.20 | 2.20 | -0% || 58.26 | 50.77 | -13% | 0.9547 |
-| Stock-Level || 1.93 | 2.18 | +13% || 5.18 | 4.70 | -9% | 0.0000 |
+--------------++----------+---------+--------++----------+----------+--------+---------+
-| Sum || 42.85 | 48.72 | +14% || | | | |
-| Geomean || | | || | | -10% | |
+--------------++----------+---------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCC - multi-threaded, shuffled, 64 clients, 10 warehouses, 64 cores (high contention) Sum of avg. item runtimes: -3% || Geometric mean of throughput changes: +3%Configuration Overview - click to expand +Configuration Overview---------+-----------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCC_0bcfa0250faed47181d2591d19daefc98bfcd5a4_mt_highcont.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCC_704bc3145cfcc51bcb4cbda8ae7ee2387e67fc94_mt_highcont.json |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4-dirty | 704bc3145cfcc51bcb4cbda8ae7ee2387e67fc94-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 13:56:23 | 2025-06-06 09:04:59 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 600000000000 | 600000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10 | 10 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------+ +--------------++----------+---------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+--------------++----------+---------+--------++----------+----------+--------+---------+
| Delivery || 181.26 | 175.46 | -3% || 33.75 | 34.61 | +3% | 0.0000 |
| unsucc.: || 3.31 | 3.47 | +5% || 50.88 | 51.99 | +2% | |
| New-Order || 93.42 | 91.59 | -2% || 471.42 | 485.58 | +3% | 0.0000 |
| unsucc.: || 8.90 | 8.11 | -9% || 476.66 | 489.69 | +3% | |
| Order-Status || 9.53 | 9.38 | -2% || 85.20 | 85.98 | +1% | 0.2053 |
+| Payment || 15.67 | 14.68 | -6% || 239.31 | 249.01 | +4% | 0.0000 |
| unsucc.: || 5.48 | 5.26 | -4% || 665.74 | 681.99 | +2% | |
| Stock-Level || 13.87 | 13.65 | -2% || 83.49 | 86.48 | +4% | 0.1971 |
+--------------++----------+---------+--------++----------+----------+--------+---------+
| Sum || 313.75 | 304.76 | -3% || | | | |
| Geomean || | | || | | +3% | |
+--------------++----------+---------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCC - multi-threaded, shuffled, 10 clients, 10 warehouses, 64 cores (low contention) Sum of avg. item runtimes: +3% || Geometric mean of throughput changes: -4%Configuration Overview - click to expand +Configuration Overview---------+----------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCC_0bcfa0250faed47181d2591d19daefc98bfcd5a4_mt_lowcont.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCC_704bc3145cfcc51bcb4cbda8ae7ee2387e67fc94_mt_lowcont.json |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4-dirty | 704bc3145cfcc51bcb4cbda8ae7ee2387e67fc94-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 10 | 10 |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 14:06:35 | 2025-06-06 09:15:10 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 600000000000 | 600000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10 | 10 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------+ +--------------++----------+---------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+--------------++----------+---------+--------++----------+----------+--------+---------+
| Delivery || 75.34 | 77.46 | +3% || 16.40 | 16.04 | -2% | 0.0000 |
| unsucc.: || 0.85 | 0.98 | +16% || 2.12 | 1.95 | -8% | |
-| New-Order || 37.40 | 39.40 | +5% || 190.10 | 182.54 | -4% | 0.0000 |
| unsucc.: || 3.55 | 3.57 | +1% || 18.28 | 17.52 | -4% | |
| Order-Status || 4.29 | 4.42 | +3% || 18.60 | 17.79 | -4% | 0.0000 |
| Payment || 8.11 | 7.88 | -3% || 162.49 | 157.66 | -3% | 0.0000 |
| unsucc.: || 2.04 | 2.04 | +0% || 36.34 | 34.28 | -6% | |
| Stock-Level || 5.56 | 5.52 | -1% || 18.45 | 17.68 | -4% | 0.0008 |
+--------------++----------+---------+--------++----------+----------+--------+---------+
| Sum || 130.70 | 134.68 | +3% || | | | |
| Geomean || | | || | | -4% | |
+--------------++----------+---------+--------++----------+----------+--------+---------+hyriseBenchmarkJoinOrder - single-threaded Sum of avg. item runtimes: -4% || Geometric mean of throughput changes: -2%Configuration Overview - click to expand +Configuration Overview---+-------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkJoinOrder_0bcfa0250faed47181d2591d19daefc98bfcd5a4_st.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkJoinOrder_704bc3145cfcc51bcb4cbda8ae7ee2387e67fc94_st.json |
+-------------------------+-------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4-dirty | 704bc3145cfcc51bcb4cbda8ae7ee2387e67fc94-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 14:16:42 | 2025-06-06 09:25:17 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+-------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+----------------------+
| Item
426B
|| Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
+| 10a || 156.28 | 124.54 | -20%˄ || 6.40 | 8.03 | +25%˄ | (run time too short) |
+| 10b || 94.97 | 73.98 | -22%˄ || 10.53 | 13.52 | +28%˄ | (run time too short) |
+| 10c || 359.64 | 313.41 | -13%˄ || 2.78 | 3.19 | +15%˄ | (run time too short) |
-| 11a || 29.57 | 37.91 | +28%˄ || 33.81 | 26.37 | -22%˄ | (run time too short) |
-| 11b || 25.70 | 32.45 | +26%˄ || 38.90 | 30.82 | -21%˄ | (run time too short) |
-| 11c || 24.61 | 26.50 | +8%˄ || 40.64 | 37.73 | -7%˄ | (run time too short) |
-| 11d || 23.54 | 26.02 | +11%˄ || 42.48 | 38.43 | -10%˄ | (run time too short) |
-| 12a || 31.96 | 47.96 | +50%˄ || 31.28 | 20.85 | -33%˄ | (run time too short) |
-| 12b || 27.71 | 37.72 | +36%˄ || 36.09 | 26.51 | -27%˄ | (run time too short) |
-| 12c || 74.30 | 80.48 | +8%˄ || 13.46 | 12.42 | -8%˄ | (run time too short) |
| 13a || 182.97 | 185.42 | +1%˄ || 5.47 | 5.39 | -1%˄ | (run time too short) |
| 13b || 236.04 | 244.55 | +4%˄ || 4.24 | 4.09 | -3%˄ | (run time too short) |
-| 13c || 32.07 | 42.58 | +33%˄ || 31.18 | 23.48 | -25%˄ | (run time too short) |
-| 13d || 532.31 | 560.54 | +5%˄ || 1.88 | 1.78 | -5%˄ | (run time too short) |
| 14a || 103.47 | 106.24 | +3%˄ || 9.66 | 9.41 | -3%˄ | (run time too short) |
-| 14b || 110.68 | 117.26 | +6%˄ || 9.03 | 8.53 | -6%˄ | (run time too short) |
| 14c || 184.29 | 187.21 | +2%˄ || 5.43 | 5.34 | -2%˄ | (run time too short) |
+| 15a || 76.45 | 59.02 | -23%˄ || 13.08 | 16.94 | +30%˄ | (run time too short) |
+| 15b || 80.24 | 74.86 | -7%˄ || 12.46 | 13.36 | +7%˄ | (run time too short) |
+| 15c || 52.04 | 47.43 | -9%˄ || 19.21 | 21.08 | +10%˄ | (run time too short) |
+| 15d || 49.36 | 45.00 | -9%˄ || 20.26 | 22.22 | +10%˄ | (run time too short) |
+| 16a || 1445.42 | 1272.58 | -12% || 0.68 | 0.78 | +15% | 0.0000 |
+| 16b || 2709.47 | 2565.05 | -5% || 0.37 | 0.38 | +5% | (run time too short) |
+| 16c || 1621.40 | 1436.21 | -11% || 0.62 | 0.68 | +11% | (run time too short) |
+| 16d || 1575.46 | 1402.11 | -11% || 0.63 | 0.70 | +11% | (run time too short) |
+| 17a || 462.60 | 392.79 | -15%˄ || 2.16 | 2.55 | +18%˄ | (run time too short) |
+| 17b || 366.49 | 306.84 | -16%˄ || 2.73 | 3.26 | +19%˄ | (run time too short) |
+| 17c || 345.77 | 289.33 | -16%˄ || 2.89 | 3.46 | +20%˄ | (run time too short) |
+| 17d || 428.13 | 373.71 | -13%˄ || 2.34 | 2.68 | +15%˄ | (run time too short) |
+| 17e || 1674.18 | 1519.75 | -9% || 0.58 | 0.65 | +11% | (run time too short) |
+| 17f || 946.83 | 880.67 | -7%˄ || 1.06 | 1.14 | +8%˄ | (run time too short) |
-| 18a || 143.70 | 157.74 | +10%˄ || 6.96 | 6.34 | -9%˄ | (run time too short) |
| 18b || 107.32 | 111.28 | +4%˄ || 9.32 | 8.99 | -4%˄ | (run time too short) |
+| 18c || 199.17 | 187.45 | -6%˄ || 5.02 | 5.33 | +6%˄ | (run time too short) |
-| 19a || 221.40 | 234.74 | +6%˄ || 4.52 | 4.26 | -6%˄ | (run time too short) |
-| 19b || 192.93 | 202.52 | +5%˄ || 5.18 | 4.94 | -5%˄ | (run time too short) |
| 19c || 266.70 | 263.69 | -1%˄ || 3.75 | 3.79 | +1%˄ | (run time too short) |
| 19d || 749.25 | 761.09 | +2%˄ || 1.33 | 1.31 | -2%˄ | (run time too short) |
-| 1a || 10.27 | 11.53 | +12%˄ || 97.39 | 86.73 | -11%˄ | (run time too short) |
-| 1b || 16.44 | 29.62 | +80%˄ || 60.81 | 33.75 | -44%˄ | (run time too short) |
| 1c || 21.63 | 21.55 | -0%˄ || 46.22 | 46.40 | +0%˄ | (run time too short) |
-| 1d || 9.47 | 11.11 | +17%˄ || 105.55 | 89.97 | -15%˄ | (run time too short) |
-| 20a || 554.43 | 672.77 | +21%˄ || 1.80 | 1.49 | -18%˄ | (run time too short) |
-| 20b || 602.99 | 720.45 | +19%˄ || 1.66 | 1.39 | -16%˄ | (run time too short) |
+| 20c || 435.79 | 399.12 | -8%˄ || 2.29 | 2.51 | +9%˄ | (run time too short) |
-| 21a || 44.65 | 51.79 | +16%˄ || 22.39 | 19.31 | -14%˄ | (run time too short) |
-| 21b || 34.60 | 44.87 | +30%˄ || 28.90 | 22.28 | -23%˄ | (run time too short) |
| 21c || 40.86 | 41.32 | +1%˄ || 24.47 | 24.20 | -1%˄ | (run time too short) |
| 22a || 184.53 | 179.35 | -3%˄ || 5.42 | 5.58 | +3%˄ | (run time too short) |
| 22b || 167.60 | 162.44 | -3%˄ || 5.97 | 6.16 | +3%˄ | (run time too short) |
+| 22c || 250.95 | 239.56 | -5%˄ || 3.98 | 4.17 | +5%˄ | (run time too short) |
| 22d || 366.64 | 360.80 | -2%˄ || 2.73 | 2.77 | +2%˄ | (run time too short) |
+| 23a || 55.36 | 50.70 | -8%˄ || 18.06 | 19.72 | +9%˄ | (run time too short) |
| 23b || 60.46 | 58.56 | -3%˄ || 16.54 | 17.08 | +3%˄ | (run time too short) |
+| 23c || 58.79 | 53.47 | -9%˄ || 17.01 | 18.70 | +10%˄ | (run time too short) |
-| 24a || 219.28 | 230.09 | +5%˄ || 4.56 | 4.35 | -5%˄ | (run time too short) |
-| 24b || 203.05 | 215.75 | +6%˄ || 4.92 | 4.63 | -6%˄ | (run time too short) |
| 25a || 104.68 | 101.52 | -3%˄ || 9.55 | 9.85 | +3%˄ | (run time too short) |
| 25b || 64.12 | 66.69 | +4%˄ || 15.59 | 14.99 | -4%˄ | (run time too short) |
| 25c || 241.92 | 231.93 | -4%˄ || 4.13 | 4.31 | +4%˄ | (run time too short) |
+| 26a || 170.91 | 141.38 | -17%˄ || 5.85 | 7.07 | +21%˄ | (run time too short) |
+| 26b || 142.08 | 123.03 | -13%˄ || 7.04 | 8.13 | +15%˄ | (run time too short) |
+| 26c || 320.37 | 252.46 | -21%˄ || 3.12 | 3.96 | +27%˄ | (run time too short) |
-| 27a || 37.56 | 46.63 | +24%˄ || 26.62 | 21.44 | -19%˄ | (run time too short) |
-| 27b || 26.49 | 33.14 | +25%˄ || 37.75 | 30.17 | -20%˄ | (run time too short) |
| 27c || 40.93 | 41.63 | +2%˄ || 24.43 | 24.02 | -2%˄ | (run time too short) |
+| 28a || 212.25 | 203.08 | -4%˄ || 4.71 | 4.92 | +5%˄ | (run time too short) |
| 28b || 80.16 | 81.20 | +1%˄ || 12.47 | 12.31 | -1%˄ | (run time too short) |
| 28c || 186.96 | 180.48 | -3%˄ || 5.35 | 5.54 | +4%˄ | (run time too short) |
-| 29a || 178.86 | 192.52 | +8%˄ || 5.59 | 5.19 | -7%˄ | (run time too short) |
| 29b || 930.66 | 939.12 | +1%˄ || 1.07 | 1.06 | -1%˄ | (run time too short) |
-| 29c || 222.11 | 239.76 | +8%˄ || 4.50 | 4.17 | -7%˄ | (run time too short) |
| 2a || 29.20 | 30.11 | +3%˄ || 34.24 | 33.21 | -3%˄ | (run time too short) |
-| 2b || 26.55 | 27.94 | +5%˄ || 37.66 | 35.78 | -5%˄ | (run time too short) |
-| 2c || 21.95 | 24.18 | +10%˄ || 45.56 | 41.35 | -9%˄ | (run time too short) |
| 2d || 57.77 | 56.78 | -2%˄ || 17.31 | 17.61 | +2%˄ | (run time too short) |
| 30a || 90.03 | 90.25 | +0%˄ || 11.11 | 11.08 | -0%˄ | (run time too short) |
| 30b || 92.51 | 95.98 | +4%˄ || 10.81 | 10.42 | -4%˄ | (run time too short) |
| 30c || 159.61 | 154.55 | -3%˄ || 6.27 | 6.47 | +3%˄ | (run time too short) |
| 31a || 79.45 | 80.67 | +2%˄ || 12.59 | 12.40 | -2%˄ | (run time too short) |
| 31b || 84.05 | 80.89 | -4%˄ || 11.90 | 12.36 | +4%˄ | (run time too short) |
| 31c || 90.35 | 91.00 | +1%˄ || 11.07 | 10.99 | -1%˄ | (run time too short) |
| 32a || 14.96 | 15.34 | +3%˄ || 66.85 | 65.18 | -3%˄ | (run time too short) |
+| 32b || 36.31 | 34.13 | -6%˄ || 27.54 | 29.30 | +6%˄ | (run time too short) |
-| 33a || 34.06 | 51.89 | +52%˄ || 29.36 | 19.27 | -34%˄ | (run time too short) |
-| 33b || 22.84 | 30.04 | +32%˄ || 43.78 | 33.29 | -24%˄ | (run time too short) |
-| 33c || 45.43 | 56.41 | +24%˄ || 22.01 | 17.73 | -19%˄ | (run time too short) |
| 3a || 71.03 | 71.43 | +1%˄ || 14.08 | 14.00 | -1%˄ | (run time too short) |
-| 3b || 19.87 | 24.45 | +23%˄ || 50.32 | 40.89 | -19%˄ | (run time too short) |
+| 3c || 223.76 | 211.01 | -6%˄ || 4.47 | 4.74 | +6%˄ | (run time too short) |
| 4a || 150.45 | 150.41 | -0%˄ || 6.65 | 6.65 | +0%˄ | (run time too short) |
-| 4b || 18.45 | 23.29 | +26%˄ || 54.18 | 42.93 | -21%˄ | (run time too short) |
| 4c || 191.03 | 187.53 | -2%˄ || 5.23 | 5.33 | +2%˄ | (run time too short) |
+| 5a || 64.67 | 57.54 | -11%˄ || 15.46 | 17.38 | +12%˄ | (run time too short) |
+| 5b || 61.21 | 57.55 | -6%˄ || 16.34 | 17.38 | +6%˄ | (run time too short) |
+| 5c || 99.55 | 90.48 | -9%˄ || 10.04 | 11.05 | +10%˄ | (run time too short) |
+| 6a || 167.34 | 148.68 | -11%˄ || 5.98 | 6.73 | +13%˄ | (run time too short) |
+| 6b || 178.05 | 161.51 | -9%˄ || 5.62 | 6.19 | +10%˄ | (run time too short) |
+| 6c || 157.83 | 138.78 | -12%˄ || 6.34 | 7.21 | +14%˄ | (run time too short) |
+| 6d || 389.69 | 351.65 | -10%˄ || 2.57 | 2.84 | +11%˄ | (run time too short) |
+| 6e || 164.69 | 142.61 | -13%˄ || 6.07 | 7.01 | +15%˄ | (run time too short) |
+| 6f || 721.47 | 673.97 | -7%˄ || 1.39 | 1.48 | +7%˄ | (run time too short) |
-| 7a || 92.60 | 123.91 | +34%˄ || 10.80 | 8.07 | -25%˄ | (run time too short) |
-| 7b || 86.43 | 118.64 | +37%˄ || 11.57 | 8.43 | -27%˄ | (run time too short) |
| 7c || 576.79 | 567.65 | -2%˄ || 1.73 | 1.76 | +2%˄ | (run time too short) |
| 8a || 202.35 | 197.23 | -3%˄ || 4.94 | 5.07 | +3%˄ | (run time too short) |
-| 8b || 188.95 | 201.27 | +7%˄ || 5.29 | 4.97 | -6%˄ | (run time too short) |
| 8c || 1863.54 | 1826.42 | -2% || 0.53 | 0.53 | +0% | (run time too short) |
| 8d || 488.32 | 489.19 | +0%˄ || 2.05 | 2.04 | -0%˄ | (run time too short) |
+| 9a || 257.35 | 244.08 | -5%˄ || 3.89 | 4.10 | +5%˄ | (run time too short) |
+| 9b || 165.70 | 157.26 | -5%˄ || 6.03 | 6.36 | +5%˄ | (run time too short) |
+| 9c || 311.21 | 289.86 | -7%˄ || 3.21 | 3.45 | +7%˄ | (run time too short) |
| 9d || 457.28 | 447.00 | -2%˄ || 2.19 | 2.24 | +2%˄ | (run time too short) |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Sum || 30496.95 | 29331.61 | -4% || | | | |
| Geomean || | | || | | -2% | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkJoinOrder - multi-threaded, ordered, 1 client, 64 cores Sum of avg. item runtimes: -2% || Geometric mean of throughput changes: -1%Configuration Overview - click to expand +Configuration Overview---------+---------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkJoinOrder_0bcfa0250faed47181d2591d19daefc98bfcd5a4_mt_ordered.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkJoinOrder_704bc3145cfcc51bcb4cbda8ae7ee2387e67fc94_mt_ordered.json |
+-------------------------------+---------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4-dirty | 704bc3145cfcc51bcb4cbda8ae7ee2387e67fc94-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 14:41:54 | 2025-06-06 09:51:11 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------------+---------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| 10a || 39.83 | 41.24 | +4%˄ || 25.08 | 24.23 | -3%˄ | (run time too short) |
-| 10b || 18.33 | 20.44 | +12%˄ || 54.46 | 48.82 | -10%˄ | (run time too short) |
+| 10c || 120.65 | 107.14 | -11%˄ || 8.29 | 9.33 | +13%˄ | (run time too short) |
| 11a || 10.54 | 10.74 | +2%˄ || 94.59 | 92.83 | -2%˄ | (run time too short) |
| 11b || 8.37 | 8.60 | +3%˄ || 119.00 | 115.79 | -3%˄ | (run time too short) |
| 11c || 23.23 | 24.20 | +4%˄ || 42.98 | 41.25 | -4%˄ | (run time too short) |
| 11d || 27.18 | 26.83 | -1%˄ || 36.74 | 37.22 | +1%˄ | (run time too short) |
+| 12a || 21.55 | 20.61 | -4%˄ || 46.32 | 48.43 | +5%˄ | (run time too short) |
| 12b || 12.03 | 12.52 | +4%˄ || 82.86 | 79.62 | -4%˄ | (run time too short) |
| 12c || 51.14 | 49.72 | -3%˄ || 19.54 | 20.10 | +3%˄ | (run time too short) |
+| 13a || 134.71 | 128.40 | -5%˄ || 7.42 | 7.79 | +5%˄ | (run time too short) |
| 13b || 96.71 | 93.85 | -3%˄ || 10.34 | 10.65 | +3%˄ | (run time too short) |
| 13c || 15.59 | 16.23 | +4%˄ || 63.99 | 61.47 | -4%˄ | (run time too short) |
| 13d || 372.34 | 378.61 | +2%˄ || 2.69 | 2.64 | -2%˄ | (run time too short) |
| 14a || 57.08 | 55.93 | -2%˄ || 17.51 | 17.87 | +2%˄ | (run time too short) |
| 14b || 72.00 | 71.75 | -0%˄ || 13.88 | 13.93 | +0%˄ | (run time too short) |
| 14c || 118.28 | 115.09 | -3%˄ || 8.45 | 8.69 | +3%˄ | (run time too short) |
| 15a || 30.30 | 29.71 | -2%˄ || 32.97 | 33.61 | +2%˄ | (run time too short) |
| 15b || 24.94 | 25.25 | +1%˄ || 40.03 | 39.54 | -1%˄ | (run time too short) |
| 15c || 23.12 | 22.89 | -1%˄ || 43.18 | 43.61 | +1%˄ | (run time too short) |
| 15d || 28.99 | 29.56 | +2%˄ || 34.45 | 33.79 | -2%˄ | (run time too short) |
+| 16a || 846.11 | 755.21 | -11%˄ || 1.18 | 1.32 | +12%˄ | (run time too short) |
| 16b || 2054.41 | 2034.99 | -1% || 0.48 | 0.48 | +0% | 0.0369 |
+| 16c || 1005.65 | 928.19 | -8%˄ || 0.99 | 1.08 | +8%˄ | (run time too short) |
+| 16d || 967.56 | 891.28 | -8%˄ || 1.03 | 1.12 | +9%˄ | (run time too short) |
| 17a || 187.95 | 183.66 | -2%˄ || 5.32 | 5.44 | +2%˄ | (run time too short) |
| 17b || 155.80 | 154.66 | -1%˄ || 6.42 | 6.46 | +1%˄ | (run time too short) |
| 17c || 128.35 | 128.57 | +0%˄ || 7.79 | 7.78 | -0%˄ | (run time too short) |
| 17d || 126.57 | 123.90 | -2%˄ || 7.90 | 8.07 | +2%˄ | (run time too short) |
| 17e || 846.50 | 819.64 | -3%˄ || 1.18 | 1.22 | +3%˄ | (run time too short) |
| 17f || 322.94 | 319.84 | -1%˄ || 3.10 | 3.13 | +1%˄ | (run time too short) |
-| 18a || 52.67 | 55.26 | +5%˄ || 18.97 | 18.08 | -5%˄ | (run time too short) |
| 18b || 50.23 | 48.94 | -3%˄ || 19.89 | 20.42 | +3%˄ | (run time too short) |
| 18c || 99.03 | 98.18 | -1%˄ || 10.09 | 10.18 | +1%˄ | (run time too short) |
| 19a || 100.42 | 97.48 | -3%˄ || 9.95 | 10.25 | +3%˄ | (run time too short) |
| 19b || 62.93 | 61.16 | -3%˄ || 15.88 | 16.34 | +3%˄ | (run time too short) |
| 19c || 113.80 | 112.52 | -1%˄ || 8.78 | 8.88 | +1%˄ | (run time too short) |
| 19d || 520.87 | 536.46 | +3%˄ || 1.92 | 1.86 | -3%˄ | (run time too short) |
| 1a || 6.36 | 6.44 | +1%˄ || 156.53 | 154.60 | -1%˄ | (run time too short) |
-| 1b || 4.48 | 7.51 | +67%˄ || 221.24 | 132.55 | -40%˄ | (run time too short) |
-| 1c || 4.00 | 5.00 | +25%˄ || 247.71 | 198.45 | -20%˄ | (run time too short) |
| 1d || 5.02 | 5.17 | +3%˄ || 198.07 | 192.16 | -3%˄ | (run time too short) |
-| 20a || 83.48 | 108.69 | +30%˄ || 11.97 | 9.20 | -23%˄ | (run time too short) |
-| 20b || 72.40 | 103.21 | +43%˄ || 13.81 | 9.69 | -30%˄ | (run time too short) |
| 20c || 79.82 | 81.16 | +2%˄ || 12.52 | 12.32 | -2%˄ | (run time too short) |
| 21a || 16.66 | 16.59 | -0%˄ || 59.89 | 60.16 | +0%˄ | (run time too short) |
| 21b || 15.15 | 15.00 | -1%˄ || 65.86 | 66.52 | +1%˄ | (run time too short) |
| 21c || 18.69 | 18.36 | -2%˄ || 53.39 | 54.37 | +2%˄ | (run time too short) |
| 22a || 73.07 | 71.18 | -3%˄ || 13.68 | 14.04 | +3%˄ | (run time too short) |
+| 22b || 54.81 | 51.48 | -6%˄ || 18.23 | 19.41 | +6%˄ | (run time too short) |
+| 22c || 123.41 | 117.97 | -4%˄ || 8.10 | 8.47 | +5%˄ | (run time too short) |
+| 22d || 223.78 | 212.32 | -5%˄ || 4.47 | 4.71 | +5%˄ | (run time too short) |
| 23a || 16.50 | 16.09 | -2%˄ || 60.47 | 62.01 | +3%˄ | (run time too short) |
-| 23b || 27.03 | 29.66 | +10%˄ || 36.94 | 33.67 | -9%˄ | (run time too short) |
| 23c || 18.76 | 18.40 | -2%˄ || 53.19 | 54.24 | +2%˄ | (run time too short) |
| 24a || 60.07 | 59.91 | -0%˄ || 16.63 | 16.68 | +0%˄ | (run time too short) |
| 24b || 60.36 | 62.96 | +4%˄ || 16.55 | 15.87 | -4%˄ | (run time too short) |
| 25a || 57.48 | 56.94 | -1%˄ || 17.38 | 17.55 | +1%˄ | (run time too short) |
-| 25b || 32.64 | 36.25 | +11%˄ || 30.60 | 27.56 | -10%˄ | (run time too short) |
| 25c || 157.31 | 153.21 | -3%˄ || 6.36 | 6.53 | +3%˄ | (run time too short) |
| 26a || 86.84 | 84.38 | -3%˄ || 11.51 | 11.84 | +3%˄ | (run time too short) |
+| 26b || 64.08 | 60.40 | -6%˄ || 15.59 | 16.54 | +6%˄ | (run time too short) |
+| 26c || 131.43 | 122.74 | -7%˄ || 7.61 | 8.14 | +7%˄ | (run time too short) |
| 27a || 19.60 | 19.38 | -1%˄ || 50.93 | 51.51 | +1%˄ | (run time too short) |
| 27b || 18.21 | 18.12 | -0%˄ || 54.80 | 55.07 | +0%˄ | (run time too short) |
| 27c || 18.26 | 18.06 | -1%˄ || 54.65 | 55.26 | +1%˄ | (run time too short) |
| 28a || 126.69 | 124.22 | -2%˄ || 7.89 | 8.05 | +2%˄ | (run time too short) |
| 28b || 27.56 | 27.12 | -2%˄ || 36.24 | 36.82 | +2%˄ | (run time too short) |
| 28c || 105.64 | 102.25 | -3%˄ || 9.46 | 9.78 | +3%˄ | (run time too short) |
| 29a || 52.78 | 53.23 | +1%˄ || 18.93 | 18.77 | -1%˄ | (run time too short) |
-| 29b || 133.17 | 156.86 | +18%˄ || 7.51 | 6.37 | -15%˄ | (run time too short) |
| 29c || 65.92 | 66.58 | +1%˄ || 15.16 | 15.01 | -1%˄ | (run time too short) |
| 2a || 22.42 | 22.85 | +2%˄ || 44.53 | 43.70 | -2%˄ | (run time too short) |
| 2b || 19.70 | 20.20 | +3%˄ || 50.67 | 49.43 | -2%˄ | (run time too short) |
| 2c || 13.85 | 14.36 | +4%˄ || 72.06 | 69.47 | -4%˄ | (run time too short) |
+| 2d || 52.65 | 49.73 | -6%˄ || 18.98 | 20.10 | +6%˄ | (run time too short) |
| 30a || 48.40 | 47.23 | -2%˄ || 20.64 | 21.15 | +2%˄ | (run time too short) |
| 30b || 37.02 | 37.85 | +2%˄ || 26.98 | 26.39 | -2%˄ | (run time too short) |
| 30c || 115.23 | 113.16 | -2%˄ || 8.67 | 8.83 | +2%˄ | (run time too short) |
-| 31a || 38.97 | 41.99 | +8%˄ || 25.63 | 23.79 | -7%˄ | (run time too short) |
-| 31b || 34.28 | 37.77 | +10%˄ || 29.14 | 26.45 | -9%˄ | (run time too short) |
-| 31c || 43.18 | 45.71 | +6%˄ || 23.14 | 21.86 | -6%˄ | (run time too short) |
-| 32a || 6.39 | 6.68 | +5%˄ || 155.84 | 148.92 | -4%˄ | (run time too short) |
| 32b || 28.36 | 28.91 | +2%˄ || 35.22 | 34.55 | -2%˄ | (run time too short) |
-| 33a || 10.56 | 14.08 | +33%˄ || 94.40 | 70.83 | -25%˄ | (run time too short) |
-| 33b || 8.44 | 9.78 | +16%˄ || 117.95 | 101.84 | -14%˄ | (run time too short) |
-| 33c || 18.82 | 20.74 | +10%˄ || 53.03 | 48.14 | -9%˄ | (run time too short) |
+| 3a || 38.67 | 32.44 | -16%˄ || 25.83 | 30.79 | +19%˄ | (run time too short) |
| 3b || 6.60 | 6.43 | -3%˄ || 150.76 | 154.73 | +3%˄ | (run time too short) |
| 3c || 71.85 | 72.46 | +1%˄ || 13.91 | 13.79 | -1%˄ | (run time too short) |
+| 4a || 69.52 | 65.49 | -6%˄ || 14.38 | 15.26 | +6%˄ | (run time too short) |
-| 4b || 5.19 | 5.60 | +8%˄ || 191.35 | 177.52 | -7%˄ | (run time too short) |
| 4c || 86.15 | 83.63 | -3%˄ || 11.60 | 11.95 | +3%˄ | (run time too short) |
| 5a || 24.54 | 24.73 | +1%˄ || 40.69 | 40.38 | -1%˄ | (run time too short) |
| 5b || 20.66 | 20.27 | -2%˄ || 48.32 | 49.26 | +2%˄ | (run time too short) |
+| 5c || 48.59 | 44.70 | -8%˄ || 20.56 | 22.35 | +9%˄ | (run time too short) |
+| 6a || 29.21 | 24.38 | -17%˄ || 34.19 | 40.96 | +20%˄ | (run time too short) |
| 6b || 50.78 | 48.72 | -4%˄ || 19.68 | 20.51 | +4%˄ | (run time too short) |
+| 6c || 26.47 | 23.12 | -13%˄ || 37.72 | 43.18 | +14%˄ | (run time too short) |
| 6d || 129.28 | 129.14 | -0%˄ || 7.73 | 7.74 | +0%˄ | (run time too short) |
+| 6e || 28.77 | 24.18 | -16%˄ || 34.72 | 41.29 | +19%˄ | (run time too short) |
| 6f || 479.70 | 488.38 | +2%˄ || 2.08 | 2.05 | -2%˄ | (run time too short) |
| 7a || 27.26 | 27.88 | +2%˄ || 36.63 | 35.82 | -2%˄ | (run time too short) |
| 7b || 25.77 | 26.55 | +3%˄ || 38.76 | 37.60 | -3%˄ | (run time too short) |
| 7c || 257.05 | 263.28 | +2%˄ || 3.89 | 3.80 | -2%˄ | (run time too short) |
-| 8a || 41.73 | 46.67 | +12%˄ || 23.94 | 21.41 | -11%˄ | (run time too short) |
-| 8b || 40.17 | 45.63 | +14%˄ || 24.87 | 21.90 | -12%˄ | (run time too short) |
| 8c || 1133.53 | 1133.94 | +0%˄ || 0.88 | 0.88 | -0%˄ | (run time too short) |
| 8d || 278.75 | 278.97 | +0%˄ || 3.59 | 3.58 | -0%˄ | (run time too short) |
+| 9a || 132.07 | 126.28 | -4%˄ || 7.57 | 7.92 | +5%˄ | (run time too short) |
+| 9b || 74.63 | 71.34 | -4%˄ || 13.39 | 14.01 | +5%˄ | (run time too short) |
+| 9c || 149.21 | 140.80 | -6%˄ || 6.70 | 7.10 | +6%˄ | (run time too short) |
| 9d || 353.48 | 366.73 | +4%˄ || 2.83 | 2.73 | -4%˄ | (run time too short) |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Sum || 15138.04 | 14878.87 | -2% || | | | |
| Geomean || | | || | | -1% | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkJoinOrder - multi-threaded, shuffled, 64 clients, 64 cores Sum of avg. item runtimes: -4% || Geometric mean of throughput changes: +4%Configuration Overview - click to expand +Configuration Overview---------+-------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkJoinOrder_0bcfa0250faed47181d2591d19daefc98bfcd5a4_mt.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkJoinOrder_704bc3145cfcc51bcb4cbda8ae7ee2387e67fc94_mt.json |
+-------------------------------+-------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4-dirty | 704bc3145cfcc51bcb4cbda8ae7ee2387e67fc94-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 14:56:30 | 2025-06-06 10:07:07 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+-------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+---------+
-| 10a || 207.30 | 217.48 | +5% || 1.18 | 1.22 | +4% | 0.5901 |
| 10b || 146.27 | 145.95 | -0% || 1.18 | 1.22 | +4% | 0.9841 |
+| 10c || 709.92 | 585.66 | -18% || 1.18 | 1.22 | +4% | 0.0001 |
+| 11a || 90.30 | 84.24 | -7% || 1.18 | 1.22 | +4% | 0.6080 |
-| 11b || 77.36 | 93.45 | +21% || 1.18 | 1.22 | +4% | 0.1615 |
| 11c || 125.80 | 127.17 | +1% || 1.18 | 1.22 | +4% | 0.9157 |
-| 11d || 95.39 | 113.79 | +19% || 1.18 | 1.22 | +3% | 0.1232 |
-| 12a || 161.32 | 171.52 | +6% || 1.18 | 1.22 | +4% | 0.5031 |
+| 12b || 86.09 | 78.99 | -8% || 1.18 | 1.22 | +4% | 0.5471 |
+| 12c || 396.66 | 373.33 | -6% || 1.18 | 1.22 | +4% | 0.3865 |
+| 13a || 541.77 | 475.76 | -12% || 1.18 | 1.22 | +3% | 0.0121 |
| 13b || 366.20 | 375.87 | +3% || 1.18 | 1.22 | +3% | 0.7078 |
| 13c || 90.68 | 88.10 | -3% || 1.18 | 1.22 | +4% | 0.8054 |
| 13d || 941.54 | 950.40 | +1% || 1.18 | 1.22 | +3% | 0.7622 |
-| 14a || 441.14 | 468.12 | +6% || 1.18 | 1.22 | +4% | 0.3354 |
+| 14b || 486.85 | 436.89 | -10% || 1.18 | 1.22 | +4% | 0.0737 |
+| 14c || 656.58 | 621.40 | -5% || 1.18 | 1.22 | +4% | 0.2747 |
+| 15a || 129.97 | 115.08 | -11% || 1.18 | 1.22 | +4% | 0.2028 |
| 15b || 119.85 | 121.92 | +2% || 1.18 | 1.22 | +4% | 0.8583 |
| 15c || 139.26 | 133.09 | -4% || 1.18 | 1.22 | +4% | 0.6228 |
+| 15d || 159.80 | 150.87 | -6% || 1.18 | 1.22 | +4% | 0.5094 |
+| 16a || 1796.01 | 1597.21 | -11% || 1.18 | 1.22 | +4% | 0.0000 |
| 16b || 3316.65 | 3255.33 | -2% || 1.17 | 1.22 | +4% | 0.1579 |
| 16c || 1990.67 | 1911.89 | -4% || 1.18 | 1.22 | +3% | 0.0529 |
+| 16d || 1981.54 | 1779.82 | -10% || 1.18 | 1.22 | +3% | 0.0000 |
+| 17a || 925.80 | 846.54 | -9% || 1.18 | 1.22 | +4% | 0.0249 |
+| 17b || 711.79 | 621.37 | -13% || 1.18 | 1.22 | +4% | 0.0037 |
+| 17c || 640.32 | 589.59 | -8% || 1.18 | 1.22 | +3% | 0.0948 |
| 17d || 607.26 | 594.83 | -2% || 1.18 | 1.22 | +4% | 0.6657 |
| 17e || 1770.67 | 1707.27 | -4% || 1.18 | 1.22 | +4% | 0.1037 |
| 17f || 1228.37 | 1177.36 | -4% || 1.18 | 1.22 | +4% | 0.1992 |
-| 18a || 274.17 | 294.87 | +8% || 1.18 | 1.22 | +4% | 0.3605 |
+| 18b || 433.79 | 397.82 | -8% || 1.18 | 1.22 | +4% | 0.1998 |
+| 18c || 679.02 | 646.87 | -5% || 1.18 | 1.22 | +4% | 0.3690 |
-| 19a || 569.58 | 604.23 | +6% || 1.18 | 1.22 | +3% | 0.2609 |
| 19b || 434.99 | 433.46 | -0% || 1.18 | 1.22 | +4% | 0.9585 |
+| 19c || 676.73 | 636.47 | -6% || 1.18 | 1.22 | +4% | 0.2459 |
| 19d || 1445.51 | 1504.06 | +4% || 1.18 | 1.22 | +4% | 0.1348 |
+| 1a || 38.64 | 36.46 | -6% || 1.18 | 1.22 | +4% | 0.6638 |
| 1b || 48.16 | 46.62 | -3% || 1.18 | 1.22 | +4% | 0.8295 |
| 1c || 68.71 | 68.34 | -1% || 1.18 | 1.22 | +4% | 0.9730 |
+| 1d || 40.25 | 36.56 | -9% || 1.18 | 1.22 | +4% | 0.6869 |
-| 20a || 488.60 | 524.92 | +7% || 1.18 | 1.22 | +3% | 0.2271 |
+| 20b || 427.24 | 396.96 | -7% || 1.18 | 1.22 | +4% | 0.2373 |
| 20c || 423.66 | 405.36 | -4% || 1.18 | 1.22 | +4% | 0.4889 |
| 21a || 187.68 | 183.74 | -2% || 1.18 | 1.22 | +4% | 0.8366 |
| 21b || 133.19 | 134.20 | +1% || 1.18 | 1.22 | +3% | 0.9527 |
+| 21c || 228.41 | 192.05 | -16% || 1.18 | 1.22 | +4% | 0.1029 |
-| 22a || 489.12 | 556.67 | +14% || 1.18 | 1.22 | +4% | 0.0391 |
+| 22b || 448.85 | 387.66 | -14% || 1.18 | 1.22 | +3% | 0.0162 |
| 22c || 715.90 | 689.68 | -4% || 1.18 | 1.22 | +3% | 0.4409 |
| 22d || 967.71 | 958.68 | -1% || 1.18 | 1.22 | +4% | 0.8193 |
-| 23a || 156.52 | 176.92 | +13% || 1.18 | 1.22 | +4% | 0.2546 |
| 23b || 135.68 | 133.56 | -2% || 1.18 | 1.22 | +4% | 0.8788 |
| 23c || 174.25 | 176.67 | +1% || 1.18 | 1.22 | +4% | 0.8983 |
+| 24a || 437.08 | 412.97 | -6% || 1.18 | 1.22 | +3% | 0.4128 |
-| 24b || 315.19 | 340.15 | +8% || 1.18 | 1.22 | +4% | 0.3052 |
+| 25a || 474.67 | 418.79 | -12% || 1.18 | 1.22 | +4% | 0.0767 |
| 25b || 248.57 | 251.80 | +1% || 1.18 | 1.22 | +3% | 0.8893 |
+| 25c || 966.56 | 893.02 | -8% || 1.18 | 1.22 | +4% | 0.0455 |
+| 26a || 425.47 | 375.20 | -12% || 1.18 | 1.22 | +4% | 0.0186 |
+| 26b || 279.03 | 219.77 | -21% || 1.18 | 1.22 | +3% | 0.0010 |
+| 26c || 655.79 | 581.56 | -11% || 1.18 | 1.22 | +4% | 0.0051 |
| 27a || 171.75 | 172.80 | +1% || 1.18 | 1.22 | +4% | 0.9463 |
+| 27b || 174.04 | 158.27 | -9% || 1.18 | 1.22 | +4% | 0.3525 |
+| 27c || 200.48 | 190.24 | -5% || 1.18 | 1.22 | +3% | 0.6416 |
| 28a || 672.36 | 693.08 | +3% || 1.18 | 1.22 | +3% | 0.4952 |
| 28b || 252.00 | 250.80 | -0% || 1.18 | 1.22 | +4% | 0.9516 |
+| 28c || 696.21 | 659.05 | -5% || 1.18 | 1.22 | +4% | 0.2813 |
+| 29a || 307.12 | 289.14 | -6% || 1.18 | 1.22 | +4% | 0.4724 |
-| 29b || 369.39 | 460.36 | +25% || 1.18 | 1.22 | +4% | 0.0018 |
+| 29c || 401.55 | 382.08 | -5% || 1.18 | 1.22 | +4% | 0.4706 |
+| 2a || 147.76 | 137.13 | -7% || 1.18 | 1.22 | +4% | 0.4693 |
+| 2b || 138.11 | 122.29 | -11% || 1.18 | 1.22 | +4% | 0.1967 |
-| 2c || 90.14 | 98.87 | +10% || 1.18 | 1.22 | +4% | 0.3703 |
| 2d || 210.40 | 209.31 | -1% || 1.18 | 1.22 | +4% | 0.9407 |
+| 30a || 374.76 | 349.41 | -7% || 1.18 | 1.22 | +4% | 0.3021 |
| 30b || 316.48 | 313.97 | -1% || 1.18 | 1.22 | +4% | 0.9114 |
+| 30c || 720.14 | 683.84 | -5% || 1.18 | 1.22 | +3% | 0.3018 |
-| 31a || 296.20 | 309.55 | +5% || 1.18 | 1.22 | +4% | 0.5987 |
| 31b || 261.70 | 260.50 | -0% || 1.18 | 1.22 | +4% | 0.9611 |
-| 31c || 325.66 | 349.38 | +7% || 1.18 | 1.22 | +4% | 0.3950 |
+| 32a || 52.34 | 41.44 | -21% || 1.18 | 1.22 | +4% | 0.0502 |
+| 32b || 161.95 | 143.58 | -11% || 1.18 | 1.22 | +4% | 0.1319 |
+| 33a || 138.99 | 128.86 | -7% || 1.18 | 1.22 | +4% | 0.5641 |
-| 33b || 75.18 | 80.85 | +8% || 1.18 | 1.22 | +4% | 0.4875 |
| 33c || 153.11 | 150.21 | -2% || 1.18 | 1.22 | +4% | 0.8589 |
+| 3a || 321.56 | 270.82 | -16% || 1.18 | 1.22 | +4% | 0.0539 |
+| 3b || 75.63 | 70.37 | -7% || 1.18 | 1.22 | +4% | 0.6107 |
+| 3c || 487.07 | 400.85 | -18% || 1.18 | 1.22 | +3% | 0.0009 |
+| 4a || 297.69 | 282.30 | -5% || 1.18 | 1.22 | +4% | 0.4412 |
| 4b || 57.29 | 54.79 | -4% || 1.18 | 1.22 | +4% | 0.7570 |
-| 4c || 298.11 | 319.02 | +7% || 1.18 | 1.22 | +3% | 0.2455 |
| 5a || 249.90 | 260.79 | +4% || 1.18 | 1.22 | +4% | 0.6134 |
| 5b || 159.53 | 154.61 | -3% || 1.18 | 1.22 | +4% | 0.7619 |
+| 5c || 351.50 | 325.21 | -7% || 1.18 | 1.22 | +3% | 0.3353 |
+| 6a || 161.91 | 133.10 | -18% || 1.18 | 1.22 | +4% | 0.0662 |
+| 6b || 229.00 | 190.29 | -17% || 1.18 | 1.22 | +4% | 0.0331 |
+| 6c || 120.14 | 107.76 | -10% || 1.18 | 1.22 | +4% | 0.2442 |
| 6d || 573.43 | 576.37 | +1% || 1.18 | 1.22 | +4% | 0.9224 |
+| 6e || 154.70 | 114.54 | -26% || 1.18 | 1.22 | +4% | 0.0008 |
| 6f || 1253.69 | 1244.20 | -1% || 1.18 | 1.22 | +4% | 0.7666 |
-| 7a || 165.54 | 183.17 | +11% || 1.18 | 1.22 | +4% | 0.3430 |
-| 7b || 167.67 | 193.02 | +15% || 1.18 | 1.22 | +3% | 0.1795 |
| 7c || 1073.04 | 1100.90 | +3% || 1.18 | 1.22 | +4% | 0.4503 |
+| 8a || 218.28 | 206.93 | -5% || 1.18 | 1.22 | +4% | 0.6005 |
+| 8b || 160.39 | 150.47 | -6% || 1.18 | 1.22 | +4% | 0.6106 |
| 8c || 2396.25 | 2357.72 | -2% || 1.18 | 1.22 | +4% | 0.3613 |
| 8d || 891.97 | 869.90 | -2% || 1.18 | 1.22 | +3% | 0.4233 |
+| 9a || 709.94 | 659.94 | -7% || 1.18 | 1.22 | +4% | 0.1218 |
| 9b || 379.06 | 380.35 | +0% || 1.18 | 1.22 | +4% | 0.9555 |
| 9c || 810.26 | 797.51 | -2% || 1.18 | 1.22 | +3% | 0.7326 |
| 9d || 1152.33 | 1174.02 | +2% || 1.18 | 1.22 | +4% | 0.5557 |
+---------++----------+----------+--------++----------+----------+--------+---------+
| Sum || 54251.56 | 52340.34 | -4% || | | | |
| Geomean || | | || | | +4% | |
+---------++----------+----------+--------++----------+----------+--------+---------+hyriseBenchmarkStarSchema - single-threaded Sum of avg. item runtimes: +9% || Geometric mean of throughput changes: -12%Configuration Overview - click to expand +Configuration Overview---+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkStarSchema_0bcfa0250faed47181d2591d19daefc98bfcd5a4_st.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkStarSchema_704bc3145cfcc51bcb4cbda8ae7ee2387e67fc94_st.json |
+-------------------------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4-dirty | 704bc3145cfcc51bcb4cbda8ae7ee2387e67fc94-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 15:16:50 | 2025-06-06 10:27:51 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+ +---------++----------+---------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
-| 1.1 || 418.70 | 606.29 | +45%˄ || 2.39 | 1.65 | -31%˄ | (run time too short) |
-| 1.2 || 231.42 | 653.26 | +182%˄ || 4.32 | 1.53 | -65%˄ | (run time too short) |
-| 1.3 || 226.28 | 657.21 | +190%˄ || 4.42 | 1.52 | -66%˄ | (run time too short) |
+| 2.1 || 512.39 | 415.39 | -19%˄ || 1.95 | 2.41 | +23%˄ | (run time too short) |
+| 2.2 || 279.38 | 208.26 | -25%˄ || 3.58 | 4.80 | +34%˄ | (run time too short) |
+| 2.3 || 175.89 | 122.98 | -30%˄ || 5.69 | 8.13 | +43%˄ | (run time too short) |
| 3.1 || 2621.47 | 2681.70 | +2% || 0.37 | 0.37 | +0% | (run time too short) |
+| 3.2 || 286.32 | 268.82 | -6%˄ || 3.49 | 3.72 | +7%˄ | (run time too short) |
-| 3.3 || 117.36 | 128.59 | +10%˄ || 8.52 | 7.78 | -9%˄ | (run time too short) |
-| 3.4 || 110.91 | 126.14 | +14%˄ || 9.02 | 7.93 | -12%˄ | (run time too short) |
+| 4.1 || 2454.42 | 2330.92 | -5% || 0.40 | 0.42 | +4% | (run time too short) |
+| 4.2 || 778.59 | 741.64 | -5%˄ || 1.28 | 1.35 | +5%˄ | (run time too short) |
| 4.3 || 214.97 | 212.79 | -1%˄ || 4.65 | 4.70 | +1%˄ | (run time too short) |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
-| Sum || 8428.10 | 9153.98 | +9% || | | | |
-| Geomean || | | || | | -12% | |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+---------+--------++----------+----------+--------+----------------------+hyriseBenchmarkStarSchema - multi-threaded, ordered, 1 client, 64 cores Sum of avg. item runtimes: +3% || Geometric mean of throughput changes: -9%Configuration Overview - click to expand +Configuration Overview---------+----------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkStarSchema_0bcfa0250faed47181d2591d19daefc98bfcd5a4_mt_ordered.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkStarSchema_704bc3145cfcc51bcb4cbda8ae7ee2387e67fc94_mt_ordered.json |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4-dirty | 704bc3145cfcc51bcb4cbda8ae7ee2387e67fc94-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 15:25:47 | 2025-06-06 10:37:25 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------+ +---------++----------+---------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
-| 1.1 || 127.14 | 164.70 | +30%˄ || 7.86 | 6.07 | -23%˄ | (run time too short) |
-| 1.2 || 83.90 | 163.15 | +94%˄ || 11.91 | 6.13 | -49%˄ | (run time too short) |
-| 1.3 || 80.81 | 160.96 | +99%˄ || 12.37 | 6.21 | -50%˄ | (run time too short) |
| 2.1 || 329.47 | 317.19 | -4%˄ || 3.03 | 3.15 | +4%˄ | (run time too short) |
+| 2.2 || 156.14 | 147.05 | -6%˄ || 6.40 | 6.80 | +6%˄ | (run time too short) |
+| 2.3 || 63.94 | 52.92 | -17%˄ || 15.63 | 18.88 | +21%˄ | (run time too short) |
+| 3.1 || 805.70 | 759.63 | -6%˄ || 1.24 | 1.32 | +6%˄ | (run time too short) |
+| 3.2 || 150.06 | 142.25 | -5%˄ || 6.66 | 7.03 | +5%˄ | (run time too short) |
| 3.3 || 77.71 | 76.58 | -1%˄ || 12.86 | 13.05 | +1%˄ | (run time too short) |
| 3.4 || 69.96 | 71.54 | +2%˄ || 14.29 | 13.97 | -2%˄ | (run time too short) |
| 4.1 || 867.68 | 836.57 | -4%˄ || 1.15 | 1.20 | +4%˄ | (run time too short) |
| 4.2 || 348.80 | 352.07 | +1%˄ || 2.87 | 2.84 | -1%˄ | (run time too short) |
| 4.3 || 111.56 | 113.69 | +2%˄ || 8.96 | 8.79 | -2%˄ | (run time too short) |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| Sum || 3272.85 | 3358.29 | +3% || | | | |
-| Geomean || | | || | | -9% | |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+---------+--------++----------+----------+--------+----------------------+hyriseBenchmarkStarSchema - multi-threaded, shuffled, 64 clients, 64 cores Sum of avg. item runtimes: -5% || Geometric mean of throughput changes: +5%Configuration Overview - click to expand +Configuration Overview---------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkStarSchema_0bcfa0250faed47181d2591d19daefc98bfcd5a4_mt.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkStarSchema_704bc3145cfcc51bcb4cbda8ae7ee2387e67fc94_mt.json |
+-------------------------------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4-dirty | 704bc3145cfcc51bcb4cbda8ae7ee2387e67fc94-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 15:29:06 | 2025-06-06 10:40:51 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+---------+
+| 1.1 || 844.00 | 836.31 | -1% || 3.74 | 3.94 | +5% | 0.6722 |
+| 1.2 || 463.76 | 550.56 | +19% || 3.74 | 3.94 | +5% | 0.0000 |
+| 1.3 || 421.70 | 516.46 | +22% || 3.74 | 3.94 | +5% | 0.0000 |
+| 2.1 || 2110.74 | 1909.75 | -10% || 3.74 | 3.94 | +5% | 0.0000 |
+| 2.2 || 1110.95 | 941.54 | -15% || 3.74 | 3.94 | +5% | 0.0000 |
+| 2.3 || 382.51 | 287.25 | -25% || 3.74 | 3.94 | +5% | 0.0000 |
+| 3.1 || 3280.39 | 3202.43 | -2% || 3.73 | 3.93 | +5% | 0.0179 |
+| 3.2 || 978.05 | 879.99 | -10% || 3.74 | 3.94 | +5% | 0.0000 |
+| 3.3 || 474.81 | 426.17 | -10% || 3.74 | 3.94 | +5% | 0.0011 |
+| 3.4 || 466.32 | 442.71 | -5% || 3.74 | 3.94 | +5% | 0.1336 |
+| 4.1 || 3310.98 | 3105.99 | -6% || 3.73 | 3.93 | +5% | 0.0000 |
+| 4.2 || 2493.69 | 2394.84 | -4% || 3.73 | 3.94 | +5% | 0.0036 |
+| 4.3 || 752.92 | 711.98 | -5% || 3.74 | 3.94 | +5% | 0.0412 |
+---------++----------+----------+--------++----------+----------+--------+---------+
+| Sum || 17090.81 | 16205.99 | -5% || | | | |
+| Geomean || | | || | | +5% | |
+---------++----------+----------+--------++----------+----------+--------+---------+ |
Nicer: So it's nice for almost all benchmarks, apart from JOB, where things just blow up. |
|
I'm assuming JOB means Join Order Benchmark. I think that your results may not be useful, because you tested against a commit with FixedStringDictionary. I did run a benchmark with the latest commit (everything dictionary) and will do another run today with the second latest commit (int as FOR). I kept FSD and FOR in, so the CI would run all tests and check whether there is still a place where we implicitly assume dictionary encoding. |
|
This is the benchmark comparing all dictionary auto to master. System cx28 - click to expand
Commit Info and Build Time
hyriseBenchmarkTPCH - single-threaded, SF 10.0 Sum of avg. item runtimes: -8% || Geometric mean of throughput changes: +3%Configuration Overview - click to expand +Configuration Overview----+---------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkTPCH_0bcfa0250faed47181d2591d19daefc98bfcd5a4_st.json | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkTPCH_036d2ca7327d9f76b74cac0f821834d9638f9d3d_st.json |
+--------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4 | 036d2ca7327d9f76b74cac0f821834d9638f9d3d |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 17.0.6 | clang 17.0.6 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 14:02:10 | 2025-06-06 17:59:26 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+--------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------+ +----------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
-| TPC-H 01 || 5422.89 | 5905.77 | +9% || 0.18 | 0.17 | -9% | 0.0000 |
+| TPC-H 02 || 39.36 | 33.80 | -14%˄ || 25.40 | 29.58 | +16%˄ | (run time too short) |
| TPC-H 03 || 1294.83 | 1294.58 | -0% || 0.77 | 0.77 | +0% | 0.9805 |
-| TPC-H 04 || 1356.89 | 1432.31 | +6% || 0.73 | 0.68 | -7% | (run time too short) |
| TPC-H 05 || 2236.68 | 2197.09 | -2% || 0.43 | 0.45 | +4% | (run time too short) |
-| TPC-H 06 || 181.11 | 190.06 | +5%˄ || 5.52 | 5.26 | -5%˄ | (run time too short) |
| TPC-H 07 || 707.54 | 718.18 | +2%˄ || 1.41 | 1.39 | -1%˄ | (run time too short) |
| TPC-H 08 || 532.68 | 524.82 | -1%˄ || 1.88 | 1.91 | +1%˄ | (run time too short) |
+| TPC-H 09 || 6299.40 | 5874.61 | -7% || 0.15 | 0.17 | +11% | (run time too short) |
| TPC-H 10 || 1347.49 | 1304.81 | -3% || 0.73 | 0.75 | +2% | (run time too short) |
| TPC-H 11 || 48.29 | 49.80 | +3%˄ || 20.71 | 20.08 | -3%˄ | (run time too short) |
+| TPC-H 12 || 939.77 | 887.34 | -6%˄ || 1.06 | 1.13 | +6%˄ | (run time too short) |
+| TPC-H 13 || 6853.85 | 4132.06 | -40% || 0.13 | 0.23 | +75% | (run time too short) |
| TPC-H 14 || 495.60 | 500.36 | +1%˄ || 2.02 | 2.00 | -1%˄ | (run time too short) |
-| TPC-H 15 || 179.73 | 190.85 | +6%˄ || 5.56 | 5.24 | -6%˄ | (run time too short) |
| TPC-H 16 || 515.76 | 502.19 | -3%˄ || 1.94 | 1.99 | +3%˄ | (run time too short) |
| TPC-H 17 || 218.98 | 213.55 | -2%˄ || 4.57 | 4.68 | +3%˄ | (run time too short) |
-| TPC-H 18 || 1462.69 | 1534.47 | +5% || 0.68 | 0.65 | -5% | 0.0003 |
-| TPC-H 19 || 215.89 | 230.49 | +7%˄ || 4.63 | 4.34 | -6%˄ | (run time too short) |
| TPC-H 20 || 398.49 | 381.59 | -4%˄ || 2.51 | 2.62 | +4%˄ | (run time too short) |
+| TPC-H 21 || 4234.50 | 3898.31 | -8% || 0.23 | 0.25 | +7% | (run time too short) |
| TPC-H 22 || 497.87 | 495.91 | -0%˄ || 2.01 | 2.02 | +0%˄ | (run time too short) |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
+| Sum || 35480.29 | 32492.93 | -8% || | | | |
| Geomean || | | || | | +3% | |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+----------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCH - single-threaded, SF 0.01 Sum of avg. item runtimes: -3% || Geometric mean of throughput changes: +2%Configuration Overview - click to expand +Configuration Overview----+-------------------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkTPCH_0bcfa0250faed47181d2591d19daefc98bfcd5a4_st_s01.json | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkTPCH_036d2ca7327d9f76b74cac0f821834d9638f9d3d_st_s01.json |
+--------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4 | 036d2ca7327d9f76b74cac0f821834d9638f9d3d |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 17.0.6 | clang 17.0.6 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 14:18:56 | 2025-06-06 18:14:57 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 0.009999999776482582 | 0.009999999776482582 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+--------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------+ +----------++----------+---------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+----------++----------+---------+--------++----------+----------+--------+----------------------+
| TPC-H 01 || 5.25 | 5.29 | +1%˄ || 190.35 | 188.95 | -1%˄ | (run time too short) |
| TPC-H 02 || 3.32 | 3.30 | -1%˄ || 301.07 | 302.68 | +1%˄ | (run time too short) |
+| TPC-H 03 || 0.57 | 0.54 | -5%˄ || 1750.61 | 1842.29 | +5%˄ | (run time too short) |
+| TPC-H 04 || 0.37 | 0.35 | -5%˄ || 2709.52 | 2864.87 | +6%˄ | (run time too short) |
| TPC-H 05 || 0.92 | 0.91 | -1%˄ || 1082.59 | 1096.10 | +1%˄ | (run time too short) |
+| TPC-H 06 || 0.21 | 0.20 | -6%˄ || 4811.19 | 5101.86 | +6%˄ | (run time too short) |
+| TPC-H 07 || 9.20 | 8.69 | -6%˄ || 108.72 | 115.12 | +6%˄ | (run time too short) |
| TPC-H 08 || 13.50 | 13.10 | -3%˄ || 74.09 | 76.34 | +3%˄ | (run time too short) |
+| TPC-H 09 || 2.81 | 2.68 | -5%˄ || 355.27 | 373.46 | +5%˄ | (run time too short) |
+| TPC-H 10 || 0.65 | 0.62 | -4%˄ || 1528.13 | 1599.62 | +5%˄ | (run time too short) |
| TPC-H 11 || 0.17 | 0.17 | -2%˄ || 5809.53 | 5905.21 | +2%˄ | (run time too short) |
| TPC-H 12 || 0.62 | 0.61 | -2%˄ || 1619.04 | 1648.62 | +2%˄ | (run time too short) |
+| TPC-H 13 || 2.10 | 1.94 | -8%˄ || 476.23 | 515.89 | +8%˄ | (run time too short) |
| TPC-H 14 || 0.30 | 0.29 | -1%˄ || 3372.93 | 3411.49 | +1%˄ | (run time too short) |
| TPC-H 15 || 1.07 | 1.06 | -1%˄ || 930.46 | 938.65 | +1%˄ | (run time too short) |
| TPC-H 16 || 1.88 | 1.87 | -1%˄ || 530.15 | 535.78 | +1%˄ | (run time too short) |
-| TPC-H 17 || 0.46 | 0.55 | +19%˄ || 2149.85 | 1802.55 | -16%˄ | (run time too short) |
+| TPC-H 18 || 1.15 | 0.98 | -15%˄ || 870.35 | 1021.14 | +17%˄ | (run time too short) |
| TPC-H 19 || 4.33 | 4.31 | -1%˄ || 230.70 | 231.88 | +1%˄ | (run time too short) |
| TPC-H 20 || 2.24 | 2.31 | +3%˄ || 446.62 | 432.13 | -3%˄ | (run time too short) |
| TPC-H 21 || 1.04 | 1.02 | -2%˄ || 959.67 | 978.22 | +2%˄ | (run time too short) |
| TPC-H 22 || 1.06 | 1.06 | -1%˄ || 937.82 | 945.64 | +1%˄ | (run time too short) |
+----------++----------+---------+--------++----------+----------+--------+----------------------+
| Sum || 53.23 | 51.84 | -3% || | | | |
| Geomean || | | || | | +2% | |
+----------++----------+---------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+----------++----------+---------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCH - multi-threaded, ordered, 1 client, 64 cores, SF 10.0 Sum of avg. item runtimes: -12% || Geometric mean of throughput changes: +7%Configuration Overview - click to expand +Configuration Overview---------+-----------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkTPCH_0bcfa0250faed47181d2591d19daefc98bfcd5a4_mt_ordered.json | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkTPCH_036d2ca7327d9f76b74cac0f821834d9638f9d3d_mt_ordered.json |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4 | 036d2ca7327d9f76b74cac0f821834d9638f9d3d |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 17.0.6 | clang 17.0.6 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 14:19:24 | 2025-06-06 18:15:22 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------+ +----------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| TPC-H 01 || 4665.08 | 4667.22 | +0% || 0.20 | 0.20 | +0% | (run time too short) |
+| TPC-H 02 || 58.34 | 55.59 | -5%˄ || 17.13 | 17.98 | +5%˄ | (run time too short) |
| TPC-H 03 || 643.33 | 628.91 | -2%˄ || 1.55 | 1.59 | +2%˄ | (run time too short) |
| TPC-H 04 || 640.16 | 623.27 | -3%˄ || 1.56 | 1.60 | +3%˄ | (run time too short) |
+| TPC-H 05 || 600.11 | 558.62 | -7%˄ || 1.67 | 1.79 | +7%˄ | (run time too short) |
| TPC-H 06 || 65.76 | 64.61 | -2%˄ || 15.20 | 15.47 | +2%˄ | (run time too short) |
| TPC-H 07 || 252.82 | 243.81 | -4%˄ || 3.95 | 4.10 | +4%˄ | (run time too short) |
| TPC-H 08 || 234.03 | 225.83 | -4%˄ || 4.27 | 4.43 | +4%˄ | (run time too short) |
| TPC-H 09 || 2167.59 | 2077.44 | -4% || 0.45 | 0.47 | +4% | (run time too short) |
+| TPC-H 10 || 613.46 | 570.85 | -7%˄ || 1.63 | 1.75 | +7%˄ | (run time too short) |
| TPC-H 11 || 68.13 | 69.18 | +2%˄ || 14.67 | 14.45 | -2%˄ | (run time too short) |
+| TPC-H 12 || 499.17 | 454.60 | -9%˄ || 2.00 | 2.20 | +10%˄ | (run time too short) |
+| TPC-H 13 || 3509.13 | 1606.91 | -54% || 0.28 | 0.62 | +118% | 0.0000 |
| TPC-H 14 || 153.28 | 151.75 | -1%˄ || 6.52 | 6.59 | +1%˄ | (run time too short) |
| TPC-H 15 || 135.01 | 134.80 | -0%˄ || 7.40 | 7.42 | +0%˄ | (run time too short) |
| TPC-H 16 || 575.50 | 552.71 | -4%˄ || 1.74 | 1.81 | +4%˄ | (run time too short) |
| TPC-H 17 || 88.01 | 88.11 | +0%˄ || 11.36 | 11.34 | -0%˄ | (run time too short) |
| TPC-H 18 || 1669.52 | 1679.54 | +1% || 0.58 | 0.58 | +0% | (run time too short) |
| TPC-H 19 || 110.10 | 109.24 | -1%˄ || 9.08 | 9.15 | +1%˄ | (run time too short) |
| TPC-H 20 || 194.98 | 191.69 | -2%˄ || 5.13 | 5.22 | +2%˄ | (run time too short) |
+| TPC-H 21 || 1126.86 | 1056.58 | -6%˄ || 0.89 | 0.95 | +7%˄ | (run time too short) |
| TPC-H 22 || 162.14 | 156.46 | -3%˄ || 6.17 | 6.39 | +4%˄ | (run time too short) |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
+| Sum || 18232.49 | 15967.72 | -12% || | | | |
+| Geomean || | | || | | +7% | |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+----------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCH - multi-threaded, shuffled, 64 clients, 64 cores, SF 10.0 Sum of avg. item runtimes: -6% || Geometric mean of throughput changes: +6%Configuration Overview - click to expand +Configuration Overview---------+---------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkTPCH_0bcfa0250faed47181d2591d19daefc98bfcd5a4_mt.json | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkTPCH_036d2ca7327d9f76b74cac0f821834d9638f9d3d_mt.json |
+-------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4 | 036d2ca7327d9f76b74cac0f821834d9638f9d3d |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| clustering | None | None |
| compiler | clang 17.0.6 | clang 17.0.6 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 14:31:03 | 2025-06-06 18:26:40 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------+ +----------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+----------++----------+----------+--------++----------+----------+--------+---------+
+| TPC-H 01 || 6109.26 | 6124.29 | +0% || 1.04 | 1.11 | +6% | 0.8441 |
+| TPC-H 02 || 409.00 | 488.29 | +19% || 1.05 | 1.11 | +6% | 0.1574 |
+| TPC-H 03 || 2872.95 | 2779.71 | -3% || 1.04 | 1.11 | +6% | 0.4603 |
+| TPC-H 04 || 2421.91 | 2319.29 | -4% || 1.04 | 1.11 | +6% | 0.3660 |
+| TPC-H 05 || 4292.99 | 4110.18 | -4% || 1.04 | 1.11 | +6% | 0.2573 |
+| TPC-H 06 || 833.94 | 768.87 | -8% || 1.04 | 1.11 | +6% | 0.3403 |
+| TPC-H 07 || 3437.09 | 3488.75 | +2% || 1.05 | 1.11 | +6% | 0.7640 |
+| TPC-H 08 || 2469.48 | 2452.47 | -1% || 1.04 | 1.11 | +6% | 0.9027 |
+| TPC-H 09 || 6114.92 | 6250.98 | +2% || 1.04 | 1.11 | +6% | 0.4499 |
+| TPC-H 10 || 3629.40 | 3510.11 | -3% || 1.04 | 1.11 | +6% | 0.4267 |
+| TPC-H 11 || 507.86 | 529.27 | +4% || 1.05 | 1.11 | +6% | 0.7089 |
+| TPC-H 12 || 2703.76 | 2525.96 | -7% || 1.04 | 1.11 | +6% | 0.1462 |
+| TPC-H 13 || 6839.90 | 3894.67 | -43% || 1.04 | 1.11 | +7% | 0.0000 |
+| TPC-H 14 || 1135.32 | 1163.76 | +3% || 1.05 | 1.11 | +6% | 0.7266 |
+| TPC-H 15 || 657.70 | 725.70 | +10% || 1.05 | 1.11 | +6% | 0.2006 |
+| TPC-H 16 || 2307.96 | 2231.71 | -3% || 1.04 | 1.11 | +6% | 0.5191 |
+| TPC-H 17 || 884.03 | 820.33 | -7% || 1.05 | 1.11 | +6% | 0.4630 |
+| TPC-H 18 || 3708.35 | 3699.22 | -0% || 1.04 | 1.11 | +7% | 0.9279 |
+| TPC-H 19 || 1061.00 | 1077.41 | +2% || 1.05 | 1.11 | +6% | 0.8543 |
+| TPC-H 20 || 1852.47 | 1629.31 | -12% || 1.05 | 1.11 | +6% | 0.0535 |
+| TPC-H 21 || 5414.02 | 5412.10 | -0% || 1.04 | 1.11 | +6% | 0.9918 |
+| TPC-H 22 || 1142.43 | 1216.39 | +6% || 1.04 | 1.11 | +7% | 0.4558 |
+----------++----------+----------+--------++----------+----------+--------+---------+
+| Sum || 60805.76 | 57218.77 | -6% || | | | |
+| Geomean || | | || | | +6% | |
+----------++----------+----------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCDS - single-threaded Sum of avg. item runtimes: -10% || Geometric mean of throughput changes: +8%Configuration Overview - click to expand +Configuration Overview---+----------------------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkTPCDS_0bcfa0250faed47181d2591d19daefc98bfcd5a4_st.json | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkTPCDS_036d2ca7327d9f76b74cac0f821834d9638f9d3d_st.json |
+-------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4 | 036d2ca7327d9f76b74cac0f821834d9638f9d3d |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.6 | clang 17.0.6 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 14:52:31 | 2025-06-06 18:48:07 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| 01 || 219.19 | 213.96 | -2%˄ || 4.56 | 4.67 | +2%˄ | (run time too short) |
+| 03 || 62.71 | 36.42 | -42%˄ || 15.95 | 27.45 | +72%˄ | (run time too short) |
+| 06 || 197.57 | 162.04 | -18%˄ || 5.06 | 6.17 | +22%˄ | (run time too short) |
| 07 || 259.49 | 256.21 | -1%˄ || 3.85 | 3.90 | +1%˄ | (run time too short) |
| 09 || 719.86 | 739.99 | +3%˄ || 1.39 | 1.35 | -3%˄ | (run time too short) |
| 10 || 121.06 | 124.98 | +3%˄ || 8.26 | 8.00 | -3%˄ | (run time too short) |
| 13 || 460.82 | 462.38 | +0%˄ || 2.17 | 2.16 | -0%˄ | (run time too short) |
| 15 || 118.30 | 117.73 | -0%˄ || 8.45 | 8.49 | +0%˄ | (run time too short) |
| 16 || 56.10 | 54.23 | -3%˄ || 17.82 | 18.44 | +3%˄ | (run time too short) |
+| 17 || 320.03 | 258.62 | -19%˄ || 3.12 | 3.87 | +24%˄ | (run time too short) |
+| 19 || 98.37 | 87.12 | -11%˄ || 10.17 | 11.48 | +13%˄ | (run time too short) |
+| 25 || 167.87 | 144.09 | -14%˄ || 5.96 | 6.94 | +16%˄ | (run time too short) |
| 26 || 115.77 | 116.84 | +1%˄ || 8.64 | 8.56 | -1%˄ | (run time too short) |
| 28 || 595.07 | 582.15 | -2%˄ || 1.68 | 1.72 | +2%˄ | (run time too short) |
+| 29 || 474.79 | 428.79 | -10%˄ || 2.11 | 2.33 | +11%˄ | (run time too short) |
| 31 || 1288.16 | 1289.17 | +0% || 0.77 | 0.77 | +0% | 0.6558 |
| 32 || 30.20 | 29.28 | -3%˄ || 33.11 | 34.15 | +3%˄ | (run time too short) |
| 34 || 144.41 | 146.92 | +2%˄ || 6.92 | 6.81 | -2%˄ | (run time too short) |
| 35 || 599.36 | 601.16 | +0%˄ || 1.67 | 1.66 | -0%˄ | (run time too short) |
+| 37 || 712.65 | 679.42 | -5%˄ || 1.40 | 1.47 | +5%˄ | (run time too short) |
| 39a || 1630.41 | 1591.91 | -2% || 0.60 | 0.62 | +3% | (run time too short) |
+| 39b || 1631.15 | 1577.23 | -3% || 0.60 | 0.63 | +6% | (run time too short) |
-| 41 || 280.65 | 314.97 | +12%˄ || 3.56 | 3.17 | -11%˄ | (run time too short) |
+| 42 || 79.21 | 69.52 | -12%˄ || 12.62 | 14.38 | +14%˄ | (run time too short) |
| 43 || 942.06 | 958.70 | +2%˄ || 1.06 | 1.04 | -2%˄ | (run time too short) |
+| 45 || 124.32 | 102.71 | -17%˄ || 8.04 | 9.74 | +21%˄ | (run time too short) |
| 48 || 1030.33 | 1055.97 | +2%˄ || 0.97 | 0.95 | -2%˄ | (run time too short) |
+| 50 || 123.78 | 107.58 | -13%˄ || 8.08 | 9.29 | +15%˄ | (run time too short) |
+| 52 || 80.10 | 67.78 | -15%˄ || 12.48 | 14.75 | +18%˄ | (run time too short) |
+| 55 || 75.36 | 63.31 | -16%˄ || 13.27 | 15.79 | +19%˄ | (run time too short) |
| 62 || 528.47 | 537.21 | +2%˄ || 1.89 | 1.86 | -2%˄ | (run time too short) |
+| 65 || 1844.72 | 1747.67 | -5% || 0.53 | 0.57 | +6% | 0.0000 |
| 69 || 140.03 | 135.99 | -3%˄ || 7.14 | 7.35 | +3%˄ | (run time too short) |
| 73 || 78.23 | 75.40 | -4%˄ || 12.78 | 13.26 | +4%˄ | (run time too short) |
| 79 || 485.29 | 480.45 | -1%˄ || 2.06 | 2.08 | +1%˄ | (run time too short) |
| 81 || 151.09 | 150.14 | -1%˄ || 6.62 | 6.66 | +1%˄ | (run time too short) |
+| 82 || 758.13 | 712.75 | -6%˄ || 1.32 | 1.40 | +6%˄ | (run time too short) |
| 83 || 38.26 | 37.09 | -3%˄ || 26.13 | 26.96 | +3%˄ | (run time too short) |
| 84 || 13.83 | 14.15 | +2%˄ || 72.31 | 70.66 | -2%˄ | (run time too short) |
| 85 || 159.72 | 153.18 | -4%˄ || 6.26 | 6.53 | +4%˄ | (run time too short) |
| 88 || 642.62 | 626.39 | -3%˄ || 1.56 | 1.60 | +3%˄ | (run time too short) |
+| 91 || 17.61 | 16.40 | -7%˄ || 56.76 | 60.96 | +7%˄ | (run time too short) |
+| 92 || 35.28 | 26.37 | -25%˄ || 28.34 | 37.92 | +34%˄ | (run time too short) |
+| 93 || 3694.92 | 2124.82 | -42% || 0.27 | 0.47 | +75% | 0.0000 |
+| 94 || 35.25 | 33.25 | -6%˄ || 28.37 | 30.07 | +6%˄ | (run time too short) |
+| 95 || 4963.44 | 4647.08 | -6% || 0.20 | 0.20 | +0% | (run time too short) |
| 96 || 59.49 | 58.48 | -2%˄ || 16.81 | 17.10 | +2%˄ | (run time too short) |
+| 97 || 3881.09 | 3219.18 | -17% || 0.25 | 0.30 | +20% | (run time too short) |
| 99 || 1033.61 | 1045.47 | +1%˄ || 0.97 | 0.96 | -1%˄ | (run time too short) |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
+| Sum || 31320.20 | 28282.67 | -10% || | | | |
+| Geomean || | | || | | +8% | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCDS - multi-threaded, ordered, 1 client, 64 cores Sum of avg. item runtimes: -5% || Geometric mean of throughput changes: +3%Configuration Overview - click to expand +Configuration Overview---------+------------------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkTPCDS_0bcfa0250faed47181d2591d19daefc98bfcd5a4_mt_ordered.json | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkTPCDS_036d2ca7327d9f76b74cac0f821834d9638f9d3d_mt_ordered.json |
+-------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4 | 036d2ca7327d9f76b74cac0f821834d9638f9d3d |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.6 | clang 17.0.6 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 15:13:17 | 2025-06-06 19:06:41 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| 01 || 230.57 | 226.56 | -2%˄ || 4.34 | 4.41 | +2%˄ | (run time too short) |
+| 03 || 33.38 | 30.18 | -10%˄ || 29.93 | 33.09 | +11%˄ | (run time too short) |
+| 06 || 187.54 | 162.91 | -13%˄ || 5.33 | 6.14 | +15%˄ | (run time too short) |
| 07 || 184.59 | 184.37 | -0%˄ || 5.42 | 5.42 | +0%˄ | (run time too short) |
| 09 || 111.73 | 111.94 | +0%˄ || 8.95 | 8.93 | -0%˄ | (run time too short) |
| 10 || 36.53 | 36.06 | -1%˄ || 27.35 | 27.71 | +1%˄ | (run time too short) |
| 13 || 253.51 | 255.05 | +1%˄ || 3.94 | 3.92 | -1%˄ | (run time too short) |
| 15 || 73.76 | 72.39 | -2%˄ || 13.55 | 13.81 | +2%˄ | (run time too short) |
| 16 || 30.83 | 30.80 | -0%˄ || 32.40 | 32.43 | +0%˄ | (run time too short) |
+| 17 || 140.79 | 114.51 | -19%˄ || 7.10 | 8.73 | +23%˄ | (run time too short) |
| 19 || 70.53 | 69.63 | -1%˄ || 14.17 | 14.35 | +1%˄ | (run time too short) |
+| 25 || 102.04 | 88.79 | -13%˄ || 9.80 | 11.26 | +15%˄ | (run time too short) |
| 26 || 88.23 | 91.41 | +4%˄ || 11.33 | 10.94 | -3%˄ | (run time too short) |
| 28 || 147.36 | 149.45 | +1%˄ || 6.78 | 6.69 | -1%˄ | (run time too short) |
+| 29 || 441.60 | 390.12 | -12%˄ || 2.26 | 2.56 | +13%˄ | (run time too short) |
| 31 || 448.33 | 461.49 | +3%˄ || 2.23 | 2.17 | -3%˄ | (run time too short) |
+| 32 || 30.23 | 28.28 | -6%˄ || 33.04 | 35.31 | +7%˄ | (run time too short) |
| 34 || 94.59 | 92.49 | -2%˄ || 10.57 | 10.81 | +2%˄ | (run time too short) |
| 35 || 374.69 | 370.74 | -1%˄ || 2.67 | 2.70 | +1%˄ | (run time too short) |
+| 37 || 203.62 | 194.70 | -4%˄ || 4.91 | 5.14 | +5%˄ | (run time too short) |
+| 39a || 730.79 | 699.08 | -4%˄ || 1.37 | 1.43 | +5%˄ | (run time too short) |
+| 39b || 738.02 | 673.62 | -9%˄ || 1.35 | 1.48 | +10%˄ | (run time too short) |
-| 41 || 365.13 | 388.98 | +7%˄ || 2.74 | 2.57 | -6%˄ | (run time too short) |
| 42 || 49.39 | 49.02 | -1%˄ || 20.23 | 20.38 | +1%˄ | (run time too short) |
| 43 || 443.34 | 438.82 | -1%˄ || 2.26 | 2.28 | +1%˄ | (run time too short) |
| 45 || 53.87 | 54.33 | +1%˄ || 18.55 | 18.39 | -1%˄ | (run time too short) |
| 48 || 507.71 | 508.16 | +0%˄ || 1.97 | 1.97 | -0%˄ | (run time too short) |
| 50 || 102.46 | 106.83 | +4%˄ || 9.76 | 9.36 | -4%˄ | (run time too short) |
| 52 || 52.12 | 51.98 | -0%˄ || 19.17 | 19.22 | +0%˄ | (run time too short) |
-| 55 || 43.83 | 45.83 | +5%˄ || 22.80 | 21.80 | -4%˄ | (run time too short) |
+| 62 || 365.15 | 346.78 | -5%˄ || 2.74 | 2.88 | +5%˄ | (run time too short) |
| 65 || 1458.19 | 1439.80 | -1% || 0.68 | 0.68 | +0% | 0.0180 |
| 69 || 71.19 | 69.64 | -2%˄ || 14.04 | 14.35 | +2%˄ | (run time too short) |
| 73 || 54.37 | 53.81 | -1%˄ || 18.38 | 18.57 | +1%˄ | (run time too short) |
| 79 || 470.08 | 474.15 | +1%˄ || 2.13 | 2.11 | -1%˄ | (run time too short) |
| 81 || 172.02 | 173.38 | +1%˄ || 5.81 | 5.77 | -1%˄ | (run time too short) |
+| 82 || 233.32 | 219.45 | -6%˄ || 4.29 | 4.56 | +6%˄ | (run time too short) |
| 83 || 45.75 | 45.34 | -1%˄ || 21.84 | 22.04 | +1%˄ | (run time too short) |
| 84 || 10.10 | 9.70 | -4%˄ || 98.72 | 102.78 | +4%˄ | (run time too short) |
| 85 || 71.12 | 68.38 | -4%˄ || 14.05 | 14.62 | +4%˄ | (run time too short) |
| 88 || 82.15 | 81.13 | -1%˄ || 12.17 | 12.32 | +1%˄ | (run time too short) |
| 91 || 18.02 | 17.61 | -2%˄ || 55.39 | 56.68 | +2%˄ | (run time too short) |
+| 92 || 42.13 | 35.39 | -16%˄ || 23.72 | 28.23 | +19%˄ | (run time too short) |
+| 93 || 747.07 | 520.47 | -30%˄ || 1.34 | 1.92 | +44%˄ | (run time too short) |
| 94 || 30.68 | 31.73 | +3%˄ || 32.56 | 31.48 | -3%˄ | (run time too short) |
+| 95 || 706.69 | 668.16 | -5%˄ || 1.41 | 1.50 | +6%˄ | (run time too short) |
-| 96 || 45.11 | 47.37 | +5%˄ || 22.15 | 21.10 | -5%˄ | (run time too short) |
+| 97 || 1371.58 | 1285.96 | -6% || 0.72 | 0.77 | +7% | (run time too short) |
| 99 || 548.54 | 558.50 | +2%˄ || 1.82 | 1.79 | -2%˄ | (run time too short) |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
+| Sum || 12914.38 | 12325.25 | -5% || | | | |
| Geomean || | | || | | +3% | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCDS - multi-threaded, shuffled, 64 clients, 64 cores Sum of avg. item runtimes: -2% || Geometric mean of throughput changes: +2%Configuration Overview - click to expand +Configuration Overview---------+----------------------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkTPCDS_0bcfa0250faed47181d2591d19daefc98bfcd5a4_mt.json | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkTPCDS_036d2ca7327d9f76b74cac0f821834d9638f9d3d_mt.json |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4 | 036d2ca7327d9f76b74cac0f821834d9638f9d3d |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release
17AE
| release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| compiler | clang 17.0.6 | clang 17.0.6 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 15:25:11 | 2025-06-06 19:18:13 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+---------+
+| 01 || 882.57 | 760.55 | -14% || 1.00 | 1.03 | +2% | 0.0182 |
+| 03 || 274.22 | 238.60 | -13% || 1.00 | 1.03 | +2% | 0.1959 |
+| 06 || 945.98 | 780.18 | -18% || 1.00 | 1.03 | +3% | 0.0042 |
-| 07 || 989.76 | 1044.24 | +6% || 1.00 | 1.03 | +2% | 0.3426 |
| 09 || 912.29 | 896.62 | -2% || 1.00 | 1.03 | +2% | 0.8008 |
+| 10 || 754.29 | 719.50 | -5% || 1.00 | 1.03 | +2% | 0.5415 |
| 13 || 1751.93 | 1797.18 | +3% || 1.00 | 1.02 | +2% | 0.5720 |
| 15 || 554.26 | 551.75 | -0% || 1.00 | 1.03 | +2% | 0.9599 |
+| 16 || 475.55 | 418.95 | -12% || 1.00 | 1.03 | +2% | 0.2076 |
+| 17 || 1485.24 | 1326.08 | -11% || 1.00 | 1.03 | +2% | 0.0341 |
+| 19 || 679.25 | 631.21 | -7% || 1.00 | 1.03 | +2% | 0.2954 |
+| 25 || 1095.72 | 1030.02 | -6% || 1.00 | 1.03 | +2% | 0.3502 |
+| 26 || 533.16 | 497.64 | -7% || 1.00 | 1.03 | +2% | 0.4012 |
| 28 || 1584.73 | 1644.62 | +4% || 1.00 | 1.03 | +2% | 0.4979 |
+| 29 || 1845.81 | 1712.88 | -7% || 1.00 | 1.03 | +2% | 0.1021 |
| 31 || 2715.26 | 2733.12 | +1% || 1.00 | 1.03 | +2% | 0.8713 |
| 32 || 180.37 | 176.50 | -2% || 1.00 | 1.03 | +2% | 0.8983 |
| 34 || 776.93 | 792.20 | +2% || 1.00 | 1.03 | +2% | 0.7773 |
+| 35 || 2273.96 | 2132.69 | -6% || 1.00 | 1.03 | +2% | 0.0965 |
+| 37 || 941.45 | 886.77 | -6% || 1.00 | 1.03 | +2% | 0.2873 |
-| 39a || 2922.67 | 3067.35 | +5% || 1.00 | 1.02 | +2% | 0.1067 |
-| 39b || 2846.15 | 3036.57 | +7% || 1.00 | 1.03 | +2% | 0.0311 |
-| 41 || 1975.75 | 2134.95 | +8% || 1.00 | 1.03 | +2% | 0.0902 |
| 42 || 504.84 | 509.26 | +1% || 1.00 | 1.03 | +2% | 0.9267 |
| 43 || 1566.43 | 1553.14 | -1% || 1.00 | 1.03 | +2% | 0.8390 |
+| 45 || 811.23 | 723.55 | -11% || 1.00 | 1.03 | +2% | 0.1368 |
| 48 || 2714.26 | 2759.53 | +2% || 1.00 | 1.02 | +2% | 0.6602 |
| 50 || 1074.18 | 1099.53 | +2% || 1.00 | 1.03 | +2% | 0.6848 |
+| 52 || 494.02 | 425.94 | -14% || 1.00 | 1.03 | +2% | 0.0584 |
| 55 || 460.38 | 463.62 | +1% || 1.00 | 1.03 | +2% | 0.9308 |
| 62 || 1071.72 | 1044.19 | -3% || 1.00 | 1.03 | +2% | 0.6011 |
| 65 || 4433.73 | 4589.62 | +4% || 1.00 | 1.02 | +2% | 0.0152 |
+| 69 || 1111.69 | 990.95 | -11% || 1.00 | 1.03 | +2% | 0.0918 |
| 73 || 528.61 | 512.93 | -3% || 1.00 | 1.03 | +2% | 0.7128 |
-| 79 || 1546.82 | 1643.12 | +6% || 1.00 | 1.03 | +2% | 0.1256 |
-| 81 || 620.80 | 687.28 | +11% || 1.00 | 1.03 | +2% | 0.1032 |
+| 82 || 1038.98 | 954.46 | -8% || 1.00 | 1.03 | +2% | 0.1168 |
| 83 || 319.09 | 322.06 | +1% || 1.00 | 1.03 | +2% | 0.9356 |
| 84 || 129.00 | 123.87 | -4% || 1.00 | 1.03 | +2% | 0.7809 |
+| 85 || 925.81 | 883.11 | -5% || 1.00 | 1.03 | +2% | 0.5258 |
+| 88 || 2944.60 | 2616.65 | -11% || 1.00 | 1.03 | +2% | 0.0094 |
| 91 || 199.02 | 206.61 | +4% || 1.00 | 1.03 | +2% | 0.8027 |
+| 92 || 315.70 | 243.59 | -23% || 1.00 | 1.03 | +2% | 0.0272 |
+| 93 || 2307.39 | 1754.43 | -24% || 1.00 | 1.03 | +2% | 0.0000 |
-| 94 || 436.29 | 474.89 | +9% || 1.00 | 1.03 | +2% | 0.3792 |
| 95 || 2207.27 | 2173.79 | -2% || 1.00 | 1.03 | +2% | 0.6402 |
-| 96 || 438.50 | 472.94 | +8% || 1.00 | 1.03 | +2% | 0.4388 |
| 97 || 4567.30 | 4458.78 | -2% || 1.00 | 1.02 | +2% | 0.2820 |
-| 99 || 1361.01 | 1438.13 | +6% || 1.00 | 1.03 | +2% | 0.1346 |
+---------++----------+----------+--------++----------+----------+--------+---------+
| Sum || 63525.95 | 62136.14 | -2% || | | | |
| Geomean || | | || | | +2% | |
+---------++----------+----------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCC - single-threaded Sum of avg. item runtimes: -2% || Geometric mean of throughput changes: -1%Configuration Overview - click to expand +Configuration Overview---+---------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkTPCC_0bcfa0250faed47181d2591d19daefc98bfcd5a4_st.json | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkTPCC_036d2ca7327d9f76b74cac0f821834d9638f9d3d_st.json |
+-------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4 | 036d2ca7327d9f76b74cac0f821834d9638f9d3d |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.6 | clang 17.0.6 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 15:45:26 | 2025-06-06 19:38:29 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10 | 10 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------+ +--------------++----------+---------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+--------------++----------+---------+--------++----------+----------+--------+---------+
+| Delivery || 25.57 | 25.11 | -2% || 4.98 | 5.37 | +8% | 0.0000 |
| New-Order || 12.00 | 11.84 | -1% || 60.50 | 60.55 | +0% | 0.0515 |
-| Order-Status || 1.16 | 1.19 | +2% || 5.47 | 4.83 | -12% | 0.0001 |
| Payment || 2.22 | 2.22 | -0% || 57.25 | 58.93 | +3% | 0.4126 |
| Stock-Level || 1.95 | 1.89 | -3% || 5.27 | 5.22 | -1% | 0.0001 |
+--------------++----------+---------+--------++----------+----------+--------+---------+
| Sum || 42.91 | 42.25 | -2% || | | | |
| Geomean || | | || | | -1% | |
+--------------++----------+---------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCC - multi-threaded, shuffled, 64 clients, 10 warehouses, 64 cores (high contention) Sum of avg. item runtimes: +2% || Geometric mean of throughput changes: -2%Configuration Overview - click to expand +Configuration Overview---------+------------------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkTPCC_0bcfa0250faed47181d2591d19daefc98bfcd5a4_mt_highcont.json | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkTPCC_036d2ca7327d9f76b74cac0f821834d9638f9d3d_mt_highcont.json |
+-------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4 | 036d2ca7327d9f76b74cac0f821834d9638f9d3d |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| compiler | clang 17.0.6 | clang 17.0.6 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 15:53:11 | 2025-06-06 19:39:35 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 600000000000 | 600000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10 | 10 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ +--------------++----------+---------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+--------------++----------+---------+--------++----------+----------+--------+---------+
| Delivery || 184.20 | 188.26 | +2% || 33.23 | 32.46 | -2% | 0.0000 |
| unsucc.: || 3.45 | 3.45 | -0% || 50.16 | 49.01 | -2% | |
| New-Order || 95.02 | 96.96 | +2% || 466.09 | 455.99 | -2% | 0.0000 |
| unsucc.: || 8.50 | 8.79 | +3% || 467.99 | 460.65 | -2% | |
| Order-Status || 9.72 | 10.03 | +3% || 83.04 | 81.66 | -2% | 0.0081 |
| Payment || 16.05 | 16.34 | +2% || 234.83 | 230.28 | -2% | 0.0000 |
| unsucc.: || 5.51 | 5.63 | +2% || 659.03 | 648.06 | -2% | |
| Stock-Level || 14.15 | 14.42 | +2% || 82.71 | 81.04 | -2% | 0.1458 |
+--------------++----------+---------+--------++----------+----------+--------+---------+
| Sum || 319.14 | 326.01 | +2% || | | | |
| Geomean || | | || | | -2% | |
+--------------++----------+---------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCC - multi-threaded, shuffled, 10 clients, 10 warehouses, 64 cores (low contention) Sum of avg. item runtimes: -0% || Geometric mean of throughput changes: +0%Configuration Overview - click to expand +Configuration Overview---------+-----------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkTPCC_0bcfa0250faed47181d2591d19daefc98bfcd5a4_mt_lowcont.json | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkTPCC_036d2ca7327d9f76b74cac0f821834d9638f9d3d_mt_lowcont.json |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4 | 036d2ca7327d9f76b74cac0f821834d9638f9d3d |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 10 | 10 |
| compiler | clang 17.0.6 | clang 17.0.6 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 16:03:23 | 2025-06-06 19:49:47 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 600000000000 | 600000000000 |
| max_runs | -1 | -1
F438
|
| scale_factor | 10 | 10 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------+ +--------------++----------+---------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+--------------++----------+---------+--------++----------+----------+--------+---------+
| Delivery || 74.68 | 74.54 | -0% || 16.44 | 16.85 | +2% | 0.0664 |
| unsucc.: || 1.01 | 0.86 | -15% || 2.04 | 2.10 | +3% | |
| New-Order || 37.03 | 36.89 | -0% || 193.02 | 193.26 | +0% | 0.0014 |
| unsucc.: || 3.59 | 3.52 | -2% || 18.74 | 18.35 | -2% | |
| Order-Status || 4.10 | 4.12 | +1% || 18.56 | 18.74 | +1% | 0.0209 |
| Payment || 7.83 | 7.84 | +0% || 164.44 | 163.95 | -0% | 0.8501 |
| unsucc.: || 1.99 | 2.00 | +0% || 36.98 | 36.07 | -2% | |
| Stock-Level || 5.54 | 5.53 | -0% || 18.81 | 18.53 | -1% | 0.1919 |
+--------------++----------+---------+--------++----------+----------+--------+---------+
| Sum || 129.19 | 128.92 | -0% || | | | |
| Geomean || | | || | | +0% | |
+--------------++----------+---------+--------++----------+----------+--------+---------+hyriseBenchmarkJoinOrder - single-threaded Sum of avg. item runtimes: -6% || Geometric mean of throughput changes: +12%Configuration Overview - click to expand +Configuration Overview---+--------------------------------------------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkJoinOrder_0bcfa0250faed47181d2591d19daefc98bfcd5a4_st.json | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkJoinOrder_036d2ca7327d9f76b74cac0f821834d9638f9d3d_st.json |
+-------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4 | 036d2ca7327d9f76b74cac0f821834d9638f9d3d |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.6 | clang 17.0.6 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 16:14:24 | 2025-06-06 19:59:54 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
+| 10a || 146.00 | 99.28 | -32%˄ || 6.85 | 10.07 | +47%˄ | (run time too short) |
+| 10b || 94.50 | 59.58 | -37%˄ || 10.58 | 16.78 | +59%˄ | (run time too short) |
+| 10c || 353.62 | 316.50 | -10%˄ || 2.83 | 3.16 | +12%˄ | (run time too short) |
+| 11a || 29.46 | 26.39 | -10%˄ || 33.94 | 37.89 | +12%˄ | (run time too short) |
| 11b || 24.44 | 24.04 | -2%˄ || 40.92 | 41.59 | +2%˄ | (run time too short) |
+| 11c || 24.37 | 21.19 | -13%˄ || 41.03 | 47.18 | +15%˄ | (run time too short) |
+| 11d || 23.09 | 19.95 | -14%˄ || 43.30 | 50.13 | +16%˄ | (run time too short) |
+| 12a || 31.07 | 29.13 | -6%˄ || 32.18 | 34.33 | +7%˄ | (run time too short) |
+| 12b || 27.83 | 24.26 | -13%˄ || 35.93 | 41.22 | +15%˄ | (run time too short) |
+| 12c || 71.74 | 67.66 | -6%˄ || 13.94 | 14.78 | +6%˄ | (run time too short) |
| 13a || 179.85 | 172.61 | -4%˄ || 5.56 | 5.79 | +4%˄ | (run time too short) |
| 13b || 231.12 | 228.32 | -1%˄ || 4.33 | 4.38 | +1%˄ | (run time too short) |
| 13c || 31.71 | 30.42 | -4%˄ || 31.53 | 32.87 | +4%˄ | (run time too short) |
| 13d || 513.60 | 507.68 | -1%˄ || 1.95 | 1.97 | +1%˄ | (run time too short) |
+| 14a || 98.89 | 92.11 | -7%˄ || 10.11 | 10.86 | +7%˄ | (run time too short) |
| 14b || 107.13 | 104.61 | -2%˄ || 9.33 | 9.56 | +2%˄ | (run time too short) |
+| 14c || 177.62 | 168.46 | -5%˄ || 5.63 | 5.94 | +5%˄ | (run time too short) |
+| 15a || 74.40 | 49.68 | -33%˄ || 13.44 | 20.13 | +50%˄ | (run time too short) |
+| 15b || 78.10 | 54.43 | -30%˄ || 12.80 | 18.37 | +43%˄ | (run time too short) |
+| 15c || 49.99 | 39.53 | -21%˄ || 20.00 | 25.30 | +26%˄ | (run time too short) |
+| 15d || 47.41 | 36.34 | -23%˄ || 21.09 | 27.52 | +30%˄ | (run time too short) |
| 16a || 1390.33 | 1334.90 | -4% || 0.72 | 0.73 | +2% | (run time too short) |
| 16b || 2599.00 | 2504.42 | -4% || 0.38 | 0.38 | +0% | (run time too short) |
+| 16c || 1570.43 | 1497.16 | -5% || 0.63 | 0.67 | +5% | 0.0000 |
+| 16d || 1533.84 | 1461.69 | -5% || 0.65 | 0.68 | +5% | 0.0000 |
| 17a || 452.69 | 436.57 | -4%˄ || 2.21 | 2.29 | +4%˄ | (run time too short) |
| 17b || 359.65 | 352.13 | -2%˄ || 2.78 | 2.84 | +2%˄ | (run time too short) |
| 17c || 342.06 | 333.30 | -3%˄ || 2.92 | 3.00 | +3%˄ | (run time too short) |
+| 17d || 424.67 | 401.98 | -5%˄ || 2.35 | 2.49 | +6%˄ | (run time too short) |
+| 17e || 1639.24 | 1545.43 | -6% || 0.60 | 0.63 | +6% | (run time too short) |
+| 17f || 936.01 | 883.15 | -6%˄ || 1.07 | 1.13 | +6%˄ | (run time too short) |
+| 18a || 144.74 | 126.82 | -12%˄ || 6.91 | 7.88 | +14%˄ | (run time too short) |
| 18b || 105.80 | 102.78 | -3%˄ || 9.45 | 9.73 | +3%˄ | (run time too short) |
| 18c || 193.43 | 185.82 | -4%˄ || 5.17 | 5.38 | +4%˄ | (run time too short) |
| 19a || 220.00 | 215.20 | -2%˄ || 4.55 | 4.65 | +2%˄ | (run time too short) |
+| 19b || 191.08 | 174.66 | -9%˄ || 5.23 | 5.73 | +9%˄ | (run time too short) |
| 19c || 261.23 | 258.47 | -1%˄ || 3.83 | 3.87 | +1%˄ | (run time too short) |
| 19d || 718.26 | 713.63 | -1%˄ || 1.39 | 1.40 | +1%˄ | (run time too short) |
+| 1a || 10.09 | 6.98 | -31%˄ || 99.12 | 143.17 | +44%˄ | (run time too short) |
+| 1b || 16.17 | 13.62 | -16%˄ || 61.83 | 73.42 | +19%˄ | (run time too short) |
+| 1c || 21.34 | 14.20 | -33%˄ || 46.85 | 70.38 | +50%˄ | (run time too short) |
+| 1d || 9.45 | 6.44 | -32%˄ || 105.78 | 155.18 | +47%˄ | (run time too short) |
+| 20a || 563.48 | 512.17 | -9%˄ || 1.77 | 1.95 | +10%˄ | (run time too short) |
+| 20b || 613.00 | 550.54 | -10%˄ || 1.63 | 1.82 | +11%˄ | (run time too short) |
+| 20c || 432.29 | 356.47 | -18%˄ || 2.31 | 2.81 | +21%˄ | (run time too short) |
+| 21a || 41.12 | 38.34 | -7%˄ || 24.32 | 26.08 | +7%˄ | (run time too short) |
+| 21b || 33.79 | 29.97 | -11%˄ || 29.59 | 33.36 | +13%˄ | (run time too short) |
+| 21c || 37.59 | 34.30 | -9%˄ || 26.60 | 29.15 | +10%˄ | (run time too short) |
+| 22a || 180.09 | 160.85 | -11%˄ || 5.55 | 6.22 | +12%˄ | (run time too short) |
+| 22b || 163.62 | 143.66 | -12%˄ || 6.11 | 6.96 | +14%˄ | (run time too short) |
+| 22c || 242.96 | 218.70 | -10%˄ || 4.12 | 4.57 | +11%˄ | (run time too short) |
| 22d || 357.10 | 342.30 | -4%˄ || 2.80 | 2.92 | +4%˄ | (run time too short) |
+| 23a || 53.75 | 42.44 | -21%˄ || 18.60 | 23.56 | +27%˄ | (run time too short) |
+| 23b || 59.45 | 50.22 | -16%˄ || 16.82 | 19.91 | +18%˄ | (run time too short) |
+| 23c || 56.92 | 45.26 | -20%˄ || 17.57 | 22.09 | +26%˄ | (run time too short) |
| 24a || 216.97 | 215.86 | -1%˄ || 4.61 | 4.63 | +1%˄ | (run time too short) |
| 24b || 200.38 | 202.73 | +1%˄ || 4.99 | 4.93 | -1%˄ | (run time too short) |
| 25a || 102.72 | 98.77 | -4%˄ || 9.73 | 10.12 | +4%˄ | (run time too short) |
| 25b || 63.59 | 64.43 | +1%˄ || 15.72 | 15.52 | -1%˄ | (run time too short) |
+| 25c || 237.56 | 224.99 | -5%˄ || 4.21 | 4.44 | +6%˄ | (run time too short) |
+| 26a || 169.60 | 159.75 | -6%˄ || 5.90 | 6.26 | +6%˄ | (run time too short) |
+| 26b || 141.67 | 130.71 | -8%˄ || 7.06 | 7.65 | +8%˄ | (run time too short) |
+| 26c || 318.74 | 302.52 | -5%˄ || 3.14 | 3.31 | +5%˄ | (run time too short) |
+| 27a || 36.09 | 32.54 | -10%˄ || 27.70 | 30.72 | +11%˄ | (run time too short) |
+| 27b || 24.28 | 22.88 | -6%˄ || 41.18 | 43.70 | +6%˄ | (run time too short) |
+| 27c || 37.72 | 34.25 | -9%˄ || 26.51 | 29.19 | +10%˄ | (run time too short) |
+| 28a || 204.71 | 184.49 | -10%˄ || 4.88 | 5.42 | +11%˄ | (run time too short) |
+| 28b || 79.21 | 66.50 | -16%˄ || 12.62 | 15.04 | +19%˄ | (run time too short) |
+| 28c || 180.55 | 161.15 | -11%˄ || 5.54 | 6.21 | +12%˄ | (run time too short) |
| 29a || 176.54 | 179.42 | +2%˄ || 5.66 | 5.57 | -2%˄ | (run time too short) |
+| 29b || 912.21 | 741.08 | -19%˄ || 1.10 | 1.35 | +23%˄ | (run time too short) |
| 29c || 217.08 | 215.52 | -1%˄ || 4.61 | 4.64 | +1%˄ | (run time too short) |
+| 2a || 29.27 | 24.98 | -15%˄ || 34.16 | 40.02 | +17%˄ | (run time too short) |
+| 2b || 26.77 | 22.80 | -15%˄ || 37.36 | 43.86 | +17%˄ | (run time too short) |
+| 2c || 22.32 | 18.94 | -15%˄ || 44.79 | 52.79 | +18%˄ | (run time too short) |
+| 2d || 57.11 | 51.19 | -10%˄ || 17.51 | 19.53 | +12%˄ | (run time too short) |
| 30a || 88.62 | 85.00 | -4%˄ || 11.28 | 11.76 | +4%˄ | (run time too short) |
| 30b || 90.45 | 87.79 | -3%˄ || 11.05 | 11.39 | +3%˄ | (run time too short) |
+| 30c || 156.28 | 147.46 | -6%˄ || 6.40 | 6.78 | +6%˄ | (run time too short) |
| 31a || 77.90 | 75.31 | -3%˄ || 12.84 | 13.28 | +3%˄ | (run time too short) |
+| 31b || 82.84 | 74.40 | -10%˄ || 12.07 | 13.44 | +11%˄ | (run time too short) |
| 31c || 87.60 | 83.90 | -4%˄ || 11.42 | 11.92 | +4%˄ | (run time too short) |
+| 32a || 14.97 | 9.78 | -35%˄ || 66.77 | 102.25 | +53%˄ | (run time too short) |
+| 32b || 35.94 | 27.56 | -23%˄ || 27.82 | 36.28 | +30%˄ | (run time too short) |
+| 33a || 34.93 | 28.97 | -17%˄ || 28.63 | 34.51 | +21%˄ | (run time too short) |
+| 33b || 22.39 | 17.78 | -21%˄ || 44.66 | 56.25 | +26%˄ | (run time too short) |
+| 33c || 46.14 | 38.94 | -16%˄ || 21.67 | 25.68 | +18%˄ | (run time too short) |
+| 3a || 68.39 | 62.72 | -8%˄ || 14.62 | 15.94 | +9%˄ | (run time too short) |
+| 3b || 19.95 | 16.26 | -18%˄ || 50.11 | 61.47 | +23%˄ | (run time too short) |
+| 3c || 218.96 | 204.55 | -7%˄ || 4.57 | 4.89 | +7%˄ | (run time too short) |
+| 4a || 150.43 | 141.54 | -6%˄ || 6.65 | 7.06 | +6%˄ | (run time too short) |
+| 4b || 19.06 | 15.05 | -21%˄ || 52.47 | 66.42 | +27%˄ | (run time too short) |
+| 4c || 189.58 | 177.96 | -6%˄ || 5.27 | 5.62 | +7%˄ | (run time too short) |
+| 5a || 61.29 | 47.03 | -23%˄ || 16.31 | 21.26 | +30%˄ | (run time too short) |
+| 5b || 61.33 | 49.13 | -20%˄ || 16.30 | 20.35 | +25%˄ | (run time too short) |
+| 5c || 95.53 | 84.98 | -11%˄ || 10.47 | 11.77 | +12%˄ | (run time too short) |
+| 6a || 169.03 | 149.25 | -12%˄ || 5.92 | 6.70 | +13%˄ | (run time too short) |
+| 6b || 179.10 | 162.40 | -9%˄ || 5.58 | 6.16 | +10%˄ | (run time too short) |
+| 6c || 159.27 | 141.16 | -11%˄ || 6.28 | 7.08 | +13%˄ | (run time too short) |
+| 6d || 379.48 | 357.45 | -6%˄ || 2.64 | 2.80 | +6%˄ | (run time too short) |
+| 6e || 164.89 | 145.81 | -12%˄ || 6.06 | 6.86 | +13%˄ | (run time too short) |
| 6f || 701.68 | 677.61 | -3%˄ || 1.43 | 1.48 | +4%˄ | (run time too short) |
+| 7a || 91.63 | 81.77 | -11%˄ || 10.91 | 12.23 | +12%˄ | (run time too short) |
+| 7b || 85.20 | 77.57 | -9%˄ || 11.74 | 12.89 | +10%˄ | (run time too short) |
| 7c || 551.70 | 532.54 | -3%˄ || 1.81 | 1.88 | +4%˄ | (run time too short) |
+| 8a || 198.60 | 176.88 | -11%˄ || 5.04 | 5.65 | +12%˄ | (run time too short) |
+| 8b || 185.92 | 168.33 | -9%˄ || 5.38 | 5.94 | +10%˄ | (run time too short) |
| 8c || 1796.74 | 1740.66 | -3% || 0.55 | 0.57 | +3% | 0.0000 |
+| 8d || 480.75 | 442.48 | -8%˄ || 2.08 | 2.26 | +9%˄ | (run time too short) |
| 9a || 256.06 | 248.86 | -3%˄ || 3.91 | 4.02 | +3%˄ | (run time too short) |
+| 9b || 163.40 | 140.66 | -14%˄ || 6.12 | 7.11 | +16%˄ | (run time too short) |
| 9c || 306.58 | 298.73 | -3%˄ || 3.26 | 3.35 | +3%˄ | (run time too short) |
| 9d || 436.28 | 443.13 | +2%˄ || 2.29 | 2.26 | -2%˄ | (run time too short) |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
+| Sum || 29774.61 | 27883.69 | -6% || | | | |
+| Geomean || | | || | | +12% | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkJoinOrder - multi-threaded, ordered, 1 client, 64 cores Sum of avg. item runtimes: -2% || Geometric mean of throughput changes: +2%Configuration Overview - click to expand +Configuration Overview---------+----------------------------------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkJoinOrder_0bcfa0250faed47181d2591d19daefc98bfcd5a4_mt_ordered.json | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkJoinOrder_036d2ca7327d9f76b74cac0f821834d9638f9d3d_mt_ordered.json |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4 | 036d2ca7327d9f76b74cac0f821834d9638f9d3d |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.6 | clang 17.0.6 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0
10000
|
| date | 2025-06-06 16:39:20 | 2025-06-06 20:23:17 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| 10a || 37.73 | 37.24 | -1%˄ || 26.47 | 26.83 | +1%˄ | (run time too short) |
+| 10b || 18.29 | 17.48 | -4%˄ || 54.57 | 57.07 | +5%˄ | (run time too short) |
| 10c || 119.70 | 118.45 | -1%˄ || 8.35 | 8.44 | +1%˄ | (run time too short) |
| 11a || 10.68 | 10.26 | -4%˄ || 93.35 | 97.16 | +4%˄ | (run time too short) |
| 11b || 8.28 | 8.21 | -1%˄ || 120.29 | 121.33 | +1%˄ | (run time too short) |
| 11c || 22.90 | 22.51 | -2%˄ || 43.59 | 44.36 | +2%˄ | (run time too short) |
| 11d || 26.96 | 26.29 | -2%˄ || 37.04 | 37.98 | +3%˄ | (run time too short) |
| 12a || 21.24 | 20.73 | -2%˄ || 46.99 | 48.16 | +2%˄ | (run time too short) |
| 12b || 12.19 | 11.89 | -2%˄ || 81.79 | 83.82 | +2%˄ | (run time too short) |
| 12c || 50.75 | 49.63 | -2%˄ || 19.69 | 20.13 | +2%˄ | (run time too short) |
| 13a || 133.49 | 129.43 | -3%˄ || 7.49 | 7.72 | +3%˄ | (run time too short) |
| 13b || 91.15 | 90.07 | -1%˄ || 10.97 | 11.10 | +1%˄ | (run time too short) |
| 13c || 15.64 | 15.63 | -0%˄ || 63.77 | 63.84 | +0%˄ | (run time too short) |
| 13d || 370.55 | 360.37 | -3%˄ || 2.70 | 2.77 | +3%˄ | (run time too short) |
| 14a || 57.03 | 55.56 | -3%˄ || 17.52 | 17.99 | +3%˄ | (run time too short) |
| 14b || 71.11 | 71.19 | +0%˄ || 14.06 | 14.04 | -0%˄ | (run time too short) |
+| 14c || 117.34 | 111.97 | -5%˄ || 8.52 | 8.93 | +5%˄ | (run time too short) |
| 15a || 29.80 | 28.94 | -3%˄ || 33.52 | 34.51 | +3%˄ | (run time too short) |
| 15b || 24.60 | 24.53 | -0%˄ || 40.59 | 40.71 | +0%˄ | (run time too short) |
+| 15c || 22.60 | 21.59 | -4%˄ || 44.18 | 46.25 | +5%˄ | (run time too short) |
| 15d || 28.43 | 27.75 | -2%˄ || 35.13 | 35.99 | +2%˄ | (run time too short) |
| 16a || 825.53 | 807.31 | -2%˄ || 1.21 | 1.24 | +2%˄ | (run time too short) |
| 16b || 2048.09 | 1993.83 | -3% || 0.48 | 0.50 | +3% | 0.0000 |
| 16c || 988.49 | 956.10 | -3%˄ || 1.01 | 1.05 | +3%˄ | (run time too short) |
| 16d || 951.47 | 924.60 | -3%˄ || 1.05 | 1.08 | +3%˄ | (run time too short) |
| 17a || 187.65 | 181.12 | -3%˄ || 5.33 | 5.52 | +4%˄ | (run time too short) |
| 17b || 155.23 | 153.72 | -1%˄ || 6.44 | 6.50 | +1%˄ | (run time too short) |
| 17c || 130.82 | 130.71 | -0%˄ || 7.64 | 7.65 | +0%˄ | (run time too short) |
| 17d || 125.35 | 122.04 | -3%˄ || 7.98 | 8.19 | +3%˄ | (run time too short) |
| 17e || 821.77 | 802.71 | -2%˄ || 1.22 | 1.25 | +2%˄ | (run time too short) |
| 17f || 326.08 | 315.83 | -3%˄ || 3.07 | 3.17 | +3%˄ | (run time too short) |
| 18a || 52.62 | 50.79 | -3%˄ || 18.99 | 19.68 | +4%˄ | (run time too short) |
| 18b || 50.10 | 49.44 | -1%˄ || 19.95 | 20.21 | +1%˄ | (run time too short) |
| 18c || 97.10 | 100.77 | +4%˄ || 10.29 | 9.92 | -4%˄ | (run time too short) |
| 19a || 100.40 | 97.93 | -2%˄ || 9.96 | 10.21 | +3%˄ | (run time too short) |
| 19b || 62.56 | 60.54 | -3%˄ || 15.97 | 16.51 | +3%˄ | (run time too short) |
| 19c || 113.73 | 112.48 | -1%˄ || 8.79 | 8.89 | +1%˄ | (run time too short) |
| 19d || 524.91 | 520.33 | -1%˄ || 1.90 | 1.92 | +1%˄ | (run time too short) |
+| 1a || 6.36 | 6.06 | -5%˄ || 156.42 | 164.11 | +5%˄ | (run time too short) |
| 1b || 4.47 | 4.33 | -3%˄ || 222.07 | 229.34 | +3%˄ | (run time too short) |
+| 1c || 4.00 | 3.82 | -5%˄ || 248.10 | 259.75 | +5%˄ | (run time too short) |
| 1d || 4.95 | 4.75 | -4%˄ || 200.79 | 209.28 | +4%˄ | (run time too short) |
| 20a || 84.34 | 82.56 | -2%˄ || 11.85 | 12.11 | +2%˄ | (run time too short) |
| 20b || 74.90 | 73.88 | -1%˄ || 13.34 | 13.53 | +1%˄ | (run time too short) |
| 20c || 80.12 | 78.06 | -3%˄ || 12.48 | 12.80 | +3%˄ | (run time too short) |
| 21a || 16.74 | 16.40 | -2%˄ || 59.60 | 60.84 | +2%˄ | (run time too short) |
| 21b || 14.98 | 14.66 | -2%˄ || 66.62 | 68.07 | +2%˄ | (run time too short) |
| 21c || 18.71 | 18.15 | -3%˄ || 53.33 | 55.00 | +3%˄ | (run time too short) |
| 22a || 72.34 | 70.72 | -2%˄ || 13.82 | 14.13 | +2%˄ | (run time too short) |
| 22b || 53.00 | 52.61 | -1%˄ || 18.85 | 18.99 | +1%˄ | (run time too short) |
| 22c || 121.52 | 118.07 | -3%˄ || 8.23 | 8.47 | +3%˄ | (run time too short) |
| 22d || 220.92 | 212.68 | -4%˄ || 4.53 | 4.70 | +4%˄ | (run time too short) |
+| 23a || 16.46 | 15.39 | -6%˄ || 60.63 | 64.84 | +7%˄ | (run time too short) |
| 23b || 26.83 | 26.07 | -3%˄ || 37.23 | 38.30 | +3%˄ | (run time too short) |
+| 23c || 18.55 | 17.19 | -7%˄ || 53.80 | 58.05 | +8%˄ | (run time too short) |
| 24a || 59.95 | 60.58 | +1%˄ || 16.67 | 16.49 | -1%˄ | (run time too short) |
| 24b || 59.65 | 59.81 | +0%˄ || 16.75 | 16.71 | -0%˄ | (run time too short) |
| 25a || 57.44 | 55.99 | -3%˄ || 17.40 | 17.85 | +3%˄ | (run time too short) |
| 25b || 32.69 | 32.05 | -2%˄ || 30.55 | 31.17 | +2%˄ | (run time too short) |
| 25c || 156.64 | 154.31 | -1%˄ || 6.38 | 6.48 | +2%˄ | (run time too short) |
| 26a || 86.09 | 84.62 | -2%˄ || 11.61 | 11.81 | +2%˄ | (run time too short) |
| 26b || 63.96 | 62.51 | -2%˄ || 15.62 | 15.99 | +2%˄ | (run time too short) |
| 26c || 131.54 | 128.76 | -2%˄ || 7.60 | 7.76 | +2%˄ | (run time too short) |
| 27a || 19.62 | 19.22 | -2%˄ || 50.88 | 51.93 | +2%˄ | (run time too short) |
| 27b || 18.03 | 18.08 | +0%˄ || 55.34 | 55.20 | -0%˄ | (run time too short) |
| 27c || 18.21 | 17.59 | -3%˄ || 54.81 | 56.75 | +4%˄ | (run time too short) |
+| 28a || 124.97 | 119.28 | -5%˄ || 8.00 | 8.38 | +5%˄ | (run time too short) |
| 28b || 27.56 | 26.76 | -3%˄ || 36.23 | 37.32 | +3%˄ | (run time too short) |
+| 28c || 104.98 | 98.99 | -6%˄ || 9.52 | 10.10 | +6%˄ | (run time too short) |
| 29a || 52.38 | 53.53 | +2%˄ || 19.08 | 18.67 | -2%˄ | (run time too short) |
| 29b || 127.00 | 128.92 | +2%˄ || 7.87 | 7.75 | -1%˄ | (run time too short) |
| 29c || 65.23 | 65.27 | +0%˄ || 15.32 | 15.31 | -0%˄ | (run time too short) |
+| 2a || 22.48 | 21.19 | -6%˄ || 44.42 | 47.14 | +6%˄ | (run time too short) |
| 2b || 19.66 | 19.41 | -1%˄ || 50.79 | 51.44 | +1%˄ | (run time too short) |
| 2c || 13.86 | 13.41 | -3%˄ || 72.01 | 74.39 | +3%˄ | (run time too short) |
| 2d || 50.75 | 49.93 | -2%˄ || 19.69 | 20.01 | +2%˄ | (run time too short) |
| 30a || 48.49 | 46.46 | -4%˄ || 20.61 | 21.50 | +4%˄ | (run time too short) |
| 30b || 36.77 | 36.01 | -2%˄ || 27.17 | 27.74 | +2%˄ | (run time too short) |
+| 30c || 115.95 | 110.72 | -5%˄ || 8.62 | 9.03 | +5%˄ | (run time too short) |
| 31a || 38.45 | 37.88 | -1%˄ || 25.98 | 26.37 | +1%˄ | (run time too short) |
| 31b || 34.22 | 33.69 | -2%˄ || 29.19 | 29.65 | +2%˄ | (run time too short) |
| 31c || 42.64 | 41.80 | -2%˄ || 23.43 | 23.90 | +2%˄ | (run time too short) |
+| 32a || 6.42 | 6.01 | -6%˄ || 155.01 | 165.59 | +7%˄ | (run time too short) |
| 32b || 28.97 | 27.77 | -4%˄ || 34.47 | 35.97 | +4%˄ | (run time too short) |
| 33a || 10.52 | 10.21 | -3%˄ || 94.71 | 97.63 | +3%˄ | (run time too short) |
| 33b || 8.35 | 8.24 | -1%˄ || 119.21 | 120.82 | +1%˄ | (run time too short) |
| 33c || 18.46 | 17.79 | -4%˄ || 54.07 | 56.11 | +4%˄ | (run time too short) |
| 3a || 39.12 | 37.57 | -4%˄ || 25.54 | 26.59 | +4%˄ | (run time too short) |
| 3b || 6.41 | 6.36 | -1%˄ || 155.32 | 156.43 | +1%˄ | (run time too short) |
| 3c || 72.44 | 70.84 | -2%˄ || 13.80 | 14.11 | +2%˄ | (run time too short) |
| 4a || 65.37 | 65.15 | -0%˄ || 15.29 | 15.34 | +0%˄ | (run time too short) |
| 4b || 5.28 | 5.46 | +3%˄ || 188.17 | 182.03 | -3%˄ | (run time too short) |
| 4c || 87.30 | 84.11 | -4%˄ || 11.45 | 11.89 | +4%˄ | (run time too short) |
| 5a || 25.35 | 24.92 | -2%˄ || 39.40 | 40.06 | +2%˄ | (run time too short) |
| 5b || 20.19 | 20.31 | +1%˄ || 49.44 | 49.15 | -1%˄ | (run time too short) |
| 5c || 46.63 | 47.77 | +2%˄ || 21.43 | 20.91 | -2%˄ | (run time too short) |
| 6a || 28.63 | 29.30 | +2%˄ || 34.88 | 34.09 | -2%˄ | (run time too short) |
| 6b || 50.23 | 50.09 | -0%˄ || 19.89 | 19.95 | +0%˄ | (run time too short) |
| 6c || 27.13 | 27.35 | +1%˄ || 36.81 | 36.52 | -1%˄ | (run time too short) |
| 6d || 128.79 | 126.87 | -1%˄ || 7.76 | 7.88 | +2%˄ | (run time too short) |
| 6e || 28.52 | 29.54 | +4%˄ || 35.01 | 33.81 | -3%˄ | (run time too short) |
| 6f || 473.06 | 469.59 | -1%˄ || 2.11 | 2.13 | +1%˄ | (run time too short) |
| 7a || 27.39 | 27.27 | -0%˄ || 36.45 | 36.62 | +0%˄ | (run time too short) |
| 7b || 25.97 | 26.13 | +1%˄ || 38.45 | 38.22 | -1%˄ | (run time too short) |
| 7c || 256.90 | 255.85 | -0%˄ || 3.89 | 3.91 | +0%˄ | (run time too short) |
| 8a || 41.18 | 41.13 | -0%˄ || 24.26 | 24.29 | +0%˄ | (run time too short) |
| 8b || 39.57 | 39.89 | +1%˄ || 25.24 | 25.04 | -1%˄ | (run time too short) |
| 8c || 1118.72 | 1080.71 | -3%˄ || 0.89 | 0.93 | +4%˄ | (run time too short) |
| 8d || 274.74 | 265.01 | -4%˄ || 3.64 | 3.77 | +4%˄ | (run time too short) |
| 9a || 131.81 | 130.61 | -1%˄ || 7.58 | 7.65 | +1%˄ | (run time too short) |
| 9b || 74.07 | 72.58 | -2%˄ || 13.49 | 13.77 | +2%˄ | (run time too short) |
| 9c || 149.65 | 146.21 | -2%˄ || 6.68 | 6.84 | +2%˄ | (run time too short) |
| 9d || 359.00 | 356.37 | -1%˄ || 2.79 | 2.81 | +1%˄ | (run time too short) |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Sum || 14996.95 | 14659.08 | -2% || | | | |
| Geomean || | | || | | +2% | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkJoinOrder - multi-threaded, shuffled, 64 clients, 64 cores Sum of avg. item runtimes: -4% || Geometric mean of throughput changes: +4%Configuration Overview - click to expand +Configuration Overview---------+--------------------------------------------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkJoinOrder_0bcfa0250faed47181d2591d19daefc98bfcd5a4_mt.json | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkJoinOrder_036d2ca7327d9f76b74cac0f821834d9638f9d3d_mt.json |
+-------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4 | 036d2ca7327d9f76b74cac0f821834d9638f9d3d |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| compiler | clang 17.0.6 | clang 17.0.6 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 16:53:50 | 2025-06-06 20:37:31 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+---------+
| 10a || 186.80 | 189.08 | +1% || 1.17 | 1.22 | +4% | 0.8950 |
-| 10b || 132.92 | 154.40 | +16% || 1.18 | 1.22 | +4% | 0.1984 |
+| 10c || 703.35 | 646.15 | -8% || 1.17 | 1.22 | +4% | 0.0888 |
| 11a || 92.46 | 93.82 | +1% || 1.17 | 1.22 | +4% | 0.9223 |
+| 11b || 85.80 | 72.76 | -15% || 1.17 | 1.22 | +4% | 0.2164 |
+| 11c || 147.26 | 132.29 | -10% || 1.17 | 1.22 | +4% | 0.3340 |
+| 11d || 96.08 | 91.29 | -5% || 1.17 | 1.22 | +4% | 0.6194 |
-| 12a || 157.37 | 165.46 | +5% || 1.17 | 1.22 | +4% | 0.6168 |
+| 12b || 88.45 | 62.06 | -30% || 1.17 | 1.22 | +4% | 0.0052 |
+| 12c || 345.14 | 314.03 | -9% || 1.17 | 1.22 | +4% | 0.1234 |
| 13a || 491.23 | 472.52 | -4% || 1.17 | 1.22 | +4% | 0.4307 |
| 13b || 380.65 | 371.52 | -2% || 1.17 | 1.22 | +4% | 0.7094 |
| 13c || 85.18 | 83.35 | -2% || 1.17 | 1.22 | +4% | 0.8405 |
+| 13d || 949.89 | 888.60 | -6% || 1.17 | 1.22 | +4% | 0.0244 |
+| 14a || 464.95 | 437.96 | -6% || 1.17 | 1.22 | +4% | 0.3433 |
-| 14b || 420.64 | 464.78 | +10% || 1.17 | 1.22 | +4% | 0.1131 |
| 14c || 629.01 | 601.81 | -4% || 1.17 | 1.22 | +4% | 0.3695 |
+| 15a || 135.10 | 128.07 | -5% || 1.17 | 1.22 | +4% | 0.6424 |
+| 15b || 141.66 | 106.65 | -25% || 1.17 | 1.22 | +4% | 0.0407 |
+| 15c || 154.35 | 137.69 | -11% || 1.17 | 1.22 | +4% | 0.2495 |
+| 15d || 138.98 | 132.32 | -5% || 1.17 | 1.22 | +4% | 0.5505 |
| 16a || 1727.91 | 1676.81 | -3% || 1.17 | 1.22 | +4% | 0.2053 |
| 16b || 3335.17 | 3256.14 | -2% || 1.17 | 1.22 | +4% | 0.0819 |
| 16c || 2019.57 | 1944.83 | -4% || 1.17 | 1.22 | +4% | 0.0817 |
| 16d || 1969.79 | 1896.21 | -4% || 1.17 | 1.22 | +4% | 0.0843 |
| 17a || 888.25 | 900.18 | +1% || 1.17 | 1.22 | +4% | 0.7306 |
+| 17b || 713.31 | 642.03 | -10% || 1.17 | 1.22 | +4% | 0.0327 |
-| 17c || 624.30 | 652.43 | +5% || 1.17 | 1.22 | +4% | 0.3752 |
+| 17d || 647.79 | 607.54 | -6% || 1.17 | 1.22 | +4% | 0.2339 |
+| 17e || 1832.00 | 1748.70 | -5% || 1.17 | 1.22 | +4% | 0.0426 |
| 17f || 1250.75 | 1235.30 | -1% || 1.17 | 1.22 | +4% | 0.7116 |
+| 18a || 279.82 | 262.82 | -6% || 1.17 | 1.22 | +4% | 0.4275 |
+| 18b || 461.79 | 388.29 | -16% || 1.17 | 1.22 | +4% | 0.0190 |
+| 18c || 745.00 | 644.39 | -14% || 1.17 | 1.22 | +4% | 0.0125 |
| 19a || 620.10 | 595.48 | -4% || 1.17 | 1.22 | +4% | 0.4815 |
+| 19b || 434.22 | 405.62 | -7% || 1.17 | 1.22 | +4% | 0.3599 |
| 19c || 650.95 | 641.47 | -1% || 1.17 | 1.22 | +4% | 0.7706 |
| 19d || 1419.80 | 1414.64 | -0% || 1.17 | 1.22 | +4% | 0.8921 |
| 1a || 39.09 | 38.23 | -2% || 1.17 | 1.22 | +4% | 0.8931 |
+| 1b || 60.12 | 54.93 | -9% || 1.17 | 1.22 | +4% | 0.6089 |
-| 1c || 47.76 | 55.05 | +15% || 1.17 | 1.22 | +4% | 0.3921 |
+| 1d || 28.54 | 24.25 | -15% || 1.17 | 1.22 | +4% | 0.2259 |
-| 20a || 440.25 | 495.68 | +13% || 1.17 | 1.22 | +4% | 0.0452 |
+| 20b || 433.02 | 391.29 | -10% || 1.17 | 1.22 | +4% | 0.1131 |
| 20c || 428.53 | 410.16 | -4% || 1.17 | 1.22 | +4% | 0.4838 |
-| 21a || 165.11 | 185.36 | +12% || 1.17 | 1.22 | +4% | 0.2552 |
| 21b || 122.41 | 126.75 | +4% || 1.17 | 1.22 | +4% | 0.7605 |
+| 21c || 189.44 | 180.88 | -5% || 1.17 | 1.22 | +4% | 0.6792 |
+| 22a || 529.22 | 503.82 | -5% || 1.17 | 1.22 | +4% | 0.4323 |
| 22b || 440.87 | 435.17 | -1% || 1.17 | 1.22 | +4% | 0.8401 |
+| 22c || 703.96 | 669.15 | -5% || 1.17 | 1.22 | +4% | 0.2889 |
+| 22d || 1068.00 | 954.15 | -11% || 1.17 | 1.22 | +4% | 0.0100 |
+| 23a || 184.32 | 168.31 | -9% || 1.17 | 1.22 | +4% | 0.4389 |
| 23b || 140.42 | 134.34 | -4% || 1.17 | 1.22 | +4% | 0.6803 |
+| 23c || 170.80 | 156.45 | -8% || 1.17 | 1.22 | +4% | 0.3566 |
| 24a || 400.97 | 391.40 | -2% || 1.17 | 1.22 | +4% | 0.7179 |
+| 24b || 358.21 | 333.63 | -7% || 1.17 | 1.22 | +4% | 0.3952 |
+| 25a || 452.84 | 403.68 | -11% || 1.17 | 1.22 | +4% | 0.0945 |
-| 25b || 235.66 | 249.28 | +6% || 1.17 | 1.22 | +4% | 0.5469 |
+| 25c || 1002.49 | 884.62 | -12% || 1.17 | 1.22 | +4% | 0.0028 |
| 26a || 421.46 | 418.61 | -1% || 1.17 | 1.22 | +4% | 0.9017 |
+| 26b || 257.26 | 240.83 | -6% || 1.17 | 1.22 | +4% | 0.3448 |
| 26c || 666.71 | 650.49 | -2% || 1.17 | 1.22 | +4% | 0.5920 |
+| 27a || 178.33 | 169.70 | -5% || 1.17 | 1.22 | +4% | 0.6325 |
| 27b || 163.02 | 162.13 | -1% || 1.17 | 1.22 | +4% | 0.9622 |
| 27c || 208.14 | 209.16 | +0% || 1.17 | 1.22 | +4% | 0.9635 |
+| 28a || 704.22 | 652.65 | -7% || 1.17 | 1.22 | +4% | 0.1060 |
+| 28b || 311.10 | 235.50 | -24% || 1.17 | 1.22 | +4% | 0.0067 |
| 28c || 634.98 | 659.98 | +4% || 1.17 | 1.22 | +4% | 0.4438 |
-| 29a || 296.06 | 312.33 | +5% || 1.17 | 1.22 | +4% | 0.5250 |
| 29b || 374.41 | 376.22 | +0% || 1.17 | 1.22 | +4% | 0.9443 |
-| 29c || 380.23 | 413.76 | +9% || 1.17 | 1.22 | +4% | 0.2613 |
+| 2a || 151.13 | 118.99 | -21% || 1.17 | 1.22 | +4% | 0.0185 |
+| 2b || 133.67 | 102.57 | -23% || 1.17 | 1.22 | +4% | 0.0074 |
+| 2c || 123.06 | 79.64 | -35% || 1.17 | 1.22 | +4% | 0.0034 |
+| 2d || 240.95 | 197.85 | -18% || 1.17 | 1.22 | +4% | 0.
10000
0026 |
-| 30a || 344.19 | 367.70 | +7% || 1.17 | 1.22 | +4% | 0.3618 |
-| 30b || 336.51 | 375.44 | +12% || 1.17 | 1.22 | +4% | 0.1687 |
+| 30c || 756.76 | 677.75 | -10% || 1.17 | 1.22 | +4% | 0.0432 |
+| 31a || 302.44 | 277.10 | -8% || 1.17 | 1.22 | +4% | 0.3581 |
-| 31b || 266.63 | 278.73 | +5% || 1.17 | 1.22 | +4% | 0.6205 |
| 31c || 351.05 | 338.06 | -4% || 1.17 | 1.22 | +4% | 0.6557 |
+| 32a || 47.91 | 35.54 | -26% || 1.17 | 1.22 | +4% | 0.0281 |
+| 32b || 167.42 | 146.14 | -13% || 1.17 | 1.22 | +4% | 0.0859 |
+| 33a || 144.98 | 129.62 | -11% || 1.17 | 1.22 | +4% | 0.4498 |
-| 33b || 79.74 | 90.03 | +13% || 1.17 | 1.22 | +4% | 0.3411 |
+| 33c || 164.13 | 135.95 | -17% || 1.17 | 1.22 | +4% | 0.1074 |
-| 3a || 256.44 | 305.85 | +19% || 1.17 | 1.22 | +4% | 0.0349 |
+| 3b || 83.80 | 70.69 | -16% || 1.17 | 1.22 | +4% | 0.3182 |
+| 3c || 499.93 | 452.46 | -9% || 1.17 | 1.22 | +4% | 0.0979 |
| 4a || 271.17 | 279.49 | +3% || 1.17 | 1.22 | +4% | 0.6742 |
+| 4b || 80.31 | 57.63 | -28% || 1.17 | 1.22 | +4% | 0.0616 |
| 4c || 307.11 | 305.21 | -1% || 1.17 | 1.22 | +4% | 0.9182 |
| 5a || 228.28 | 223.04 | -2% || 1.17 | 1.22 | +4% | 0.8237 |
+| 5b || 159.50 | 144.58 | -9% || 1.17 | 1.22 | +4% | 0.3738 |
+| 5c || 378.65 | 331.80 | -12% || 1.17 | 1.22 | +4% | 0.1002 |
+| 6a || 153.70 | 139.18 | -9% || 1.17 | 1.22 | +4% | 0.2729 |
| 6b || 190.78 | 195.30 | +2% || 1.17 | 1.22 | +4% | 0.7428 |
| 6c || 137.46 | 133.71 | -3% || 1.17 | 1.22 | +4% | 0.8081 |
| 6d || 573.74 | 575.01 | +0% || 1.17 | 1.22 | +4% | 0.9642 |
| 6e || 151.68 | 144.91 | -4% || 1.18 | 1.22 | +4% | 0.6681 |
| 6f || 1222.37 | 1231.59 | +1% || 1.17 | 1.22 | +4% | 0.7599 |
-| 7a || 158.90 | 169.56 | +7% || 1.17 | 1.22 | +4% | 0.4964 |
+| 7b || 176.17 | 135.97 | -23% || 1.17 | 1.22 | +4% | 0.0135 |
| 7c || 1064.75 | 1098.56 | +3% || 1.17 | 1.22 | +4% | 0.3577 |
| 8a || 186.24 | 187.30 | +1% || 1.18 | 1.22 | +4% | 0.9452 |
+| 8b || 143.48 | 130.51 | -9% || 1.17 | 1.22 | +4% | 0.4141 |
+| 8c || 2441.63 | 2308.54 | -5% || 1.17 | 1.22 | +4% | 0.0027 |
| 8d || 896.48 | 884.29 | -1% || 1.17 | 1.22 | +4% | 0.7113 |
| 9a || 716.78 | 695.17 | -3% || 1.17 | 1.22 | +4% | 0.5576 |
| 9b || 401.29 | 401.90 | +0% || 1.17 | 1.22 | +4% | 0.9798 |
| 9c || 771.29 | 785.97 | +2% || 1.17 | 1.22 | +4% | 0.6633 |
+| 9d || 1191.76 | 1135.44 | -5% || 1.17 | 1.22 | +4% | 0.1488 |
+---------++----------+----------+--------++----------+----------+--------+---------+
| Sum || 54339.96 | 52282.15 | -4% || | | | |
| Geomean || | | || | | +4% | |
+---------++----------+----------+--------++----------+----------+--------+---------+hyriseBenchmarkStarSchema - single-threaded Sum of avg. item runtimes: -3% || Geometric mean of throughput changes: +1%Configuration Overview - click to expand +Configuration Overview---+---------------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkStarSchema_0bcfa0250faed47181d2591d19daefc98bfcd5a4_st.json | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkStarSchema_036d2ca7327d9f76b74cac0f821834d9638f9d3d_st.json |
+-------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4 | 036d2ca7327d9f76b74cac0f821834d9638f9d3d |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.6 | clang 17.0.6 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 17:14:12 | 2025-06-06 20:57:51 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+ +---------++----------+---------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| 1.1 || 409.50 | 413.05 | +1%˄ || 2.44 | 2.42 | -1%˄ | (run time too short) |
| 1.2 || 233.38 | 237.71 | +2%˄ || 4.28 | 4.21 | -2%˄ | (run time too short) |
| 1.3 || 228.84 | 231.67 | +1%˄ || 4.37 | 4.32 | -1%˄ | (run time too short) |
| 2.1 || 511.45 | 506.18 | -1%˄ || 1.96 | 1.98 | +1%˄ | (run time too short) |
| 2.2 || 279.13 | 280.73 | +1%˄ || 3.58 | 3.56 | -1%˄ | (run time too short) |
| 2.3 || 176.60 | 178.90 | +1%˄ || 5.66 | 5.59 | -1%˄ | (run time too short) |
+| 3.1 || 2610.72 | 2511.14 | -4% || 0.37 | 0.38 | +5% | (run time too short) |
| 3.2 || 281.98 | 277.39 | -2%˄ || 3.55 | 3.60 | +2%˄ | (run time too short) |
| 3.3 || 118.55 | 115.87 | -2%˄ || 8.43 | 8.63 | +2%˄ | (run time too short) |
| 3.4 || 111.03 | 109.43 | -1%˄ || 9.01 | 9.14 | +1%˄ | (run time too short) |
| 4.1 || 2477.05 | 2380.25 | -4% || 0.40 | 0.42 | +4% | 0.0000 |
| 4.2 || 788.50 | 758.69 | -4%˄ || 1.27 | 1.32 | +4%˄ | (run time too short) |
| 4.3 || 215.21 | 209.51 | -3%˄ || 4.65 | 4.77 | +3%˄ | (run time too short) |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| Sum || 8441.94 | 8210.52 | -3% || | | | |
| Geomean || | | || | | +1% | |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+---------+--------++----------+----------+--------+----------------------+hyriseBenchmarkStarSchema - multi-threaded, ordered, 1 client, 64 cores Sum of avg. item runtimes: -0% || Geometric mean of throughput changes: +0%Configuration Overview - click to expand +Configuration Overview---------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkStarSchema_0bcfa0250faed47181d2591d19daefc98bfcd5a4_mt_ordered.json | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkStarSchema_036d2ca7327d9f76b74cac0f821834d9638f9d3d_mt_ordered.json |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4 | 036d2ca7327d9f76b74cac0f821834d9638f9d3d |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.6 | clang 17.0.6 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 17:23:07 | 2025-06-06 21:03:11 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------+ +---------++----------+---------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| 1.1 || 126.89 | 127.93 | +1%˄ || 7.88 | 7.81 | -1%˄ | (run time too short) |
| 1.2 || 84.48 | 84.74 | +0%˄ || 11.83 | 11.80 | -0%˄ | (run time too short) |
| 1.3 || 81.40 | 81.84 | +1%˄ || 12.28 | 12.21 | -1%˄ | (run time too short) |
| 2.1 || 329.21 | 331.63 | +1%˄ || 3.04 | 3.02 | -1%˄ | (run time too short) |
| 2.2 || 160.35 | 159.04 | -1%˄ || 6.23 | 6.29 | +1%˄ | (run time too short) |
| 2.3 || 64.73 | 64.28 | -1%˄ || 15.44 | 15.55 | +1%˄ | (run time too short) |
| 3.1 || 799.94 | 801.35 | +0%˄ || 1.25 | 1.25 | -0%˄ | (run time too short) |
| 3.2 || 151.57 | 149.27 | -2%˄ || 6.60 | 6.70 | +2%˄ | (run time too short) |
| 3.3 || 78.34 | 76.92 | -2%˄ || 12.76 | 12.99 | +2%˄ | (run time too short) |
| 3.4 || 70.26 | 69.59 | -1%˄ || 14.22 | 14.36 | +1%˄ | (run time too short) |
| 4.1 || 858.68 | 848.51 | -1%˄ || 1.16 | 1.18 | +1%˄ | (run time too short) |
| 4.2 || 349.58 | 350.10 | +0%˄ || 2.86 | 2.86 | -0%˄ | (run time too short) |
| 4.3 || 111.85 | 111.38 | -0%˄ || 8.94 | 8.97 | +0%˄ | (run time too short) |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| Sum || 3267.30 | 3256.58 | -0% || | | | |
| Geomean || | | || | | +0% | |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+---------+--------++----------+----------+--------+----------------------+hyriseBenchmarkStarSchema - multi-threaded, shuffled, 64 clients, 64 cores Sum of avg. item runtimes: -0% || Geometric mean of throughput changes: +0%Configuration Overview - click to expand +Configuration Overview---------+---------------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkStarSchema_0bcfa0250faed47181d2591d19daefc98bfcd5a4_mt.json | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkStarSchema_036d2ca7327d9f76b74cac0f821834d9638f9d3d_mt.json |
+-------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4 | 036d2ca7327d9f76b74cac0f821834d9638f9d3d |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| compiler | clang 17.0.6 | clang 17.0.6 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 17:26:25 | 2025-06-06 21:06:29 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+---------+
| 1.1 || 851.03 | 858.35 | +1% || 3.7
10000
4 | 3.76 | +0% | 0.7196 |
| 1.2 || 461.09 | 450.81 | -2% || 3.74 | 3.76 | +0% | 0.4457 |
| 1.3 || 443.22 | 424.29 | -4% || 3.74 | 3.76 | +0% | 0.1640 |
| 2.1 || 2156.82 | 2123.89 | -2% || 3.74 | 3.75 | +0% | 0.3717 |
| 2.2 || 1097.80 | 1082.60 | -1% || 3.74 | 3.76 | +0% | 0.5392 |
| 2.3 || 357.35 | 361.46 | +1% || 3.74 | 3.76 | +0% | 0.7102 |
| 3.1 || 3222.74 | 3328.58 | +3% || 3.74 | 3.75 | +0% | 0.0027 |
| 3.2 || 989.93 | 990.15 | +0% || 3.74 | 3.76 | +0% | 0.9921 |
+| 3.3 || 513.42 | 485.83 | -5% || 3.74 | 3.75 | +0% | 0.1285 |
| 3.4 || 478.93 | 490.43 | +2% || 3.74 | 3.76 | +0% | 0.5253 |
| 4.1 || 3201.02 | 3249.13 | +2% || 3.73 | 3.75 | +0% | 0.1465 |
| 4.2 || 2528.30 | 2454.83 | -3% || 3.74 | 3.75 | +0% | 0.0367 |
+| 4.3 || 771.52 | 711.65 | -8% || 3.74 | 3.76 | +0% | 0.0019 |
+---------++----------+----------+--------++----------+----------+--------+---------+
| Sum || 17073.18 | 17012.00 | -0% || | | | |
| Geomean || | | || | | +0% | |
+---------++----------+----------+--------++----------+----------+--------+---------+ |
yes.
But I wanted to test FixedString?!??? |
Ah, then I misunderstood you. I thought we wanted to skip FixedString because the memory footprint was too large. Let's maybe discuss in person after all benchmarks are done what we choose to be the default. |
|
Comparing FOR for int and everything else dictionary with master: System cx28 - click to expand
Commit Info and Build Time
hyriseBenchmarkTPCH - single-threaded, SF 10.0 Sum of avg. item runtimes: -12% || Geometric mean of throughput changes: +11%Configuration Overview - click to expand +Configuration Overview----+---------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkTPCH_6012f29ab8781fbfbfef89d55745f7547796caab_st.json | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkTPCH_85450217ce7cb6cd090d5efa04b6051fe625caf2_st.json |
+--------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 6012f29ab8781fbfbfef89d55745f7547796caab | 85450217ce7cb6cd090d5efa04b6051fe625caf2 |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 17.0.6 | clang 17.0.6 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-08 11:37:21 | 2025-06-08 15:19:54 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+--------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------+ +----------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| TPC-H 01 || 5696.15 | 5738.62 | +1% || 0.17 | 0.17 | +0% | (run time too short) |
| TPC-H 02 || 40.47 | 42.07 | +4%˄ || 24.71 | 23.77 | -4%˄ | (run time too short) |
+| TPC-H 03 || 1349.02 | 1282.88 | -5% || 0.73 | 0.77 | +5% | 0.0000 |
| TPC-H 04 || 1439.89 | 1409.70 | -2% || 0.68 | 0.70 | +2% | 0.0001 |
+| TPC-H 05 || 2274.63 | 1904.20 | -16% || 0.43 | 0.52 | +19% | 0.0000 |
| TPC-H 06 || 182.73 | 183.66 | +1%˄ || 5.47 | 5.44 | -1%˄ | (run time too short) |
+| TPC-H 07 || 724.36 | 619.08 | -15%˄ || 1.38 | 1.62 | +17%˄ | (run time too short) |
+| TPC-H 08 || 538.79 | 436.67 | -19%˄ || 1.86 | 2.29 | +23%˄ | (run time too short) |
+| TPC-H 09 || 6165.41 | 4903.50 | -20% || 0.15 | 0.20 | +33% | (run time too short) |
+| TPC-H 10 || 1349.11 | 1256.50 | -7% || 0.73 | 0.78 | +7% | 0.0000 |
| TPC-H 11 || 48.88 | 50.32 | +3%˄ || 20.45 | 19.87 | -3%˄ | (run time too short) |
+| TPC-H 12 || 945.02 | 894.81 | -5%˄ || 1.06 | 1.12 | +6%˄ | (run time too short) |
+| TPC-H 13 || 5843.52 | 4481.95 | -23% || 0.17 | 0.22 | +30% | (run time too short) |
+| TPC-H 14 || 488.20 | 461.49 | -5%˄ || 2.05 | 2.17 | +6%˄ | (run time too short) |
+| TPC-H 15 || 179.56 | 166.95 | -7%˄ || 5.57 | 5.99 | +8%˄ | (run time too short) |
| TPC-H 16 || 515.59 | 524.99 | +2%˄ || 1.94 | 1.90 | -2%˄ | (run time too short) |
+| TPC-H 17 || 215.93 | 138.36 | -36%˄ || 4.63 | 7.23 | +56%˄ | (run time too short) |
| TPC-H 18 || 1676.12 | 1635.77 | -2% || 0.58 | 0.60 | +3% | (run time too short) |
+| TPC-H 19 || 221.41 | 211.33 | -5%˄ || 4.52 | 4.73 | +5%˄ | (run time too short) |
+| TPC-H 20 || 402.30 | 289.84 | -28%˄ || 2.49 | 3.45 | +39%˄ | (run time too short) |
+| TPC-H 21 || 4231.15 | 3712.70 | -12% || 0.23 | 0.27 | +14% | 0.0000 |
+| TPC-H 22 || 486.25 | 454.52 | -7%˄ || 2.06 | 2.20 | +7%˄ | (run time too short) |
+----------++-
10000
---------+----------+--------++----------+----------+--------+----------------------+
+| Sum || 35014.50 | 30799.90 | -12% || | | | |
+| Geomean || | | || | | +11% | |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+----------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCH - single-threaded, SF 0.01 Sum of avg. item runtimes: -2% || Geometric mean of throughput changes: -2%Configuration Overview - click to expand +Configuration Overview----+-------------------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkTPCH_6012f29ab8781fbfbfef89d55745f7547796caab_st_s01.json | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkTPCH_85450217ce7cb6cd090d5efa04b6051fe625caf2_st_s01.json |
+--------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 6012f29ab8781fbfbfef89d55745f7547796caab | 85450217ce7cb6cd090d5efa04b6051fe625caf2 |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 17.0.6 | clang 17.0.6 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-08 11:52:57 | 2025-06-08 15:35:02 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 0.009999999776482582 | 0.009999999776482582 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+--------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------+ +----------++----------+---------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+----------++----------+---------+--------++----------+----------+--------+----------------------+
| TPC-H 01 || 5.27 | 5.30 | +1%˄ || 189.72 | 188.74 | -1%˄ | (run time too short) |
| TPC-H 02 || 3.31 | 3.45 | +4%˄ || 301.69 | 289.38 | -4%˄ | (run time too short) |
| TPC-H 03 || 0.57 | 0.59 | +4%˄ || 1754.19 | 1690.61 | -4%˄ | (run time too short) |
-| TPC-H 04 || 0.37 | 0.40 | +8%˄ || 2681.56 | 2492.19 | -7%˄ | (run time too short) |
| TPC-H 05 || 0.92 | 0.94 | +2%˄ || 1084.27 | 1058.56 | -2%˄ | (run time too short) |
| TPC-H 06 || 0.21 | 0.21 | +1%˄ || 4816.31 | 4764.86 | -1%˄ | (run time too short) |
+| TPC-H 07 || 9.63 | 9.00 | -7%˄ || 103.83 | 111.09 | +7%˄ | (run time too short) |
+| TPC-H 08 || 13.57 | 12.96 | -5%˄ || 73.68 | 77.18 | +5%˄ | (run time too short) |
-| TPC-H 09 || 2.86 | 3.15 | +10%˄ || 350.01 | 317.64 | -9%˄ | (run time too short) |
| TPC-H 10 || 0.65 | 0.64 | -2%˄ || 1528.04 | 1551.43 | +2%˄ | (run time too short) |
| TPC-H 11 || 0.17 | 0.17 | -2%˄ || 5776.66 | 5868.81 | +2%˄ | (run time too short) |
-| TPC-H 12 || 0.62 | 0.65 | +5%˄ || 1615.17 | 1539.82 | -5%˄ | (run time too short) |
| TPC-H 13 || 2.03 | 1.98 | -2%˄ || 493.33 | 503.98 | +2%˄ | (run time too short) |
| TPC-H 14 || 0.30 | 0.30 | -1%˄ || 3342.02 | 3372.88 | +1%˄ | (run time too short) |
| TPC-H 15 || 1.08 | 1.06 | -1%˄ || 927.89 | 937.19 | +1%˄ | (run time too short) |
| TPC-H 16 || 1.88 | 1.87 | -1%˄ || 530.72 | 533.87 | +1%˄ | (run time too short) |
-| TPC-H 17 || 0.42 | 0.58 | +39%˄ || 2381.82 | 1714.93 | -28%˄ | (run time too short) |
+| TPC-H 18 || 1.14 | 1.08 | -6%˄ || 874.19 | 926.34 | +6%˄ | (run time too short) |
| TPC-H 19 || 4.36 | 4.34 | -0%˄ || 229.18 | 230.24 | +0%˄ | (run time too short) |
+| TPC-H 20 || 2.39 | 2.21 | -8%˄ || 417.97 | 452.19 | +8%˄ | (run time too short) |
| TPC-H 21 || 1.01 | 1.04 | +3%˄ || 985.44 | 960.87 | -2%˄ | (run time too short) |
| TPC-H 22 || 1.05 | 1.07 | +1%˄ || 946.82 | 934.85 | -1%˄ | (run time too short) |
+----------++----------+---------+--------++----------+----------+--------+----------------------+
| Sum || 53.82 | 53.00 | -2% || | | | |
| Geomean || | | || | | -2% | |
+----------++----------+---------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+----------++----------+---------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCH - multi-threaded, ordered, 1 client, 64 cores, SF 10.0 Sum of avg. item runtimes: -12% || Geometric mean of throughput changes: +8%Configuration Overview - click to expand +Configuration Overview---------+-----------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkTPCH_6012f29ab8781fbfbfef89d55745f7547796caab_mt_ordered.json | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkTPCH_85450217ce7cb6cd090d5efa04b6051fe625caf2_mt_ordered.json |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 6012f29ab8781fbfbfef89d55745f7547796caab | 85450217ce7cb6cd090d5efa04b6051fe625caf2 |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 17.0.6 | clang 17.0.6 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-08 11:53:22 | 2025-06-08 15:35:27 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------+ +----------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| TPC-H 01 || 4658.45 | 4692.51 | +1% || 0.20 | 0.20 | +0% | (run time too short) |
| TPC-H 02 || 58.27 | 57.09 | -2%˄ || 17.15 | 17.50 | +2%˄ | (run time too short) |
| TPC-H 03 || 649.33 | 633.11 | -2%˄ || 1.54 | 1.58 | +3%˄ | (run time too short) |
| TPC-H 04 || 647.55 | 631.05 | -3%˄ || 1.54 | 1.58 | +3%˄ | (run time too short) |
+| TPC-H 05 || 600.44 | 517.48 | -14%˄ || 1.67 | 1.93 | +16%˄ | (run time too short) |
| TPC-H 06 || 65.97 | 67.73 | +3%˄ || 15.15 | 14.75 | -3%˄ | (run time too short) |
| TPC-H 07 || 250.50 | 249.45 | -0%˄ || 3.99 | 4.01 | +0%˄ | (run time too short) |
+| TPC-H 08 || 235.51 | 219.24 | -7%˄ || 4.25 | 4.56 | +7%˄ | (run time too short) |
+| TPC-H 09 || 2182.63 | 1882.05 | -14% || 0.45 | 0.52 | +15% | (run time too short) |
+| TPC-H 10 || 614.08 | 566.69 | -8%˄ || 1.63 | 1.76 | +8%˄ | (run time too short) |
| TPC-H 11 || 67.04 | 68.81 | +3%˄ || 14.91 | 14.52 | -3%˄ | (run time too short) |
+| TPC-H 12 || 502.15 | 466.71 | -7%˄ || 1.99 | 2.14 | +8%˄ | (run time too short) |
+| TPC-H 13 || 3528.52 | 1943.07 | -45% || 0.27 | 0.50 | +88% | (run time too short) |
| TPC-H 14 || 151.99 | 154.49 | +2%˄ || 6.58 | 6.47 | -2%˄ | (run time too short) |
+| TPC-H 15 || 136.45 | 122.92 | -10%˄ || 7.33 | 8.13 | +11%˄ | (run time too short) |
| TPC-H 16 || 573.67 | 553.60 | -3%˄ || 1.74 | 1.81 | +4%˄ | (run time too short) |
+| TPC-H 17 || 89.52 | 72.17 | -19%˄ || 11.17 | 13.85 | +24%˄ | (run time too short) |
| TPC-H 18 || 1687.95 | 1679.00 | -1% || 0.58 | 0.58 | +0% | (run time too short) |
-| TPC-H 19 || 106.68 | 112.21 | +5%˄ || 9.37 | 8.91 | -5%˄ | (run time too short) |
+| TPC-H 20 || 195.74 | 181.82 | -7%˄ || 5.11 | 5.50 | +8%˄ | (run time too short) |
+| TPC-H 21 || 1125.61 | 1021.32 | -9%˄ || 0.89 | 0.98 | +10%˄ | (run time too short) |
| TPC-H 22 || 162.33 | 156.99 | -3%˄ || 6.16 | 6.37 | +3%˄ | (run time too short) |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
+| Sum || 18290.39 | 16049.50 | -12% || | | | |
+| Geomean || | | || | | +8% | |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+----------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCH - multi-threaded, shuffled, 64 clients, 64 cores, SF 10.0 Sum of avg. item runtimes: -10% || Geometric mean of throughput changes: +11%Configuration Overview - click to expand +Configuration Overview---------+---------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkTPCH_6012f29ab8781fbfbfef89d55745f7547796caab_mt.json | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkTPCH_85450217ce7cb6cd090d5efa04b6051fe625caf2_mt.json |
+-------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 6012f29ab8781fbfbfef89d55745f7547796caab | 85450217ce7cb6cd090d5efa04b6051fe625caf2 |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| clustering | None | None |
| compiler | clang 17.0.6 | clang 17.0.6 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-08 12:05:01 | 2025-06-08 15:46:43 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64]
97AE
| [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------+ +----------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+----------++----------+----------+--------++----------+----------+--------+---------+
+| TPC-H 01 || 6105.61 | 6187.08 | +1% || 1.04 | 1.15 | +10% | 0.2683 |
+| TPC-H 02 || 488.89 | 496.63 | +2% || 1.05 | 1.16 | +11% | 0.9082 |
+| TPC-H 03 || 2843.66 | 2531.57 | -11% || 1.05 | 1.16 | +11% | 0.0102 |
+| TPC-H 04 || 2298.26 | 2164.02 | -6% || 1.05 | 1.16 | +11% | 0.1576 |
+| TPC-H 05 || 4305.11 | 3818.47 | -11% || 1.04 | 1.15 | +10% | 0.0033 |
+| TPC-H 06 || 755.96 | 736.48 | -3% || 1.05 | 1.16 | +10% | 0.7668 |
+| TPC-H 07 || 3551.91 | 3032.09 | -15% || 1.05 | 1.15 | +10% | 0.0007 |
+| TPC-H 08 || 2382.57 | 2118.20 | -11% || 1.05 | 1.16 | +11% | 0.0365 |
+| TPC-H 09 || 6073.27 | 5757.24 | -5% || 1.04 | 1.15 | +11% | 0.0454 |
+| TPC-H 10 || 3582.60 | 3186.20 | -11% || 1.04 | 1.16 | +11% | 0.0056 |
+| TPC-H 11 || 517.10 | 508.13 | -2% || 1.05 | 1.16 | +11% | 0.8813 |
+| TPC-H 12 || 2573.65 | 2510.23 | -2% || 1.05 | 1.16 | +10% | 0.5771 |
+| TPC-H 13 || 6891.16 | 4818.63 | -30% || 1.04 | 1.15 | +11% | 0.0000 |
+| TPC-H 14 || 1239.14 | 1143.64 | -8% || 1.05 | 1.16 | +10% | 0.2445 |
+| TPC-H 15 || 741.18 | 562.29 | -24% || 1.05 | 1.16 | +11% | 0.0012 |
+| TPC-H 16 || 2295.35 | 2203.84 | -4% || 1.05 | 1.15 | +10% | 0.3788 |
+| TPC-H 17 || 872.63 | 772.96 | -11% || 1.05 | 1.16 | +11% | 0.1850 |
+| TPC-H 18 || 3626.61 | 3665.86 | +1% || 1.04 | 1.15 | +11% | 0.6530 |
+| TPC-H 19 || 1192.20 | 1098.42 | -8% || 1.05 | 1.16 | +11% | 0.3000 |
+| TPC-H 20 || 1865.45 | 1502.30 | -19% || 1.05 | 1.16 | +11% | 0.0007 |
+| TPC-H 21 || 5505.42 | 4958.15 | -10% || 1.04 | 1.15 | +10% | 0.0013 |
+| TPC-H 22 || 1094.55 | 1143.62 | +4% || 1.05 | 1.16 | +10% | 0.5716 |
+----------++----------+----------+--------++----------+----------+--------+---------+
+| Sum || 60802.28 | 54916.07 | -10% || | | | |
+| Geomean || | | || | | +11% | |
+----------++----------+----------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCDS - single-threaded Sum of avg. item runtimes: +3% || Geometric mean of throughput changes: -7%Configuration Overview - click to expand +Configuration Overview---+----------------------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkTPCDS_6012f29ab8781fbfbfef89d55745f7547796caab_st.json | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkTPCDS_85450217ce7cb6cd090d5efa04b6051fe625caf2_st.json |
+-------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 6012f29ab8781fbfbfef89d55745f7547796caab | 85450217ce7cb6cd090d5efa04b6051fe625caf2 |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.6 | clang 17.0.6 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-08 12:26:27 | 2025-06-08 16:08:13 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
+| 01 || 217.13 | 202.75 | -7%˄ || 4.61 | 4.93 | +7%˄ | (run time too short) |
+| 03 || 64.75 | 52.52 | -19%˄ || 15.44 | 19.04 | +23%˄ | (run time too short) |
+| 06 || 197.78 | 181.88 | -8%˄ || 5.06 | 5.50 | +9%˄ | (run time too short) |
-| 07 || 278.34 | 293.76 | +6%˄ || 3.59 | 3.40 | -5%˄ | (run time too short) |
-| 09 || 732.32 | 1357.77 | +85%˄ || 1.37 | 0.73 | -46%˄ | (run time too short) |
-| 10 || 129.69 | 161.90 | +25%˄ || 7.71 | 6.18 | -20%˄ | (run time too short) |
| 13 || 488.71 | 505.20 | +3%˄ || 2.05 | 1.98 | -3%˄ | (run time too short) |
| 15 || 119.73 | 122.34 | +2%˄ || 8.35 | 8.17 | -2%˄ | (run time too short) |
-| 16 || 59.84 | 73.16 | +22%˄ || 16.71 | 13.67 | -18%˄ | (run time too short) |
+| 17 || 331.77 | 290.49 | -12%˄ || 3.01 | 3.44 | +14%˄ | (run time too short) |
-| 19 || 102.64 | 110.44 | +8%˄ || 9.74 | 9.05 | -7%˄ | (run time too short) |
| 25 || 176.39 | 177.17 | +0%˄ || 5.67 | 5.64 | -0%˄ | (run time too short) |
| 26 || 128.73 | 130.21 | +1%˄ || 7.77 | 7.68 | -1%˄ | (run time too short) |
-| 28 || 587.62 | 1145.50 | +95%˄ || 1.70 | 0.87 | -49%˄ | (run time too short) |
| 29 || 476.34 | 462.81 | -3%˄ || 2.10 | 2.16 | +3%˄ | (run time too short) |
-| 31 || 1286.89 | 1347.53 | +5% || 0.77 | 0.73 | -4% | 0.0000 |
-| 32 || 31.27 | 39.14 | +25%˄ || 31.98 | 25.55 | -20%˄ | (run time too short) |
-| 34 || 152.11 | 170.84 | +12%˄ || 6.57 | 5.85 | -11%˄ | (run time too short) |
| 35 || 612.14 | 634.18 | +4%˄ || 1.63 | 1.58 | -3%˄ | (run time too short) |
-| 37 || 746.39 | 1216.07 | +63%˄ || 1.34 | 0.82 | -39%˄ | (run time too short) |
-| 39a || 1661.21 | 1780.11 | +7% || 0.60 | 0.55 | -8% | (run time too short) |
-| 39b || 1649.53 | 1761.92 | +7% || 0.60 | 0.57 | -6% | 0.0000 |
| 41 || 281.38 | 279.16 | -1%˄ || 3.55 | 3.58 | +1%˄ | (run time too short) |
-| 42 || 81.05 | 94.15 | +16%˄ || 12.34 | 10.62 | -14%˄ | (run time too short) |
| 43 || 968.11 | 997.31 | +3%˄ || 1.03 | 1.00 | -3%˄ | (run time too short) |
+| 45 || 122.76 | 106.09 | -14%˄ || 8.15 | 9.43 | +16%˄ | (run time too short) |
| 48 || 1044.94 | 1067.61 | +2%˄ || 0.96 | 0.94 | -2%˄ | (run time too short) |
| 50 || 123.26 | 120.98 | -2%˄ || 8.11 | 8.27 | +2%˄ | (run time too short) |
-| 52 || 79.61 | 91.93 | +15%˄ || 12.56 | 10.88 | -13%˄ | (run time too short) |
-| 55 || 74.99 | 87.32 | +16%˄ || 13.33 | 11.45 | -14%˄ | (run time too short) |
| 62 || 530.99 | 531.05 | +0%˄ || 1.88 | 1.88 | -0%˄ | (run time too short) |
| 65 || 1826.16 | 1772.99 | -3% || 0.53 | 0.55 | +3% | (run time too short) |
-| 69 || 139.99 | 167.56 | +20%˄ || 7.14 | 5.97 | -16%˄ | (run time too short) |
-| 73 || 78.86 | 96.92 | +23%˄ || 12.68 | 10.32 | -19%˄ | (run time too short) |
| 79 || 487.87 | 492.49 | +1%˄ || 2.05 | 2.03 | -1%˄ | (run time too short) |
| 81 || 150.03 | 143.81 | -4%˄ || 6.67 | 6.95 | +4%˄ | (run time too short) |
-| 82 || 795.55 | 1254.92 | +58%˄ || 1.26 | 0.78 | -38%˄ | (run time too short) |
| 83 || 39.00 | 39.64 | +2%˄ || 25.64 | 25.22 | -2%˄ | (run time too short) |
+| 84 || 13.86 | 12.09 | -13%˄ || 72.13 | 82.67 | +15%˄ | (run time too short) |
+| 85 || 160.74 | 153.79 | -4%˄ || 6.22 | 6.50 | +5%˄ | (run time too short) |
-| 88 || 645.37 | 777.04 | +20%˄ || 1.55 | 1.29 | -17%˄ | (run time too short) |
+| 91 || 17.96 | 16.74 | -7%˄ || 55.66 | 59.73 | +7%˄ | (run time too short) |
+| 92 || 35.88 | 32.56 | -9%˄ || 27.87 | 30.71 | +10%˄ | (run time too short) |
+| 93 || 3700.14 | 2319.87 | -37% || 0.27 | 0.42 | +56% | (run time too short) |
-| 94 || 35.16 | 43.34 | +23%˄ || 28.44 | 23.07 | -19%˄ | (run time too short) |
| 95 || 4694.43 | 4822.90 | +3% || 0.20 | 0.20 | +0% | (run time too short) |
-| 96 || 60.43 | 80.44 | +33%˄ || 16.55 | 12.43 | -25%˄ | (run time too short) |
+| 97 || 3839.15 | 3418.44 | -11% || 0.25 | 0.28 | +13% | (run time too short) |
| 99 || 1034.89 | 1049.66 | +1%˄ || 0.97 | 0.95 | -1%˄ | (run time too short) |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Sum || 31293.86 | 32288.52 | +3% || | | | |
-| Geomean || | | || | | -7% | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCDS - multi-threaded, ordered, 1 client, 64 cores Sum of avg. item runtimes: -2% || Geometric mean of throughput changes: -0%Configuration Overview - click to expand +Configuration Overview---------+------------------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkTPCDS_6012f29ab8781fbfbfef89d55745f7547796caab_mt_ordered.json | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkTPCDS_85450217ce7cb6cd090d5efa04b6051fe625caf2_mt_ordered.json |
+-------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 6012f29ab8781fbfbfef89d55745f7547796caab | 85450217ce7cb6cd090d5efa04b6051fe625caf2 |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.6 | clang 17.0.6 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-08 12:45:34 | 2025-06-08 16:29:11 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
+| 01 || 230.12 | 219.84 | -4%˄ || 4.34 | 4.55 | +5%˄ | (run time too short) |
+| 03 || 33.37 | 30.78 | -8%˄ || 29.93 | 32.45 | +8%˄ | (run time too short) |
+| 06 || 189.70 | 167.66 | -12%˄ || 5.27 | 5.96 | +13%˄ | (run time too short) |
| 07 || 185.43 | 188.56 | +2%˄ || 5.39 | 5.30 | -2%˄ | (run time too short) |
-| 09 || 111.12 | 150.17 | +35%˄ || 9.00 | 6.66 | -26%˄ | (run time too short) |
-| 10 || 36.33 | 40.59 | +12%˄ || 27.50 | 24.61 | -10%˄ | (run time too short) |
| 13 || 252.66 | 246.68 | -2%˄ || 3.96 | 4.05 | +2%˄ | (run time too short) |
| 15 || 74.18 | 74.08 | -0%˄ || 13.47 | 13.49 | +0%˄ | (run time too short) |
| 16 || 30.94 | 31.72 | +3%˄ || 32.28 | 31.49 | -2%˄ | (run time too short) |
+| 17 || 141.36 | 120.61 | -15%˄ || 7.07 | 8.29 | +17%˄ | (run time too short) |
| 19 || 70.20 | 71.45 | +2%˄ || 14.24 | 13.99 | -2%˄ | (run time too short) |
+| 25 || 103.25 | 91.00 | -12%˄ || 9.68 | 10.99 | +13%˄ | (run time too short) |
| 26 || 89.06 | 91.36 | +3%˄ || 11.22 | 10.94 | -3%˄ | (run time too short) |
-| 28 || 148.75 | 161.14 | +8%˄ || 6.72 | 6.20 | -8%˄ | (run time too short) |
+| 29 || 444.98 | 412.46 | -7%˄ || 2.25 | 2.42 | +8%˄ | (run time too short) |
-| 31 || 457.94 | 487.81 | +7%˄ || 2.18 | 2.05 | -6%˄ | (run time too short) |
| 32 || 30.80 | 30.17 | -2%˄ || 32.43 | 33.11 | +2%˄ | (run time too short) |
| 34 || 94.57 | 96.67 | +2%˄ || 10.57 | 10.34 | -2%˄ | (run time too short) |
| 35 || 377.10 | 367.63 | -3%˄ || 2.65 | 2.72 | +3%˄ | (run time too short) |
-| 37 || 199.35 | 251.52 | +26%˄ || 5.02 | 3.98 | -21%˄ | (run time too short) |
| 39a || 716.90 | 688.41 | -4%˄ || 1.39 | 1.45 | +4%˄ | (run time too short) |
| 39b || 699.56 | 723.58 | +3%˄ || 1.43 | 1.38 | -3%˄ | (run time too short) |
| 41 || 365.87 | 358.00 | -2%˄ || 2.73 | 2.79 | +2%˄ | (run time too short) |
-| 42 || 48.32 | 52.96 | +10%˄ || 20.68 | 18.87 | -9%˄ | (run time too short) |
| 43 || 442.58 | 449.52 | +2%˄ || 2.26 | 2.22 | -2%˄ | (run time too short) |
| 45 || 55.33 | 53.77 | -3%˄ || 18.06 | 18.58 | +3%˄ | (run time too short) |
| 48 || 507.60 | 507.56 | -0%˄ || 1.97 | 1.97 | +0%˄ | (run time too short) |
| 50 || 103.73 | 105.29 | +2%˄ || 9.64 | 9.49 | -1%˄ | (run time too short) |
-| 52 || 52.53 | 56.11 | +7%˄ || 19.02 | 17.81 | -6%˄ | (run time too short) |
-| 55 || 45.34 | 49.60 | +9%˄ || 22.04 | 20.14 | -9%˄ | (run time too short) |
| 62 || 352.46 | 347.43 | -1%˄ || 2.84 | 2.88 | +1%˄ | (run time too short) |
| 65 || 1460.64 | 1451.26 | -1% || 0.68 | 0.68 | +0% | 0.2095 |
| 69 || 70.66 | 72.84 | +3%˄ || 14.14 | 13.72 | -3%˄ | (run time too short) |
-| 73 || 54.30 | 58.02 | +7%˄ || 18.41 | 17.23 | -6%˄ | (run time too short) |
| 79 || 474.67 | 463.84 | -2%˄ || 2.11 | 2.16 | +2%˄ | (run time too short) |
| 81 || 172.84 | 172.70 | -0%˄ || 5.78 | 5.79 | +0%˄ | (run time too short) |
-| 82 || 231.38 | 281.17 | +22%˄ || 4.32 | 3.56 | -18%˄ | (run time too short) |
+| 83 || 47.01 | 44.96 | -4%˄ || 21.25 | 22.22 | +5%˄ | (run time too short) |
+| 84 || 10.13 | 9.31 | -8%˄ || 98.40 | 107.06 | +9%˄ | (run time too short) |
+| 85 || 70.95 | 67.59 | -5%˄ || 14.09 | 14.79 | +5%˄ | (run time too short) |
-| 88 || 84.45 | 90.65 | +7%˄ || 11.84 | 11.03 | -7%˄ | (run time too short) |
+| 91 || 18.01 | 17.01 | -6%˄ || 55.42 | 58.66 | +6%˄ | (run time too short) |
+| 92 || 41.80 | 36.21 | -13%˄ || 23.90 | 27.59 | +15%˄ | (run time too short) |
+| 93 || 749.47 | 545.29 | -27%˄ || 1.33 | 1.83 | +37%˄ | (run time too short) |
| 94 || 30.62 | 31.96 | +4%˄ || 32.62 | 31.26 | -4%˄ | (run time too short) |
| 95 || 703.91 | 704.82 | +0%˄ || 1.42 | 1.42 | -0%˄ | (run time too short) |
| 96 || 47.64 | 49.10 | +3%˄ || 20.98 | 20.35 | -3%˄ | (run time too short) |
+| 97 || 1371.56 | 1296.49 | -5% || 0.72 | 0.77 | +7% | (run time too short) |
| 99 || 574.08 | 564.11 | -2%˄ || 1.74 | 1.77 | +2%˄ | (run time too short) |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Sum || 12905.52 | 12681.44 | -2% || | | | |
| Geomean || | | || | | -0% | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCDS - multi-threaded, shuffled, 64 clients, 64 cores Sum of avg. item runtimes: -2% || Geometric mean of throughput changes: +2%Configuration Overview - click to expand +Configuration Overview---------+----------------------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkTPCDS_6012f29ab8781fbfbfef89d55745f7547796caab_mt.json | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkTPCDS_85450217ce7cb6cd090d5efa04b6051fe625caf2_mt.json |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 6012f29ab8781fbfbfef89d55745f7547796caab | 85450217ce7cb6cd090d5efa04b6051fe625caf2 |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| compiler | clang 17.0.6 | clang 17.0.6 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-08 12:57:28 | 2025-06-08 16:41:00 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+---------+
+| 01 || 846.98 | 756.34 | -11% || 1.00 | 1.02 | +2% | 0.0873 |
+| 03 || 298.19 | 236.26 | -21% || 1.00 | 1.02 | +2% | 0.0589 |
| 06 || 928.05 | 892.52 | -4% || 1.00 | 1.02 | +2% | 0.5651 |
+| 07 || 1008.06 | 959.94 | -5% || 1.00 | 1.02 | +2% | 0.3709 |
-| 09 || 864.75 | 1073.94 | +24% || 1.00 | 1.02 | +2% | 0.0020 |
| 10 || 876.01 | 849.35 | -3% || 1.00 | 1.02 | +2% | 0.6986 |
+| 13 || 1790.15 | 1677.70 | -6% || 1.00 | 1.02 | +2% | 0.1506 |
+| 15 || 579.71 | 493.51 | -15% || 1.00 | 1.02 | +2% | 0.0907 |
-| 16 || 435.06 | 488.19 | +12% || 1.00 | 1.02 | +2% | 0.2370 |
+| 17 || 1448.49 | 1325.08 | -9% || 1.00 | 1.02 | +2% | 0.0983 |
| 19 || 664.83 | 671.68 | +1% || 1.00 | 1.02 | +2% | 0.8867 |
+| 25 || 1066.35 | 950.48 | -11% || 1.00 | 1.02 | +2% | 0.0927 |
| 26 || 531.34 | 545.41 | +3% || 1.00 | 1.02 | +2% | 0.7670 |
-| 28 || 1638.72 | 1804.08 | +10% || 1.00 | 1.02 | +2% | 0.0817 |
+| 29 || 1893.16 | 1758.34 | -7% || 1.00 | 1.02 | +2% | 0.0997 |
| 31 || 2669.94 | 2687.13 | +1% || 1.00 | 1.02 | +2% | 0.8743 |
+| 32 || 232.08 | 203.98 | -12% || 1.00 | 1.02 | +2% | 0.4283 |
| 34 || 746.88 | 759.75 | +2% || 1.00 | 1.02 | +2% | 0.7886 |
+| 35 || 2279.05 | 2128.86 | -7% || 1.00 | 1.02 | +2% | 0.0905 |
-| 37 || 910.32 | 1033.73 | +14% || 1.00 | 1.02 | +2% | 0.0305 |
| 39a || 2819.81 | 2907.69 | +3% || 1.00 | 1.02 | +2% | 0.2954 |
| 39b || 2763.13 | 2882.63 | +4% || 1.00 | 1.02 | +1% | 0.1540 |
| 41 || 1949.01 | 1978.00 | +1% || 1.00 | 1.02 | +2% | 0.7402 |
-| 42 || 489.65 | 521.24 | +6% || 1.00 | 1.02 | +2% | 0.4614 |
| 43 || 1592.67 | 1556.17 | -2% || 1.00 | 1.02 | +2% | 0.5911 |
+| 45 || 873.39 | 727.46 | -17% || 1.00 | 1.02 | +2% | 0.0120 |
| 48 || 2630.77 | 2724.37 | +4% || 1.00 | 1.02 | +2% | 0.3393 |
| 50 || 1098.88 | 1093.47 | -0% || 1.00 | 1.02 | +2% | 0.9313 |
+| 52 || 560.59 | 531.39 | -5% || 1.00 | 1.02 | +1% | 0.5164 |
| 55 || 469.45 | 464.48 | -1% || 1.00 | 1.02 | +2% | 0.8999 |
| 62 || 1107.31 | 1134.38 | +2% || 1.00 | 1.02 | +2% | 0.6266 |
| 65 || 4440.29 | 4447.98 | +0% || 1.00 | 1.02 | +2% | 0.9184 |
| 69 || 1142.16 | 1101.94 | -4% || 1.00 | 1.02 | +2% | 0.6169 |
| 73 || 571.25 | 592.52 | +4% || 1.00 | 1.02 | +2% | 0.6929 |
| 79 || 1626.90 | 1629.17 | +0% || 1.00 | 1.02 | +2% | 0.9746 |
+| 81 || 672.88 | 562.97 | -16% || 1.00 | 1.02 | +2% | 0.0149 |
-| 82 || 1070.48 | 1146.66 | +7% || 1.00 | 1.02 | +2% | 0.1718 |
+| 83 || 328.83 | 290.64 | -12% || 1.00 | 1.02 | +2% | 0.3040 |
+| 84 || 132.70 | 120.33 | -9% || 1.00 | 1.02 | +2% | 0.5954 |
-| 85 || 881.54 | 962.63 | +9% || 1.00 | 1.02 | +2% | 0.2519 |
| 88 || 2694.61 | 2689.65 | -0% || 1.00 | 1.02 | +2% | 0.9660 |
+| 91 || 206.13 | 174.46 | -15% || 1.00 | 1.02 | +2% | 0.2107 |
+| 92 || 328.85 | 264.64 | -20% || 1.00 | 1.02 | +2% | 0.0658 |
+| 93 || 2205.13 | 1758.70 | -20% || 1.00 | 1.02 | +2% | 0.0000 |
-| 94 || 452.36 | 513.22 | +13% || 1.00 | 1.02 | +1% | 0.2429 |
| 95 || 2292.85 | 2320.47 | +1% || 1.00 | 1.02 | +2% | 0.7422 |
+| 96 || 502.35 | 461.19 | -8% || 1.00 | 1.02 | +2% | 0.3757 |
+| 97 || 4519.90 | 4282.52 | -5% || 1.00 | 1.02 | +2% | 0.0170 |
| 99 || 1426.00 | 1427.77 | +0% || 1.00 | 1.02 | +2% | 0.9747 |
+---------++----------+----------+--------++----------+----------+--------+---------+
| Sum || 63558.00 | 62565.02 | -2% || | | | |
| Geomean || | | || | | +2% | |
+---------++----------+----------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCC - single-threaded Sum of avg. item runtimes: +15% || Geometric mean of throughput changes: -15%Configuration Overview - click to expand +Configuration Overview---+---------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkTPCC_6012f29ab8781fbfbfef89d55745f7547796caab_st.json | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkTPCC_85450217ce7cb6cd090d5efa04b6051fe625caf2_st.json |
+-------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 6012f29ab8781fbfbfef89d55745f7547796caab | 85450217ce7cb6cd090d5efa04b6051fe625caf2 |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.6 | clang 17.0.6 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-08 13:17:45 | 2025-06-08 17:01:17 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10 | 10 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------+ +--------------++----------+---------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+--------------++----------+---------+--------++----------+----------+--------+---------+
-| Delivery || 24.99 | 28.79 | +15% || 5.73 | 4.85 | -15% | 0.0000 |
-| New-Order || 11.84 | 13.80 | +16% || 60.35 | 53.15 | -12% | 0.0000 |
-| Order-Status || 1.15 | 1.40 | +21% || 5.48 | 4.40 | -20% | 0.0000 |
-| Payment || 2.17 | 2.19 | +1% || 56.66 | 49.70 | -12% | 0.0417 |
-| Stock-Level || 1.91 | 2.16 | +13% || 5.43 | 4.52 | -17% | 0.0000 |
+--------------++----------+---------+--------++----------+----------+--------+---------+
-| Sum || 42.07 | 48.34 | +15% || | | | |
-| Geomean || | | || | | -15% | |
+--------------++----------+---------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCC - multi-threaded, shuffled, 64 clients, 10 warehouses, 64 cores (high contention) Sum of avg. item runtimes: -3% || Geometric mean of throughput changes: +3%Configuration Overview - click to expand +Configuration Overview---------+------------------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkTPCC_6012f29ab8781fbfbfef89d55745f7547796caab_mt_highcont.json | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkTPCC_85450217ce7cb6cd090d5efa04b6051fe625caf2_mt_highcont.json |
+-------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 6012f29ab8781fbfbfef89d55745f7547796caab | 85450217ce7cb6cd090d5efa04b6051fe625caf2 |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| compiler | clang 17.0.6 | clang 17.0.6 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-08 13:18:51 | 2025-06-08 17:02:24 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 600000000000 | 600000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10 | 10 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ +--------------++----------+---------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+--------------++----------+---------+--------++----------+----------+--------+---------+
| Delivery || 184.23 | 178.52 | -3% || 33.25 | 34.11 | +3% | 0.0000 |
| unsucc.: || 3.48 | 3.58 | +3% || 50.10 | 51.31 | +2% | |
| New-Order || 94.49 | 93.24 | -1% || 467.66 | 477.20 | +2% | 0.0000 |
| unsucc.: || 8.57 | 8.28 | -3% || 473.40 | 485.48 | +3% | |
| Order-Status || 9.68 | 9.35 | -3% || 83.37 | 85.82 | +3% | 0.0039 |
+| Payment || 15.98 | 14.88 | -7% || 235.76 | 246.49 | +5% | 0.0000 |
| unsucc.: || 5.47 | 5.24 | -4% || 662.36 | 672.49 | +2% | |
+| Stock-Level || 14.23 | 13.52 | -5% || 83.52 | 85.53 | +2% | 0.0001 |
+--------------++----------+---------+--------++----------+----------+--------+---------+
| Sum || 318.61 | 309.50 | -3% || | | | |
| Geomean || | | || | | +3% | |
+--------------++----------+---------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCC - multi-threaded, shuffled, 10 clients, 10 warehouses, 64 cores (low contention) Sum of avg. item runtimes: +4% || Geometric mean of throughput changes: -4%Configuration Overview - click to expand +Configuration Overview---------+-----------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkTPCC_6012f29ab8781fbfbfef89d55745f7547796caab_mt_lowcont.json | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkTPCC_85450217ce7cb6cd090d5efa04b6051fe625caf2_mt_lowcont.json |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 6012f29ab8781fbfbfef89d55745f7547796caab | 85450217ce7cb6cd090d5efa04b6051fe625caf2 |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 10 | 10 |
| compiler | clang 17.0.6 | clang 17.0.6 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-08 13:29:03 | 2025-06-08 17:12:36 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 600000000000 | 600000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10 | 10 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------+ +--------------++----------+---------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+--------------++----------+---------+--------++----------+----------+--------+---------+
| Delivery || 74.58 | 77.06 | +3% || 16.75 | 16.33 | -2% | 0.0000 |
| unsucc.: || 0.83 | 0.96 | +17% || 2.18 | 2.03 | -7% | |
-| New-Order || 37.05 | 39.21 | +6% || 192.73 | 183.67 | -5% | 0.0000 |
| unsucc.: || 3.34 | 3.44 | +3% || 18.48 | 17.52 | -5% | |
-| Order-Status || 4.10 | 4.36 | +6% || 18.59 | 17.72 | -5% | 0.0000 |
| Payment || 7.79 | 7.75 | -1% || 164.74 | 157.85 | -4% | 0.0000 |
| unsucc.: || 1.98 | 1.99 | +1% || 36.26 | 33.75 | -7% | |
| Stock-Level || 5.54 | 5.48 | -1% || 18.49 | 17.79 | -4% | 0.0000 |
+--------------++----------+---------+--------++----------+----------+--------+---------+
| Sum || 129.07 | 133.86 | +4% || | | | |
| Geomean || | | || | | -4% | |
+--------------++----------+---------+--------++----------+----------+--------+---------+hyriseBenchmarkJoinOrder - single-threaded Sum of avg. item runtimes: -7% || Geometric mean of throughput changes: +1%Configuration Overview - click to expand +Configuration Overview---+--------------------------------------------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkJoinOrder_6012f29ab8781fbfbfef89d55745f7547796caab_st.json | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkJoinOrder_85450217ce7cb6cd090d5efa04b6051fe625caf2_st.json |
+-------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 6012f29ab8781fbfbfef89d55745f7547796caab | 85450217ce7cb6cd090d5efa04b6051fe625caf2 |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.6 | clang 17.0.6 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-08 13:39:11 | 2025-06-08 17:22:43 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| 10a || 107.33 | 106.60 | -1%˄ || 9.32 | 9.38 | +1%˄ | (run time too short) |
+| 10b || 67.70 | 64.25 | -5%˄ || 14.77 | 15.56 | +5%˄ | (run time too short) |
+| 10c || 330.02 | 298.54 | -10%˄ || 3.03 | 3.35 | +11%˄ | (run time too short) |
-| 11a || 29.84 | 36.82 | +23%˄ || 33.51 | 27.16 | -19%˄ | (run time too short) |
-| 11b || 24.81 | 31.17 | +26%˄ || 40.29 | 32.08 | -20%˄ | (run time too short) |
| 11c || 24.65 | 24.75 | +0%˄ || 40.57 | 40.40 | -0%˄ | (run time too short) |
| 11d || 23.56 | 23.45 | -0%˄ || 42.44 | 42.65 | +0%˄ | (run time too short) |
-| 12a || 31.56 | 45.81 | +45%˄ || 31.68 | 21.83 | -31%˄ | (run time too short) |
-| 12b || 28.12 | 32.13 | +14%˄ || 35.56 | 31.12 | -12%˄ | (run time too short) |
-| 12c || 71.84 | 76.66 | +7%˄ || 13.92 | 13.04 | -6%˄ | (run time too short) |
| 13a || 185.16 | 184.46 | -0%˄ || 5.40 | 5.42 | +0%˄ | (run time too short) |
| 13b || 234.84 | 239.62 | +2%˄ || 4.26 | 4.17 | -2%˄ | (run time too short) |
-| 13c || 32.16 | 38.16 | +19%˄ || 31.09 | 26.20 | -16%˄ | (run time too short) |
| 13d || 519.55 | 525.16 | +1%˄ || 1.92 | 1.90 | -1%˄ | (run time too short) |
| 14a || 100.05 | 99.05 | -1%˄ || 9.99 | 10.10 | +1%˄ | (run time too short) |
| 14b || 108.28 | 112.42 | +4%˄ || 9.24 | 8.89 | -4%˄ | (run time too short) |
| 14c || 178.39 | 183.34 | +3%˄ || 5.61 | 5.45 | -3%˄ | (run time too short) |
| 15a || 52.99 | 54.93 | +4%˄ || 18.87 | 18.20 | -4%˄ | (run time too short) |
-| 15b || 56.59 | 71.51 | +26%˄ || 17.67 | 13.98 | -21%˄ | (run time too short) |
-| 15c || 42.86 | 45.42 | +6%˄ || 23.33 | 22.02 | -6%˄ | (run time too short) |
| 15d || 40.13 | 41.33 | +3%˄ || 24.91 | 24.19 | -3%˄ | (run time too short) |
+| 16a || 1383.23 | 1221.31 | -12% || 0.72 | 0.82 | +14% | 0.0000 |
+| 16b || 2594.48 | 2384.03 | -8% || 0.38 | 0.42 | +9% | 0.0000 |
+| 16c || 1565.33 | 1378.32 | -12% || 0.63 | 0.72 | +13% | 0.0000 |
+| 16d || 1519.18 | 1341.12 | -12% || 0.65 | 0.73 | +13% | 0.0000 |
+| 17a || 452.27 | 380.76 | -16%˄ || 2.21 | 2.63 | +19%˄ | (run time too short) |
+| 17b || 360.27 | 298.61 | -17%˄ || 2.78 | 3.35 | +21%˄ | (run time too short) |
+| 17c || 339.26 | 281.81 | -17%˄ || 2.95 | 3.55 | +20%˄ | (run time too short) |
+| 17d || 406.54 | 348.94 | -14%˄ || 2.46 | 2.87 | +17%˄ | (run time too short) |
+| 17e || 1625.23 | 1448.34 | -11% || 0.60 | 0.68 | +14% | (run time too short) |
+| 17f || 908.71 | 821.19 | -10%˄ || 1.10 | 1.22 | +11%˄ | (run time too short) |
-| 18a || 133.71 | 142.70 | +7%˄ || 7.48 | 7.01 | -6%˄ | (run time too short) |
-| 18b || 104.81 | 115.76 | +10%˄ || 9.54 | 8.64 | -9%˄ | (run time too short) |
| 18c || 191.76 | 188.82 | -2%˄ || 5.21 | 5.30 | +2%˄ | (run time too short) |
-| 19a || 209.98 | 235.46 | +12%˄ || 4.76 | 4.25 | -11%˄ | (run time too short) |
-| 19b || 173.95 | 194.06 | +12%˄ || 5.75 | 5.15 | -10%˄ | (run time too short) |
-| 19c || 250.70 | 263.81 | +5%˄ || 3.99 | 3.79 | -5%˄ | (run time too short) |
| 19d || 721.05 | 719.47 | -0%˄ || 1.39 | 1.39 | +0%˄ | (run time too short) |
| 1a || 10.14 | 10.37 | +2%˄ || 98.57 | 96.41 | -2%˄ | (run time too short) |
-| 1b || 16.17 | 28.85 | +78%˄ || 61.84 | 34.66 | -44%˄ | (run time too short) |
-| 1c || 16.45 | 20.07 | +22%˄ || 60.77 | 49.83 | -18%˄ | (run time too short) |
| 1d || 9.47 | 9.84 | +4%˄ || 105.55 | 101.59 | -4%˄ | (run time too short) |
+| 20a || 529.26 | 505.22 | -5%˄ || 1.89 | 1.98 | +5%˄ | (run time too short) |
+| 20b || 566.78 | 541.17 | -5%˄ || 1.76 | 1.85 | +5%˄ | (run time too short) |
+| 20c || 375.07 | 336.21 | -10%˄ || 2.67 | 2.97 | +12%˄ | (run time too short) |
-| 21a || 45.58 | 52.55 | +15%˄ || 21.94 | 19.03 | -13%˄ | (run time too short) |
-| 21b || 35.52 | 45.10 | +27%˄ || 28.15 | 22.17 | -21%˄ | (run time too short) |
| 21c || 41.80 | 41.92 | +0%˄ || 23.92 | 23.85 | -0%˄ | (run time too short) |
| 22a || 172.27 | 172.67 | +0%˄ || 5.80 | 5.79 | -0%˄ | (run time too short) |
| 22b || 154.91 | 154.16 | -0%˄ || 6.46 | 6.49 | +0%˄ | (run time too short) |
+| 22c || 237.77 | 226.92 | -5%˄ || 4.21 | 4.41 | +5%˄ | (run time too short) |
+| 22d || 364.05 | 346.16 | -5%˄ || 2.75 | 2.89 | +5%˄ | (run time too short) |
| 23a || 47.54 | 46.65 | -2%˄ || 21.03 | 21.43 | +2%˄ | (run time too short) |
| 23b || 54.81 | 52.81 | -4%˄ || 18.25 | 18.94 | +4%˄ | (run time too short) |
| 23c || 50.71 | 49.36 | -3%˄ || 19.72 | 20.26 | +3%˄ | (run time too short) |
+| 24a || 227.56 | 205.91 | -10%˄ || 4.39 | 4.86 | +11%˄ | (run time too short) |
+| 24b || 212.23 | 191.38 | -10%˄ || 4.71 | 5.23 | +11%˄ | (run time too short) |
+| 25a || 109.94 | 96.10 | -13%˄ || 9.10 | 10.41 | +14%˄ | (run time too short) |
+| 25b || 71.17 | 62.90 | -12%˄ || 14.05 | 15.90 | +13%˄ | (run time too short) |
+| 25c || 245.36 | 222.62 | -9%˄ || 4.08 | 4.49 | +10%˄ | (run time too short) |
+| 26a || 173.76 | 134.25 | -23%˄ || 5.75 | 7.45 | +29%˄ | (run time too short) |
+| 26b || 145.99 | 118.49 | -19%˄ || 6.85 | 8.44 | +23%˄ | (run time too short) |
+| 26c || 321.83 | 242.63 | -25%˄ || 3.11 | 4.12 | +33%˄ | (run time too short) |
-| 27a || 38.78 | 44.66 | +15%˄ || 25.78 | 22.39 | -13%˄ | (run time too short) |
-| 27b || 26.92 | 31.65 | +18%˄ || 37.14 | 31.59 | -15%˄ | (run time too short) |
+| 27c || 41.68 | 36.87 | -12%˄ || 23.99 | 27.12 | +13%˄ | (run time too short) |
+| 28a || 201.30 | 192.33 | -4%˄ || 4.97 | 5.20 | +5%˄ | (run time too short) |
| 28b || 74.09 | 75.59 | +2%˄ || 13.50 | 13.23 | -2%˄ | (run time too short) |
| 28c || 177.31 | 170.42 | -4%˄ || 5.64 | 5.87 | +4%˄ | (run time too short) |
+| 29a || 185.09 | 171.92 | -7%˄ || 5.40 | 5.82 | +8%˄ | (run time too short) |
| 29b || 762.16 | 753.48 | -1%˄ || 1.31 | 1.33 | +1%˄ | (run time too short) |
+| 29c || 228.44 | 216.63 | -5%˄ || 4.38 | 4.62 | +5%˄ | (run time too short) |
+| 2a || 29.54 | 28.09 | -5%˄ || 33.85 | 35.60 | +5%˄ | (run time too short) |
| 2b || 27.09 | 26.14 | -4%˄ || 36.91 | 38.25 | +4%˄ | (run time too short) |
| 2c || 22.62 | 22.46 | -1%˄ || 44.21 | 44.51 | +1%˄ | (run time too short) |
+| 2d || 56.88 | 54.04 | -5%˄ || 17.58 | 18.50 | +5%˄ | (run time too short) |
+| 30a || 96.16 | 85.65 | -11%˄ || 10.40 | 11.67 | +12%˄ | (run time too short) |
+| 30b || 98.02 | 88.79 | -9%˄ || 10.20 | 11.26 | +10%˄ | (run time too short) |
+| 30c || 165.37 | 146.57 | -11%˄ || 6.05 | 6.82 | +13%˄ | (run time too short) |
+| 31a || 85.72 | 75.54 | -12%˄ || 11.67 | 13.24 | +13%˄ | (run time too short) |
+| 31b || 84.50 | 74.22 | -12%˄ || 11.83 | 13.47 | +14%˄ | (run time too short) |
+| 31c || 97.41 | 84.42 | -13%˄ || 10.27 | 11.85 | +15%˄ | (run time too short) |
+| 32a || 15.45 | 13.78 | -11%˄ || 64.72 | 72.55 | +12%˄ | (run time too short) |
+| 32b || 36.15 | 32.42 | -10%˄ || 27.66 | 30.84 | +12%˄ | (run time too short) |
-| 33a || 35.94 | 50.14 | +40%˄ || 27.82 | 19.94 | -28%˄ | (run time too short) |
-| 33b || 23.56 | 28.94 | +23%˄ || 42.44 | 34.55 | -19%˄ | (run time too short) |
-| 33c || 47.39 | 55.30 | +17%˄ || 21.10 | 18.08 | -14%˄ | (run time too short) |
+| 3a || 71.02 | 67.17 | -5%˄ || 14.08 | 14.89 | +6%˄ | (run time too short) |
-| 3b || 19.65 | 23.36 | +19%˄ || 50.88 | 42.80 | -16%˄ | (run time too short) |
+| 3c || 222.15 | 208.42 | -6%˄ || 4.50 | 4.80 | +7%˄ | (run time too short) |
| 4a || 148.92 | 149.96 | +1%˄ || 6.71 | 6.67 | -1%˄ | (run time too short) |
-| 4b || 18.44 | 22.81 | +24%˄ || 54.21 | 43.84 | -19%˄ | (run time too short) |
| 4c || 187.79 | 186.29 | -1%˄ || 5.33 | 5.37 | +1%˄ | (run time too short) |
| 5a || 53.70 | 51.99 | -3%˄ || 18.62 | 19.23 | +3%˄ | (run time too short) |
-| 5b || 52.01 | 55.09 | +6%˄ || 19.23 | 18.15 | -6%˄ | (run time too short) |
+| 5c || 91.65 | 84.87 | -7%˄ || 10.91 | 11.78 | +8%˄ | (run time too short) |
+| 6a || 154.19 | 131.22 | -15%˄ || 6.49 | 7.62 | +18%˄ | (run time too short) |
+| 6b || 165.63 | 141.21 | -15%˄ || 6.04 | 7.08 | +17%˄ | (run time too short) |
+| 6c || 144.38 | 119.89 | -17%˄ || 6.93 | 8.34 | +20%˄ | (run time too short) |
+| 6d || 366.60 | 326.87 | -11%˄ || 2.73 | 3.06 | +12%˄ | (run time too short) |
+| 6e || 151.39 | 123.41 | -18%˄ || 6.61 | 8.10 | +23%˄ | (run time too short) |
+| 6f || 701.58 | 634.33 | -10%˄ || 1.43 | 1.58 | +11%˄ | (run time too short) |
-| 7a || 89.46 | 113.24 | +27%˄ || 11.18 | 8.83 | -21%˄ | (run time too short) |
-| 7b || 83.09 | 106.68 | +28%˄ || 12.03 | 9.37 | -22%˄ | (run time too short) |
| 7c || 553.60 | 536.20 | -3%˄ || 1.81 | 1.86 | +3%˄ | (run time too short) |
+| 8a || 182.79 | 171.79 | -6%˄ || 5.47 | 5.82 | +6%˄ | (run time too short) |
| 8b || 170.61 | 175.04 | +3%˄ || 5.86 | 5.71 | -3%˄ | (run time too short) |
+| 8c || 1804.63 | 1722.71 | -5% || 0.55 | 0.57 | +3% | (run time too short) |
| 8d || 479.07 | 472.54 | -1%˄ || 2.09 | 2.12 | +1%˄ | (run time too short) |
+| 9a || 265.15 | 227.46 | -14%˄ || 3.77 | 4.40 | +17%˄ | (run time too short) |
+| 9b || 151.03 | 143.96 | -5%˄ || 6.62 | 6.95 | +5%˄ | (run time too short) |
+| 9c || 316.40 | 269.37 | -15%˄ || 3.16 | 3.71 | +17%˄ | (run time too short) |
+| 9d || 459.70 | 416.26 | -9%˄ || 2.18 | 2.40 | +10%˄ | (run time too short) |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
+| Sum || 29229.22 | 27256.54 | -7% || | | | |
| Geomean || | | || | | +1% | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkJoinOrder - multi-threaded, ordered, 1 client, 64 cores Sum of avg. item runtimes: -5% || Geometric mean of throughput changes: +2%Configuration Overview - click to expand +Configuration Overview---------+----------------------------------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkJoinOrder_6012f29ab8781fbfbfef89d55745f7547796caab_mt_ordered.json | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkJoinOrder_85450217ce7cb6cd090d5efa04b6051fe625caf2_mt_ordered.json |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 6012f29ab8781fbfbfef89d55745f7547796caab | 85450217ce7cb6cd090d5efa04b6051fe625caf2 |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.6 | clang 17.0.6 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-08 14:03:23 | 2025-06-08 17:46:07 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| 10a || 37.96 | 37.27 | -2%˄ || 26.32 | 26.80 | +2%˄ | (run time too short) |
+| 10b || 18.28 | 17.47 | -4%˄ || 54.58 | 57.13 | +5%˄ | (run time too short) |
+| 10c || 119.62 | 105.65 | -12%˄ || 8.36 | 9.46 | +13%˄ | (run time too short) |
| 11a || 10.57 | 10.53 | -0%˄ || 94.28 | 94.61 | +0%˄ | (run time too short) |
| 11b || 8.36 | 8.47 | +1%˄ || 119.15 | 117.58 | -1%˄ | (run time too short) |
| 11c || 22.97 | 23.15 | +1%˄ || 43.46 | 43.13 | -1%˄ | (run time too short) |
| 11d || 27.15 | 26.59 | -2%˄ || 36.78 | 37.56 | +2%˄ | (run time too short) |
| 12a || 21.26 | 20.47 | -4%˄ || 46.96 | 48.78 | +4%˄ | (run time too short) |
| 12b || 12.18 | 11.98 | -2%˄ || 81.85 | 83.23 | +2%˄ | (run time too short) |
| 12c || 50.66 | 49.24 | -3%˄ || 19.72 | 20.29 | +3%˄ | (run time too short) |
| 13a || 135.13 | 133.09 | -2%˄ || 7.40 | 7.51 | +2%˄ | (run time too short) |
| 13b || 91.32 | 92.89 | +2%˄ || 10.95 | 10.76 | -2%˄ | (run time too short) |
| 13c || 15.61 | 15.96 | +2%˄ || 63.90 | 62.49 | -2%˄ | (run time too short) |
| 13d || 377.19 | 362.26 | -4%˄ || 2.65 | 2.76 | +4%˄ | (run time too short) |
| 14a || 57.31 | 55.50 | -3%˄ || 17.44 | 18.01 | +3%˄ | (run time too short) |
| 14b || 71.36 | 71.42 | +0%˄ || 14.01 | 13.99 | -0%˄ | (run time too short) |
| 14c || 116.90 | 113.47 | -3%˄ || 8.55 | 8.81 | +3%˄ | (run time too short) |
| 15a || 29.62 | 29.02 | -2%˄ || 33.72 | 34.42 | +2%˄ | (run time too short) |
| 15b || 24.96 | 24.42 | -2%˄ || 40.00 | 40.89 | +2%˄ | (run time too short) |
| 15c || 22.48 | 21.54 | -4%˄ || 44.41 | 46.36 | +4%˄ | (run time too short) |
| 15d || 28.66 | 27.87 | -3%˄ || 34.84 | 35.83 | +3%˄ | (run time too short) |
+| 16a || 824.85 | 745.63 | -10%˄ || 1.21 | 1.34 | +11%˄ | (run time too short) |
+| 16b || 2070.87 | 1963.23 | -5% || 0.47 | 0.50 | +7% | (run time too short) |
+| 16c || 987.25 | 897.68 | -9%˄ || 1.01 | 1.11 | +10%˄ | (run time too short) |
+| 16d || 955.63 | 869.40 | -9%˄ || 1.05 | 1.15 | +10%˄ | (run time too short) |
| 17a || 186.05 | 180.61 | -3%˄ || 5.37 | 5.54 | +3%˄ | (run time too short) |
| 17b || 153.76 | 150.29 | -2%˄ || 6.50 | 6.65 | +2%˄ | (run time too short) |
| 17c || 130.63 | 128.44 | -2%˄ || 7.65 | 7.78 | +2%˄ | (run time too short) |
| 17d || 126.26 | 122.48 | -3%˄ || 7.92 | 8.16 | +3%˄ | (run time too short) |
+| 17e || 829.51 | 779.59 | -6%˄ || 1.21 | 1.28 | +6%˄ | (run time too short) |
| 17f || 324.95 | 314.33 | -3%˄ || 3.08 | 3.18 | +3%˄ | (run time too short) |
| 18a || 52.86 | 50.70 | -4%˄ || 18.90 | 19.71 | +4%˄ | (run time too short) |
| 18b || 50.20 | 48.77 | -3%˄ || 19.91 | 20.49 | +3%˄ | (run time too short) |
| 18c || 98.79 | 96.15 | -3%˄ || 10.12 | 10.40 | +3%˄ | (run time too short) |
| 19a || 101.07 | 97.39 | -4%˄ || 9.89 | 10.26 | +4%˄ | (run time too short) |
| 19b || 62.46 | 59.99 | -4%˄ || 16.00 | 16.66 | +4%˄ | (run time too short) |
+| 19c || 115.36 | 110.26 | -4%˄ || 8.67 | 9.07 | +5%˄ | (run time too short) |
| 19d || 527.94 | 519.19 | -2%˄ || 1.89 | 1.93 | +2%˄ | (run time too short) |
| 1a || 6.29 | 6.25 | -1%˄ || 158.21 | 159.18 | +1%˄ | (run time too short) |
-| 1b || 4.50 | 7.37 | +64%˄ || 220.64 | 134.98 | -39%˄ | (run time too short) |
-| 1c || 4.09 | 5.05 | +23%˄ || 242.53 | 196.87 | -19%˄ | (run time too short) |
| 1d || 5.00 | 4.93 | -1%˄ || 198.61 | 201.57 | +1%˄ | (run time too short) |
| 20a || 83.98 | 83.25 | -1%˄ || 11.90 | 12.01 | +1%˄ | (run time too short) |
| 20b || 73.55 | 74.42 | +1%˄ || 13.59 | 13.43 | -1%˄ | (run time too short) |
+| 20c || 79.47 | 73.44 | -8%˄ || 12.58 | 13.61 | +8%˄ | (run time too short) |
| 21a || 16.73 | 16.47 | -2%˄ || 59.64 | 60.59 | +2%˄ | (run time too short) |
| 21b || 14.91 | 14.87 | -0%˄ || 66.89 | 67.09 | +0%˄ | (run time too short) |
| 21c || 18.61 | 18.20 | -2%˄ || 53.63 | 54.82 | +2%˄ | (run time too short) |
+| 22a || 73.78 | 69.63 | -6%˄ || 13.55 | 14.35 | +6%˄ | (run time too short) |
| 22b || 52.73 | 52.64 | -0%˄ || 18.95 | 18.98 | +0%˄ | (run time too short) |
+| 22c || 123.53 | 115.34 | -7%˄ || 8.09 | 8.67 | +7%˄ | (run time too short) |
| 22d || 220.23 | 211.73 | -4%˄ || 4.54 | 4.72 | +4%˄ | (run time too short) |
| 23a || 16.30 | 15.67 | -4%˄ || 61.23 | 63.68 | +4%˄ | (run time too short) |
| 23b || 26.75 | 25.83 | -3%˄ || 37.34 | 38.67 | +4%˄ | (run time too short) |
| 23c || 18.63 | 17.86 | -4%˄ || 53.58 | 55.88 | +4%˄ | (run time too short) |
| 24a || 59.87 | 59.90 | +0%˄ || 16.69 | 16.68 | -0%˄ | (run time too short) |
| 24b || 59.81 | 58.80 | -2%˄ || 16.71 | 17.00 | +2%˄ | (run time too short) |
| 25a || 57.75 | 55.89 | -3%˄ || 17.30 | 17.88 | +3%˄ | (run time too short) |
| 25b || 32.47 | 31.88 | -2%˄ || 30.76 | 31.33 | +2%˄ | (run time too short) |
+| 25c || 158.78 | 151.94 | -4%˄ || 6.30 | 6.58 | +5%˄ | (run time too short) |
+| 26a || 86.51 | 78.55 | -9%˄ || 11.55 | 12.72 | +10%˄ | (run time too short) |
+| 26b || 64.52 | 56.11 | -13%˄ || 15.49 | 17.81 | +15%˄ | (run time too short) |
+| 26c || 131.40 | 118.23 | -10%˄ || 7.61 | 8.46 | +11%˄ | (run time too short) |
| 27a || 19.61 | 19.35 | -1%˄ || 50.89 | 51.58 | +1%˄ | (run time too short) |
| 27b || 18.13 | 17.90 | -1%˄ || 55.04 | 55.74 | +1%˄ | (run time too short) |
| 27c || 18.18 | 17.79 | -2%˄ || 54.89 | 56.11 | +2%˄ | (run time too short) |
| 28a || 124.36 | 122.45 | -2%˄ || 8.04 | 8.16 | +2%˄ | (run time too short) |
| 28b || 27.54 | 26.80 | -3%˄ || 36.26 | 37.27 | +3%˄ | (run time too short) |
| 28c || 104.28 | 101.26 | -3%˄ || 9.59 | 9.87 | +3%˄ | (run time too short) |
| 29a || 52.61 | 52.67 | +0%˄ || 18.99 | 18.97 | -0%˄ | (run time too short) |
| 29b || 134.06 | 134.49 | +0%˄ || 7.46 | 7.43 | -0%˄ | (run time too short) |
| 29c || 65.09 | 65.14 | +0%˄ || 15.35 | 15.34 | -0%˄ | (run time too short) |
| 2a || 22.24 | 21.37 | -4%˄ || 44.89 | 46.74 | +4%˄ | (run time too short) |
| 2b || 20.01 | 19.89 | -1%˄ || 49.90 | 50.19 | +1%˄ | (run time too short) |
| 2c || 13.75 | 14.03 | +2%˄ || 72.57 | 71.14 | -2%˄ | (run time too short) |
| 2d || 51.79 | 50.74 | -2%˄ || 19.29 | 19.70 | +2%˄ | (run time too short) |
| 30a || 48.76 | 46.97 | -4%˄ || 20.49 | 21.27 | +4%˄ | (run time too short) |
| 30b || 36.80 | 36.07 | -2%˄ || 27.15 | 27.69 | +2%˄ | (run time too short) |
| 30c || 115.43 | 112.27 | -3%˄ || 8.66 | 8.90 | +3%˄ | (run time too short) |
| 31a || 38.48 | 37.26 | -3%˄ || 25.96 | 26.81 | +3%˄ | (run time too short) |
| 31b || 34.28 | 33.75 | -2%˄ || 29.14 | 29.59 | +2%˄ | (run time too short) |
+| 31c || 42.77 | 40.87 | -4%˄ || 23.36 | 24.44 | +5%˄ | (run time too short) |
| 32a || 6.42 | 6.28 | -2%˄ || 155.10 | 158.50 | +2%˄ | (run time too short) |
| 32b || 29.93 | 30.05 | +0%˄ || 33.38 | 33.24 | -0%˄ | (run time too short) |
-| 33a || 10.63 | 13.76 | +29%˄ || 93.78 | 72.48 | -23%˄ | (run time too short) |
-| 33b || 8.30 | 9.56 | +15%˄ || 120.05 | 104.24 | -13%˄ | (run time too short) |
-| 33c || 18.59 | 20.14 | +8%˄ || 53.70 | 49.56 | -8%˄ | (run time too short) |
+| 3a || 38.64 | 32.22 | -17%˄ || 25.85 | 31.00 | +20%˄ | (run time too short) |
| 3b || 6.43 | 6.44 | +0%˄ || 154.71 | 154.51 | -0%˄ | (run time too short) |
+| 3c || 73.34 | 69.22 | -6%˄ || 13.63 | 14.44 | +6%˄ | (run time too short) |
+| 4a || 68.79 | 65.70 | -4%˄ || 14.53 | 15.21 | +5%˄ | (run time too short) |
-| 4b || 5.31 | 5.64 | +6%˄ || 187.05 | 176.19 | -6%˄ | (run time too short) |
+| 4c || 89.41 | 84.60 | -5%˄ || 11.18 | 11.82 | +6%˄ | (run time too short) |
| 5a || 24.68 | 25.29 | +2%˄ || 40.45 | 39.48 | -2%˄ | (run time too short) |
| 5b || 19.90 | 20.19 | +1%˄ || 50.17 | 49.44 | -1%˄ | (run time too short) |
| 5c || 48.73 | 48.44 | -1%˄ || 20.51 | 20.63 | +1%˄ | (run time too short) |
+| 6a || 29.26 | 23.70 | -19%˄ || 34.14 | 42.13 | +23%˄ | (run time too short) |
+| 6b || 51.28 | 44.06 | -14%˄ || 19.48 | 22.68 | +16%˄ | (run time too short) |
+| 6c || 27.45 | 22.20 | -19%˄ || 36.38 | 44.97 | +24%˄ | (run time too short) |
| 6d || 128.48 | 127.98 | -0%˄ || 7.78 | 7.81 | +0%˄ | (run time too short) |
+| 6e || 29.05 | 23.75 | -18%˄ || 34.38 | 42.04 | +22%˄ | (run time too short) |
| 6f || 478.19 | 467.51 | -2%˄ || 2.09 | 2.14 | +2%˄ | (run time too short) |
| 7a || 27.00 | 27.18 | +1%˄ || 36.98 | 36.74 | -1%˄ | (run time too short) |
| 7b || 25.69 | 25.80 | +0%˄ || 38.87 | 38.71 | -0%˄ | (run time too short) |
| 7c || 258.54 | 257.48 | -0%˄ || 3.87 | 3.88 | +0%˄ | (run time too short) |
| 8a || 40.75 | 40.28 | -1%˄ || 24.51 | 24.80 | +1%˄ | (run time too short) |
| 8b || 39.53 | 39.34 | -0%˄ || 25.27 | 25.39 | +0%˄ | (run time too short) |
+| 8c || 1138.26 | 1087.62 | -4%˄ || 0.88 | 0.92 | +5%˄ | (run time too short) |
| 8d || 277.08 | 270.60 | -2%˄ || 3.61 | 3.70 | +2%˄ | (run time too short) |
+| 9a || 131.76 | 124.98 | -5%˄ || 7.59 | 8.00 | +5%˄ | (run time too short) |
| 9b || 74.24 | 71.35 | -4%˄ || 13.46 | 14.01 | +4%˄ | (run time too short) |
| 9c || 148.72 | 142.93 | -4%˄ || 6.72 | 6.99 | +4%˄ | (run time too short) |
| 9d || 361.62 | 354.94 | -2%˄ || 2.77 | 2.82 | +2%˄ | (run time too short) |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
+| Sum || 15092.34 | 14376.95 | -5% || | | | |
| Geomean || | | || | | +2% | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkJoinOrder - multi-threaded, shuffled, 64 clients, 64 cores Sum of avg. item runtimes: -8% || Geometric mean of throughput changes: +8%Configuration Overview - click to expand +Configuration Overview---------+--------------------------------------------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkJoinOrder_6012f29ab8781fbfbfef89d55745f7547796caab_mt.json | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkJoinOrder_85450217ce7cb6cd090d5efa04b6051fe625caf2_mt.json |
+-------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 6012f29ab8781fbfbfef89d55745f7547796caab | 85450217ce7cb6cd090d5efa04b6051fe625caf2 |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| compiler | clang 17.0.6 | clang 17.0.6 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-08 14:17:54 | 2025-06-08 18:00:08 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+---------+
+| 10a || 200.79 | 195.83 | -2% || 1.18 | 1.27 | +8% | 0.7797 |
+| 10b || 134.27 | 127.36 | -5% || 1.18 | 1.27 | +8% | 0.6087 |
+| 10c || 671.20 | 585.57 | -13% || 1.18 | 1.27 | +8% | 0.0052 |
+| 11a || 104.82 | 91.38 | -13% || 1.18 | 1.27 | +8% | 0.3442 |
+| 11b || 93.11 | 79.58 | -15% || 1.18 | 1.27 | +8% | 0.2445 |
+| 11c || 126.12 | 112.77 | -11% || 1.18 | 1.27 | +8% | 0.2129 |
+| 11d || 97.62 | 96.52 | -1% || 1.18 | 1.27 | +8% | 0.9137 |
+| 12a || 137.70 | 155.71 | +13% || 1.18 | 1.27 | +8% | 0.2086 |
+| 12b || 85.38 | 79.84 | -6% || 1.18 | 1.27 | +8% | 0.6407 |
+| 12c || 366.52 | 349.57 | -5% || 1.18 | 1.27 | +8% | 0.4833 |
+| 13a || 523.26 | 467.38 | -11% || 1.18 | 1.27 | +8% | 0.0318 |
+| 13b || 370.06 | 434.71 | +17% || 1.18 | 1.27 | +8% | 0.0330 |
+| 13c || 93.64 | 91.82 | -2% || 1.18 | 1.27 | +8% | 0.8590 |
+| 13d || 953.00 | 914.07 | -4% || 1.18 | 1.27 | +8% | 0.2001 |
+| 14a || 449.67 | 371.54 | -17% || 1.18 | 1.27 | +8% | 0.0016 |
+| 14b || 444.84 | 422.53 | -5% || 1.18 | 1.27 | +8% | 0.3680 |
+| 14c || 656.66 | 617.36 | -6% || 1.18 | 1.27 | +8% | 0.2209 |
+| 15a || 138.04 | 114.44 | -17% || 1.18 | 1.27 | +8% | 0.1240 |
+| 15b || 130.51 | 132.46 | +1% || 1.18 | 1.27 | +8% | 0.8934 |
+| 15c || 132.82 | 139.31 | +5% || 1.18 | 1.27 | +8% | 0.6589 |
+| 15d || 142.41 | 138.98 | -2% || 1.18 | 1.27 | +8% | 0.7820 |
+| 16a || 1813.18 | 1579.68 | -13% || 1.17 | 1.27 | +8% | 0.0000 |
+| 16b || 3294.41 | 3079.15 | -7% || 1.17 | 1.27 | +8% | 0.0000 |
+| 16c || 2030.84 | 1827.76 | -10% || 1.18 | 1.27 | +8% | 0.0000 |
+| 16d || 1950.52 | 1787.17 | -8% || 1.17 | 1.27 | +8% | 0.0000 |
+| 17a || 903.59 | 870.00 | -4% || 1.18 | 1.27 | +8% | 0.3213 |
+| 17b || 691.05 | 613.04 | -11% || 1.18 | 1.27 | +8% | 0.0108 |
+| 17c || 620.19 | 558.03 | -10% || 1.18 | 1.27 | +8% | 0.0307 |
+| 17d || 627.27 | 570.87 | -9% || 1.18 | 1.27 | +8% | 0.0558 |
+| 17e || 1853.40 | 1698.53 | -8% || 1.18 | 1.27 | +8% | 0.0001 |
+| 17f || 1248.09 | 1066.63 | -15% || 1.18 | 1.27 | +8% | 0.0000 |
+| 18a || 309.11 | 261.15 | -16% || 1.18 | 1.27 | +8% | 0.0308 |
+| 18b || 429.29 | 381.62 | -11% || 1.18 | 1.27 | +8% | 0.1056 |
+| 18c || 636.30 | 593.78 | -7% || 1.18 | 1.27 | +8% | 0.1783 |
+| 19a || 629.87 | 553.48 | -12% || 1.18 | 1.27 | +8% | 0.0173 |
+| 19b || 390.82 | 407.28 | +4% || 1.18 | 1.27 | +8% | 0.5010 |
+| 19c || 647.03 | 624.04 | -4% || 1.18 | 1.27 | +8% | 0.4842 |
+| 19d || 1504.90 | 1435.20 | -5% || 1.17 | 1.27 | +8% | 0.0806 |
+| 1a || 43.52 | 36.20 | -17% || 1.18 | 1.27 | +8% | 0.2956 |
+| 1b || 55.62 | 39.85 | -28% || 1.18 | 1.27 | +8% | 0.0213 |
+| 1c || 55.36 | 52.01 | -6% || 1.18 | 1.27 | +8% | 0.6742 |
+| 1d || 36.33 | 32.65 | -10% || 1.18 | 1.27 | +8% | 0.5802 |
+| 20a || 527.05 | 450.15 | -15% || 1.18 | 1.27 | +8% | 0.0112 |
+| 20b || 449.16 | 400.74 | -11% || 1.18 | 1.27 | +8% | 0.0810 |
+| 20c || 411.87 | 355.79 | -14% || 1.18 | 1.27 | +8% | 0.0188 |
+| 21a || 180.96 | 209.99 | +16% || 1.18 | 1.27 | +8% | 0.1611 |
+| 21b || 125.21 | 133.49 | +7% || 1.18 | 1.27 | +8% | 0.5537 |
+| 21c || 192.96 | 186.17 | -4% || 1.18 | 1.27 | +8% | 0.7414 |
+| 22a || 465.99 | 479.95 | +3% || 1.18 | 1.27 | +8% | 0.6059 |
+| 22b || 448.02 | 420.25 | -6% || 1.18 | 1.27 | +8% | 0.3640 |
+| 22c || 717.43 | 644.15 | -10% || 1.18 | 1.27 | +8% | 0.0208 |
+| 22d || 1022.17 | 931.46 | -9% || 1.18 | 1.27 | +8% | 0.0193 |
+| 23a || 166.24 | 166.18 | -0% || 1.18 | 1.27 | +8% | 0.9972 |
+| 23b || 159.03 | 119.08 | -25% || 1.18 | 1.27 | +8% | 0.0229 |
+| 23c || 152.53 | 159.83 | +5% || 1.18 | 1.27 | +8% | 0.6207 |
+| 24a || 424.39 | 414.01 | -2% || 1.18 | 1.27 | +8% | 0.7188 |
+| 24b || 305.18 | 300.89 | -1% || 1.18 | 1.27 | +8% | 0.8626 |
+| 25a || 432.21 | 382.19 | -12% || 1.18 | 1.27 | +8% | 0.0589 |
+| 25b || 246.87 | 238.72 | -3% || 1.18 | 1.27 | +8% | 0.7184 |
+| 25c || 936.86 | 796.79 | -15% || 1.18 | 1.27 | +8% | 0.0000 |
+| 26a || 424.93 | 379.80 | -11% || 1.18 | 1.27 | +8% | 0.0544 |
+| 26b || 278.74 | 224.64 | -19% || 1.18 | 1.27 | +8% | 0.0015 |
+| 26c || 675.07 | 611.66 | -9% || 1.18 | 1.27 | +8% | 0.0203 |
+| 27a || 185.46 | 170.63 | -8% || 1.18 | 1.27 | +8% | 0.4263 |
+| 27b || 147.55 | 158.98 | +8% || 1.18 | 1.27 | +8% | 0.4680 |
+| 27c || 204.40 | 175.03 | -14% || 1.18 | 1.27 | +8% | 0.1380 |
+| 28a || 694.36 | 650.19 | -6% || 1.18 | 1.27 | +8% | 0.1597 |
+| 28b || 292.20 | 242.80 | -17% || 1.18 | 1.27 | +8% | 0.0283 |
+| 28c || 690.30 | 634.96 | -8% || 1.18 | 1.27 | +8% | 0.1011 |
+| 29a || 273.67 | 276.37 | +1% || 1.18 | 1.27 | +8% | 0.8981 |
+| 29b || 375.38 | 382.13 | +2% || 1.18 | 1.27 | +8% | 0.7911 |
+| 29c || 372.14 | 354.12 | -5% || 1.18 | 1.27 | +8% | 0.4803 |
+| 2a || 131.67 | 112.65 | -14% || 1.18 | 1.27 | +8% | 0.0589 |
+| 2b || 136.96 | 104.05 | -24% || 1.18 | 1.27 | +8% | 0.0016 |
+| 2c || 99.87 | 84.89 | -15% || 1.18 | 1.27 | +8% | 0.1807 |
+| 2d || 213.67 | 183.25 | -14% || 1.18 | 1.27 | +8% | 0.0074 |
+| 30a || 389.70 | 349.17 | -10% || 1.18 | 1.27 | +8% | 0.1473 |
+| 30b || 332.56 | 388.60 | +17% || 1.18 | 1.27 | +8% | 0.0464 |
+| 30c || 708.93 | 595.19 | -16% || 1.18 | 1.27 | +8% | 0.0011 |
+| 31a || 305.82 | 280.60 | -8% || 1.18 | 1.27 | +8% | 0.3146 |
+| 31b || 277.22 | 249.77 | -10% || 1.18 | 1.27 | +8% | 0.2323 |
+| 31c || 353.94 | 325.68 | -8% || 1.18 | 1.27 | +8% | 0.2641 |
+| 32a || 47.73 | 46.33 | -3% || 1.18 | 1.27 | +8% | 0.8588 |
+| 32b || 181.08 | 147.93 | -18% || 1.18 | 1.27 | +8% | 0.0267 |
+| 33a || 119.93 | 111.76 | -7% || 1.18 | 1.27 | +8% | 0.5523 |
+| 33b || 93.86 | 83.36 | -11% || 1.18 | 1.27 | +8% | 0.4024 |
+| 33c || 157.34 | 141.82 | -10% || 1.18 | 1.27 | +8% | 0.3123 |
+| 3a || 297.22 | 229.55 | -23% || 1.18 | 1.27 | +8% | 0.0008 |
+| 3b || 82.31 | 77.18 | -6% || 1.18 | 1.27 | +8% | 0.6997 |
+| 3c || 441.31 | 447.45 | +1% || 1.18 | 1.27 | +8% | 0.8274 |
+| 4a || 291.48 | 242.03 | -17% || 1.18 | 1.27 | +8% | 0.0066 |
+| 4b || 64.90 | 54.49 | -16% || 1.18 | 1.27 | +8% | 0.2079 |
+| 4c || 322.54 | 296.17 | -8% || 1.18 | 1.27 | +8% | 0.1692 |
+| 5a || 274.38 | 260.94 | -5% || 1.18 | 1.27 | +8% | 0.5859 |
+| 5b || 142.86 | 163.30 | +14% || 1.18 | 1.27 | +8% | 0.2174 |
+| 5c || 345.31 | 339.38 | -2% || 1.18 | 1.27 | +8% | 0.8108 |
+| 6a || 158.98 | 132.98 | -16% || 1.18 | 1.27 | +8% | 0.1018 |
+| 6b || 197.14 | 177.25 | -10% || 1.18 | 1.27 | +8% | 0.1900 |
+| 6c || 139.20 | 108.60 | -22% || 1.18 | 1.27 | +8% | 0.0208 |
+| 6d || 584.40 | 532.63 | -9% || 1.18 | 1.27 | +8% | 0.0903 |
+| 6e || 152.21 | 107.08 | -30% || 1.18 | 1.27 | +8% | 0.0001 |
+| 6f || 1274.55 | 1219.95 | -4% || 1.18 | 1.27 | +8% | 0.1053 |
+| 7a || 169.61 | 161.00 | -5% || 1.18 | 1.27 | +8% | 0.6223 |
+| 7b || 145.23 | 153.53 | +6% || 1.18 | 1.27 | +8% | 0.5661 |
+| 7c || 1121.55 | 1048.33 | -7% || 1.18 | 1.27 | +8% | 0.0548 |
+| 8a || 211.00 | 184.67 | -12% || 1.18 | 1.27 | +8% | 0.1615 |
+| 8b || 132.97 | 154.15 | +16% || 1.18 | 1.27 | +8% | 0.1887 |
+| 8c || 2415.36 | 2307.48 | -4% || 1.17 | 1.27 | +8% | 0.0121 |
+| 8d || 909.44 | 865.90 | -5% || 1.18 | 1.27 | +8% | 0.1255 |
+| 9a || 711.25 | 678.43 | -5% || 1.18 | 1.27 | +8% | 0.3575 |
+| 9b || 393.69 | 376.21 | -4% || 1.18 | 1.27 | +8% | 0.4787 |
+| 9c || 800.64 | 704.86 | -12% || 1.18 | 1.27 | +8% | 0.0049 |
+| 9d || 1151.90 | 1088.72 | -5% || 1.18 | 1.27 | +8% | 0.0717 |
+---------++----------+----------+--------++----------+----------+--------+---------+
+| Sum || 54283.18 | 50155.26 | -8% || | | | |
+| Geomean || | | || | | +8% | |
+---------++----------+----------+--------++----------+----------+--------+---------+hyriseBenchmarkStarSchema - single-threaded Sum of avg. item runtimes: +7% || Geometric mean of throughput changes: -11%Configuration Overview - click to expand +Configuration Overview---+---------------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkStarSchema_6012f29ab8781fbfbfef89d55745f7547796caab_st.json | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkStarSchema_85450217ce7cb6cd090d5efa04b6051fe625caf2_st.json |
+-------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 6012f29ab8781fbfbfef89d55745f7547796caab | 85450217ce7cb6cd090d5efa04b6051fe625caf2 |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.6 | clang 17.0.6 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-08 14:38:15 | 2025-06-08 18:20:31 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+ +---------++----------+---------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
-| 1.1 || 412.44 | 587.65 | +42%˄ || 2.42 | 1.70 | -30%˄ | (run time too short) |
-| 1.2 || 234.61 | 649.41 | +177%˄ || 4.26 | 1.54 | -64%˄ | (run time too short) |
-| 1.3 || 223.91 | 652.47 | +191%˄ || 4.47 | 1.53 | -66%˄ | (run time too short) |
+| 2.1 || 508.55 | 400.89 | -21%˄ || 1.97 | 2.49 | +27%˄ | (run time too short) |
+| 2.2 || 281.63 | 203.96 | -28%˄ || 3.55 | 4.90 | +38%˄ | (run time too short) |
+| 2.3 || 177.98 | 118.60 | -33%˄ || 5.62 | 8.43 | +50%˄ | (run time too short) |
| 3.1 || 2537.65 | 2499.06 | -2% || 0.38 | 0.40 | +4% | (run time too short) |
| 3.2 || 277.32 | 265.45 | -4%˄ || 3.61 | 3.77 | +4%˄ | (run time too short) |
-| 3.3 || 114.24 | 126.02 | +10%˄ || 8.75 | 7.94 | -9%˄ | (run time too short) |
-| 3.4 || 108.29 | 122.74 | +13%˄ || 9.23 | 8.15 | -12%˄ | (run time too short) |
+| 4.1 || 2409.20 | 2285.97 | -5% || 0.40 | 0.43 | +8% | (run time too short) |
+| 4.2 || 765.87 | 728.88 | -5%˄ || 1.31 | 1.37 | +5%˄ | (run time too short) |
| 4.3 || 211.41 | 210.62 | -0%˄ || 4.73 | 4.75 | +0%˄ | (run time too short) |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
-| Sum || 8263.09 | 8851.72 | +7% || | | | |
-| Geomean || | | || | | -11% | |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+---------+--------++----------+----------+--------+----------------------+hyriseBenchmarkStarSchema - multi-threaded, ordered, 1 client, 64 cores Sum of avg. item runtimes: +0% || Geometric mean of throughput changes: -7%Configuration Overview - click to expand +Configuration Overview---------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkStarSchema_6012f29ab8781fbfbfef89d55745f7547796caab_mt_ordered.json | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkStarSchema_85450217ce7cb6cd090d5efa04b6051fe625caf2_mt_ordered.json |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 6012f29ab8781fbfbfef89d55745f7547796caab | 85450217ce7cb6cd090d5efa04b6051fe625caf2 |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.6 | clang 17.0.6 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-08 14:43:36 | 2025-06-08 18:26:36 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------+ +---------++----------+---------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
-| 1.1 || 127.52 | 163.07 | +28%˄ || 7.84 | 6.13 | -22%˄ | (run time too short) |
-| 1.2 || 84.03 | 161.28 | +92%˄ || 11.90 | 6.20 | -48%˄ | (run time too short) |
-| 1.3 || 80.84 | 159.98 | +98%˄ || 12.37 | 6.25 | -49%˄ | (run time too short) |
+| 2.1 || 329.07 | 306.25 | -7%˄ || 3.04 | 3.26 | +7%˄ | (run time too short) |
+| 2.2 || 159.20 | 146.39 | -8%˄ || 6.28 | 6.83 | +9%˄ | (run time too short) |
+| 2.3 || 64.79 | 50.96 | -21%˄ || 15.43 | 19.61 | +27%˄ | (run time too short) |
+| 3.1 || 809.89 | 742.95 | -8%˄ || 1.23 | 1.35 | +9%˄ | (run time too short) |
+| 3.2 || 151.26 | 141.41 | -7%˄ || 6.61 | 7.07 | +7%˄ | (run time too short) |
| 3.3 || 77.81 | 76.92 | -1%˄ || 12.84 | 12.99 | +1%˄ | (run time too short) |
| 3.4 || 70.49 | 71.59 | +2%˄ || 14.18 | 13.96 | -2%˄ | (run time too short) |
+| 4.1 || 860.83 | 810.45 | -6%˄ || 1.16 | 1.23 | +6%˄ | (run time too short) |
| 4.2 || 351.34 | 347.78 | -1%˄ || 2.85 | 2.87 | +1%˄ | (run time too short) |
| 4.3 || 110.57 | 113.12 | +2%˄ || 9.04 | 8.84 | -2%˄ | (run time too short) |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| Sum || 3277.63 | 3292.17 | +0% || | | | |
-| Geomean || | | || | | -7% | |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+---------+--------++----------+----------+--------+----------------------+hyriseBenchmarkStarSchema - multi-threaded, shuffled, 64 clients, 64 cores Sum of avg. item runtimes: -5% || Geometric mean of throughput changes: +6%Configuration Overview - click to expand +Configuration Overview---------+---------------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkStarSchema_6012f29ab8781fbfbfef89d55745f7547796caab_mt.json | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkStarSchema_85450217ce7cb6cd090d5efa04b6051fe625caf2_mt.json |
+-------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 6012f29ab8781fbfbfef89d55745f7547796caab | 85450217ce7cb6cd090d5efa04b6051fe625caf2 |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| compiler | clang 17.0.6 | clang 17.0.6 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-08 14:46:54 | 2025-06-08 18:29:58 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+---------+
+| 1.1 || 835.95 | 851.73 | +2% || 3.74 | 3.96 | +6% | 0.4013 |
+| 1.2 || 452.82 | 566.45 | +25% || 3.75 | 3.96 | +6% | 0.0000 |
+| 1.3 || 417.55 | 536.22 | +28% || 3.75 | 3.96 | +6% | 0.0000 |
+| 2.1 || 2117.70 | 1897.91 | -10% || 3.74 | 3.96 | +6% | 0.0000 |
+| 2.2 || 1086.19 | 960.39 | -12% || 3.74 | 3.96 | +6% | 0.0000 |
+| 2.3 || 358.22 | 297.37 | -17% || 3.75 | 3.97 | +6% | 0.0000 |
+| 3.1 || 3274.29 | 3115.98 | -5% || 3.74 | 3.96 | +6% | 0.0000 |
+| 3.2 || 987.58 | 883.55 | -11% || 3.75 | 3.96 | +6% | 0.0000 |
+| 3.3 || 498.91 | 457.04 | -8% || 3.75 | 3.97 | +6% | 0.0084 |
+| 3.4 || 477.35 | 439.61 | -8% || 3.75 | 3.96 | +6% | 0.0123 |
+| 4.1 || 3291.13 | 3093.45 | -6% || 3.74 | 3.96 | +6% | 0.0000 |
+| 4.2 || 2536.91 | 2336.63 | -8% || 3.74 | 3.96 | +6% | 0.0000 |
+| 4.3 || 722.94 | 685.25 | -5% || 3.75 | 3.96 | +6% | 0.0355 |
+---------++----------+----------+--------++----------+----------+--------+---------+
+| Sum || 17057.55 | 16121.57 | -5% || | | | |
+| Geomean || | | || | | +6% | |
+---------++----------+----------+--------++----------+----------+--------+---------+ |
|
Comparing for int and everything else dict with all dict System cx28 - click to expand
Commit Info and Build Time
hyriseBenchmarkTPCH - single-threaded, SF 10.0 Sum of avg. item runtimes: +5% || Geometric mean of throughput changes: -7%Configuration Overview - click to expand +Configuration Overview----+---------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkTPCH_85450217ce7cb6cd090d5efa04b6051fe625caf2_st.json | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkTPCH_036d2ca7327d9f76b74cac0f821834d9638f9d3d_st.json |
+--------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 85450217ce7cb6cd090d5efa04b6051fe625caf2 | 036d2ca7327d9f76b74cac0f821834d9638f9d3d |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 17.0.6 | clang 17.0.6 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-08 15:19:54 | 2025-06-06 17:59:26 |
| encoding | None | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+--------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------+ +----------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| TPC-H 01 || 5738.62 | 5905.77 | +3% || 0.17 | 0.17 | +0% | (run time too short) |
+| TPC-H 02 || 42.07 | 33.80 | -20%˄ || 23.77 | 29.58 | +24%˄ | (run time too short) |
| TPC-H 03 || 1282.88 | 1294.58 | +1% || 0.77 | 0.77 | +0% | 0.2344 |
| TPC-H 04 || 1409.70 | 1432.31 | +2% || 0.70 | 0.68 | -2% | (run time too short) |
-| TPC-H 05 || 1904.20 | 2197.09 | +15% || 0.52 | 0.45 | -13% | 0.0000 |
| TPC-H 06 || 183.66 | 190.06 | +3%˄ || 5.44 | 5.26 | -3%˄ | (run time too short) |
-| TPC-H 07 || 619.08 | 718.18 | +16%˄ || 1.62 | 1.39 | -14%˄ | (run time too short) |
-| TPC-H 08 || 436.67 | 524.82 | +20%˄ || 2.29 | 1.91 | -17%˄ | (run time too short) |
-| TPC-H 09 || 4903.50 | 5874.61 | +20% || 0.20 | 0.17 | -17% | (run time too short) |
| TPC-H 10 || 1256.50 | 1304.81 | +4% || 0.78 | 0.75 | -4% | (run time too short) |
| TPC-H 11 || 50.32 | 49.80 | -1%˄ || 19.87 | 20.08 | +1%˄ | (run time too short) |
| TPC-H 12 || 894.81 | 887.34 | -1%˄ || 1.12 | 1.13 | +1%˄ | (run time too short) |
+| TPC-H 13 || 4481.95 | 4132.06 | -8% || 0.22 | 0.23 | +8% | (run time too short) |
-| TPC-H 14 || 461.49 | 500.36 | +8%˄ || 2.17 | 2.00 | -8%˄ | (run time too short) |
-| TPC-H 15 || 166.95 | 190.85 | +14%˄ || 5.99 | 5.24 | -13%˄ | (run time too short) |
+| TPC-H 16 || 524.99 | 502.19 | -4%˄ || 1.90 | 1.99 | +5%˄ | (run time too short) |
-| TPC-H 17 || 138.36 | 213.55 | +54%˄ || 7.23 | 4.68 | -35%˄ | (run time too short) |
+| TPC-H 18 || 1635.77 | 1534.47 | -6% || 0.60 | 0.65 | +8% | (run time too short) |
-| TPC-H 19 || 211.33 | 230.49 | +9%˄ || 4.73 | 4.34 | -8%˄ | (run time too short) |
-| TPC-H 20 || 289.84 | 381.59 | +32%˄ || 3.45 | 2.62 | -24%˄ | (run time too short) |
-| TPC-H 21 || 3712.70 | 3898.31 | +5% || 0.27 | 0.25 | -6% | (run time too short) |
-| TPC-H 22 || 454.52 | 495.91 | +9%˄ || 2.20 | 2.02 | -8%˄ | (run time too short) |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
-| Sum || 30799.90 | 32492.93 | +5% || | | | |
-| Geomean || | | || | | -7% | |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+----------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCH - single-threaded, SF 0.01 Sum of avg. item runtimes: -2% || Geometric mean of throughput changes: +4%Configuration Overview - click to expand +Configuration Overview----+-------------------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkTPCH_85450217ce7cb6cd090d5efa04b6051fe625caf2_st_s01.json | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkTPCH_036d2ca7327d9f76b74cac0f821834d9638f9d3d_st_s01.json |
+--------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 85450217ce7cb6cd090d5efa04b6051fe625caf2 | 036d2ca7327d9f76b74cac0f821834d9638f9d3d |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 17.0.6 | clang 17.0.6 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-08 15:35:02 | 2025-06-06 18:14:57 |
| encoding | None | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 0.009999999776482582 | 0.009999999776482582 |
| time_unit | ns | ns |
| use_prepared_statements | False
10000
| False |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+--------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------+ +----------++----------+---------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+----------++----------+---------+--------++----------+----------+--------+----------------------+
| TPC-H 01 || 5.30 | 5.29 | -0%˄ || 188.74 | 188.95 | +0%˄ | (run time too short) |
+| TPC-H 02 || 3.45 | 3.30 | -4%˄ || 289.38 | 302.68 | +5%˄ | (run time too short) |
+| TPC-H 03 || 0.59 | 0.54 | -8%˄ || 1690.61 | 1842.29 | +9%˄ | (run time too short) |
+| TPC-H 04 || 0.40 | 0.35 | -13%˄ || 2492.19 | 2864.87 | +15%˄ | (run time too short) |
| TPC-H 05 || 0.94 | 0.91 | -3%˄ || 1058.56 | 1096.10 | +4%˄ | (run time too short) |
+| TPC-H 06 || 0.21 | 0.20 | -7%˄ || 4764.86 | 5101.86 | +7%˄ | (run time too short) |
| TPC-H 07 || 9.00 | 8.69 | -4%˄ || 111.09 | 115.12 | +4%˄ | (run time too short) |
| TPC-H 08 || 12.96 | 13.10 | +1%˄ || 77.18 | 76.34 | -1%˄ | (run time too short) |
+| TPC-H 09 || 3.15 | 2.68 | -15%˄ || 317.64 | 373.46 | +18%˄ | (run time too short) |
| TPC-H 10 || 0.64 | 0.62 | -3%˄ || 1551.43 | 1599.62 | +3%˄ | (run time too short) |
| TPC-H 11 || 0.17 | 0.17 | -1%˄ || 5868.81 | 5905.21 | +1%˄ | (run time too short) |
+| TPC-H 12 || 0.65 | 0.61 | -7%˄ || 1539.82 | 1648.62 | +7%˄ | (run time too short) |
| TPC-H 13 || 1.98 | 1.94 | -2%˄ || 503.98 | 515.89 | +2%˄ | (run time too short) |
| TPC-H 14 || 0.30 | 0.29 | -1%˄ || 3372.88 | 3411.49 | +1%˄ | (run time too short) |
| TPC-H 15 || 1.06 | 1.06 | -0%˄ || 937.19 | 938.65 | +0%˄ | (run time too short) |
| TPC-H 16 || 1.87 | 1.87 | -0%˄ || 533.87 | 535.78 | +0%˄ | (run time too short) |
+| TPC-H 17 || 0.58 | 0.55 | -5%˄ || 1714.93 | 1802.55 | +5%˄ | (run time too short) |
+| TPC-H 18 || 1.08 | 0.98 | -9%˄ || 926.34 | 1021.14 | +10%˄ | (run time too short) |
| TPC-H 19 || 4.34 | 4.31 | -1%˄ || 230.24 | 231.88 | +1%˄ | (run time too short) |
-| TPC-H 20 || 2.21 | 2.31 | +5%˄ || 452.19 | 432.13 | -4%˄ | (run time too short) |
| TPC-H 21 || 1.04 | 1.02 | -2%˄ || 960.87 | 978.22 | +2%˄ | (run time too short) |
| TPC-H 22 || 1.07 | 1.06 | -1%˄ || 934.85 | 945.64 | +1%˄ | (run time too short) |
+----------++----------+---------+--------++----------+----------+--------+----------------------+
| Sum || 53.00 | 51.84 | -2% || | | | |
| Geomean || | | || | | +4% | |
+----------++----------+---------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+----------++----------+---------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCH - multi-threaded, ordered, 1 client, 64 cores, SF 10.0 Sum of avg. item runtimes: -1% || Geometric mean of throughput changes: -1%Configuration Overview - click to expand +Configuration Overview---------+-----------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkTPCH_85450217ce7cb6cd090d5efa04b6051fe625caf2_mt_ordered.json | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkTPCH_036d2ca7327d9f76b74cac0f821834d9638f9d3d_mt_ordered.json |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 85450217ce7cb6cd090d5efa04b6051fe625caf2 | 036d2ca7327d9f76b74cac0f821834d9638f9d3d |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 17.0.6 | clang 17.0.6 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-08 15:35:27 | 2025-06-06 18:15:22 |
| encoding | None | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------+ +----------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| TPC-H 01 || 4692.51 | 4667.22 | -1% || 0.20 | 0.20 | +0% | (run time too short) |
| TPC-H 02 || 57.09 | 55.59 | -3%˄ || 17.50 | 17.98 | +3%˄ | (run time too short) |
| TPC-H 03 || 633.11 | 628.91 | -1%˄ || 1.58 | 1.59 | +1%˄ | (run time too short) |
| TPC-H 04 || 631.05 | 623.27 | -1%˄ || 1.58 | 1.60 | +1%˄ | (run time too short) |
-| TPC-H 05 || 517.48 | 558.62 | +8%˄ || 1.93 | 1.79 | -7%˄ | (run time too short) |
+| TPC-H 06 || 67.73 | 64.61 | -5%˄ || 14.75 | 15.47 | +5%˄ | (run time too short) |
| TPC-H 07 || 249.45 | 243.81 | -2%˄ || 4.01 | 4.10 | +2%˄ | (run time too short) |
| TPC-H 08 || 219.24 | 225.83 | +3%˄ || 4.56 | 4.43 | -3%˄ | (run time too short) |
-| TPC-H 09 || 1882.05 | 2077.44 | +10% || 0.52 | 0.47 | -10% | (run time too short) |
| TPC-H 10 || 566.69 | 570.85 | +1%˄ || 1.76 | 1.75 | -1%˄ | (run time too short) |
| TPC-H 11 || 68.81 | 69.18 | +1%˄ || 14.52 | 14.45 | -1%˄ | (run time too short) |
| TPC-H 12 || 466.71 | 454.60 | -3%˄ || 2.14 | 2.20 | +3%˄ | (run time too short) |
+| TPC-H 13 || 1943.07 | 1606.91 | -17% || 0.50 | 0.62 | +23% | (run time too short) |
| TPC-H 14 || 154.49 | 151.75 | -2%˄ || 6.47 | 6.59 | +2%˄ | (run time too short) |
-| TPC-H 15 || 122.92 | 134.80 | +10%˄ || 8.13 | 7.42 | -9%˄ | (run time too short) |
| TPC-H 16 || 553.60 | 552.71 | -0%˄ || 1.81 | 1.81 | +0%˄ | (run time too short) |
-| TPC-H 17 || 72.17 | 88.11 | +22%˄ || 13.85 | 11.34 | -18%˄ | (run time too short) |
| TPC-H 18 || 1679.00 | 1679.54 | +0% || 0.58 | 0.58 | +0% | (run time too short) |
| TPC-H 19 || 112.21 | 109.24 | -3%˄ || 8.91 | 9.15 | +3%˄ | (run time too short) |
-| TPC-H 20 || 181.82 | 191.69 | +5%˄ || 5.50 | 5.22 | -5%˄ | (run time too short) |
| TPC-H 21 || 1021.32 | 1056.58 | +3%˄ || 0.98 | 0.95 | -3%˄ | (run time too short) |
| TPC-H 22 || 156.99 | 156.46 | -0%˄ || 6.37 | 6.39 | +0%˄ | (run time too short) |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| Sum || 16049.50 | 15967.72 | -1% || | | | |
| Geomean || | | || | | -1% | |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+----------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCH - multi-threaded, shuffled, 64 clients, 64 cores, SF 10.0 Sum of avg. item runtimes: +4% || Geometric mean of throughput changes: -4%Configuration Overview - click to expand +Configuration Overview---------+---------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkTPCH_85450217ce7cb6cd090d5efa04b6051fe625caf2_mt.json | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkTPCH_036d2ca7327d9f76b74cac0f821834d9638f9d3d_mt.json |
+-------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 85450217ce7cb6cd090d5efa04b6051fe625caf2 | 036d2ca7327d9f76b74cac0f821834d9638f9d3d |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| clustering | None | None |
| compiler | clang 17.0.6 | clang 17.0.6 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-08 15:46:43 | 2025-06-06 18:26:40 |
| encoding | None | None |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------+ +----------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+----------++----------+----------+--------++----------+----------+--------+---------+
| TPC-H 01 || 6187.08 | 6124.29 | -1% || 1.15 | 1.11 | -4% | 0.3296 |
| TPC-H 02 || 496.63 | 488.29 | -2% || 1.16 | 1.11 | -4% | 0.9025 |
-| TPC-H 03 || 2531.57 | 2779.71 | +10% || 1.16 | 1.11 | -4% | 0.0333 |
-| TPC-H 04 || 2164.02 | 2319.29 | +7% || 1.16 | 1.11 | -4% | 0.0933 |
-| TPC-H 05 || 3818.47 | 4110.18 | +8% || 1.15 | 1.11 | -4% | 0.0459 |
| TPC-H 06 || 736.48 | 768.87 | +4% || 1.16 | 1.11 | -4% | 0.5924 |
-| TPC-H 07 || 3032.09 | 3488.75 | +15% || 1.15 | 1.11 | -4% | 0.0023 |
-| TPC-H 08 || 2118.20 | 2452.47 | +16% || 1.16 | 1.11 | -4% | 0.0072 |
-| TPC-H 09 || 5757.24 | 6250.98 | +9% || 1.15 | 1.11 | -4% | 0.0025 |
-| TPC-H 10 || 3186.20 | 3510.11 | +10% || 1.16 | 1.11 | -4% | 0.0166 |
| TPC-H 11 || 508.13 | 529.27 | +4% || 1.16 | 1.11 | -4% | 0.7045 |
| TPC-H 12 || 2510.23 | 2525.96 | +1% || 1.16 | 1.11 | -4% | 0.8844 |
+| TPC-H 13 || 4818.63 | 3894.67 | -19% || 1.15 | 1.11 | -4% | 0.0000 |
| TPC-H 14 || 1143.64 | 1163.76 | +2% || 1.16 | 1.11 | -4% | 0.7977 |
-| TPC-H 15 || 562.29 | 725.70 | +29% || 1.16 | 1.11 | -4% | 0.0004 |
| TPC-H 16 || 2203.84 | 2231.71 | +1% || 1.15 | 1.11 | -4% | 0.7812 |
-| TPC-H 17 || 772.96 | 820.33 | +6% || 1.16 | 1.11 | -4% | 0.5138 |
| TPC-H 18 || 3665.86 | 3699.22 | +1% || 1.15 | 1.11 | -4% | 0.7035 |
| TPC-H 19 || 1098.42 | 1077.41 | -2% || 1.16 | 1.11 | -4% | 0.8012 |
-| TPC-H 20 || 1502.30 | 1629.31 | +8% || 1.16 | 1.11 | -4% | 0.1875 |
-| TPC-H 21 || 4958.15 | 5412.10 | +9% || 1.15 | 1.11 | -4% | 0.0050 |
-| TPC-H 22 || 1143.62 | 1216.39 | +6% || 1.16 | 1.11 | -4% | 0.4337 |
+----------++----------+----------+--------++----------+----------+--------+---------+
| Sum || 54916.07 | 57218.77 | +4% || | | | |
| Geomean || | | || | | -4% | |
+----------++----------+----------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCDS - single-threaded Sum of avg. item runtimes: -12% || Geometric mean of throughput changes: +17%Configuration Overview - click to expand +Configuration Overview---+----------------------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkTPCDS_85450217ce7cb6cd090d5efa04b6051fe625caf2_st.json | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkTPCDS_036d2ca7327d9f76b74cac0f821834d9638f9d3d_st.json |
+-------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 85450217ce7cb6cd090d5efa04b6051fe625caf2 | 036d2ca7327d9f76b74cac0f821834d9638f9d3d
10000
|
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.6 | clang 17.0.6 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-08 16:08:13 | 2025-06-06 18:48:07 |
| encoding | None | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
-| 01 || 202.75 | 213.96 | +6%˄ || 4.93 | 4.67 | -5%˄ | (run time too short) |
+| 03 || 52.52 | 36.42 | -31%˄ || 19.04 | 27.45 | +44%˄ | (run time too short) |
+| 06 || 181.88 | 162.04 | -11%˄ || 5.50 | 6.17 | +12%˄ | (run time too short) |
+| 07 || 293.76 | 256.21 | -13%˄ || 3.40 | 3.90 | +15%˄ | (run time too short) |
+| 09 || 1357.77 | 739.99 | -45%˄ || 0.73 | 1.35 | +84%˄ | (run time too short) |
+| 10 || 161.90 | 124.98 | -23%˄ || 6.18 | 8.00 | +30%˄ | (run time too short) |
+| 13 || 505.20 | 462.38 | -8%˄ || 1.98 | 2.16 | +9%˄ | (run time too short) |
| 15 || 122.34 | 117.73 | -4%˄ || 8.17 | 8.49 | +4%˄ | (run time too short) |
+| 16 || 73.16 | 54.23 | -26%˄ || 13.67 | 18.44 | +35%˄ | (run time too short) |
+| 17 || 290.49 | 258.62 | -11%˄ || 3.44 | 3.87 | +12%˄ | (run time too short) |
+| 19 || 110.44 | 87.12 | -21%˄ || 9.05 | 11.48 | +27%˄ | (run time too short) |
+| 25 || 177.17 | 144.09 | -19%˄ || 5.64 | 6.94 | +23%˄ | (run time too short) |
+| 26 || 130.21 | 116.84 | -10%˄ || 7.68 | 8.56 | +11%˄ | (run time too short) |
+| 28 || 1145.50 | 582.15 | -49%˄ || 0.87 | 1.72 | +97%˄ | (run time too short) |
+| 29 || 462.81 | 428.79 | -7%˄ || 2.16 | 2.33 | +8%˄ | (run time too short) |
+| 31 || 1347.53 | 1289.17 | -4% || 0.73 | 0.77 | +5% | 0.0000 |
+| 32 || 39.14 | 29.28 | -25%˄ || 25.55 | 34.15 | +34%˄ | (run time too short) |
+| 34 || 170.84 | 146.92 | -14%˄ || 5.85 | 6.81 | +16%˄ | (run time too short) |
+| 35 || 634.18 | 601.16 | -5%˄ || 1.58 | 1.66 | +5%˄ | (run time too short) |
+| 37 || 1216.07 | 679.42 | -44%˄ || 0.82 | 1.47 | +80%˄ | (run time too short) |
+| 39a || 1780.11 | 1591.91 | -11% || 0.55 | 0.62 | +12% | (run time too short) |
+| 39b || 1761.92 | 1577.23 | -10% || 0.57 | 0.63 | +12% | 0.0000 |
-| 41 || 279.16 | 314.97 | +13%˄ || 3.58 | 3.17 | -11%˄ | (run time too short) |
+| 42 || 94.15 | 69.52 | -26%˄ || 10.62 | 14.38 | +35%˄ | (run time too short) |
| 43 || 997.31 | 958.70 | -4%˄ || 1.00 | 1.04 | +4%˄ | (run time too short) |
| 45 || 106.09 | 102.71 | -3%˄ || 9.43 | 9.74 | +3%˄ | (run time too short) |
| 48 || 1067.61 | 1055.97 | -1%˄ || 0.94 | 0.95 | +1%˄ | (run time too short) |
+| 50 || 120.98 | 107.58 | -11%˄ || 8.27 | 9.29 | +12%˄ | (run time too short) |
+| 52 || 91.93 | 67.78 | -26%˄ || 10.88 | 14.75 | +36%˄ | (run time too short) |
+| 55 || 87.32 | 63.31 | -27%˄ || 11.45 | 15.79 | +38%˄ | (run time too short) |
| 62 || 531.05 | 537.21 | +1%˄ || 1.88 | 1.86 | -1%˄ | (run time too short) |
| 65 || 1772.99 | 1747.67 | -1% || 0.55 | 0.57 | +3% | (run time too short) |
+| 69 || 167.56 | 135.99 | -19%˄ || 5.97 | 7.35 | +23%˄ | (run time too short) |
+| 73 || 96.92 | 75.40 | -22%˄ || 10.32 | 13.26 | +29%˄ | (run time too short) |
| 79 || 492.49 | 480.45 | -2%˄ || 2.03 | 2.08 | +3%˄ | (run time too short) |
| 81 || 143.81 | 150.14 | +4%˄ || 6.95 | 6.66 | -4%˄ | (run time too short) |
+| 82 || 1254.92 | 712.75 | -43%˄ || 0.78 | 1.40 | +79%˄ | (run time too short) |
+| 83 || 39.64 | 37.09 | -6%˄ || 25.22 | 26.96 | +7%˄ | (run time too short) |
-| 84 || 12.09 | 14.15 | +17%˄ || 82.67 | 70.66 | -15%˄ | (run time too short) |
| 85 || 153.79 | 153.18 | -0%˄ || 6.50 | 6.53 | +0%˄ | (run time too short) |
+| 88 || 777.04 | 626.39 | -19%˄ || 1.29 | 1.60 | +24%˄ | (run time too short) |
| 91 || 16.74 | 16.40 | -2%˄ || 59.73 | 60.96 | +2%˄ | (run time too short) |
+| 92 || 32.56 | 26.37 | -19%˄ || 30.71 | 37.92 | +23%˄ | (run time too short) |
+| 93 || 2319.87 | 2124.82 | -8% || 0.42 | 0.47 | +12% | (run time too short) |
+| 94 || 43.34 | 33.25 | -23%˄ || 23.07 | 30.07 | +30%˄ | (run time too short) |
| 95 || 4822.90 | 4647.08 | -4% || 0.20 | 0.20 | +0% | (run time too short) |
+| 96 || 80.44 | 58.48 | -27%˄ || 12.43 | 17.10 | +38%˄ | (run time too short) |
+| 97 || 3418.44 | 3219.18 | -6% || 0.28 | 0.30 | +6% | (run time too short) |
| 99 || 1049.66 | 1045.47 | -0%˄ || 0.95 | 0.96 | +0%˄ | (run time too short) |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
+| Sum || 32288.52 | 28282.67 | -12% || | | | |
+| Geomean || | | || | | +17% | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCDS - multi-threaded, ordered, 1 client, 64 cores Sum of avg. item runtimes: -3% || Geometric mean of throughput changes: +4%Configuration Overview - click to expand +Configuration Overview---------+------------------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkTPCDS_85450217ce7cb6cd090d5efa04b6051fe625caf2_mt_ordered.json | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkTPCDS_036d2ca7327d9f76b74cac0f821834d9638f9d3d_mt_ordered.json |
+-------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 85450217ce7cb6cd090d5efa04b6051fe625caf2 | 036d2ca7327d9f76b74cac0f821834d9638f9d3d |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.6 | clang 17.0.6 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-08 16:29:11 | 2025-06-06 19:06:41 |
| encoding | None | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| 01 || 219.84 | 226.56 | +3%˄ || 4.55 | 4.41 | -3%˄ | (run time too short) |
| 03 || 30.78 | 30.18 | -2%˄ || 32.45 | 33.09 | +2%˄ | (run time too short) |
| 06 || 167.66 | 162.91 | -3%˄ || 5.96 | 6.14 | +3%˄ | (run time too short) |
| 07 || 188.56 | 184.37 | -2%˄ || 5.30 | 5.42 | +2%˄ | (run time too short) |
+| 09 || 150.17 | 111.94 | -25%˄ || 6.66 | 8.93 | +34%˄ | (run time too short) |
+| 10 || 40.59 | 36.06 | -11%˄ || 24.61 | 27.71 | +13%˄ | (run time too short) |
| 13 || 246.68 | 255.05 | +3%˄ || 4.05 | 3.92 | -3%˄ | (run time too short) |
| 15 || 74.08 | 72.39 | -2%˄ || 13.49 | 13.81 | +2%˄ | (run time too short) |
| 16 || 31.72 | 30.80 | -3%˄ || 31.49 | 32.43 | +3%˄ | (run time too short) |
+| 17 || 120.61 | 114.51 | -5%˄ || 8.29 | 8.73 | +5%˄ | (run time too short) |
| 19 || 71.45 | 69.63 | -3%˄ || 13.99 | 14.35 | +3%˄ | (run time too short) |
| 25 || 91.00 | 88.79 | -2%˄ || 10.99 | 11.26 | +2%˄ | (run time too short) |
| 26 || 91.36 | 91.41 | +0%˄ || 10.94 | 10.94 | -0%˄ | (run time too short) |
+| 28 || 161.14 | 149.45 | -7%˄ || 6.20 | 6.69 | +8%˄ | (run time too short) |
+| 29 || 412.46 | 390.12 | -5%˄ || 2.42 | 2.56 | +6%˄ | (run time too short) |
+| 31 || 487.81 | 461.49 | -5%˄ || 2.05 | 2.17 | +6%˄ | (run time too short) |
+| 32 || 30.17 | 28.28 | -6%˄ || 33.11 | 35.31 | +7%˄ | (run time too short) |
+| 34 || 96.67 | 92.49 | -4%˄ || 10.34 | 10.81 | +5%˄ | (run time too short) |
| 35 || 367.63 | 370.74 | +1%˄ || 2.72 | 2.70 | -1%˄ | (run time too short) |
+| 37 || 251.52 | 194.70 | -23%˄ || 3.98 | 5.14 | +29%˄ | (run time too short) |
| 39a || 688.41 | 699.08 | +2%˄ || 1.45 | 1.43 | -2%˄ | (run time too short) |
+| 39b || 723.58 | 673.62 | -7%˄ || 1.38 | 1.48 | +7%˄ | (run time too short) |
-| 41 || 358.00 | 388.98 | +9%˄ || 2.79 | 2.57 | -8%˄ | (run time too short) |
+| 42 || 52.96 | 49.02 | -7%˄ || 18.87 | 20.38 | +8%˄ | (run time too short) |
| 43 || 449.52 | 438.82 | -2%˄ || 2.22 | 2.28 | +2%˄ | (run time too short) |
| 45 || 53.77 | 54.33 | +1%˄ || 18.58 | 18.39 | -1%˄ | (run time too short) |
| 48 || 507.56 | 508.16 | +0%˄ || 1.97 | 1.97 | -0%˄ | (run time too short) |
| 50 || 105.29 | 106.83 | +1%˄ || 9.49 | 9.36 | -1%˄ | (run time too short) |
+| 52 || 56.11 | 51.98 | -7%˄ || 17.81 | 19.22 | +8%˄ | (run time too short) |
+| 55 || 49.60 | 45.83 | -8%˄ || 20.14 | 21.80 | +8%˄ | (run time too short) |
| 62 || 347.43 | 346.78 | -0%˄ || 2.88 | 2.88 | +0%˄ | (run time too short) |
| 65 || 1451.26 | 1439.80 | -1% || 0.68 | 0.68 | +0% | 0.1567 |
+| 69 || 72.84 | 69.64 | -4%˄ || 13.72 | 14.35 | +5%˄ | (run time too short) |
+| 73 || 58.02 | 53.81 | -7%˄ || 17.23 | 18.57 | +8%˄ | (run time too short) |
| 79 || 463.84 | 474.15 | +2%˄ || 2.16 | 2.11 | -2%˄ | (run time too short) |
| 81 || 172.70 | 173.38 | +0%˄ || 5.79 | 5.77 | -0%˄ | (run time too short) |
+| 82 || 281.17 | 219.45 | -22%˄ || 3.56 | 4.56 | +28%˄ | (run time too short) |
| 83 || 44.96 | 45.34 | +1%˄ || 22.22 | 22.04 | -1%˄ | (run time too short) |
| 84 || 9.31 | 9.70 | +4%˄ || 107.06 | 102.78 | -4%˄ | (run time too short) |
| 85 || 67.59 | 68.38 | +1%˄ || 14.79 | 14.62 | -1%˄ | (run time too short) |
+| 88 || 90.65 | 81.13 | -10%˄ || 11.03 | 12.32 | +12%˄ | (run time too short) |
| 91 || 17.01 | 17.61 | +4%˄ || 58.66 | 56.68 | -3%˄ | (run time too short) |
| 92 || 36.21 | 35.39 | -2%˄ || 27.59 | 28.23 | +2%˄ | (run time too short) |
+| 93 || 545.29 | 520.47 | -5%˄ || 1.83 | 1.92 | +5%˄ | (run time too short) |
| 94 || 31.96 | 31.73 | -1%˄ || 31.26 | 31.48 | +1%˄ | (run time too short) |
+| 95 || 704.82 | 668.16 | -5%˄ || 1.42 | 1.50 | +5%˄ | (run time too short) |
| 96 || 49.10 | 47.37 | -4%˄ || 20.35 | 21.10 | +4%˄ | (run time too short) |
| 97 || 1296.49 | 1285.96 | -1% || 0.77 | 0.77 | +0% | 0.3126 |
| 99 || 564.11 | 558.50 | -1%˄ || 1.77 | 1.79 | +1%˄ | (run time too short) |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Sum || 12681.44 | 12325.25 | -3% || | | | |
| Geomean || | | || | | +4% | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCDS - multi-threaded, shuffled, 64 clients, 64 cores Sum of avg. item runtimes: -1% || Geometric mean of throughput changes: +1%Configuration Overview - click to expand +Configuration Overview---------+----------------------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkTPCDS_85450217ce7cb6cd090d5efa04b6051fe625caf2_mt.json | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkTPCDS_036d2ca7327d9f76b74cac0f821834d9638f9d3d_mt.json |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 85450217ce7cb6cd090d5efa04b6051fe625caf2 | 036d2ca7327d9f76b74cac0f821834d9638f9d3d |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| compiler | clang 17.0.6 | clang 17.0.6 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-08 16:41:00 | 2025-06-06 19:18:13 |
| encoding | None | None |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+---------+
| 01 || 756.34 | 760.55 | +1% || 1.02 | 1.03 | +1% | 0.9181 |
| 03 || 236.26 | 238.60 | +1% || 1.02 | 1.03 | +1% | 0.9201 |
+| 06 || 892.52 | 780.18 | -13% || 1.02 | 1.03 | +1% | 0.0631 |
-| 07 || 959.94 | 1044.24 | +9% || 1.02 | 1.03 | +0% | 0.1332 |
+| 09 || 1073.94 | 896.62 | -17% || 1.02 | 1.03 | +1% | 0.0092 |
+| 10 || 849.35 | 719.50 | -15% || 1.02 | 1.03 | +0% | 0.0387 |
-| 13 || 1677.70 | 1797.18 | +7% || 1.02 | 1.02 | +0% | 0.1193 |
-| 15 || 493.51 | 551.75 | +12% || 1.02 | 1.03 | +1% | 0.2114 |
+| 16 || 488.19 | 418.95 | -14% || 1.02 | 1.03 | +1% | 0.1141 |
| 17 || 1325.08 | 1326.08 | +0% || 1.02 | 1.03 | +1% | 0.9887 |
+| 19 || 671.68 | 631.21 | -6% || 1.02 | 1.03 | +1% | 0.3856 |
-| 25 || 950.48 | 1030.02 | +8% || 1.02 | 1.03 | +1% | 0.2325 |
+| 26 || 545.41 | 497.64 | -9% || 1.02 | 1.03 | +1% | 0.2650 |
+| 28 || 1804.08 | 1644.62 | -9% || 1.02 | 1.03 | +1% | 0.0788 |
| 29 || 1758.34 | 1712.88 | -3% || 1.02 | 1.03 | +1% | 0.5544 |
| 31 || 2687.13 | 2733.12 | +2% || 1.02 | 1.03 | +1% | 0.6775 |
+| 32 || 203.98 | 176.50 | -13% || 1.02 | 1.03 | +1% | 0.3016 |
| 34 || 759.75 | 792.20 | +4% || 1.02 | 1.03 | +1% | 0.5214 |
| 35 || 2128.86 | 2132.69 | +0% || 1.02 | 1.03 | +1% | 0.9634 |
+| 37 || 1033.73 | 886.77 | -14% || 1.02 | 1.03 | +1% | 0.0084 |
-| 39a || 2907.69 | 3067.35 | +5% || 1.02 | 1.02 | +0% | 0.0714 |
-| 39b || 2882.63 | 3036.57 | +5% || 1.02 | 1.03 | +1% | 0.0831 |
-| 41 || 1978.00 | 2134.95 | +8% || 1.02 | 1.03 | +1% | 0.0958 |
| 42 || 521.24 | 509.26 | -2% || 1.02 | 1.03 | +1% | 0.8064 |
| 43 || 1556.17 | 1553.14 | -0% || 1.02 | 1.03 | +1% | 0.9621 |
| 45 || 727.46 | 723.55 | -1% || 1.02 | 1.03 | +1% | 0.9439 |
| 48 || 2724.37 | 2759.53 | +1% || 1.02 | 1.02 | +0% | 0.7360 |
| 50 || 1093.47 | 1099.53 | +1% || 1.02 | 1.03 | +1% | 0.9241 |
+| 52 || 531.39 | 425.94 | -20% || 1.02 | 1.03 | +1% | 0.0069 |
| 55 || 464.48 | 463.62 | -0% || 1.02 | 1.03 | +1% | 0.9823 |
+| 62 || 1134.38 | 1044.19 | -8% || 1.02 | 1.03 | +1% | 0.0988 |
| 65 || 4447.98 | 4589.62 | +3% || 1.02 | 1.02 | +1% | 0.0413 |
+| 69 || 1101.94 | 990.95 | -10% || 1.02 | 1.03 | +0% | 0.1474 |
+| 73 || 592.52 | 512.93 | -13% || 1.02 | 1.03 | +1% | 0.1243 |
| 79 || 1629.17 | 1643.12 | +1% || 1.02 | 1.03 | +0% | 0.8397 |
-| 81 || 562.97 | 687.28 | +22% || 1.02 | 1.03 | +0% | 0.0023 |
+| 82 || 1146.66 | 954.46 | -17% || 1.02 | 1.03 | +1% | 0.0001 |
-| 83 || 290.64 | 322.06 | +11% || 1.02 | 1.03 | +1% | 0.3940 |
| 84 || 120.33 | 123.87 | +3% || 1.02 | 1.03 | +1% | 0.8617 |
+| 85 || 962.63 | 883.11 | -8% || 1.02 | 1.03 | +1% | 0.2746 |
| 88 || 2689.65 | 2616.65 | -3% || 1.02 | 1.03 | +1% | 0.5310 |
-| 91 || 174.46 | 206.61 | +18% || 1.02 | 1.03 | +1% | 0.2736 |
+| 92 || 264.64 | 243.59 | -8% || 1.02 | 1.03 | +1% | 0.4220 |
| 93 || 1758.70 | 1754.43 | -0% || 1.02 | 1.03 | +1% | 0.9530 |
+| 94 || 513.22 | 474.89 | -7% || 1.02 | 1.03 | +1% | 0.4709 |
+| 95 || 2320.47 | 2173.79 | -6% || 1.02 | 1.03 | +1% | 0.0602 |
| 96 || 461.19 | 472.94 | +3% || 1.02 | 1.03 | +1% | 0.7890 |
| 97 || 4282.52 | 4458.78 | +4% || 1.02 | 1.02 | +0% | 0.0795 |
| 99 || 1427.77 | 1438.13 | +1% || 1.02 | 1.03 | +1% | 0.8416 |
+---------++----------+----------+--------++----------+----------+--------+---------+
| Sum || 62565.02 | 62136.14 | -1% || | | | |
| Geomean || | | || | | +1% | |
+---------++----------+----------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCC - single-threaded Sum of avg. item runtimes: -13% || Geometric mean of throughput changes: +14%Configuration Overview - click to expand +Configuration Overview---+---------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkTPCC_85450217ce7cb6cd090d5efa04b6051fe625caf2_st.json | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkTPCC_036d2ca7327d9f76b74cac0f821834d9638f9d3d_st.json |
+-------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 85450217ce7cb6cd090d5efa04b6051fe625caf2 | 036d2ca7327d9f76b74cac0f821834d9638f9d3d |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.6 | clang 17.0.6 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-08 17:01:17 | 2025-06-06 19:38:29 |
| encoding | None | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10 | 10 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------+ +--------------++----------+---------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+--------------++----------+---------+--------++----------+----------+--------+---------+
+| Delivery || 28.79 | 25.11 | -13% || 4.85 | 5.37 | +11% | 0.0000 |
+| New-Order || 13.80 | 11.84 | -14% || 53.15 | 60.55 | +14% | 0.0000 |
+| Order-Status || 1.40 | 1.19 | -15% || 4.40 | 4.83 | +10% | 0.0000 |
+| Payment || 2.19 | 2.22 | +1% || 49.70 | 58.93 | +19% | 0.0119 |
+| Stock-Level || 2.16 | 1.89 | -12% || 4.52 | 5.22 | +15% | 0.0000 |
+--------------++----------+---------+--------++----------+----------+--------+---------+
+| Sum || 48.34 | 42.25 | -13% || | | | |
+| Geomean || | | || | | +14% | |
+--------------++----------+---------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCC - multi-threaded, shuffled, 64 clients, 10 warehouses, 64 cores (high contention) Sum of avg. item runtimes: +5% || Geometric mean of throughput changes: -5%Configuration Overview - click to expand +Configuration Overview---------+------------------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkTPCC_85450217ce7cb6cd090d5efa04b6051fe625caf2_mt_highcont.json | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkTPCC_036d2ca7327d9f76b74cac0f821834d9638f9d3d_mt_highcont.json |
+-------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 85450217ce7cb6cd090d5efa04b6051fe625caf2 | 036d2ca7327d9f76b74cac0f821834d9638f9d3d |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| compiler | clang 17.0.6 | clang 17.0.6 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-08 17:02:24 | 2025-06-06 19:39:35 |
| encoding | None | None |
| max_duration | 600000000000 | 600000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10 | 10 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------+ +--------------++----------+---------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+--------------++----------+---------+--------++----------+----------+--------+---------+
-| Delivery || 178.52 | 188.26 | +5% || 34.11 | 32.46 | -5% | 0.0000 |
| unsucc.: || 3.58 | 3.45 | -4% || 51.31 | 49.01 | -4% | |
| New-Order || 93.24 | 96.96 | +4% || 477.20 | 455.99 | -4% | 0.0000 |
| unsucc.: || 8.28 | 8.79 | +6% || 485.48 | 460.65 | -5% | |
-| Order-Status || 9.35 | 10.03 | +7% || 85.82 | 81.66 | -5% | 0.0000 |
-| Payment || 14.88 | 16.34 | +10% || 246.49 | 230.28 | -7% | 0.0000 |
| unsucc.: || 5.24 | 5.63 | +7% || 672.49 | 648.06 | -4% | |
-| Stock-Level || 13.52 | 14.42 | +7% || 85.53 | 81.04 | -5% | 0.0000 |
+--------------++----------+---------+--------++----------+----------+--------+---------+
-| Sum || 309.50 | 326.01 | +5% || | | | |
-| Geomean || | | || | | -5% | |
+--------------++----------+---------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCC - multi-threaded, shuffled, 10 clients, 10 warehouses, 64 cores (low contention) Sum of avg. item runtimes: -4% || Geometric mean of throughput changes: +4%Configuration Overview - click to expand +Configuration Overview---------+-----------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkTPCC_85450217ce7cb6cd090d5efa04b6051fe625caf2_mt_lowcont.json | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkTPCC_036d2ca7327d9f76b74cac0f821834d9638f9d3d_mt_lowcont.json |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 85450217ce7cb6cd090d5efa04b6051fe625caf2 | 036d2ca7327d9f76b74cac0f821834d9638f9d3d |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 10 | 10 |
| compiler | clang 17.0.6 | clang 17.0.6 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-08 17:12:36 | 2025-06-06 19:49:47 |
| encoding | None | None |
| max_duration | 600000000000 | 600000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10 | 10 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------+ +--------------++----------+---------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+--------------++----------+---------+--------++----------+----------+--------+---------+
| Delivery || 77.06 | 74.54 | -3% || 16.33 | 16.85 | +3% | 0.0000 |
| unsucc.: || 0.96 | 0.86 | -11% || 2.03 | 2.10 | +3% | |
+| New-Order || 39.21 | 36.89 | -6% || 183.67 | 193.26 | +5% | 0.0000 |
| unsucc.: || 3.44 | 3.52 | +2% || 17.52 | 18.35 | +5% | |
+| Order-Status || 4.36 | 4.12 | -5% || 17.72 | 18.74 | +6% | 0.0000 |
| Payment || 7.75 | 7.84 | +1% || 157.85 | 163.95 | +4% | 0.0000 |
| unsucc.: || 1.99 | 2.00 | +0% || 33.75 | 36.07 | +7% | |
| Stock-Level || 5.48 | 5.53 | +1% || 17.79 | 18.53 | +4% | 0.0000 |
+--------------++----------+---------+--------++----------+----------+--------+---------+
| Sum || 133.86 | 128.92 | -4% || | | | |
| Geomean || | | || | | +4% | |
+--------------++----------+---------+--------++----------+----------+--------+---------+hyriseBenchmarkJoinOrder - single-threaded Sum of avg. item runtimes: +2% || Geometric mean of throughput changes: +9%Configuration Overview - click to expand +Configuration Overview---+--------------------------------------------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkJoinOrder_85450217ce7cb6cd090d5efa04b6051fe625caf2_st.json | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkJoinOrder_036d2ca7327d9f76b74cac0f821834d9638f9d3d_st.json |
+-------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 85450217ce7cb6cd090d5efa04b6051fe625caf2 | 036d2ca7327d9f76b74cac0f821834d9638f9d3d |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.6 | clang 17.0.6 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-08 17:22:43 | 2025-06-06 19:59:54 |
| encoding | None | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
+| 10a || 106.60 | 99.28 | -7%˄ || 9.38 | 10.07 | +7%˄ | (run time too short) |
+| 10b || 64.25 | 59.58 | -7%˄ || 15.56 | 16.78 | +8%˄ | (run time too short) |
-| 10c || 298.54 | 316.50 | +6%˄ || 3.35 | 3.16 | -6%˄ | (run time too short) |
+| 11a || 36.82 | 26.39 | -28%˄ || 27.16 | 37.89 | +40%˄ | (run time too short) |
+| 11b || 31.17 | 24.04 | -23%˄ || 32.08 | 41.59 | +30%˄ | (run time too short) |
+| 11c || 24.75 | 21.19 | -14%˄ || 40.40 | 47.18 | +17%˄ | (run time too short) |
+| 11d || 23.45 | 19.95 | -15%˄ || 42.65 | 50.13 | +18%˄ | (run time too short) |
+| 12a || 45.81 | 29.13 | -36%˄ || 21.83 | 34.33 | +57%˄ | (run time too short) |
+| 12b || 32.13 | 24.26 | -24%˄ || 31.12 | 41.22 | +32%˄ | (run time too short) |
+| 12c || 76.66 | 67.66 | -12%˄ || 13.04 | 14.78 | +13%˄ | (run time too short) |
+| 13a || 184.46 | 172.61 | -6%˄ || 5.42 | 5.79 | +7%˄ | (run time too short) |
+| 13b || 239.62 | 228.32 | -5%˄ || 4.17 | 4.38 | +5%˄ | (run time too short) |
+| 13c || 38.16 | 30.42 | -20%˄ || 26.20 | 32.87 | +25%˄ | (run time too short) |
| 13d || 525.16 | 507.68 | -3%˄ || 1.90 | 1.97 | +3%˄ | (run time too short) |
+| 14a || 99.05 | 92.11 | -7%˄ || 10.10 | 10.86 | +8%˄ | (run time too short) |
+| 14b || 112.42 | 104.61 | -7%˄ || 8.89 | 9.56 | +7%˄ | (run time too short) |
+| 14c || 183.34 | 168.46 | -8%˄ || 5.45 | 5.94 | +9%˄ | (run time too short) |
+| 15a || 54.93 | 49.68 | -10%˄ || 18.20 | 20.13 | +11%˄ | (run time too short) |
+| 15b || 71.51 | 54.43 | -24%˄ || 13.98 | 18.37 | +31%˄ | (run time too short) |
+| 15c || 45.42 | 39.53 | -13%˄ || 22.02 | 25.30 | +15%˄ | (run time too short) |
+| 15d || 41.33 | 36.34 | -12%˄ || 24.19 | 27.52 | +14%˄ | (run time too short) |
-| 16a || 1221.31 | 1334.90 | +9% || 0.82 | 0.73 | -10% | (run time too short) |
-| 16b || 2384.03 | 2504.42 | +5% || 0.42 | 0.38 | -8% | (run time too short) |
-| 16c || 1378.32 | 1497.16 | +9% || 0.72 | 0.67 | -7% | 0.0000 |
-| 16d || 1341.12 | 1461.69 | +9% || 0.73 | 0.68 | -7% | 0.0000 |
-| 17a || 380.76 | 436.57 | +15%˄ || 2.63 | 2.29 | -13%˄ | (run time too short) |
-| 17b || 298.61 | 352.13 | +18%˄ || 3.35 | 2.84 | -15%˄ | (run time too short) |
-| 17c || 281.81 | 333.30 | +18%˄ || 3.55 | 3.00 | -15%˄ | (run time too short) |
-| 17d || 348.94 | 401.98 | +15%˄ || 2.87 | 2.49 | -13%˄ | (run time too short) |
-| 17e || 1448.34 | 1545.43 | +7% || 0.68 | 0.63 | -7% | (run time too short) |
-| 17f || 821.19 | 883.15 | +8%˄ || 1.22 | 1.13 | -7%˄ | (run time too short) |
+| 18a || 142.70 | 126.82 | -11%˄ || 7.01 | 7.88 | +13%˄ | (run time too short) |
+| 18b || 115.76 | 102.78 | -11%˄ || 8.64 | 9.73 | +13%˄ | (run time too short) |
| 18c || 188.82 | 185.82 | -2%˄ || 5.30 | 5.38 | +2%˄ | (run time too short) |
+| 19a || 235.46 | 215.20 | -9%˄ || 4.25 | 4.65 | +9%˄ | (run time too short) |
+| 19b || 194.06 | 174.66 | -10%˄ || 5.15 | 5.73 | +11%˄ | (run time too short) |
| 19c || 263.81 | 258.47 | -2%˄ || 3.79 | 3.87 | +2%˄ | (run time too short) |
| 19d || 719.47 | 713.63 | -1%˄ || 1.39 | 1.40 | +1%˄ | (run time too short) |
+| 1a || 10.37 | 6.98 | -33%˄ || 96.41 | 143.17 | +49%˄ | (run time too short) |
+| 1b || 28.85 | 13.62 | -53%˄ || 34.66 | 73.42 | +112%˄ | (run time too short) |
+| 1c || 20.07 | 14.20 | -29%˄ || 49.83 | 70.38 | +41%˄ | (run time too short) |
+| 1d || 9.84 | 6.44 | -35%˄ || 101.59 | 155.18 | +53%˄ | (run time too short) |
| 20a || 505.22 | 512.17 | +1%˄ || 1.98 | 1.95 | -1%˄ | (run time too short) |
| 20b || 541.17 | 550.54 | +2%˄ || 1.85 | 1.82 | -2%˄ | (run time too short) |
-| 20c || 336.21 | 356.47 | +6%˄ || 2.97 | 2.81 | -6%˄ | (run time too short) |
+| 21a || 52.55 | 38.34 | -27%˄ || 19.03 | 26.08 | +37%˄ | (run time too short) |
+| 21b || 45.10 | 29.97 | -34%˄ || 22.17 | 33.36 | +50%˄ | (run time too short) |
+| 21c || 41.92 | 34.30 | -18%˄ || 23.85 | 29.15 | +22%˄ | (run time too short) |
+| 22a || 172.67 | 160.85 | -7%˄ || 5.79 | 6.22 | +7%˄ | (run time too short) |
+| 22b || 154.16 | 143.66 | -7%˄ || 6.49 | 6.96 | +7%˄ | (run time too short) |
| 22c || 226.92 | 218.70 | -4%˄ || 4.41 | 4.57 | +4%˄ | (run time too short) |
| 22d || 346.16 | 342.30 | -1%˄ || 2.89 | 2.92 | +1%˄ | (run time too short) |
+| 23a || 46.65 | 42.44 | -9%˄ || 21.43 | 23.56 | +10%˄ | (run time too short) |
+| 23b || 52.81 | 50.22 | -5%˄ || 18.94 | 19.91 | +5%˄ | (run time too short) |
+| 23c || 49.36 | 45.26 | -8%˄ || 20.26 | 22.09 | +9%˄ | (run time too short) |
-| 24a || 205.91 | 215.86 | +5%˄ || 4.86 | 4.63 | -5%˄ | (run time too short) |
-| 24b || 191.38 | 202.73 | +6%˄ || 5.23 | 4.93 | -6%˄ | (run time too short) |
| 25a || 96.10 | 98.77 | +3%˄ || 10.41 | 10.12 | -3%˄ | (run time too short) |
| 25b || 62.90 | 64.43 | +2%˄ || 15.90 | 15.52 | -2%˄ | (run time too short) |
| 25c || 222.62 | 224.99 | +1%˄ || 4.49 | 4.44 | -1%˄ | (run time too short) |
-| 26a || 134.25 | 159.75 | +19%˄ || 7.45 | 6.26 | -16%˄ | (run time too short) |
-| 26b || 118.49 | 130.71 | +10%˄ || 8.44 | 7.65 | -9%˄ | (run time too short) |
-| 26c || 242.63 | 302.52 | +25%˄ || 4.12 | 3.31 | -20%˄ | (run time too short) |
+| 27a || 44.66 | 32.54 | -27%˄ || 22.39 | 30.72 | +37%˄ | (run time too short) |
+| 27b || 31.65 | 22.88 | -28%˄ || 31.59 | 43.70 | +38%˄ | (run time too short) |
+| 27c || 36.87 | 34.25 | -7%˄ || 27.12 | 29.19 | +8%˄ | (run time too short) |
| 28a || 192.33 | 184.49 | -4%˄ || 5.20 | 5.42 | +4%˄ | (run time too short) |
+| 28b || 75.59 | 66.50 | -12%˄ || 13.23 | 15.04 | +14%˄ | (run time too short) |
+| 28c || 170.42 | 161.15 | -5%˄ || 5.87 | 6.21 | +6%˄ | (run time too short) |
| 29a || 171.92 | 179.42 | +4%˄ || 5.82 | 5.57 | -4%˄ | (run time too short) |
| 29b || 753.48 | 741.08 | -2%˄ || 1.33 | 1.35 | +2%˄ | (run time too short) |
| 29c || 216.63 | 215.52 | -1%˄ || 4.62 | 4.64 | +1%˄ | (run time too short) |
+| 2a || 28.09 | 24.98 | -11%˄ || 35.60 | 40.02 | +12%˄ | (run time too short) |
+| 2b || 26.14 | 22.80 | -13%˄ || 38.25 | 43.86 | +15%˄ | (run time too short) |
+| 2c || 22.46 | 18.94 | -16%˄ || 44.51 | 52.79 | +19%˄ | (run time too short) |
+| 2d || 54.04 | 51.19 | -5%˄ || 18.50 | 19.53 | +6%˄ | (run time too short) |
| 30a || 85.65 | 85.00 | -1%˄ || 11.67 | 11.76 | +1%˄ | (run time too short) |
| 30b || 88.79 | 87.79 | -1%˄ || 11.26 | 11.39 | +1%˄ | (run time too short) |
| 30c || 146.57 | 147.46 | +1%˄ || 6.82 | 6.78 | -1%˄ | (run time too short) |
| 31a || 75.54 | 75.31 | -0%˄ || 13.24 | 13.28 | +0%˄ | (run time too short) |
| 31b || 74.22 | 74.40 | +0%˄ || 13.47 | 13.44 | -0%˄ | (run time too short) |
| 31c || 84.42 | 83.90 | -1%˄ || 11.85 | 11.92 | +1%˄ | (run time too short) |
+| 32a || 13.78 | 9.78 | -29%˄ || 72.55 | 102.25 | +41%˄ | (run time too short) |
+| 32b || 32.42 | 27.56 | -15%˄ || 30.84 | 36.28 | +18%˄ | (run time too short) |
+| 33a || 50.14 | 28.97 | -42%˄ || 19.94 | 34.51 | +73%˄ | (run time too short) |
+| 33b || 28.94 | 17.78 | -39%˄ || 34.55 | 56.25 | +63%˄ | (run time too short) |
+| 33c || 55.30 | 38.94 | -30%˄ || 18.08 | 25.68 | +42%˄ | (run time too short) |
+| 3a || 67.17 | 62.72 | -7%˄ || 14.89 | 15.94 | +7%˄ | (run time too short) |
+| 3b || 23.36 | 16.26 | -30%˄ || 42.80 | 61.47 | +44%˄ | (run time too short) |
| 3c || 208.42 | 204.55 | -2%˄ || 4.80 | 4.89 | +2%˄ | (run time too short) |
+| 4a || 149.96 | 141.54 | -6%˄ || 6.67 | 7.06 | +6%˄ | (run time too short) |
+| 4b || 22.81 | 15.05 | -34%˄ || 43.84 | 66.42 | +52%˄ | (run time too short) |
+| 4c || 186.29 | 177.96 | -4%˄ || 5.37 | 5.62 | +5%˄ | (run time too short) |
+| 5a || 51.99 | 47.03 | -10%˄ || 19.23 | 21.26 | +11%˄ | (run time too short) |
+| 5b || 55.09 | 49.13 | -11%˄ || 18.15 | 20.35 | +12%˄ | (run time too short) |
| 5c || 84.87 | 84.98 | +0%˄ || 11.78 | 11.77 | -0%˄ | (run time too short) |
-| 6a || 131.22 | 149.25 | +14%˄ || 7.62 | 6.70 | -12%˄ | (run time too short) |
-| 6b || 141.21 | 162.40 | +15%˄ || 7.08 | 6.16 | -13%˄ | (run time too short) |
-| 6c || 119.89 | 141.16 | +18%˄ || 8.34 | 7.08 | -15%˄ | (run time too short) |
-| 6d || 326.87 | 357.45 | +9%˄ || 3.06 | 2.80 | -9%˄ | (run time too short) |
-| 6e || 123.41 | 145.81 | +18%˄ || 8.10 | 6.86 | -15%˄ | (run time too short) |
-| 6f || 634.33 | 677.61 | +7%˄ || 1.58 | 1.48 | -6%˄ | (run time too short) |
+| 7a || 113.24 | 81.77 | -28%˄ || 8.83 | 12.23 | +38%˄ | (run time too short) |
+| 7b || 106.68 | 77.57 | -27%˄ || 9.37 | 12.89 | +38%˄ | (run time too short) |
| 7c || 536.20 | 532.54 | -1%˄ || 1.86 | 1.88 | +1%˄ | (run time too short) |
| 8a || 171.79 | 176.88 | +3%˄ || 5.82 | 5.65 | -3%˄ | (run time too short) |
| 8b || 175.04 | 168.33 | -4%˄ || 5.71 | 5.94 | +4%˄ | (run time too short) |
| 8c || 1722.71 | 1740.66 | +1% || 0.57 | 0.57 | +0% | (run time too short) |
+| 8d || 472.54 | 442.48 | -6%˄ || 2.12 | 2.26 | +7%˄ | (run time too short) |
-| 9a || 227.46 | 248.86 | +9%˄ || 4.40 | 4.02 | -9%˄ | (run time too short) |
| 9b || 143.96 | 140.66 | -2%˄ || 6.95 | 7.11 | +2%˄ | (run time too short) |
-| 9c || 269.37 | 298.73 | +11%˄ || 3.71 | 3.35 | -10%˄ | (run time too short) |
-| 9d || 416.26 | 443.13 | +6%˄ || 2.40 | 2.26 | -6%˄ | (run time too short) |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Sum || 27256.54 | 27883.69 | +2% || | | | |
+| Geomean || | | || | | +9% | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkJoinOrder - multi-threaded, ordered, 1 client, 64 cores Sum of avg. item runtimes: +2% || Geometric mean of throughput changes: +0%Configuration Overview - click to expand +Configuration Overview---------+----------------------------------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkJoinOrder_85450217ce7cb6cd090d5efa04b6051fe625caf2_mt_ordered.json | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkJoinOrder_036d2ca7327d9f76b74cac0f821834d9638f9d3d_mt_ordered.json |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 85450217ce7cb6cd090d5efa04b6051fe625caf2 | 036d2ca7327d9f76b74cac0f821834d9638f9d3d |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.6 | clang 17.0.6 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-08 17:46:07 | 2025-06-06 20:23:17 |
| encoding | None | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| 10a || 37.27 | 37.24 | -0%˄ || 26.80 | 26.83 | +0%˄ | (run time too short) |
| 10b || 17.47 | 17.48 | +0%˄ || 57.13 | 57.07 | -0%˄ | (run time too short) |
-| 10c || 105.65 | 118.45 | +12%˄ || 9.46 | 8.44 | -11%˄ | (run time too short) |
| 11a || 10.53 | 10.26 | -3%˄ || 94.61 | 97.16 | +3%˄ | (run time too short) |
| 11b || 8.47 | 8.21 | -3%˄ || 117.58 | 121.33 | +3%˄ | (run time too short) |
| 11c || 23.15 | 22.51 | -3%˄ || 43.13 | 44.36 | +3%˄ | (run time too short) |
| 11d || 26.59 | 26.29 | -1%˄ || 37.56 | 37.98 | +1%˄ | (run time too short) |
| 12a || 20.47 | 20.73 | +1%˄ || 48.78 | 48.16 | -1%˄ | (run time too short) |
| 12b || 11.98 | 11.89 | -1%˄ || 83.23 | 83.82 | +1%˄ | (run time too short) |
| 12c || 49.24 | 49.63 | +1%˄ || 20.29 | 20.13 | -1%˄ | (run time too short) |
| 13a || 133.09 | 129.43 | -3%˄ || 7.51 | 7.72 | +3%˄ | (run time too short) |
| 13b || 92.89 | 90.07 | -3%˄ || 10.76 | 11.10 | +3%˄ | (run time too short) |
| 13c || 15.96 | 15.63 | -2%˄ || 62.49 | 63.84 | +2%˄ | (run time too short) |
| 13d || 362.26 | 360.37 | -1%˄ || 2.76 | 2.77 | +1%˄ | (run time too short) |
| 14a || 55.50 | 55.56 | +0%˄ || 18.01 | 17.99 | -0%˄ | (run time too short) |
| 14b || 71.42 | 71.19 | -0%˄ || 13.99 | 14.04 | +0%˄ | (run time too short) |
| 14c || 113.47 | 111.97 | -1%˄ || 8.81 | 8.93 | +1%˄ | (run time too short) |
| 15a || 29.02 | 28.94 | -0%˄ || 34.42 | 34.51 | +0%˄ | (run time too short) |
| 15b || 24.42 | 24.53 | +0%˄ || 40.89 | 40.71 | -0%˄ | (run time too short) |
| 15c || 21.54 | 21.59 | +0%˄ || 46.36 | 46.25 | -0%˄ | (run time too short) |
| 15d || 27.87 | 27.75 | -0%˄ || 35.83 | 35.99 | +0%˄ | (run time too short) |
-| 16a || 745.63 | 807.31 | +8%˄ || 1.34 | 1.24 | -8%˄ | (run time too short) |
| 16b || 1963.23 | 1993.83 | +2% || 0.50 | 0.50 | +0% | (run time too short) |
-| 16c || 897.68 | 956.10 | +7%˄ || 1.11 | 1.05 | -6%˄ | (run time too short) |
-| 16d || 869.40 | 924.60 | +6%˄ || 1.15 | 1.08 | -6%˄ | (run time too short) |
| 17a || 180.61 | 181.12 | +0%˄ || 5.54 | 5.52 | -0%˄ | (run time too short) |
| 17b || 150.29 | 153.72 | +2%˄ || 6.65 | 6.50 | -2%˄ | (run time too short) |
| 17c || 128.44 | 130.71 | +2%˄ || 7.78 | 7.65 | -2%˄ | (run time too short) |
| 17d || 122.48 | 122.04 | -0%˄ || 8.16 | 8.19 | +0%˄ | (run time too short) |
| 17e || 779.59 | 802.71 | +3%˄ || 1.28 | 1.25 | -3%˄ | (run time too short) |
| 17f || 314.33 | 315.83 | +0%˄ || 3.18 | 3.17 | -0%˄ | (run time too short) |
| 18a || 50.70 | 50.79 | +0%˄ || 19.71 | 19.68 | -0%˄ | (run time too short) |
| 18b || 48.77 | 49.44 | +1%˄ || 20.49 | 20.21 | -1%˄ | (run time too short) |
-| 18c || 96.15 | 100.77 | +5%˄ || 10.40 | 9.92 | -5%˄ | (run time too short) |
| 19a || 97.39 | 97.93 | +1%˄ || 10.26 | 10.21 | -1%˄ | (run time too short) |
| 19b || 59.99 | 60.54 | +1%˄ || 16.66 | 16.51 | -1%˄ | (run time too short) |
| 19c || 110.26 | 112.48 | +2%˄ || 9.07 | 8.89 | -2%˄ | (run time too short) |
| 19d || 519.19 | 520.33 | +0%˄ || 1.93 | 1.92 | -0%˄ | (run time too short) |
| 1a || 6.25 | 6.06 | -3%˄ || 159.18 | 164.11 | +3%˄ | (run time too short) |
+| 1b || 7.37 | 4.33 | -41%˄ || 134.98 | 229.34 | +70%˄ | (run time too short) |
+| 1c || 5.05 | 3.82 | -24%˄ || 196.87 | 259.75 | +32%˄ | (run time too short) |
| 1d || 4.93 | 4.75 | -4%˄ || 201.57 | 209.28 | +4%˄ | (run time too short) |
| 20a || 83.25 | 82.56 | -1%˄ || 12.01 | 12.11 | +1%˄ | (run time too short) |
| 20b || 74.42 | 73.88 | -1%˄ || 13.43 | 13.53 | +1%˄ | (run time too short) |
-| 20c || 73.44 | 78.06 | +6%˄ || 13.61 | 12.80 | -6%˄ | (run time too short) |
| 21a || 16.47 | 16.40 | -0%˄ || 60.59 | 60.84 | +0%˄ | (run time too short) |
| 21b || 14.87 | 14.66 | -1%˄ || 67.09 | 68.07 | +1%˄ | (run time too short) |
| 21c || 18.20 | 18.15 | -0%˄ || 54.82 | 55.00 | +0%˄ | (run time too short) |
| 22a || 69.63 | 70.72 | +2%˄ || 14.35 | 14.13 | -2%˄ | (run time too short) |
| 22b || 52.64 | 52.61 | -0%˄ || 18.98 | 18.99 | +0%˄ | (run time too short) |
| 22c || 115.34 | 118.07 | +2%˄ || 8.67 | 8.47 | -2%˄ | (run time too short) |
| 22d || 211.73 | 212.68 | +0%˄ || 4.72 | 4.70 | -0%˄ | (run time too short) |
| 23a || 15.67 | 15.39 | -2%˄ || 63.68 | 64.84 | +2%˄ | (run time too short) |
| 23b || 25.83 | 26.07 | +1%˄ || 38.67 | 38.30 | -1%˄ | (run time too short) |
| 23c || 17.86 | 17.19 | -4%˄ || 55.88 | 58.05 | +4%˄ | (run time too short) |
| 24a || 59.90 | 60.58 | +1%˄ || 16.68 | 16.49 | -1%˄ | (run time too short) |
| 24b || 58.80 | 59.81 | +2%˄ || 17.00 | 16.71 | -2%˄ | (run time too short) |
| 25a || 55.89 | 55.99 | +0%˄ || 17.88 | 17.85 | -0%˄ | (run time too short) |
| 25b || 31.88 | 32.05 | +1%˄ || 31.33 | 31.17 | -1%˄ | (run time too short) |
| 25c || 151.94 | 154.31 | +2%˄ || 6.58 | 6.48 | -2%˄ | (run time too short) |
-| 26a || 78.55 | 84.62 | +8%˄ || 12.72 | 11.81 | -7%˄ | (run time too short) |
-| 26b || 56.11 | 62.51 | +11%˄ || 17.81 | 15.99 | -10%˄ | (run time too short) |
-| 26c || 118.23 | 128.76 | +9%˄ || 8.46 | 7.76 | -8%˄ | (run time too short) |
| 27a || 19.35 | 19.22 | -1%˄ || 51.58 | 51.93 | +1%˄ | (run time too short) |
| 27b || 17.90 | 18.08 | +1%˄ || 55.74 | 55.20 | -1%˄ | (run time too short) |
| 27c || 17.79 | 17.59 | -1%˄ || 56.11 | 56.75 | +1%˄ | (run time too short) |
| 28a || 122.45 | 119.28 | -3%˄ || 8.16 | 8.38 | +3%˄ | (run time too short) |
| 28b || 26.80 | 26.76 | -0%˄ || 37.27 | 37.32 | +0%˄ | (run time too short) |
| 28c || 101.26 | 98.99 | -2%˄ || 9.87 | 10.10 | +2%˄ | (run time too short) |
| 29a || 52.67 | 53.53 | +2%˄ || 18.97 | 18.67 | -2%˄ | (run time too short) |
| 29b || 134.49 | 128.92 | -4%˄ || 7.43 | 7.75 | +4%˄ | (run time too short) |
| 29c || 65.14 | 65.27 | +0%˄ || 15.34 | 15.31 | -0%˄ | (run time too short) |
| 2a || 21.37 | 21.19 | -1%˄ || 46.74 | 47.14 | +1%˄ | (run time too short) |
| 2b || 19.89 | 19.41 | -2%˄ || 50.19 | 51.44 | +2%˄ | (run time too short) |
+| 2c || 14.03 | 13.41 | -4%˄ || 71.14 | 74.39 | +5%˄ | (run time too short) |
| 2d || 50.74 | 49.93 | -2%˄ || 19.70 | 20.01 | +2%˄ | (run time too short) |
| 30a || 46.97 | 46.46 | -1%˄ || 21.27 | 21.50 | +1%˄ | (run time too short) |
| 30b || 36.07 | 36.01 | -0%˄ || 27.69 | 27.74 | +0%˄ | (run time too short) |
| 30c || 112.27 | 110.72 | -1%˄ || 8.90 | 9.03 | +1%˄ | (run time too short) |
| 31a || 37.26 | 37.88 | +2%˄ || 26.81 | 26.37 | -2%˄ | (run time too short) |
| 31b || 33.75 | 33.69 | -0%˄ || 29.59 | 29.65 | +0%˄ | (run time too short) |
| 31c || 40.87 | 41.80 | +2%˄ || 24.44 | 23.90 | -2%˄ | (run time too short) |
| 32a || 6.28 | 6.01 | -4%˄ || 158.50 | 165.59 | +4%˄ | (run time too short) |
+| 32b || 30.05 | 27.77 | -8%˄ || 33.24 | 35.97 | +8%˄ | (run time too short) |
+| 33a || 13.76 | 10.21 | -26%˄ || 72.48 | 97.63 | +35%˄ | (run time too short) |
+| 33b || 9.56 | 8.24 | -14%˄ || 104.24 | 120.82 | +16%˄ | (run time too short) |
+| 33c || 20.14 | 17.79 | -12%˄ || 49.56 | 56.11 | +13%˄ | (run time too short) |
-| 3a || 32.22 | 37.57 | +17%˄ || 31.00 | 26.59 | -14%˄ | (run time too short) |
| 3b || 6.44 | 6.36 | -1%˄ || 154.51 | 156.43 | +1%˄ | (run time too short) |
| 3c || 69.22 | 70.84 | +2%˄ || 14.44 | 14.11 | -2%˄ | (run time too short) |
| 4a || 65.70 | 65.15 | -1%˄ || 15.21 | 15.34 | +1%˄ | (run time too short) |
| 4b || 5.64 | 5.46 | -3%˄ || 176.19 | 182.03 | +3%˄ | (run time too short) |
| 4c || 84.60 | 84.11 | -1%˄ || 11.82 | 11.89 | +1%˄ | (run time too short) |
| 5a || 25.29 | 24.92 | -1%˄ || 39.48 | 40.06 | +1%˄ | (run time too short) |
| 5b || 20.19 | 20.31 | +1%˄ || 49.44 | 49.15 | -1%˄ | (run time too short) |
| 5c || 48.44 | 47.77 | -1%˄ || 20.63 | 20.91 | +1%˄ | (run time too short) |
-| 6a || 23.70 | 29.30 | +24%˄ || 42.13 | 34.09 | -19%˄ | (run time too short) |
-| 6b || 44.06 | 50.09 | +14%˄ || 22.68 | 19.95 | -12%˄ | (run time too short) |
-| 6c || 22.20 | 27.35 | +23%˄ || 44.97 | 36.52 | -19%˄ | (run time too short) |
| 6d || 127.98 | 126.87 | -1%˄ || 7.81 | 7.88 | +1%˄ | (run time too short) |
-| 6e || 23.75 | 29.54 | +24%˄ || 42.04 | 33.81 | -20%˄ | (run time too short) |
| 6f || 467.51 | 469.59 | +0%˄ || 2.14 | 2.13 | -0%˄ | (run time too short) |
| 7a || 27.18 | 27.27 | +0%˄ || 36.74 | 36.62 | -0%˄ | (run time too short) |
| 7b || 25.80 | 26.13 | +1%˄ || 38.71 | 38.22 | -1%˄ | (run time too short) |
| 7c || 257.48 | 255.85 | -1%˄ || 3.88 | 3.91 | +1%˄ | (run time too short) |
| 8a || 40.28 | 41.13 | +2%˄ || 24.80 | 24.29 | -2%˄ | (run time too short) |
| 8b || 39.34 | 39.89 | +1%˄ || 25.39 | 25.04 | -1%˄ | (run time too short) |
| 8c || 1087.62 | 1080.71 | -1%˄ || 0.92 | 0.93 | +1%˄ | (run time too short) |
| 8d || 270.60 | 265.01 | -2%˄ || 3.70 | 3.77 | +2%˄ | (run time too short) |
| 9a || 124.98 | 130.61 | +4%˄ || 8.00 | 7.65 | -4%˄ | (run time too short) |
| 9b || 71.35 | 72.58 | +2%˄ || 14.01 | 13.77 | -2%˄ | (run time too short) |
| 9c || 142.93 | 146.21 | +2%˄ || 6.99 | 6.84 | -2%˄ | (run time too short) |
| 9d || 354.94 | 356.37 | +0%˄ || 2.82 | 2.81 | -0%˄ | (run time too short) |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Sum || 14376.95 | 14659.08 | +2% || | | | |
| Geomean || | | || | | +0% | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkJoinOrder - multi-threaded, shuffled, 64 clients, 64 cores Sum of avg. item runtimes: +4% || Geometric mean of throughput changes: -4%Configuration Overview - click to expand +Configuration Overview---------+--------------------------------------------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkJoinOrder_85450217ce7cb6cd090d5efa04b6051fe625caf2_mt.json | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkJoinOrder_036d2ca7327d9f76b74cac0f821834d9638f9d3d_mt.json |
+-------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 85450217ce7cb6cd090d5efa04b6051fe625caf2 | 036d2ca7327d9f76b74cac0f821834d9638f9d3d |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| compiler | clang 17.0.6 | clang 17.0.6 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-08 18:00:08 | 2025-06-06 20:37:31 |
| encoding | None | None |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+---------+
| 10a || 195.83 | 189.08 | -3% || 1.27 | 1.22 | -4% | 0.7197 |
-| 10b || 127.36 | 154.40 | +21% || 1.27 | 1.22 | -4% | 0.1023 |
-| 10c || 585.57 | 646.15 | +10% || 1.27 | 1.22 | -4% | 0.0313 |
| 11a || 91.38 | 93.82 | +3% || 1.27 | 1.22 | -4% | 0.8618 |
+| 11b || 79.58 | 72.76 | -9% || 1.27 | 1.22 | -4% | 0.4797 |
-| 11c || 112.77 | 132.29 | +17% || 1.27 | 1.22 | -4% | 0.0858 |
+| 11d || 96.52 | 91.29 | -5% || 1.27 | 1.22 | -4% | 0.6124 |
-| 12a || 155.71 | 165.46 | +6% || 1.27 | 1.22 | -4% | 0.5366 |
+| 12b || 79.84 | 62.06 | -22% || 1.27 | 1.22 | -4% | 0.0614 |
+| 12c || 349.57 | 314.03 | -10% || 1.27 | 1.22 | -4% | 0.0944 |
| 13a || 467.38 | 472.52 | +1% || 1.27 | 1.22 | -4% | 0.8208 |
+| 13b || 434.71 | 371.52 | -15% || 1.27 | 1.22 | -4% | 0.0295 |
+| 13c || 91.82 | 83.35 | -9% || 1.27 | 1.22 | -4% | 0.3691 |
| 13d || 914.07 | 888.60 | -3% || 1.27 | 1.22 | -4% | 0.3567 |
-| 14a || 371.54 | 437.96 | +18% || 1.27 | 1.22 | -4% | 0.0072 |
-| 14b || 422.53 | 464.78 | +10% || 1.27 | 1.22 | -4% | 0.1093 |
| 14c || 617.36 | 601.81 | -3% || 1.27 | 1.22 | -4% | 0.6154 |
-| 15a || 114.44 | 128.07 | +12% || 1.27 | 1.22 | -4% | 0.2847 |
+| 15b || 132.46 | 106.65 | -19% || 1.27 | 1.22 | -4% | 0.0641 |
| 15c || 139.31 | 137.69 | -1% || 1.27 | 1.22 | -4% | 0.9130 |
+| 15d || 138.98 | 132.32 | -5% || 1.27 | 1.22 | -4% | 0.5780 |
-| 16a || 1579.68 | 1676.81 | +6% || 1.27 | 1.22 | -4% | 0.0155 |
-| 16b || 3079.15 | 3256.14 | +6% || 1.27 | 1.22 | -4% | 0.0000 |
-| 16c || 1827.76 | 1944.83 | +6% || 1.27 | 1.22 | -4% | 0.0030 |
-| 16d || 1787.17 | 1896.21 | +6% || 1.27 | 1.22 | -4% | 0.0054 |
| 17a || 870.00 | 900.18 | +3% || 1.27 | 1.22 | -4% | 0.3814 |
-| 17b || 613.04 | 642.03 | +5% || 1.27 | 1.22 | -4% | 0.3045 |
-| 17c || 558.03 | 652.43 | +17% || 1.27 | 1.22 | -4% | 0.0015 |
-| 17d || 570.87 | 607.54 | +6% || 1.27 | 1.22 | -4% | 0.2147 |
| 17e || 1698.53 | 1748.70 | +3% || 1.27 | 1.22 | -4% | 0.1796 |
-| 17f || 1066.63 | 1235.30 | +16% || 1.27 | 1.22 | -4% | 0.0000 |
| 18a || 261.15 | 262.82 | +1% || 1.27 | 1.22 | -4% | 0.9297 |
| 18b || 381.62 | 388.29 | +2% || 1.27 | 1.22 | -4% | 0.8046 |
-| 18c || 593.78 | 644.39 | +9% || 1.27 | 1.22 | -4% | 0.1171 |
-| 19a || 553.48 | 595.48 | +8% || 1.27 | 1.22 | -4% | 0.2007 |
| 19b || 407.28 | 405.62 | -0% || 1.27 | 1.22 | -4% | 0.9540 |
| 19c || 624.04 | 641.47 | +3% || 1.27 | 1.22 | -4% | 0.5780 |
| 19d || 1435.20 | 1414.64 | -1% || 1.27 | 1.22 | -4% | 0.6005 |
-| 1a || 36.20 | 38.23 | +6% || 1.27 | 1.22 | -4% | 0.7379 |
-| 1b || 39.85 | 54.93 | +38% || 1.27 | 1.22 | -4% | 0.0648 |
-| 1c || 52.01 | 55.05 | +6% || 1.27 | 1.22 | -4% | 0.7347 |
+| 1d || 32.65 | 24.25 | -26% || 1.27 | 1.22 | -4% | 0.0785 |
-| 20a || 450.15 | 495.68 | +10% || 1.27 | 1.22 | -4% | 0.1305 |
| 20b || 400.74 | 391.29 | -2% || 1.27 | 1.22 | -4% | 0.7012 |
-| 20c || 355.79 | 410.16 | +15% || 1.27 | 1.22 | -4% | 0.0233 |
+| 21a || 209.99 | 185.36 | -12% || 1.27 | 1.22 | -4% | 0.2473 |
+| 21b || 133.49 | 126.75 | -5% || 1.27 | 1.22 | -4% | 0.6425 |
| 21c || 186.17 | 180.88 | -3% || 1.27 | 1.22 | -4% | 0.7888 |
-| 22a || 479.95 | 503.82 | +5% || 1.27 | 1.22 | -4% | 0.4136 |
| 22b || 420.25 | 435.17 | +4% || 1.27 | 1.22 | -4% | 0.5864 |
| 22c || 644.15 | 669.15 | +4% || 1.27 | 1.22 | -4% | 0.4218 |
| 22d || 931.46 | 954.15 | +2% || 1.27 | 1.22 | -4% | 0.5477 |
| 23a || 166.18 | 168.31 | +1% || 1.27 | 1.22 | -4% | 0.9136 |
-| 23b || 119.08 | 134.34 | +13% || 1.27 | 1.22 | -4% | 0.1996 |
| 23c || 159.83 | 156.45 | -2% || 1.27 | 1.22 | -4% | 0.8213 |
+| 24a || 414.01 | 391.40 | -5% || 1.27 | 1.22 | -4% | 0.4175 |
-| 24b || 300.89 | 333.63 | +11% || 1.27 | 1.22 | -4% | 0.2003 |
-| 25a || 382.19 | 403.68 | +6% || 1.27 | 1.22 | -4% | 0.3870 |
| 25b || 238.72 | 249.28 | +4% || 1.27 | 1.22 | -4% | 0.6468 |
-| 25c || 796.79 | 884.62 | +11% || 1.27 | 1.22 | -4% | 0.0090 |
-| 26a || 379.80 | 418.61 | +10% || 1.27 | 1.22 | -4% | 0.0977 |
-| 26b || 224.64 | 240.83 | +7% || 1.27 | 1.22 | -4% | 0.3098 |
-| 26c || 611.66 | 650.49 | +6% || 1.27 | 1.22 | -4% | 0.1303 |
| 27a || 170.63 | 169.70 | -1% || 1.27 | 1.22 | -4% | 0.9567 |
| 27b || 158.98 | 162.13 | +2% || 1.27 | 1.22 | -4% | 0.8512 |
-| 27c || 175.03 | 209.16 | +20% || 1.27 | 1.22 | -4% | 0.0816 |
| 28a || 650.19 | 652.65 | +0% || 1.27 | 1.22 | -4% | 0.9303 |
| 28b || 242.80 | 235.50 | -3% || 1.27 | 1.22 | -4% | 0.7112 |
| 28c || 634.96 | 659.98 | +4% || 1.27 | 1.22 | -4% | 0.4565 |
-| 29a || 276.37 | 312.33 | +13% || 1.27 | 1.22 | -4% | 0.1140 |
| 29b || 382.13 | 376.22 | -2% || 1.27 | 1.22 | -4% | 0.8164 |
-| 29c || 354.12 | 413.76 | +17% || 1.27 | 1.22 | -4% | 0.0406 |
-| 2a || 112.65 | 118.99 | +6% || 1.27 | 1.22 | -4% | 0.5266 |
| 2b || 104.05 | 102.57 | -1% || 1.27 | 1.22 | -4% | 0.8617 |
+| 2c || 84.89 | 79.64 | -6% || 1.27 | 1.22 | -4% | 0.5253 |
-| 2d || 183.25 | 197.85 | +8% || 1.27 | 1.22 | -4% | 0.1903 |
-| 30a || 349.17 | 367.70 | +5% || 1.27 | 1.22 | -4% | 0.4665 |
| 30b || 388.60 | 375.44 | -3% || 1.27 | 1.22 | -4% | 0.6680 |
-| 30c || 595.19 | 677.75 | +14% || 1.27 | 1.22 | -4% | 0.0140 |
| 31a || 280.60 | 277.10 | -1% || 1.27 | 1.22 | -4% | 0.8866 |
-| 31b || 249.77 | 278.73 | +12% || 1.27 | 1.22 | -4% | 0.2089 |
| 31c || 325.68 | 338.06 | +4% || 1.27 | 1.22 | -4% | 0.6390 |
+| 32a || 46.33 | 35.54 | -23% || 1.27 | 1.22 | -4% | 0.1408 |
| 32b || 147.93 | 146.14 | -1% || 1.27 | 1.22 | -4% | 0.8824 |
-| 33a || 111.76 | 129.62 | +16% || 1.27 | 1.22 | -4% | 0.2652 |
-| 33b || 83.36 | 90.03 | +8% || 1.27 | 1.22 | -4% | 0.5559 |
| 33c || 141.82 | 135.95 | -4% || 1.27 | 1.22 | -4% | 0.6845 |
-| 3a || 229.55 | 305.85 | +33% || 1.27 | 1.22 | -4% | 0.0002 |
+| 3b || 77.18 | 70.69 | -8% || 1.27 | 1.22 | -4% | 0.6265 |
| 3c || 447.45 | 452.46 | +1% || 1.27 | 1.22 | -4% | 0.8572 |
-| 4a || 242.03 | 279.49 | +15% || 1.27 | 1.22 | -4% | 0.0492 |
-| 4b || 54.49 | 57.63 | +6% || 1.27 | 1.22 | -4% | 0.6812 |
| 4c || 296.17 | 305.21 | +3% || 1.27 | 1.22 | -4% | 0.6316 |
+| 5a || 260.94 | 223.04 | -15% || 1.27 | 1.22 | -4% | 0.1311 |
+| 5b || 163.30 | 144.58 | -11% || 1.27 | 1.22 | -4% | 0.2691 |
| 5c || 339.38 | 331.80 | -2% || 1.27 | 1.22 | -4% | 0.7585 |
-| 6a || 132.98 | 139.18 | +5% || 1.27 | 1.22 | -4% | 0.6279 |
-| 6b || 177.25 | 195.30 | +10% || 1.27 | 1.22 | -4% | 0.2226 |
-| 6c || 108.60 | 133.71 | +23% || 1.27 | 1.22 | -4% | 0.0481 |
-| 6d || 532.63 | 575.01 | +8% || 1.27 | 1.22 | -4% | 0.1373 |
-| 6e || 107.08 | 144.91 | +35% || 1.27 | 1.22 | -4% | 0.0030 |
| 6f || 1219.95 | 1231.59 | +1% || 1.27 | 1.22 | -4% | 0.6976 |
-| 7a || 161.00 | 169.56 | +5% || 1.27 | 1.22 | -4% | 0.5817 |
+| 7b || 153.53 | 135.97 | -11% || 1.27 | 1.22 | -4% | 0.1663 |
-| 7c || 1048.33 | 1098.56 | +5% || 1.27 | 1.22 | -4% | 0.1706 |
| 8a || 184.67 | 187.30 | +1% || 1.27 | 1.22 | -4% | 0.8715 |
+| 8b || 154.15 | 130.51 | -15% || 1.27 | 1.22 | -4% | 0.1182 |
| 8c || 2307.48 | 2308.54 | +0% || 1.27 | 1.22 | -4% | 0.9797 |
| 8d || 865.90 | 884.29 | +2% || 1.27 | 1.22 | -4% | 0.5424 |
| 9a || 678.43 | 695.17 | +2% || 1.27 | 1.22 | -4% | 0.6402 |
-| 9b || 376.21 | 401.90 | +7% || 1.27 | 1.22 | -4% | 0.3046 |
-| 9c || 704.86 | 785.97 | +12% || 1.27 | 1.22 | -4% | 0.0137 |
| 9d || 1088.72 | 1135.44 | +4% || 1.27 | 1.22 | -4% | 0.1726 |
+---------++----------+----------+--------++----------+----------+--------+---------+
| Sum || 50155.26 | 52282.15 | +4% || | | | |
| Geomean || | | || | | -4% | |
+---------++----------+----------+--------++----------+----------+--------+---------+hyriseBenchmarkStarSchema - single-threaded Sum of avg. item runtimes: -7% || Geometric mean of throughput changes: +12%Configuration Overview - click to expand +Configuration Overview---+---------------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkStarSchema_85450217ce7cb6cd090d5efa04b6051fe625caf2_st.json | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkStarSchema_036d2ca7327d9f76b74cac0f821834d9638f9d3d_st.json |
+-------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 85450217ce7cb6cd090d5efa04b6051fe625caf2 | 036d2ca7327d9f76b74cac0f821834d9638f9d3d |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.6 | clang 17.0.6 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-08 18:20:31 | 2025-06-06 20:57:51 |
| encoding | None | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+ +---------++----------+---------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
+| 1.1 || 587.65 | 413.05 | -30%˄ || 1.70 | 2.42 | +42%˄ | (run time too short) |
+| 1.2 || 649.41 | 237.71 | -63%˄ || 1.54 | 4.21 | +173%˄ | (run time too short) |
+| 1.3 || 652.47 | 231.67 | -64%˄ || 1.53 | 4.32 | +182%˄ | (run time too short) |
-| 2.1 || 400.89 | 506.18 | +26%˄ || 2.49 | 1.98 | -21%˄ | (run time too short) |
-| 2.2 || 203.96 | 280.73 | +38%˄ || 4.90 | 3.56 | -27%˄ | (run time too short) |
-| 2.3 || 118.60 | 178.90 | +51%˄ || 8.43 | 5.59 | -34%˄ | (run time too short) |
| 3.1 || 2499.06 | 2511.14 | +0% || 0.40 | 0.38 | -4% | (run time too short) |
| 3.2 || 265.45 | 277.39 | +4%˄ || 3.77 | 3.60 | -4%˄ | (run time too short) |
+| 3.3 || 126.02 | 115.87 | -8%˄ || 7.94 | 8.63 | +9%˄ | (run time too short) |
+| 3.4 || 122.74 | 109.43 | -11%˄ || 8.15 | 9.14 | +12%˄ | (run time too short) |
| 4.1 || 2285.97 | 2380.25 | +4% || 0.43 | 0.42 | -4% | 0.0000 |
| 4.2 || 728.88 | 758.69 | +4%˄ || 1.37 | 1.32 | -4%˄ | (run time too short) |
| 4.3 || 210.62 | 209.51 | -1%˄ || 4.75 | 4.77 | +1%˄ | (run time too short) |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
+| Sum || 8851.72 | 8210.52 | -7% || | | | |
+| Geomean || | | || | | +12% | |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+---------+--------++----------+----------+--------+----------------------+hyriseBenchmarkStarSchema - multi-threaded, ordered, 1 client, 64 cores Sum of avg. item runtimes: -1% || Geometric mean of throughput changes: +8%Configuration Overview - click to expand +Configuration Overview---------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkStarSchema_85450217ce7cb6cd090d5efa04b6051fe625caf2_mt_ordered.json | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkStarSchema_036d2ca7327d9f76b74cac0f821834d9638f9d3d_mt_ordered.json |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 85450217ce7cb6cd090d5efa04b6051fe625caf2 | 036d2ca7327d9f76b74cac0f821834d9638f9d3d |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.6 | clang 17.0.6 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-08 18:26:36 | 2025-06-06 21:03:11 |
| encoding | None | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------+ +---------++----------+---------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
+| 1.1 || 163.07 | 127.93 | -22%˄ || 6.13 | 7.81 | +27%˄ | (run time too short) |
+| 1.2 || 161.28 | 84.74 | -47%˄ || 6.20 | 11.80 | +90%˄ | (run time too short) |
+| 1.3 || 159.98 | 81.84 | -49%˄ || 6.25 | 12.21 | +95%˄ | (run time too short) |
-| 2.1 || 306.25 | 331.63 | +8%˄ || 3.26 | 3.02 | -8%˄ | (run time too short) |
-| 2.2 || 146.39 | 159.04 | +9%˄ || 6.83 | 6.29 | -8%˄ | (run time too short) |
-| 2.3 || 50.96 | 64.28 | +26%˄ || 19.61 | 15.55 | -21%˄ | (run time too short) |
-| 3.1 || 742.95 | 801.35 | +8%˄ || 1.35 | 1.25 | -7%˄ | (run time too short) |
-| 3.2 || 141.41 | 149.27 | +6%˄ || 7.07 | 6.70 | -5%˄ | (run time too short) |
| 3.3 || 76.92 | 76.92 | +0%˄ || 12.99 | 12.99 | -0%˄ | (run time too short) |
| 3.4 || 71.59 | 69.59 | -3%˄ || 13.96 | 14.36 | +3%˄ | (run time too short) |
-| 4.1 || 810.45 | 848.51 | +5%˄ || 1.23 | 1.18 | -4%˄ | (run time too short) |
| 4.2 || 347.78 | 350.10 | +1%˄ || 2.87 | 2.86 | -1%˄ | (run time too short) |
| 4.3 || 113.12 | 111.38 | -2%˄ || 8.84 | 8.97 | +2%˄ | (run time too short) |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| Sum || 3292.17 | 3256.58 | -1% || | | | |
+| Geomean || | | || | | +8% | |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+---------+--------++----------+----------+--------+----------------------+hyriseBenchmarkStarSchema - multi-threaded, shuffled, 64 clients, 64 cores Sum of avg. item runtimes: +6% || Geometric mean of throughput changes: -5%Configuration Overview - click to expand +Configuration Overview---------+---------------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkStarSchema_85450217ce7cb6cd090d5efa04b6051fe625caf2_mt.json | /sc/home/lukas.hagen/hyrise/hyrise/cmake-build-release/benchmark_all_results/hyriseBenchmarkStarSchema_036d2ca7327d9f76b74cac0f821834d9638f9d3d_mt.json |
+-------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 85450217ce7cb6cd090d5efa04b6051fe625caf2 | 036d2ca7327d9f76b74cac0f821834d9638f9d3d |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| compiler | clang 17.0.6 | clang 17.0.6 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-08 18:29:58 | 2025-06-06 21:06:29 |
| encoding | None | None |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+---------+
-| 1.1 || 851.73 | 858.35 | +1% || 3.96 | 3.76 | -5% | 0.7401 |
+| 1.2 || 566.45 | 450.81 | -20% || 3.96 | 3.76 | -5% | 0.0000 |
+| 1.3 || 536.22 | 424.29 | -21% || 3.96 | 3.76 | -5% | 0.0000 |
-| 2.1 || 1897.91 | 2123.89 | +12% || 3.96 | 3.75 | -5% | 0.0000 |
-| 2.2 || 960.39 | 1082.60 | +13% || 3.96 | 3.76 | -5% | 0.0000 |
-| 2.3 || 297.37 | 361.46 | +22% || 3.97 | 3.76 | -5% | 0.0000 |
-| 3.1 || 3115.98 | 3328.58 | +7% || 3.96 | 3.75 | -5% | 0.0000 |
-| 3.2 || 883.55 | 990.15 | +12% || 3.96 | 3.76 | -5% | 0.0000 |
-| 3.3 || 457.04 | 485.83 | +6% || 3.97 | 3.75 | -5% | 0.0792 |
-| 3.4 || 439.61 | 490.43 | +12% || 3.96 | 3.76 | -5% | 0.0025 |
-| 4.1 || 3093.45 | 3249.13 | +5% || 3.96 | 3.75 | -5% | 0.0000 |
-| 4.2 || 2336.63 | 2454.83 | +5% || 3.96 | 3.75 | -5% | 0.0003 |
-| 4.3 || 685.25 | 711.65 | +4% || 3.96 | 3.76 | -5% | 0.1512 |
+---------++----------+----------+--------++----------+----------+--------+---------+
-| Sum || 16121.57 | 17012.00 | +6% || | | | |
-| Geomean || | | || | | -5% | |
+---------++----------+----------+--------++----------+----------+--------+---------+ |
|
I'll try to compile a list of benchmarks today. Too easy to get confused with all the numbers here. |
|
The following benchmarks are the ones which I deemed interesting:
Memory Consumption |
Master vs. PR (int:FoR,string:FSD)SegmentEncodingSpec auto_select_segment_encoding_spec(const DataType& type, const bool segment_values_are_unique) {
switch (type) {
case DataType::Int:
return SegmentEncodingSpec{EncodingType::FrameOfReference};
case DataType::String:
return SegmentEncodingSpec{EncodingType::FixedStringDictionary};
case DataType::Long:
case DataType::Double:
case DataType::Float:
if (segment_values_are_unique) {
return SegmentEncodingSpec{EncodingType::Unencoded};
} else {
return SegmentEncodingSpec{EncodingType::Dictionary};
}
default:
Fail("Unknown DataType when trying to select encoding for column.");
}
}System cx17 - click to expand
Commit Info and Build Time
hyriseBenchmarkTPCH - single-threaded, SF 10.0 Sum of avg. item runtimes: -15% || Geometric mean of throughput changes: +12%Configuration Overview - click to expand +Configuration Overview----+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCH_0bcfa0250faed47181d2591d19daefc98bfcd5a4_st.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCH_704bc3145cfcc51bcb4cbda8ae7ee2387e67fc94_st.json |
+--------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4-dirty | 704bc3145cfcc51bcb4cbda8ae7ee2387e67fc94-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 12:04:57 | 2025-06-06 07:20:13 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+--------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+ +----------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
-| TPC-H 01 || 5528.68 | 6005.02 | +9% || 0.17 | 0.15 | -10% | (run time too short) |
| TPC-H 02 || 40.56 | 41.26 | +2%˄ || 24.66 | 24.24 | -2%˄ | (run time too short) |
| TPC-H 03 || 1263.52 | 1268.19 | +0% || 0.78 | 0.78 | +0% | 0.3933 |
-| TPC-H 04 || 1382.00 | 1495.25 | +8% || 0.72 | 0.67 | -7% | 0.0000 |
+| TPC-H 05 || 2273.47 | 1930.21 | -15% || 0.43 | 0.52 | +19% | 0.0000 |
| TPC-H 06 || 170.52 | 169.22 | -1%˄ || 5.86 | 5.91 | +1%˄ | (run time too short) |
+| TPC-H 07 || 703.81 | 599.82 | -15%˄ || 1.42 | 1.67 | +17%˄ | (run time too short) |
+| TPC-H 08 || 537.71 | 429.62 | -20%˄ || 1.86 | 2.33 | +25%˄ | (run time too short) |
+| TPC-H 09 || 6533.99 | 4863.47 | -26% || 0.15 | 0.20 | +33% | (run time too short) |
+| TPC-H 10 || 1386.61 | 1284.31 | -7% || 0.72 | 0.77 | +7% | 0.0000 |
-| TPC-H 11 || 50.89 | 53.65 | +5%˄ || 19.65 | 18.64 | -5%˄ | (run time too short) |
+| TPC-H 12 || 942.18 | 878.99 | -7%˄ || 1.06 | 1.14 | +7%˄ | (run time too short) |
+| TPC-H 13 || 7360.10 | 4687.63 | -36% || 0.13 | 0.20 | +50% | (run time too short) |
+| TPC-H 14 || 492.69 | 458.72 | -7%˄ || 2.03 | 2.18 | +7%˄ | (run time too short) |
+| TPC-H 15 || 183.11 | 161.15 | -12%˄ || 5.46 | 6.21 | +14%˄ | (run time too short) |
| TPC-H 16 || 530.69 | 550.42 | +4%˄ || 1.88 | 1.82 | -4%˄ | (run time too short) |
+| TPC-H 17 || 220.02 | 138.96 | -37%˄ || 4.55 | 7.20 | +58%˄ | (run time too short) |
-| TPC-H 18 || 1568.85 | 1702.04 | +8% || 0.63 | 0.58 | -8% | 0.0000 |
| TPC-H 19 || 230.76 | 223.27 | -3%˄ || 4.33 | 4.48 | +3%˄ | (run time too short) |
+| TPC-H 20 || 392.62 | 274.59 | -30%˄ || 2.55 | 3.64 | +43%˄ | (run time too short) |
+| TPC-H 21 || 4267.09 | 3467.82 | -19% || 0.23 | 0.28 | +21% | (run time too short) |
+| TPC-H 22 || 482.40 | 380.38 | -21%˄ || 2.07 | 2.63 | +27%˄ | (run time too short) |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
+| Sum || 36542.26 | 31063.98 | -15% || | | | |
+| Geomean || | | || | | +12% | |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+----------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCH - single-threaded, SF 0.01 Sum of avg. item runtimes: -1% || Geometric mean of throughput changes: -2%Configuration Overview - click to expand +Configuration Overview----+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCH_0bcfa0250faed47181d2591d19daefc98bfcd5a4_st_s01.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCH_704bc3145cfcc51bcb4cbda8ae7ee2387e67fc94_st_s01.json |
+--------------------------+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4-dirty | 704bc3145cfcc51bcb4cbda8ae7ee2387e67fc94-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 12:21:50 | 2025-06-06 07:35:14 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 0.009999999776482582 | 0.009999999776482582 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000
10000
| 1000000000 |
+--------------------------+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+ +----------++----------+---------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+----------++----------+---------+--------++----------+----------+--------+----------------------+
-| TPC-H 01 || 5.24 | 5.62 | +7%˄ || 190.64 | 177.86 | -7%˄ | (run time too short) |
-| TPC-H 02 || 3.19 | 3.53 | +11%˄ || 313.71 | 282.98 | -10%˄ | (run time too short) |
| TPC-H 03 || 0.58 | 0.58 | -0%˄ || 1721.40 | 1723.83 | +0%˄ | (run time too short) |
-| TPC-H 04 || 0.37 | 0.42 | +14%˄ || 2675.72 | 2356.64 | -12%˄ | (run time too short) |
-| TPC-H 05 || 0.95 | 1.01 | +6%˄ || 1050.28 | 989.41 | -6%˄ | (run time too short) |
| TPC-H 06 || 0.19 | 0.20 | +1%˄ || 5138.39 | 5092.23 | -1%˄ | (run time too short) |
+| TPC-H 07 || 9.60 | 8.71 | -9%˄ || 104.11 | 114.82 | +10%˄ | (run time too short) |
| TPC-H 08 || 12.91 | 13.25 | +3%˄ || 77.45 | 75.46 | -3%˄ | (run time too short) |
+| TPC-H 09 || 3.96 | 3.19 | -19%˄ || 252.38 | 313.01 | +24%˄ | (run time too short) |
| TPC-H 10 || 0.70 | 0.69 | -1%˄ || 1434.57 | 1453.39 | +1%˄ | (run time too short) |
| TPC-H 11 || 0.17 | 0.17 | +1%˄ || 5771.75 | 5698.91 | -1%˄ | (run time too short) |
| TPC-H 12 || 0.62 | 0.63 | +3%˄ || 1615.42 | 1573.99 | -3%˄ | (run time too short) |
| TPC-H 13 || 2.15 | 2.18 | +2%˄ || 465.29 | 458.16 | -2%˄ | (run time too short) |
| TPC-H 14 || 0.29 | 0.30 | +3%˄ || 3401.75 | 3302.18 | -3%˄ | (run time too short) |
| TPC-H 15 || 1.07 | 1.08 | +1%˄ || 929.03 | 922.97 | -1%˄ | (run time too short) |
| TPC-H 16 || 1.92 | 1.97 | +3%˄ || 520.95 | 506.84 | -3%˄ | (run time too short) |
-| TPC-H 17 || 0.46 | 0.75 | +63%˄ || 2178.75 | 1334.06 | -39%˄ | (run time too short) |
+| TPC-H 18 || 1.32 | 1.19 | -10%˄ || 758.50 | 840.44 | +11%˄ | (run time too short) |
| TPC-H 19 || 4.51 | 4.45 | -1%˄ || 221.63 | 224.58 | +1%˄ | (run time too short) |
| TPC-H 20 || 2.38 | 2.37 | -0%˄ || 420.72 | 422.35 | +0%˄ | (run time too short) |
| TPC-H 21 || 1.11 | 1.08 | -3%˄ || 901.66 | 925.02 | +3%˄ | (run time too short) |
| TPC-H 22 || 1.06 | 1.08 | +2%˄ || 939.30 | 923.78 | -2%˄ | (run time too short) |
+----------++----------+---------+--------++----------+----------+--------+----------------------+
| Sum || 54.76 | 54.46 | -1% || | | | |
| Geomean || | | || | | -2% | |
+----------++----------+---------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+----------++----------+---------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCH - multi-threaded, ordered, 1 client, 64 cores, SF 10.0 Sum of avg. item runtimes: -13% || Geometric mean of throughput changes: +10%Configuration Overview - click to expand +Configuration Overview---------+----------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCH_0bcfa0250faed47181d2591d19daefc98bfcd5a4_mt_ordered.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCH_704bc3145cfcc51bcb4cbda8ae7ee2387e67fc94_mt_ordered.json |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4-dirty | 704bc3145cfcc51bcb4cbda8ae7ee2387e67fc94-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 12:22:17 | 2025-06-06 07:35:39 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------+ +----------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
-| TPC-H 01 || 4647.84 | 4882.89 | +5% || 0.20 | 0.20 | +0% | (run time too short) |
+| TPC-H 02 || 58.37 | 52.66 | -10%˄ || 17.12 | 18.98 | +11%˄ | (run time too short) |
| TPC-H 03 || 664.16 | 646.71 | -3%˄ || 1.51 | 1.55 | +3%˄ | (run time too short) |
| TPC-H 04 || 653.10 | 642.17 | -2%˄ || 1.53 | 1.56 | +2%˄ | (run time too short) |
+| TPC-H 05 || 614.53 | 523.75 | -15%˄ || 1.63 | 1.91 | +17%˄ | (run time too short) |
| TPC-H 06 || 64.23 | 63.63 | -1%˄ || 15.56 | 15.70 | +1%˄ | (run time too short) |
| TPC-H 07 || 248.96 | 243.81 | -2%˄ || 4.02 | 4.10 | +2%˄ | (run time too short) |
+| TPC-H 08 || 234.85 | 216.64 | -8%˄ || 4.26 | 4.61 | +8%˄ | (run time too short) |
+| TPC-H 09 || 2207.70 | 1882.03 | -15% || 0.45 | 0.52 | +15% | (run time too short) |
+| TPC-H 10 || 643.54 | 593.33 | -8%˄ || 1.55 | 1.69 | +8%˄ | (run time too short) |
| TPC-H 11 || 88.09 | 88.09 | +0%˄ || 11.35 | 11.35 | -0%˄ | (run time too short) |
+| TPC-H 12 || 502.42 | 465.08 | -7%˄ || 1.99 | 2.15 | +8%˄ | (run time too short) |
+| TPC-H 13 || 3827.23 | 1966.37 | -49% || 0.25 | 0.50 | +100% | (run time too short) |
| TPC-H 14 || 150.42 | 155.18 | +3%˄ || 6.65 | 6.44 | -3%˄ | (run time too short) |
+| TPC-H 15 || 147.53 | 126.77 | -14%˄ || 6.78 | 7.89 | +16%˄ | (run time too short) |
| TPC-H 16 || 580.92 | 570.35 | -2%˄ || 1.72 | 1.75 | +2%˄ | (run time too short) |
+| TPC-H 17 || 88.43 | 71.97 | -19%˄ || 11.30 | 13.89 | +23%˄ | (run time too short) |
| TPC-H 18 || 1745.15 | 1706.65 | -2% || 0.57 | 0.58 | +3% | 0.0541 |
| TPC-H 19 || 109.64 | 113.86 | +4%˄ || 9.12 | 8.78 | -4%˄ | (run time too short) |
+| TPC-H 20 || 193.82 | 176.60 | -9%˄ || 5.16 | 5.66 | +10%˄ | (run time too short) |
+| TPC-H 21 || 1120.78 | 1006.30 | -10%˄ || 0.89 | 0.99 | +11%˄ | (run time too short) |
+| TPC-H 22 || 161.23 | 136.52 | -15%˄ || 6.20 | 7.32 | +18%˄ | (run time too short) |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
+| Sum || 18752.92 | 16331.39 | -13% || | | | |
+| Geomean || | | || | | +10% | |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+----------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCH - multi-threaded, shuffled, 64 clients, 64 cores, SF 10.0 Sum of avg. item runtimes: -11% || Geometric mean of throughput changes: +12%Configuration Overview - click to expand +Configuration Overview---------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCH_0bcfa0250faed47181d2591d19daefc98bfcd5a4_mt.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCH_704bc3145cfcc51bcb4cbda8ae7ee2387e67fc94_mt.json |
+-------------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4-dirty | 704bc3145cfcc51bcb4cbda8ae7ee2387e67fc94-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| clustering | None | None |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 12:34:06 | 2025-06-06 07:46:56 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+ +----------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+----------++----------+----------+--------++----------+----------+--------+---------+
+| TPC-H 01 || 6094.00 | 6370.96 | +5% || 1.03 | 1.16 | +12% | 0.0000 |
+| TPC-H 02 || 470.12 | 440.27 | -6% || 1.04 | 1.16 | +12% | 0.5709 |
+| TPC-H 03 || 2815.11 | 2623.59 | -7% || 1.04 | 1.16 | +12% | 0.1324 |
+| TPC-H 04 || 2293.11 | 2228.19 | -3% || 1.04 | 1.16 | +12% | 0.5688 |
+| TPC-H 05 || 4194.02 | 3983.72 | -5% || 1.03 | 1.16 | +12% | 0.2203 |
+| TPC-H 06 || 784.96 | 734.66 | -6% || 1.04 | 1.17 | +12% | 0.4826 |
+| TPC-H 07 || 3379.16 | 2873.79 | -15% || 1.03 | 1.16 | +12% | 0.0008 |
+| TPC-H 08 || 2547.08 | 2087.30 | -18% || 1.03 | 1.16 | +12% | 0.0008 |
+| TPC-H 09 || 6472.87 | 5691.94 | -12% || 1.03 | 1.16 | +12% | 0.0000 |
+| TPC-H 10 || 3425.93 | 3137.08 | -8% || 1.03 | 1.16 | +12% | 0.0367 |
+| TPC-H 11 || 494.08 | 423.13 | -14% || 1.04 | 1.16 | +12% | 0.1437 |
+| TPC-H 12 || 2681.55 | 2391.03 | -11% || 1.03 | 1.16 | +12% | 0.0149 |
+| TPC-H 13 || 7630.22 | 4885.81 | -36% || 1.03 | 1.16 | +13% | 0.0000 |
+| TPC-H 14 || 1096.15 | 1093.04 | -0% || 1.04 | 1.16 | +12% | 0.9694 |
+| TPC-H 15 || 682.01 | 604.72 | -11% || 1.04 | 1.16 | +12% | 0.1451 |
+| TPC-H 16 || 2536.14 | 2244.17 | -12% || 1.04 | 1.16 | +12% | 0.0168 |
+| TPC-H 17 || 850.76 | 743.89 | -13% || 1.04 | 1.16 | +12% | 0.1395 |
+| TPC-H 18 || 3630.39 | 3646.37 | +0% || 1.03 | 1.16 | +12% | 0.8580 |
+| TPC-H 19 || 1140.60 | 1121.19 | -2% || 1.03 | 1.16 | +12% | 0.8268 |
+| TPC-H 20 || 1760.96 | 1483.94 | -16% || 1.04 | 1.16 | +12% | 0.0050 |
+| TPC-H 21 || 5284.28 | 4884.18 | -8% || 1.03 | 1.16 | +12% | 0.0232 |
+| TPC-H 22 || 1110.97 | 993.93 | -11% || 1.04 | 1.16 | +12% | 0.1517 |
+----------++----------+----------+--------++----------+----------+--------+---------+
+| Sum || 61374.47 | 54686.88 | -11% || | | | |
+| Geomean || | | || | | +12% | |
+----------++----------+----------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCDS - single-threaded Sum of avg. item runtimes: +5% || Geometric mean of throughput changes: -10%Configuration Overview - click to expand +Configuration Overview---+---------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCDS_0bcfa0250faed47181d2591d19daefc98bfcd5a4_st.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCDS_704bc3145cfcc51bcb4cbda8ae7ee2387e67fc94_st.json |
+-------------------------+---------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4-dirty | 704bc3145cfcc51bcb4cbda8ae7ee2387e67fc94-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 12:55:34 | 2025-06-06 08:08:23 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+---------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
+| 01 || 224.59 | 205.76 | -8%˄ || 4.45 | 4.86 | +9%˄ | (run time too short) |
+| 03 || 62.68 | 57.33 | -9%˄ || 15.95 | 17.44 | +9%˄ | (run time too short) |
+| 06 || 198.18 | 188.60 | -5%˄ || 5.05 | 5.30 | +5%˄ | (run time too short) |
-| 07 || 253.36 | 279.28 | +10%˄ || 3.95 | 3.58 | -9%˄ | (run time too short) |
-| 09 || 720.91 | 1370.75 | +90%˄ || 1.39 | 0.72 | -48%˄ | (run time too short) |
-| 10 || 120.63 | 161.78 | +34%˄ || 8.29 | 6.18 | -25%˄ | (run time too short) |
-| 13 || 464.50 | 513.05 | +10%˄ || 2.15 | 1.95 | -9%˄ | (run time too short) |
-| 15 || 124.21 | 133.69 | +8%˄ || 8.05 | 7.48 | -7%˄ | (run time too short) |
-| 16 || 55.91 | 76.54 | +37%˄ || 17.88 | 13.07 | -27%˄ | (run time too short) |
+| 17 || 323.16 | 300.29 | -7%˄ || 3.09 | 3.33 | +8%˄ | (run time too short) |
-| 19 || 97.81 | 112.81 | +15%˄ || 10.22 | 8.86 | -13%˄ | (run time too short) |
-| 25 || 167.80 | 181.29 | +8%˄ || 5.96 | 5.52 | -7%˄ | (run time too short) |
-| 26 || 114.68 | 127.71 | +11%˄ || 8.72 | 7.83 | -10%˄ | (run time too short) |
-| 28 || 574.95 | 1176.53 | +105%˄ || 1.74 | 0.85 | -51%˄ | (run time too short) |
| 29 || 484.05 | 472.25 | -2%˄ || 2.07 | 2.12 | +2%˄ | (run time too short) |
-| 31 || 1316.64 | 1437.44 | +9% || 0.75 | 0.68 | -9% | (run time too short) |
-| 32 || 30.32 | 40.72 | +34%˄ || 32.98 | 24.56 | -26%˄ | (run time too short) |
-| 34 || 140.58 | 167.50 | +19%˄ || 7.11 | 5.97 | -16%˄ | (run time too short) |
-| 35 || 604.65 | 647.37 | +7%˄ || 1.65 | 1.54 | -7%˄ | (run time too short) |
-| 37 || 653.81 | 1227.69 | +88%˄ || 1.53 | 0.80 | -48%˄ | (run time too short) |
-| 39a || 1704.00 | 1859.91 | +9% || 0.58 | 0.53 | -9% | 0.0000 |
-| 39b || 1682.21 | 1861.56 | +11% || 0.58 | 0.53 | -9% | (run time too short) |
| 41 || 281.49 | 286.47 | +2%˄ || 3.55 | 3.49 | -2%˄ | (run time too short) |
-| 42 || 78.54 | 92.67 | +18%˄ || 12.73 | 10.79 | -15%˄ | (run time too short) |
-| 43 || 974.60 | 1034.23 | +6%˄ || 1.03 | 0.97 | -6%˄ | (run time too short) |
+| 45 || 126.38 | 107.34 | -15%˄ || 7.91 | 9.32 | +18%˄ | (run time too short) |
| 48 || 1164.93 | 1186.76 | +2%˄ || 0.86 | 0.84 | -2%˄ | (run time too short) |
| 50 || 125.44 | 130.37 | +4%˄ || 7.97 | 7.67 | -4%˄ | (run time too short) |
-| 52 || 79.38 | 93.08 | +17%˄ || 12.60 | 10.74 | -15%˄ | (run time too short) |
-| 55 || 74.51 | 88.48 | +19%˄ || 13.42 | 11.30 | -16%˄ | (run time too short) |
| 62 || 554.59 | 576.69 | +4%˄ || 1.80 | 1.73 | -4%˄ | (run time too short) |
| 65 || 1924.75 | 1874.04 | -3% || 0.52 | 0.53 | +3% | 0.0000 |
-| 69 || 139.66 | 170.22 | +22%˄ || 7.16 | 5.87 | -18%˄ | (run time too short) |
-| 73 || 77.37 | 98.41 | +27%˄ || 12.92 | 10.16 | -21%˄ | (run time too short) |
| 79 || 491.32 | 508.66 | +4%˄ || 2.04 | 1.97 | -3%˄ | (run time too short) |
| 81 || 155.98 | 150.42 | -4%˄ || 6.41 | 6.65 | +4%˄ | (run time too short) |
-| 82 || 700.59 | 1255.98 | +79%˄ || 1.43 | 0.78 | -45%˄ | (run time too short) |
+| 83 || 38.43 | 36.11 | -6%˄ || 26.02 | 27.69 | +6%˄ | (run time too short) |
+| 84 || 13.88 | 12.36 | -11%˄ || 72.03 | 80.89 | +12%˄ | (run time too short) |
| 85 || 161.74 | 163.30 | +1%˄ || 6.18 | 6.12 | -1%˄ | (run time too short) |
-| 88 || 638.78 | 798.86 | +25%˄ || 1.57 | 1.25 | -20%˄ | (run time too short) |
| 91 || 17.79 | 17.29 | -3%˄ || 56.21 | 57.83 | +3%˄ | (run time too short) |
+| 92 || 35.59 | 33.45 | -6%˄ || 28.09 | 29.90 | +6%˄ | (run time too short) |
+| 93 || 3751.76 | 2395.99 | -36% || 0.25 | 0.42 | +67% | (run time too short) |
-| 94 || 35.40 | 45.52 | +29%˄ || 28.25 | 21.97 | -22%˄ | (run time too short) |
| 95 || 5159.89 | 5203.35 | +1% || 0.18 | 0.18 | +0% | (run time too short) |
-| 96 || 60.98 | 78.86 | +29%˄ || 16.40 | 12.68 | -23%˄ | (run time too short) |
+| 97 || 4040.15 | 3552.85 | -12% || 0.23 | 0.27 | +14% | (run time too short) |
| 99 || 1085.28 | 1125.71 | +4%˄ || 0.92 | 0.89 | -4%˄ | (run time too short) |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
-| Sum || 32108.83 | 33717.27 | +5% || | | | |
-| Geomean || | | || | | -10% | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCDS - multi-threaded, ordered, 1 client, 64 cores Sum of avg. item runtimes: -1% || Geometric mean of throughput changes: -1%Configuration Overview - click to expand +Configuration Overview---------+-----------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCDS_0bcfa0250faed47181d2591d19daefc98bfcd5a4_mt_ordered.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCDS_704bc3145cfcc51bcb4cbda8ae7ee2387e67fc94_mt_ordered.json |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4-dirty | 704bc3145cfcc51bcb4cbda8ae7ee2387e67fc94-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 13:16:21 | 2025-06-06 08:31:30 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
+| 01 || 241.09 | 226.55 | -6%˄ || 4.15 | 4.41 | +6%˄ | (run time too short) |
+| 03 || 33.52 | 31.93 | -5%˄ || 29.80 | 31.28 | +5%˄ | (run time too short) |
+| 06 || 192.36 | 172.75 | -10%˄ || 5.20 | 5.79 | +11%˄ | (run time too short) |
| 07 || 191.04 | 188.62 | -1%˄ || 5.23 | 5.30 | +1%˄ | (run time too short) |
-| 09 || 112.75 | 153.59 | +36%˄ || 8.87 | 6.51 | -27%˄ | (run time too short) |
-| 10 || 36.49 | 40.91 | +12%˄ || 27.37 | 24.42 | -11%˄ | (run time too short) |
| 13 || 257.93 | 250.60 | -3%˄ || 3.88 | 3.99 | +3%˄ | (run time too short) |
| 15 || 75.62 | 76.48 | +1%˄ || 13.22 | 13.07 | -1%˄ | (run time too short) |
-| 16 || 30.90 | 33.15 | +7%˄ || 32.32 | 30.13 | -7%˄ | (run time too short) |
+| 17 || 143.10 | 122.43 | -14%˄ || 6.99 | 8.17 | +17%˄ | (run time too short) |
-| 19 || 68.54 | 74.37 | +9%˄ || 14.58 | 13.44 | -8%˄ | (run time too short) |
+| 25 || 102.63 | 90.70 | -12%˄ || 9.74 | 11.02 | +13%˄ | (run time too short) |
+| 26 || 87.87 | 82.57 | -6%˄ || 11.38 | 12.11 | +6%˄ | (run time too short) |
-| 28 || 147.32 | 159.24 | +8%˄ || 6.79 | 6.28 | -7%˄ | (run time too short) |
+| 29 || 458.69 | 423.59 | -8%˄ || 2.18 | 2.36 | +8%˄ | (run time too short) |
-| 31 || 477.48 | 501.40 | +5%˄ || 2.09 | 1.99 | -5%˄ | (run time too short) |
| 32 || 34.03 | 32.84 | -4%˄ || 29.35 | 30.42 | +4%˄ | (run time too short) |
| 34 || 94.61 | 97.19 | +3%˄ || 10.57 | 10.28 | -3%˄ | (run time too short) |
| 35 || 388.22 | 380.37 | -2%˄ || 2.58 | 2.63 | +2%˄ | (run time too short) |
-| 37 || 197.37 | 255.35 | +29%˄ || 5.07 | 3.92 | -23%˄ | (run time too short) |
| 39a || 767.67 | 770.86 | +0%˄ || 1.30 | 1.30 | -0%˄ | (run time too short) |
| 39b || 744.15 | 745.58 | +0%˄ || 1.34 | 1.34 | -0%˄ | (run time too short) |
| 41 || 365.65 | 365.91 | +0%˄ || 2.73 | 2.73 | -0%˄ | (run time too short) |
-| 42 || 49.54 | 53.27 | +8%˄ || 20.17 | 18.76 | -7%˄ | (run time too short) |
| 43 || 446.83 | 462.28 | +3%˄ || 2.24 | 2.16 | -3%˄ | (run time too short) |
| 45 || 54.19 | 52.70 | -3%˄ || 18.44 | 18.96 | +3%˄ | (run time too short) |
| 48 || 536.30 | 528.72 | -1%˄ || 1.86 | 1.89 | +1%˄ | (run time too short) |
-| 50 || 102.96 | 107.73 | +5%˄ || 9.71 | 9.28 | -4%˄ | (run time too short) |
-| 52 || 51.71 | 55.82 | +8%˄ || 19.33 | 17.90 | -7%˄ | (run time too short) |
-| 55 || 44.58 | 49.20 | +10%˄ || 22.41 | 20.31 | -9%˄ | (run time too short) |
| 62 || 348.42 | 349.30 | +0%˄ || 2.87 | 2.86 | -0%˄ | (run time too short) |
| 65 || 1487.32 | 1472.47 | -1% || 0.67 | 0.67 | +0% | (run time too short) |
| 69 || 71.95 | 74.93 | +4%˄ || 13.89 | 13.34 | -4%˄ | (run time too short) |
-| 73 || 54.34 | 59.01 | +9%˄ || 18.39 | 16.94 | -8%˄ | (run time too short) |
| 79 || 482.39 | 477.67 | -1%˄ || 2.07 | 2.09 | +1%˄ | (run time too short) |
| 81 || 192.05 | 187.82 | -2%˄ || 5.21 | 5.32 | +2%˄ | (run time too short) |
-| 82 || 224.64 | 280.75 | +25%˄ || 4.45 | 3.56 | -20%˄ | (run time too short) |
+| 83 || 46.69 | 43.88 | -6%˄ || 21.40 | 22.77 | +6%˄ | (run time too short) |
+| 84 || 10.09 | 9.34 | -7%˄ || 98.82 | 106.77 | +8%˄ | (run time too short) |
+| 85 || 71.04 | 67.45 | -5%˄ || 14.07 | 14.82 | +5%˄ | (run time too short) |
-| 88 || 82.46 | 87.89 | +7%˄ || 12.12 | 11.37 | -6%˄ | (run time too short) |
+| 91 || 18.25 | 16.87 | -8%˄ || 54.68 | 59.15 | +8%˄ | (run time too short) |
+| 92 || 43.78 | 39.45 | -10%˄ || 22.82 | 25.33 | +11%˄ | (run time too short) |
+| 93 || 753.37 | 550.95 | -27%˄ || 1.33 | 1.81 | +37%˄ | (run time too short) |
-| 94 || 30.53 | 32.15 | +5%˄ || 32.71 | 31.07 | -5%˄ | (run time too short) |
| 95 || 712.51 | 713.44 | +0%˄ || 1.40 | 1.40 | -0%˄ | (run time too short) |
-| 96 || 46.38 | 49.94 | +8%˄ || 21.54 | 20.01 | -7%˄ | (run time too short) |
+| 97 || 1373.25 | 1304.19 | -5% || 0.72 | 0.77 | +7% | 0.0000 |
-| 99 || 574.74 | 651.40 | +13%˄ || 1.74 | 1.54 | -12%˄ | (run time too short) |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Sum || 13159.36 | 13055.59 | -1% || | | | |
| Geomean || | | || | | -1% | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCDS - multi-threaded, shuffled, 64 clients, 64 cores Sum of avg. item runtimes: -1% || Geometric mean of throughput changes: +1%Configuration Overview - click to expand +Configuration Overview---------+---------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCDS_0bcfa0250faed47181d2591d19daefc98bfcd5a4_mt.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCDS_704bc3145cfcc51bcb4cbda8ae7ee2387e67fc94_mt.json |
+-------------------------------+---------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4-dirty | 704bc3145cfcc51bcb4cbda8ae7ee2387e67fc94-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 13:28:30 | 2025-06-06 08:43:36 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+---------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+---------+
+| 01 || 857.64 | 715.49 | -17% || 1.00 | 1.01 | +1% | 0.0074 |
+| 03 || 302.59 | 271.87 | -10% || 1.00 | 1.01 | +1% | 0.3074 |
+| 06 || 933.97 | 851.12 | -9% || 1.00 | 1.01 | +1% | 0.1709 |
+| 07 || 1070.54 | 895.64 | -16% || 1.00 | 1.01 | +1% | 0.0043 |
-| 09 || 892.05 | 1108.93 | +24% || 1.00 | 1.01 | +1% | 0.0025 |
| 10 || 810.43 | 839.26 | +4% || 1.00 | 1.01 | +1% | 0.6769 |
+| 13 || 1758.12 | 1646.70 | -6% || 1.00 | 1.01 | +1% | 0.1290 |
| 15 || 529.36 | 508.31 | -4% || 1.00 | 1.01 | +1% | 0.6182 |
+| 16 || 505.42 | 474.75 | -6% || 1.00 | 1.01 | +1% | 0.5267 |
| 17 || 1456.84 | 1424.12 | -2% || 1.00 | 1.01 | +1% | 0.7022 |
+| 19 || 684.03 | 635.35 | -7% || 1.00 | 1.01 | +1% | 0.3553 |
| 25 || 1067.12 | 1035.53 | -3% || 1.00 | 1.01 | +1% | 0.6536 |
+| 26 || 517.34 | 473.21 | -9% || 1.00 | 1.01 | +1% | 0.2143 |
-| 28 || 1513.45 | 1849.16 | +22% || 1.00 | 1.01 | +1% | 0.0006 |
| 29 || 1867.95 | 1879.64 | +1% || 1.00 | 1.01 | +1% | 0.8963 |
-| 31 || 2665.98 | 2816.25 | +6% || 1.00 | 1.01 | +1% | 0.1941 |
| 32 || 188.89 | 188.46 | -0% || 1.00 | 1.01 | +1% | 0.9852 |
| 34 || 793.81 | 799.69 | +1% || 1.00 | 1.01 | +1% | 0.9121 |
+| 35 || 2277.05 | 2122.63 | -7% || 1.00 | 1.01 | +1% | 0.0825 |
-| 37 || 958.69 | 1062.38 | +11% || 1.00 | 1.01 | +1% | 0.0894 |
| 39a || 2877.21 | 2905.46 | +1% || 1.00 | 1.01 | +1% | 0.7555 |
| 39b || 2838.66 | 2950.73 | +4% || 1.00 | 1.01 | +1% | 0.2106 |
+| 41 || 2118.50 | 1952.42 | -8% || 1.00 | 1.01 | +1% | 0.0820 |
+| 42 || 549.85 | 469.36 | -15% || 1.00 | 1.01 | +1% | 0.0562 |
| 43 || 1634.02 | 1681.15 | +3% || 1.00 | 1.01 | +1% | 0.5139 |
+| 45 || 832.95 | 779.60 | -6% || 1.00 | 1.01 | +1% | 0.3614 |
| 48 || 2839.71 | 2805.85 | -1% || 1.00 | 1.01 | +1% | 0.7629 |
| 50 || 1125.65 | 1108.02 | -2% || 1.00 | 1.01 | +1% | 0.7920 |
+| 52 || 561.00 | 524.74 | -6% || 1.00 | 1.01 | +1% | 0.4563 |
-| 55 || 454.83 | 483.01 | +6% || 1.00 | 1.01 | +1% | 0.4560 |
-| 62 || 1040.44 | 1190.65 | +14% || 1.00 | 1.01 | +1% | 0.0056 |
| 65 || 4417.71 | 4379.75 | -1% || 1.00 | 1.01 | +1% | 0.5899 |
| 69 || 1045.11 | 1073.05 | +3% || 1.00 | 1.01 | +1% | 0.7097 |
+| 73 || 591.78 | 479.21 | -19% || 1.00 | 1.01 | +1% | 0.0107 |
| 79 || 1648.38 | 1643.27 | -0% || 1.00 | 1.01 | +1% | 0.9401 |
+| 81 || 619.10 | 581.88 | -6% || 1.00 | 1.01 | +1% | 0.4125 |
-| 82 || 1013.07 | 1111.85 | +10% || 1.00 | 1.01 | +1% | 0.0686 |
+| 83 || 349.02 | 267.02 | -23% || 1.00 | 1.02 | +1% | 0.0362 |
+| 84 || 131.22 | 100.61 | -23% || 1.00 | 1.01 | +1% | 0.1009 |
+| 85 || 898.51 | 839.10 | -7% || 1.00 | 1.01 | +1% | 0.3303 |
-| 88 || 2663.77 | 2841.32 | +7% || 1.00 | 1.01 | +1% | 0.1410 |
+| 91 || 214.04 | 203.12 | -5% || 1.00 | 1.01 | +1% | 0.7269 |
| 92 || 287.15 | 275.10 | -4% || 1.00 | 1.01 | +1% | 0.7229 |
+| 93 || 2283.35 | 1731.78 | -24% || 1.00 | 1.01 | +1% | 0.0000 |
| 94 || 470.70 | 487.49 | +4% || 1.00 | 1.01 | +1% | 0.7369 |
| 95 || 2204.25 | 2249.94 | +2% || 1.00 | 1.01 | +1% | 0.5584 |
-| 96 || 416.60 | 448.23 | +8% || 1.00 | 1.01 | +1% | 0.4059 |
+| 97 || 4515.32 | 4196.93 | -7% || 1.00 | 1.01 | +1% | 0.0017 |
-| 99 || 1444.88 | 1569.35 | +9% || 1.00 | 1.01 | +1% | 0.0468 |
+---------++----------+----------+--------++----------+----------+--------+---------+
| Sum || 63738.05 | 62928.47 | -1% || | | | |
| Geomean || | | || | | +1% | |
+---------++----------+----------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCC - single-threaded Sum of avg. item runtimes: +14% || Geometric mean of throughput changes: -10%Configuration Overview - click to expand +Configuration Overview---+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCC_0bcfa0250faed47181d2591d19daefc98bfcd5a4_st.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCC_704bc3145cfcc51bcb4cbda8ae7ee2387e67fc94_st.json |
+-------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4-dirty | 704bc3145cfcc51bcb4cbda8ae7ee2387e67fc94-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 13:48:45 | 2025-06-06 09:03:54 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10 | 10 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+ +--------------++----------+---------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+--------------++----------+---------+--------++----------+----------+--------+---------+
-| Delivery || 25.50 | 29.09 | +14% || 4.85 | 4.72 | -3% | 0.0000 |
-| New-Order || 12.07 | 13.83 | +15% || 60.41 | 52.92 | -12% | 0.0000 |
-| Order-Status || 1.16 | 1.41 | +22% || 5.46 | 4.75 | -13% | 0.0000 |
-| Payment || 2.20 | 2.20 | -0% || 58.26 | 50.77 | -13% | 0.9547 |
-| Stock-Level || 1.93 | 2.18 | +13% || 5.18 | 4.70 | -9% | 0.0000 |
+--------------++----------+---------+--------++----------+----------+--------+---------+
-| Sum || 42.85 | 48.72 | +14% || | | | |
-| Geomean || | | || | | -10% | |
+--------------++----------+---------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCC - multi-threaded, shuffled, 64 clients, 10 warehouses, 64 cores (high contention) Sum of avg. item runtimes: -3% || Geometric mean of throughput changes: +3%Configuration Overview - click to expand +Configuration Overview---------+-----------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCC_0bcfa0250faed47181d2591d19daefc98bfcd5a4_mt_highcont.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCC_704bc3145cfcc51bcb4cbda8ae7ee2387e67fc94_mt_highcont.json |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4-dirty | 704bc3145cfcc51bcb4cbda8ae7ee2387e67fc94-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 13:56:23 | 2025-06-06 09:04:59 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 600000000000 | 600000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10 | 10 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------+ +--------------++----------+---------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+--------------++----------+---------+--------++----------+----------+--------+---------+
| Delivery || 181.26 | 175.46 | -3% || 33.75 | 34.61 | +3% | 0.0000 |
| unsucc.: || 3.31 | 3.47 | +5% || 50.88 | 51.99 | +2% | |
| New-Order || 93.42 | 91.59 | -2% || 471.42 | 485.58 | +3% | 0.0000 |
| unsucc.: || 8.90 | 8.11 | -9% || 476.66 | 489.69 | +3% | |
| Order-Status || 9.53 | 9.38 | -2% || 85.20 | 85.98 | +1% | 0.2053 |
+| Payment || 15.67 | 14.68 | -6% || 239.31 | 249.01 | +4% | 0.0000 |
| unsucc.: || 5.48 | 5.26 | -4% || 665.74 | 681.99 | +2% | |
| Stock-Level || 13.87 | 13.65 | -2% || 83.49 | 86.48 | +4% | 0.1971 |
+--------------++----------+---------+--------++----------+----------+--------+---------+
| Sum || 313.75 | 304.76 | -3% || | | | |
| Geomean || | | || | | +3% | |
+--------------++----------+---------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCC - multi-threaded, shuffled, 10 clients, 10 warehouses, 64 cores (low contention) Sum of avg. item runtimes: +3% || Geometric mean of throughput changes: -4%Configuration Overview - click to expand +Configuration Overview---------+----------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCC_0bcfa0250faed47181d2591d19daefc98bfcd5a4_mt_lowcont.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCC_704bc3145cfcc51bcb4cbda8ae7ee2387e67fc94_mt_lowcont.json |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4-dirty | 704bc3145cfcc51bcb4cbda8ae7ee2387e67fc94-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 10 | 10 |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 14:06:35 | 2025-06-06 09:15:10 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 600000000000 | 600000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10 | 10 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------+ +--------------++----------+---------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+--------------++----------+---------+--------++----------+----------+--------+---------+
| Delivery || 75.34 | 77.46 | +3% || 16.40 | 16.04 | -2% | 0.0000 |
| unsucc.: || 0.85 | 0.98 | +16% || 2.12 | 1.95 | -8% | |
-| New-Order || 37.40 | 39.40 | +5% || 190.10 | 182.54 | -4% | 0.0000 |
| unsucc.: || 3.55 | 3.57 | +1% || 18.28 | 17.52 | -4% | |
| Order-Status || 4.29 | 4.42 | +3% || 18.60 | 17.79 | -4% | 0.0000 |
| Payment || 8.11 | 7.88 | -3% || 162.49 | 157.66 | -3% | 0.0000 |
| unsucc.: || 2.04 | 2.04 | +0% || 36.34 | 34.28 | -6% | |
| Stock-Level || 5.56 | 5.52 | -1% || 18.45 | 17.68 | -4% | 0.0008 |
+--------------++----------+---------+--------++----------+----------+--------+---------+
| Sum || 130.70 | 134.68 | +3% || | | | |
| Geomean || | | || | | -4% | |
+--------------++----------+---------+--------++----------+----------+--------+---------+hyriseBenchmarkJoinOrder - single-threaded Sum of avg. item runtimes: -4% || Geometric mean of throughput changes: -2%Configuration Overview - click to expand +Configuration Overview---+-------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkJoinOrder_0bcfa0250faed47181d2591d19daefc98bfcd5a4_st.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkJoinOrder_704bc3145cfcc51bcb4cbda8ae7ee2387e67fc94_st.json |
+-------------------------+-------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4-dirty | 704bc3145cfcc51bcb4cbda8ae7ee2387e67fc94-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 14:16:42 | 2025-06-06 09:25:17 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+-------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new
10000
| || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
+| 10a || 156.28 | 124.54 | -20%˄ || 6.40 | 8.03 | +25%˄ | (run time too short) |
+| 10b || 94.97 | 73.98 | -22%˄ || 10.53 | 13.52 | +28%˄ | (run time too short) |
+| 10c || 359.64 | 313.41 | -13%˄ || 2.78 | 3.19 | +15%˄ | (run time too short) |
-| 11a || 29.57 | 37.91 | +28%˄ || 33.81 | 26.37 | -22%˄ | (run time too short) |
-| 11b || 25.70 | 32.45 | +26%˄ || 38.90 | 30.82 | -21%˄ | (run time too short) |
-| 11c || 24.61 | 26.50 | +8%˄ || 40.64 | 37.73 | -7%˄ | (run time too short) |
-| 11d || 23.54 | 26.02 | +11%˄ || 42.48 | 38.43 | -10%˄ | (run time too short) |
-| 12a || 31.96 | 47.96 | +50%˄ || 31.28 | 20.85 | -33%˄ | (run time too short) |
-| 12b || 27.71 | 37.72 | +36%˄ || 36.09 | 26.51 | -27%˄ | (run time too short) |
-| 12c || 74.30 | 80.48 | +8%˄ || 13.46 | 12.42 | -8%˄ | (run time too short) |
| 13a || 182.97 | 185.42 | +1%˄ || 5.47 | 5.39 | -1%˄ | (run time too short) |
| 13b || 236.04 | 244.55 | +4%˄ || 4.24 | 4.09 | -3%˄ | (run time too short) |
-| 13c || 32.07 | 42.58 | +33%˄ || 31.18 | 23.48 | -25%˄ | (run time too short) |
-| 13d || 532.31 | 560.54 | +5%˄ || 1.88 | 1.78 | -5%˄ | (run time too short) |
| 14a || 103.47 | 106.24 | +3%˄ || 9.66 | 9.41 | -3%˄ | (run time too short) |
-| 14b || 110.68 | 117.26 | +6%˄ || 9.03 | 8.53 | -6%˄ | (run time too short) |
| 14c || 184.29 | 187.21 | +2%˄ || 5.43 | 5.34 | -2%˄ | (run time too short) |
+| 15a || 76.45 | 59.02 | -23%˄ || 13.08 | 16.94 | +30%˄ | (run time too short) |
+| 15b || 80.24 | 74.86 | -7%˄ || 12.46 | 13.36 | +7%˄ | (run time too short) |
+| 15c || 52.04 | 47.43 | -9%˄ || 19.21 | 21.08 | +10%˄ | (run time too short) |
+| 15d || 49.36 | 45.00 | -9%˄ || 20.26 | 22.22 | +10%˄ | (run time too short) |
+| 16a || 1445.42 | 1272.58 | -12% || 0.68 | 0.78 | +15% | 0.0000 |
+| 16b || 2709.47 | 2565.05 | -5% || 0.37 | 0.38 | +5% | (run time too short) |
+| 16c || 1621.40 | 1436.21 | -11% || 0.62 | 0.68 | +11% | (run time too short) |
+| 16d || 1575.46 | 1402.11 | -11% || 0.63 | 0.70 | +11% | (run time too short) |
+| 17a || 462.60 | 392.79 | -15%˄ || 2.16 | 2.55 | +18%˄ | (run time too short) |
+| 17b || 366.49 | 306.84 | -16%˄ || 2.73 | 3.26 | +19%˄ | (run time too short) |
+| 17c || 345.77 | 289.33 | -16%˄ || 2.89 | 3.46 | +20%˄ | (run time too short) |
+| 17d || 428.13 | 373.71 | -13%˄ || 2.34 | 2.68 | +15%˄ | (run time too short) |
+| 17e || 1674.18 | 1519.75 | -9% || 0.58 | 0.65 | +11% | (run time too short) |
+| 17f || 946.83 | 880.67 | -7%˄ || 1.06 | 1.14 | +8%˄ | (run time too short) |
-| 18a || 143.70 | 157.74 | +10%˄ || 6.96 | 6.34 | -9%˄ | (run time too short) |
| 18b || 107.32 | 111.28 | +4%˄ || 9.32 | 8.99 | -4%˄ | (run time too short) |
+| 18c || 199.17 | 187.45 | -6%˄ || 5.02 | 5.33 | +6%˄ | (run time too short) |
-| 19a || 221.40 | 234.74 | +6%˄ || 4.52 | 4.26 | -6%˄ | (run time too short) |
-| 19b || 192.93 | 202.52 | +5%˄ || 5.18 | 4.94 | -5%˄ | (run time too short) |
| 19c || 266.70 | 263.69 | -1%˄ || 3.75 | 3.79 | +1%˄ | (run time too short) |
| 19d || 749.25 | 761.09 | +2%˄ || 1.33 | 1.31 | -2%˄ | (run time too short) |
-| 1a || 10.27 | 11.53 | +12%˄ || 97.39 | 86.73 | -11%˄ | (run time too short) |
-| 1b || 16.44 | 29.62 | +80%˄ || 60.81 | 33.75 | -44%˄ | (run time too short) |
| 1c || 21.63 | 21.55 | -0%˄ || 46.22 | 46.40 | +0%˄ | (run time too short) |
-| 1d || 9.47 | 11.11 | +17%˄ || 105.55 | 89.97 | -15%˄ | (run time too short) |
-| 20a || 554.43 | 672.77 | +21%˄ || 1.80 | 1.49 | -18%˄ | (run time too short) |
-| 20b || 602.99 | 720.45 | +19%˄ || 1.66 | 1.39 | -16%˄ | (run time too short) |
+| 20c || 435.79 | 399.12 | -8%˄ || 2.29 | 2.51 | +9%˄ | (run time too short) |
-| 21a || 44.65 | 51.79 | +16%˄ || 22.39 | 19.31 | -14%˄ | (run time too short) |
-| 21b || 34.60 | 44.87 | +30%˄ || 28.90 | 22.28 | -23%˄ | (run time too short) |
| 21c || 40.86 | 41.32 | +1%˄ || 24.47 | 24.20 | -1%˄ | (run time too short) |
| 22a || 184.53 | 179.35 | -3%˄ || 5.42 | 5.58 | +3%˄ | (run time too short) |
| 22b || 167.60 | 162.44 | -3%˄ || 5.97 | 6.16 | +3%˄ | (run time too short) |
+| 22c || 250.95 | 239.56 | -5%˄ || 3.98 | 4.17 | +5%˄ | (run time too short) |
| 22d || 366.64 | 360.80 | -2%˄ || 2.73 | 2.77 | +2%˄ | (run time too short) |
+| 23a || 55.36 | 50.70 | -8%˄ || 18.06 | 19.72 | +9%˄ | (run time too short) |
| 23b || 60.46 | 58.56 | -3%˄ || 16.54 | 17.08 | +3%˄ | (run time too short) |
+| 23c || 58.79 | 53.47 | -9%˄ || 17.01 | 18.70 | +10%˄ | (run time too short) |
-| 24a || 219.28 | 230.09 | +5%˄ || 4.56 | 4.35 | -5%˄ | (run time too short) |
-| 24b || 203.05 | 215.75 | +6%˄ || 4.92 | 4.63 | -6%˄ | (run time too short) |
| 25a || 104.68 | 101.52 | -3%˄ || 9.55 | 9.85 | +3%˄ | (run time too short) |
| 25b || 64.12 | 66.69 | +4%˄ || 15.59 | 14.99 | -4%˄ | (run time too short) |
| 25c || 241.92 | 231.93 | -4%˄ || 4.13 | 4.31 | +4%˄ | (run time too short) |
+| 26a || 170.91 | 141.38 | -17%˄ || 5.85 | 7.07 | +21%˄ | (run time too short) |
+| 26b || 142.08 | 123.03 | -13%˄ || 7.04 | 8.13 | +15%˄ | (run time too short) |
+| 26c || 320.37 | 252.46 | -21%˄ || 3.12 | 3.96 | +27%˄ | (run time too short) |
-| 27a || 37.56 | 46.63 | +24%˄ || 26.62 | 21.44 | -19%˄ | (run time too short) |
-| 27b || 26.49 | 33.14 | +25%˄ || 37.75 | 30.17 | -20%˄ | (run time too short) |
| 27c || 40.93 | 41.63 | +2%˄ || 24.43 | 24.02 | -2%˄ | (run time too short) |
+| 28a || 212.25 | 203.08 | -4%˄ || 4.71 | 4.92 | +5%˄ | (run time too short) |
| 28b || 80.16 | 81.20 | +1%˄ || 12.47 | 12.31 | -1%˄ | (run time too short) |
| 28c || 186.96 | 180.48 | -3%˄ || 5.35 | 5.54 | +4%˄ | (run time too short) |
-| 29a || 178.86 | 192.52 | +8%˄ || 5.59 | 5.19 | -7%˄ | (run time too short) |
| 29b || 930.66 | 939.12 | +1%˄ || 1.07 | 1.06 | -1%˄ | (run time too short) |
-| 29c || 222.11 | 239.76 | +8%˄ || 4.50 | 4.17 | -7%˄ | (run time too short) |
| 2a || 29.20 | 30.11 | +3%˄ || 34.24 | 33.21 | -3%˄ | (run time too short) |
-| 2b || 26.55 | 27.94 | +5%˄ || 37.66 | 35.78 | -5%˄ | (run time too short) |
-| 2c || 21.95 | 24.18 | +10%˄ || 45.56 | 41.35 | -9%˄ | (run time too short) |
| 2d || 57.77 | 56.78 | -2%˄ || 17.31 | 17.61 | +2%˄ | (run time too short) |
| 30a || 90.03 | 90.25 | +0%˄ || 11.11 | 11.08 | -0%˄ | (run time too short) |
| 30b || 92.51 | 95.98 | +4%˄ || 10.81 | 10.42 | -4%˄ | (run time too short) |
| 30c || 159.61 | 154.55 | -3%˄ || 6.27 | 6.47 | +3%˄ | (run time too short) |
| 31a || 79.45 | 80.67 | +2%˄ || 12.59 | 12.40 | -2%˄ | (run time too short) |
| 31b || 84.05 | 80.89 | -4%˄ || 11.90 | 12.36 | +4%˄ | (run time too short) |
| 31c || 90.35 | 91.00 | +1%˄ || 11.07 | 10.99 | -1%˄ | (run time too short) |
| 32a || 14.96 | 15.34 | +3%˄ || 66.85 | 65.18 | -3%˄ | (run time too short) |
+| 32b || 36.31 | 34.13 | -6%˄ || 27.54 | 29.30 | +6%˄ | (run time too short) |
-| 33a || 34.06 | 51.89 | +52%˄ || 29.36 | 19.27 | -34%˄ | (run time too short) |
-| 33b || 22.84 | 30.04 | +32%˄ || 43.78 | 33.29 | -24%˄ | (run time too short) |
-| 33c || 45.43 | 56.41 | +24%˄ || 22.01 | 17.73 | -19%˄ | (run time too short) |
| 3a || 71.03 | 71.43 | +1%˄ || 14.08 | 14.00 | -1%˄ | (run time too short) |
-| 3b || 19.87 | 24.45 | +23%˄ || 50.32 | 40.89 | -19%˄ | (run time too short) |
+| 3c || 223.76 | 211.01 | -6%˄ || 4.47 | 4.74 | +6%˄ | (run time too short) |
| 4a || 150.45 | 150.41 | -0%˄ || 6.65 | 6.65 | +0%˄ | (run time too short) |
-| 4b || 18.45 | 23.29 | +26%˄ || 54.18 | 42.93 | -21%˄ | (run time too short) |
| 4c || 191.03 | 187.53 | -2%˄ || 5.23 | 5.33 | +2%˄ | (run time too short) |
+| 5a || 64.67 | 57.54 | -11%˄ || 15.46 | 17.38 | +12%˄ | (run time too short) |
+| 5b || 61.21 | 57.55 | -6%˄ || 16.34 | 17.38 | +6%˄ | (run time too short) |
+| 5c || 99.55 | 90.48 | -9%˄ || 10.04 | 11.05 | +10%˄ | (run time too short) |
+| 6a || 167.34 | 148.68 | -11%˄ || 5.98 | 6.73 | +13%˄ | (run time too short) |
+| 6b || 178.05 | 161.51 | -9%˄ || 5.62 | 6.19 | +10%˄ | (run time too short) |
+| 6c || 157.83 | 138.78 | -12%˄ || 6.34 | 7.21 | +14%˄ | (run time too short) |
+| 6d || 389.69 | 351.65 | -10%˄ || 2.57 | 2.84 | +11%˄ | (run time too short) |
+| 6e || 164.69 | 142.61 | -13%˄ || 6.07 | 7.01 | +15%˄ | (run time too short) |
+| 6f || 721.47 | 673.97 | -7%˄ || 1.39 | 1.48 | +7%˄ | (run time too short) |
-| 7a || 92.60 | 123.91 | +34%˄ || 10.80 | 8.07 | -25%˄ | (run time too short) |
-| 7b || 86.43 | 118.64 | +37%˄ || 11.57 | 8.43 | -27%˄ | (run time too short) |
| 7c || 576.79 | 567.65 | -2%˄ || 1.73 | 1.76 | +2%˄ | (run time too short) |
| 8a || 202.35 | 197.23 | -3%˄ || 4.94 | 5.07 | +3%˄ | (run time too short) |
-| 8b || 188.95 | 201.27 | +7%˄ || 5.29 | 4.97 | -6%˄ | (run time too short) |
| 8c || 1863.54 | 1826.42 | -2% || 0.53 | 0.53 | +0% | (run time too short) |
| 8d || 488.32 | 489.19 | +0%˄ || 2.05 | 2.04 | -0%˄ | (run time too short) |
+| 9a || 257.35 | 244.08 | -5%˄ || 3.89 | 4.10 | +5%˄ | (run time too short) |
+| 9b || 165.70 | 157.26 | -5%˄ || 6.03 | 6.36 | +5%˄ | (run time too short) |
+| 9c || 311.21 | 289.86 | -7%˄ || 3.21 | 3.45 | +7%˄ | (run time too short) |
| 9d || 457.28 | 447.00 | -2%˄ || 2.19 | 2.24 | +2%˄ | (run time too short) |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Sum || 30496.95 | 29331.61 | -4% || | | | |
| Geomean || | | || | | -2% | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkJoinOrder - multi-threaded, ordered, 1 client, 64 cores Sum of avg. item runtimes: -2% || Geometric mean of throughput changes: -1%Configuration Overview - click to expand +Configuration Overview---------+---------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkJoinOrder_0bcfa0250faed47181d2591d19daefc98bfcd5a4_mt_ordered.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkJoinOrder_704bc3145cfcc51bcb4cbda8ae7ee2387e67fc94_mt_ordered.json |
+-------------------------------+---------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4-dirty | 704bc3145cfcc51bcb4cbda8ae7ee2387e67fc94-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 14:41:54 | 2025-06-06 09:51:11 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------------+---------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| 10a || 39.83 | 41.24 | +4%˄ || 25.08 | 24.23 | -3%˄ | (run time too short) |
-| 10b || 18.33 | 20.44 | +12%˄ || 54.46 | 48.82 | -10%˄ | (run time too short) |
+| 10c || 120.65 | 107.14 | -11%˄ || 8.29 | 9.33 | +13%˄ | (run time too short) |
| 11a || 10.54 | 10.74 | +2%˄ || 94.59 | 92.83 | -2%˄ | (run time too short) |
| 11b || 8.37 | 8.60 | +3%˄ || 119.00 | 115.79 | -3%˄ | (run time too short) |
| 11c || 23.23 | 24.20 | +4%˄ || 42.98 | 41.25 | -4%˄ | (run time too short) |
| 11d || 27.18 | 26.83 | -1%˄ || 36.74 | 37.22 | +1%˄ | (run time too short) |
+| 12a || 21.55 | 20.61 | -4%˄ || 46.32 | 48.43 | +5%˄ | (run time too short) |
| 12b || 12.03 | 12.52 | +4%˄ || 82.86 | 79.62 | -4%˄ | (run time too short) |
| 12c || 51.14 | 49.72 | -3%˄ || 19.54 | 20.10 | +3%˄ | (run time too short) |
+| 13a || 134.71 | 128.40 | -5%˄ || 7.42 | 7.79 | +5%˄ | (run time too short) |
| 13b || 96.71 | 93.85 | -3%˄ || 10.34 | 10.65 | +3%˄ | (run time too short) |
| 13c || 15.59 | 16.23 | +4%˄ || 63.99 | 61.47 | -4%˄ | (run time too short) |
| 13d || 372.34 | 378.61 | +2%˄ || 2.69 | 2.64 | -2%˄ | (run time too short) |
| 14a || 57.08 | 55.93 | -2%˄ || 17.51 | 17.87 | +2%˄ | (run time too short) |
| 14b || 72.00 | 71.75 | -0%˄ || 13.88 | 13.93 | +0%˄ | (run time too short) |
| 14c || 118.28 | 115.09 | -3%˄ || 8.45 | 8.69 | +3%˄ | (run time too short) |
| 15a || 30.30 | 29.71 | -2%˄ || 32.97 | 33.61 | +2%˄ | (run time too short) |
| 15b || 24.94 | 25.25 | +1%˄ || 40.03 | 39.54 | -1%˄ | (run time too short) |
| 15c || 23.12 | 22.89 | -1%˄ || 43.18 | 43.61 | +1%˄ | (run time too short) |
| 15d || 28.99 | 29.56 | +2%˄ || 34.45 | 33.79 | -2%˄ | (run time too short) |
+| 16a || 846.11 | 755.21 | -11%˄ || 1.18 | 1.32 | +12%˄ | (run time too short) |
| 16b || 2054.41 | 2034.99 | -1% || 0.48 | 0.48 | +0% | 0.0369 |
+| 16c || 1005.65 | 928.19 | -8%˄ || 0.99 | 1.08 | +8%˄ | (run time too short) |
+| 16d || 967.56 | 891.28 | -8%˄ || 1.03 | 1.12 | +9%˄ | (run time too short) |
| 17a || 187.95 | 183.66 | -2%˄ || 5.32 | 5.44 | +2%˄ | (run time too short) |
| 17b || 155.80 | 154.66 | -1%˄ || 6.42 | 6.46 | +1%˄ | (run time too short) |
| 17c || 128.35 | 128.57 | +0%˄ || 7.79 | 7.78 | -0%˄ | (run time too short) |
| 17d || 126.57 | 123.90 | -2%˄ || 7.90 | 8.07 | +2%˄ | (run time too short) |
| 17e || 846.50 | 819.64 | -3%˄ || 1.18 | 1.22 | +3%˄ | (run time too short) |
| 17f || 322.94 | 319.84 | -1%˄ || 3.10 | 3.13 | +1%˄ | (run time too short) |
-| 18a || 52.67 | 55.26 | +5%˄ || 18.97 | 18.08 | -5%˄ | (run time too short) |
| 18b || 50.23 | 48.94 | -3%˄ || 19.89 | 20.42 | +3%˄ | (run time too short) |
| 18c || 99.03 | 98.18 | -1%˄ || 10.09 | 10.18 | +1%˄ | (run time too short) |
| 19a || 100.42 | 97.48 | -3%˄ || 9.95 | 10.25 | +3%˄ | (run time too short) |
| 19b || 62.93 | 61.16 | -3%˄ || 15.88 | 16.34 | +3%˄ | (run time too short) |
| 19c || 113.80 | 112.52 | -1%˄ || 8.78 | 8.88 | +1%˄ | (run time too short) |
| 19d || 520.87 | 536.46 | +3%˄ || 1.92 | 1.86 | -3%˄ | (run time too short) |
| 1a || 6.36 | 6.44 | +1%˄ || 156.53 | 154.60 | -1%˄ | (run time too short) |
-| 1b || 4.48 | 7.51 | +67%˄ || 221.24 | 132.55 | -40%˄ | (run time too short) |
-| 1c || 4.00 | 5.00 | +25%˄ || 247.71 | 198.45 | -20%˄ | (run time too short) |
| 1d || 5.02 | 5.17 | +3%˄ || 198.07 | 192.16 | -3%˄ | (run time too short) |
-| 20a || 83.48 | 108.69 | +30%˄ || 11.97 | 9.20 | -23%˄ | (run time too short) |
-| 20b || 72.40 | 103.21 | +43%˄ || 13.81 | 9.69 | -30%˄ | (run time too short) |
| 20c || 79.82 | 81.16 | +2%˄ || 12.52 | 12.32 | -2%˄ | (run time too short) |
| 21a || 16.66 | 16.59 | -0%˄ || 59.89 | 60.16 | +0%˄ | (run time too short) |
| 21b || 15.15 | 15.00 | -1%˄ || 65.86 | 66.52 | +1%˄ | (run time too short) |
| 21c || 18.69 | 18.36 | -2%˄ || 53.39 | 54.37 | +2%˄ | (run time too short) |
| 22a || 73.07 | 71.18 | -3%˄ || 13.68 | 14.04 | +3%˄ | (run time too short) |
+| 22b || 54.81 | 51.48 | -6%˄ || 18.23 | 19.41 | +6%˄ | (run time too short) |
+| 22c || 123.41 | 117.97 | -4%˄ || 8.10 | 8.47 | +5%˄ | (run time too short) |
+| 22d || 223.78 | 212.32 | -5%˄ || 4.47 | 4.71 | +5%˄ | (run time too short) |
| 23a || 16.50 | 16.09 | -2%˄ || 60.47 | 62.01 | +3%˄ | (run time too short) |
-| 23b || 27.03 | 29.66 | +10%˄ || 36.94 | 33.67 | -9%˄ | (run time too short) |
| 23c || 18.76 | 18.40 | -2%˄ || 53.19 | 54.24 | +2%˄ | (run time too short) |
| 24a || 60.07 | 59.91 | -0%˄ || 16.63 | 16.68 | +0%˄ | (run time too short) |
| 24b || 60.36 | 62.96 | +4%˄ || 16.55 | 15.87 | -4%˄ | (run time too short) |
| 25a || 57.48 | 56.94 | -1%˄ || 17.38 | 17.55 | +1%˄ | (run time too short) |
-| 25b || 32.64 | 36.25 | +11%˄ || 30.60 | 27.56 | -10%˄ | (run time too short) |
| 25c || 157.31 | 153.21 | -3%˄ || 6.36 | 6.53 | +3%˄ | (run time too short) |
| 26a || 86.84 | 84.38 | -3%˄ || 11.51 | 11.84 | +3%˄ | (run time too short) |
+| 26b || 64.08 | 60.40 | -6%˄ || 15.59 | 16.54 | +6%˄ | (run time too short) |
+| 26c || 131.43 | 122.74 | -7%˄ || 7.61 | 8.14 | +7%˄ | (run time too short) |
| 27a || 19.60 | 19.38 | -1%˄ || 50.93 | 51.51 | +1%˄ | (run time too short) |
| 27b || 18.21 | 18.12 | -0%˄ || 54.80 | 55.07 | +0%˄ | (run time too short) |
| 27c || 18.26 | 18.06 | -1%˄ || 54.65 | 55.26 | +1%˄ | (run time too short) |
| 28a || 126.69 | 124.22 | -2%˄ || 7.89 | 8.05 | +2%˄ | (run time too short) |
| 28b || 27.56 | 27.12 | -2%˄ || 36.24 | 36.82 | +2%˄ | (run time too short) |
| 28c || 105.64 | 102.25 | -3%˄ || 9.46 | 9.78 | +3%˄ | (run time too short) |
| 29a || 52.78 | 53.23 | +1%˄ || 18.93 | 18.77 | -1%˄ | (run time too short) |
-| 29b || 133.17 | 156.86 | +18%˄ || 7.51 | 6.37 | -15%˄ | (run time too short) |
| 29c || 65.92 | 66.58 | +1%˄ || 15.16 | 15.01 | -1%˄ | (run time too short) |
| 2a || 22.42 | 22.85 | +2%˄ || 44.53 | 43.70 | -2%˄ | (run time too short) |
| 2b || 19.70 | 20.20 | +3%˄ || 50.67 | 49.43 | -2%˄ | (run time too short) |
| 2c || 13.85 | 14.36 | +4%˄ || 72.06 | 69.47 | -4%˄ | (run time too short) |
+| 2d || 52.65 | 49.73 | -6%˄ || 18.98 | 20.10 | +6%˄ | (run time too short) |
| 30a || 48.40 | 47.23 | -2%˄ || 20.64 | 21.15 | +2%˄ | (run time too short) |
| 30b || 37.02 | 37.85 | +2%˄ || 26.98 | 26.39 | -2%˄ | (run time too short) |
| 30c || 115.23 | 113.16 | -2%˄ || 8.67 | 8.83 | +2%˄ | (run time too short) |
-| 31a || 38.97 | 41.99 | +8%˄ || 25.63 | 23.79 | -7%˄ | (run time too short) |
-| 31b || 34.28 | 37.77 | +10%˄ || 29.14 | 26.45 | -9%˄ | (run time too short) |
-| 31c || 43.18 | 45.71 | +6%˄ || 23.14 | 21.86 | -6%˄ | (run time too short) |
-| 32a || 6.39 | 6.68 | +5%˄ || 155.84 | 148.92 | -4%˄ | (run time too short) |
| 32b || 28.36 | 28.91 | +2%˄ || 35.22 | 34.55 | -2%˄ | (run time too short) |
-| 33a || 10.56 | 14.08 | +33%˄ || 94.40 | 70.83 | -25%˄ | (run time too short) |
-| 33b || 8.44 | 9.78 | +16%˄ || 117.95 | 101.84 | -14%˄ | (run time too short) |
-| 33c || 18.82 | 20.74 | +10%˄ || 53.03 | 48.14 | -9%˄ | (run time too short) |
+| 3a || 38.67 | 32.44 | -16%˄ || 25.83 | 30.79 | +19%˄ | (run time too short) |
| 3b || 6.60 | 6.43 | -3%˄ || 150.76 | 154.73 | +3%˄ | (run time too short) |
| 3c || 71.85 | 72.46 | +1%˄ || 13.91 | 13.79 | -1%˄ | (run time too short) |
+| 4a || 69.52 | 65.49 | -6%˄ || 14.38 | 15.26 | +6%˄ | (run time too short) |
-| 4b || 5.19 | 5.60 | +8%˄ || 191.35 | 177.52 | -7%˄ | (run time too short) |
| 4c || 86.15 | 83.63 | -3%˄ || 11.60 | 11.95 | +3%˄ | (run time too short) |
| 5a || 24.54 | 24.73 | +1%˄ || 40.69 | 40.38 | -1%˄ | (run time too short) |
| 5b || 20.66 | 20.27 | -2%˄ || 48.32 | 49.26 | +2%˄ | (run time too short) |
+| 5c || 48.59 | 44.70 | -8%˄ || 20.56 | 22.35 | +9%˄ | (run time too short) |
+| 6a || 29.21 | 24.38 | -17%˄ || 34.19 | 40.96 | +20%˄ | (run time too short) |
| 6b || 50.78 | 48.72 | -4%˄ || 19.68 | 20.51 | +4%˄ | (run time too short) |
+| 6c || 26.47 | 23.12 | -13%˄ || 37.72 | 43.18 | +14%˄ | (run time too short) |
| 6d || 129.28 | 129.14 | -0%˄ || 7.73 | 7.74 | +0%˄ | (run time too short) |
+| 6e || 28.77 | 24.18 | -16%˄ || 34.72 | 41.29 | +19%˄ | (run time too short) |
| 6f || 479.70 | 488.38 | +2%˄ || 2.08 | 2.05 | -2%˄ | (run time too short) |
| 7a || 27.26 | 27.88 | +2%˄ || 36.63 | 35.82 | -2%˄ | (run time too short) |
| 7b || 25.77 | 26.55 | +3%˄ || 38.76 | 37.60 | -3%˄ | (run time too short) |
| 7c || 257.05 | 263.28 | +2%˄ || 3.89 | 3.80 | -2%˄ | (run time too short) |
-| 8a || 41.73 | 46.67 | +12%˄ || 23.94 | 21.41 | -11%˄ | (run time too short) |
-| 8b || 40.17 | 45.63 | +14%˄ || 24.87 | 21.90 | -12%˄ | (run time too short) |
| 8c || 1133.53 | 1133.94 | +0%˄ || 0.88 | 0.88 | -0%˄ | (run time too short) |
| 8d || 278.75 | 278.97 | +0%˄ || 3.59 | 3.58 | -0%˄ | (run time too short) |
+| 9a || 132.07 | 126.28 | -4%˄ || 7.57 | 7.92 | +5%˄ | (run time too short) |
+| 9b || 74.63 | 71.34 | -4%˄ || 13.39 | 14.01 | +5%˄ | (run time too short) |
+| 9c || 149.21 | 140.80 | -6%˄ || 6.70 | 7.10 | +6%˄ | (run time too short) |
| 9d || 353.48 | 366.73 | +4%˄ || 2.83 | 2.73 | -4%˄ | (run time too short) |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Sum || 15138.04 | 14878.87 | -2% || | | | |
| Geomean || | | || | | -1% | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkJoinOrder - multi-threaded, shuffled, 64 clients, 64 cores Sum of avg. item runtimes: -4% || Geometric mean of throughput changes: +4%Configuration Overview - click to expand +Configuration Overview---------+-------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkJoinOrder_0bcfa0250faed47181d2591d19daefc98bfcd5a4_mt.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkJoinOrder_704bc3145cfcc51bcb4cbda8ae7ee2387e67fc94_mt.json |
+-------------------------------+-------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4-dirty | 704bc3145cfcc51bcb4cbda8ae7ee2387e67fc94-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64
10000
|
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 14:56:30 | 2025-06-06 10:07:07 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+-------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+---------+
-| 10a || 207.30 | 217.48 | +5% || 1.18 | 1.22 | +4% | 0.5901 |
| 10b || 146.27 | 145.95 | -0% || 1.18 | 1.22 | +4% | 0.9841 |
+| 10c || 709.92 | 585.66 | -18% || 1.18 | 1.22 | +4% | 0.0001 |
+| 11a || 90.30 | 84.24 | -7% || 1.18 | 1.22 | +4% | 0.6080 |
-| 11b || 77.36 | 93.45 | +21% || 1.18 | 1.22 | +4% | 0.1615 |
| 11c || 125.80 | 127.17 | +1% || 1.18 | 1.22 | +4% | 0.9157 |
-| 11d || 95.39 | 113.79 | +19% || 1.18 | 1.22 | +3% | 0.1232 |
-| 12a || 161.32 | 171.52 | +6% || 1.18 | 1.22 | +4% | 0.5031 |
+| 12b || 86.09 | 78.99 | -8% || 1.18 | 1.22 | +4% | 0.5471 |
+| 12c || 396.66 | 373.33 | -6% || 1.18 | 1.22 | +4% | 0.3865 |
+| 13a || 541.77 | 475.76 | -12% || 1.18 | 1.22 | +3% | 0.0121 |
| 13b || 366.20 | 375.87 | +3% || 1.18 | 1.22 | +3% | 0.7078 |
| 13c || 90.68 | 88.10 | -3% || 1.18 | 1.22 | +4% | 0.8054 |
| 13d || 941.54 | 950.40 | +1% || 1.18 | 1.22 | +3% | 0.7622 |
-| 14a || 441.14 | 468.12 | +6% || 1.18 | 1.22 | +4% | 0.3354 |
+| 14b || 486.85 | 436.89 | -10% || 1.18 | 1.22 | +4% | 0.0737 |
+| 14c || 656.58 | 621.40 | -5% || 1.18 | 1.22 | +4% | 0.2747 |
+| 15a || 129.97 | 115.08 | -11% || 1.18 | 1.22 | +4% | 0.2028 |
| 15b || 119.85 | 121.92 | +2% || 1.18 | 1.22 | +4% | 0.8583 |
| 15c || 139.26 | 133.09 | -4% || 1.18 | 1.22 | +4% | 0.6228 |
+| 15d || 159.80 | 150.87 | -6% || 1.18 | 1.22 | +4% | 0.5094 |
+| 16a || 1796.01 | 1597.21 | -11% || 1.18 | 1.22 | +4% | 0.0000 |
| 16b || 3316.65 | 3255.33 | -2% || 1.17 | 1.22 | +4% | 0.1579 |
| 16c || 1990.67 | 1911.89 | -4% || 1.18 | 1.22 | +3% | 0.0529 |
+| 16d || 1981.54 | 1779.82 | -10% || 1.18 | 1.22 | +3% | 0.0000 |
+| 17a || 925.80 | 846.54 | -9% || 1.18 | 1.22 | +4% | 0.0249 |
+| 17b || 711.79 | 621.37 | -13% || 1.18 | 1.22 | +4% | 0.0037 |
+| 17c || 640.32 | 589.59 | -8% || 1.18 | 1.22 | +3% | 0.0948 |
| 17d || 607.26 | 594.83 | -2% || 1.18 | 1.22 | +4% | 0.6657 |
| 17e || 1770.67 | 1707.27 | -4% || 1.18 | 1.22 | +4% | 0.1037 |
| 17f || 1228.37 | 1177.36 | -4% || 1.18 | 1.22 | +4% | 0.1992 |
-| 18a || 274.17 | 294.87 | +8% || 1.18 | 1.22 | +4% | 0.3605 |
+| 18b || 433.79 | 397.82 | -8% || 1.18 | 1.22 | +4% | 0.1998 |
+| 18c || 679.02 | 646.87 | -5% || 1.18 | 1.22 | +4% | 0.3690 |
-| 19a || 569.58 | 604.23 | +6% || 1.18 | 1.22 | +3% | 0.2609 |
| 19b || 434.99 | 433.46 | -0% || 1.18 | 1.22 | +4% | 0.9585 |
+| 19c || 676.73 | 636.47 | -6% || 1.18 | 1.22 | +4% | 0.2459 |
| 19d || 1445.51 | 1504.06 | +4% || 1.18 | 1.22 | +4% | 0.1348 |
+| 1a || 38.64 | 36.46 | -6% || 1.18 | 1.22 | +4% | 0.6638 |
| 1b || 48.16 | 46.62 | -3% || 1.18 | 1.22 | +4% | 0.8295 |
| 1c || 68.71 | 68.34 | -1% || 1.18 | 1.22 | +4% | 0.9730 |
+| 1d || 40.25 | 36.56 | -9% || 1.18 | 1.22 | +4% | 0.6869 |
-| 20a || 488.60 | 524.92 | +7% || 1.18 | 1.22 | +3% | 0.2271 |
+| 20b || 427.24 | 396.96 | -7% || 1.18 | 1.22 | +4% | 0.2373 |
| 20c || 423.66 | 405.36 | -4% || 1.18 | 1.22 | +4% | 0.4889 |
| 21a || 187.68 | 183.74 | -2% || 1.18 | 1.22 | +4% | 0.8366 |
| 21b || 133.19 | 134.20 | +1% || 1.18 | 1.22 | +3% | 0.9527 |
+| 21c || 228.41 | 192.05 | -16% || 1.18 | 1.22 | +4% | 0.1029 |
-| 22a || 489.12 | 556.67 | +14% || 1.18 | 1.22 | +4% | 0.0391 |
+| 22b || 448.85 | 387.66 | -14% || 1.18 | 1.22 | +3% | 0.0162 |
| 22c || 715.90 | 689.68 | -4% || 1.18 | 1.22 | +3% | 0.4409 |
| 22d || 967.71 | 958.68 | -1% || 1.18 | 1.22 | +4% | 0.8193 |
-| 23a || 156.52 | 176.92 | +13% || 1.18 | 1.22 | +4% | 0.2546 |
| 23b || 135.68 | 133.56 | -2% || 1.18 | 1.22 | +4% | 0.8788 |
| 23c || 174.25 | 176.67 | +1% || 1.18 | 1.22 | +4% | 0.8983 |
+| 24a || 437.08 | 412.97 | -6% || 1.18 | 1.22 | +3% | 0.4128 |
-| 24b || 315.19 | 340.15 | +8% || 1.18 | 1.22 | +4% | 0.3052 |
+| 25a || 474.67 | 418.79 | -12% || 1.18 | 1.22 | +4% | 0.0767 |
| 25b || 248.57 | 251.80 | +1% || 1.18 | 1.22 | +3% | 0.8893 |
+| 25c || 966.56 | 893.02 | -8% || 1.18 | 1.22 | +4% | 0.0455 |
+| 26a || 425.47 | 375.20 | -12% || 1.18 | 1.22 | +4% | 0.0186 |
+| 26b || 279.03 | 219.77 | -21% || 1.18 | 1.22 | +3% | 0.0010 |
+| 26c || 655.79 | 581.56 | -11% || 1.18 | 1.22 | +4% | 0.0051 |
| 27a || 171.75 | 172.80 | +1% || 1.18 | 1.22 | +4% | 0.9463 |
+| 27b || 174.04 | 158.27 | -9% || 1.18 | 1.22 | +4% | 0.3525 |
+| 27c || 200.48 | 190.24 | -5% || 1.18 | 1.22 | +3% | 0.6416 |
| 28a || 672.36 | 693.08 | +3% || 1.18 | 1.22 | +3% | 0.4952 |
| 28b || 252.00 | 250.80 | -0% || 1.18 | 1.22 | +4% | 0.9516 |
+| 28c || 696.21 | 659.05 | -5% || 1.18 | 1.22 | +4% | 0.2813 |
+| 29a || 307.12 | 289.14 | -6% || 1.18 | 1.22 | +4% | 0.4724 |
-| 29b || 369.39 | 460.36 | +25% || 1.18 | 1.22 | +4% | 0.0018 |
+| 29c || 401.55 | 382.08 | -5% || 1.18 | 1.22 | +4% | 0.4706 |
+| 2a || 147.76 | 137.13 | -7% || 1.18 | 1.22 | +4% | 0.4693 |
+| 2b || 138.11 | 122.29 | -11% || 1.18 | 1.22 | +4% | 0.1967 |
-| 2c || 90.14 | 98.87 | +10% || 1.18 | 1.22 | +4% | 0.3703 |
| 2d || 210.40 | 209.31 | -1% || 1.18 | 1.22 | +4% | 0.9407 |
+| 30a || 374.76 | 349.41 | -7% || 1.18 | 1.22 | +4% | 0.3021 |
| 30b || 316.48 | 313.97 | -1% || 1.18 | 1.22 | +4% | 0.9114 |
+| 30c || 720.14 | 683.84 | -5% || 1.18 | 1.22 | +3% | 0.3018 |
-| 31a || 296.20 | 309.55 | +5% || 1.18 | 1.22 | +4% | 0.5987 |
| 31b || 261.70 | 260.50 | -0% || 1.18 | 1.22 | +4% | 0.9611 |
-| 31c || 325.66 | 349.38 | +7% || 1.18 | 1.22 | +4% | 0.3950 |
+| 32a || 52.34 | 41.44 | -21% || 1.18 | 1.22 | +4% | 0.0502 |
+| 32b || 161.95 | 143.58 | -11% || 1.18 | 1.22 | +4% | 0.1319 |
+| 33a || 138.99 | 128.86 | -7% || 1.18 | 1.22 | +4% | 0.5641 |
-| 33b || 75.18 | 80.85 | +8% || 1.18 | 1.22 | +4% | 0.4875 |
| 33c || 153.11 | 150.21 | -2% || 1.18 | 1.22 | +4% | 0.8589 |
+| 3a || 321.56 | 270.82 | -16% || 1.18 | 1.22 | +4% | 0.0539 |
+| 3b || 75.63 | 70.37 | -7% || 1.18 | 1.22 | +4% | 0.6107 |
+| 3c || 487.07 | 400.85 | -18% || 1.18 | 1.22 | +3% | 0.0009 |
+| 4a || 297.69 | 282.30 | -5% || 1.18 | 1.22 | +4% | 0.4412 |
| 4b || 57.29 | 54.79 | -4% || 1.18 | 1.22 | +4% | 0.7570 |
-| 4c || 298.11 | 319.02 | +7% || 1.18 | 1.22 | +3% | 0.2455 |
| 5a || 249.90 | 260.79 | +4% || 1.18 | 1.22 | +4% | 0.6134 |
| 5b || 159.53 | 154.61 | -3% || 1.18 | 1.22 | +4% | 0.7619 |
+| 5c || 351.50 | 325.21 | -7% || 1.18 | 1.22 | +3% | 0.3353 |
+| 6a || 161.91 | 133.10 | -18% || 1.18 | 1.22 | +4% | 0.0662 |
+| 6b || 229.00 | 190.29 | -17% || 1.18 | 1.22 | +4% | 0.0331 |
+| 6c || 120.14 | 107.76 | -10% || 1.18 | 1.22 | +4% | 0.2442 |
| 6d || 573.43 | 576.37 | +1% || 1.18 | 1.22 | +4% | 0.9224 |
+| 6e || 154.70 | 114.54 | -26% || 1.18 | 1.22 | +4% | 0.0008 |
| 6f || 1253.69 | 1244.20 | -1% || 1.18 | 1.22 | +4% | 0.7666 |
-| 7a || 165.54 | 183.17 | +11% || 1.18 | 1.22 | +4% | 0.3430 |
-| 7b || 167.67 | 193.02 | +15% || 1.18 | 1.22 | +3% | 0.1795 |
| 7c || 1073.04 | 1100.90 | +3% || 1.18 | 1.22 | +4% | 0.4503 |
+| 8a || 218.28 | 206.93 | -5% || 1.18 | 1.22 | +4% | 0.6005 |
+| 8b || 160.39 | 150.47 | -6% || 1.18 | 1.22 | +4% | 0.6106 |
| 8c || 2396.25 | 2357.72 | -2% || 1.18 | 1.22 | +4% | 0.3613 |
| 8d || 891.97 | 869.90 | -2% || 1.18 | 1.22 | +3% | 0.4233 |
+| 9a || 709.94 | 659.94 | -7% || 1.18 | 1.22 | +4% | 0.1218 |
| 9b || 379.06 | 380.35 | +0% || 1.18 | 1.22 | +4% | 0.9555 |
| 9c || 810.26 | 797.51 | -2% || 1.18 | 1.22 | +3% | 0.7326 |
| 9d || 1152.33 | 1174.02 | +2% || 1.18 | 1.22 | +4% | 0.5557 |
+---------++----------+----------+--------++----------+----------+--------+---------+
| Sum || 54251.56 | 52340.34 | -4% || | | | |
| Geomean || | | || | | +4% | |
+---------++----------+----------+--------++----------+----------+--------+---------+hyriseBenchmarkStarSchema - single-threaded Sum of avg. item runtimes: +9% || Geometric mean of throughput changes: -12%Configuration Overview - click to expand +Configuration Overview---+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkStarSchema_0bcfa0250faed47181d2591d19daefc98bfcd5a4_st.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkStarSchema_704bc3145cfcc51bcb4cbda8ae7ee2387e67fc94_st.json |
+-------------------------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4-dirty | 704bc3145cfcc51bcb4cbda8ae7ee2387e67fc94-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 15:16:50 | 2025-06-06 10:27:51 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+ +---------++----------+---------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
-| 1.1 || 418.70 | 606.29 | +45%˄ || 2.39 | 1.65 | -31%˄ | (run time too short) |
-| 1.2 || 231.42 | 653.26 | +182%˄ || 4.32 | 1.53 | -65%˄ | (run time too short) |
-| 1.3 || 226.28 | 657.21 | +190%˄ || 4.42 | 1.52 | -66%˄ | (run time too short) |
+| 2.1 || 512.39 | 415.39 | -19%˄ || 1.95 | 2.41 | +23%˄ | (run time too short) |
+| 2.2 || 279.38 | 208.26 | -25%˄ || 3.58 | 4.80 | +34%˄ | (run time too short) |
+| 2.3 || 175.89 | 122.98 | -30%˄ || 5.69 | 8.13 | +43%˄ | (run time too short) |
| 3.1 || 2621.47 | 2681.70 | +2% || 0.37 | 0.37 | +0% | (run time too short) |
+| 3.2 || 286.32 | 268.82 | -6%˄ || 3.49 | 3.72 | +7%˄ | (run time too short) |
-| 3.3 || 117.36 | 128.59 | +10%˄ || 8.52 | 7.78 | -9%˄ | (run time too short) |
-| 3.4 || 110.91 | 126.14 | +14%˄ || 9.02 | 7.93 | -12%˄ | (run time too short) |
+| 4.1 || 2454.42 | 2330.92 | -5% || 0.40 | 0.42 | +4% | (run time too short) |
+| 4.2 || 778.59 | 741.64 | -5%˄ || 1.28 | 1.35 | +5%˄ | (run time too short) |
| 4.3 || 214.97 | 212.79 | -1%˄ || 4.65 | 4.70 | +1%˄ | (run time too short) |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
-| Sum || 8428.10 | 9153.98 | +9% || | | | |
-| Geomean || | | || | | -12% | |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+---------+--------++----------+----------+--------+----------------------+hyriseBenchmarkStarSchema - multi-threaded, ordered, 1 client, 64 cores Sum of avg. item runtimes: +3% || Geometric mean of throughput changes: -9%Configuration Overview - click to expand +Configuration Overview---------+----------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkStarSchema_0bcfa0250faed47181d2591d19daefc98bfcd5a4_mt_ordered.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkStarSchema_704bc3145cfcc51bcb4cbda8ae7ee2387e67fc94_mt_ordered.json |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4-dirty | 704bc3145cfcc51bcb4cbda8ae7ee2387e67fc94-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 15:25:47 | 2025-06-06 10:37:25 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------+ +---------++----------+---------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
-| 1.1 || 127.14 | 164.70 | +30%˄ || 7.86 | 6.07 | -23%˄ | (run time too short) |
-| 1.2 || 83.90 | 163.15 | +94%˄ || 11.91 | 6.13 | -49%˄ | (run time too short) |
-| 1.3 || 80.81 | 160.96 | +99%˄ || 12.37 | 6.21 | -50%˄ | (run time too short) |
| 2.1 || 329.47 | 317.19 | -4%˄ || 3.03 | 3.15 | +4%˄ | (run time too short) |
+| 2.2 || 156.14 | 147.05 | -6%˄ || 6.40 | 6.80 | +6%˄ | (run time too short) |
+| 2.3 || 63.94 | 52.92 | -17%˄ || 15.63 | 18.88 | +21%˄ | (run time too short) |
+| 3.1 || 805.70 | 759.63 | -6%˄ || 1.24 | 1.32 | +6%˄ | (run time too short) |
+| 3.2 || 150.06 | 142.25 | -5%˄ || 6.66 | 7.03 | +5%˄ | (run time too short) |
| 3.3 || 77.71 | 76.58 | -1%˄ || 12.86 | 13.05 | +1%˄ | (run time too short) |
| 3.4 || 69.96 | 71.54 | +2%˄ || 14.29 | 13.97 | -2%˄ | (run time too short) |
| 4.1 || 867.68 | 836.57 | -4%˄ || 1.15 | 1.20 | +4%˄ | (run time too short) |
| 4.2 || 348.80 | 352.07 | +1%˄ || 2.87 | 2.84 | -1%˄ | (run time too short) |
| 4.3 || 111.56 | 113.69 | +2%˄ || 8.96 | 8.79 | -2%˄ | (run time too short) |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| Sum || 3272.85 | 3358.29 | +3% || | | | |
-| Geomean || | | || | | -9% | |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+---------+--------++----------+----------+--------+----------------------+hyriseBenchmarkStarSchema - multi-threaded, shuffled, 64 clients, 64 cores Sum of avg. item runtimes: -5% || Geometric mean of throughput changes: +5%Configuration Overview - 10000 click to expand +Configuration Overview---------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkStarSchema_0bcfa0250faed47181d2591d19daefc98bfcd5a4_mt.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkStarSchema_704bc3145cfcc51bcb4cbda8ae7ee2387e67fc94_mt.json |
+-------------------------------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4-dirty | 704bc3145cfcc51bcb4cbda8ae7ee2387e67fc94-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 15:29:06 | 2025-06-06 10:40:51 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+---------+
+| 1.1 || 844.00 | 836.31 | -1% || 3.74 | 3.94 | +5% | 0.6722 |
+| 1.2 || 463.76 | 550.56 | +19% || 3.74 | 3.94 | +5% | 0.0000 |
+| 1.3 || 421.70 | 516.46 | +22% || 3.74 | 3.94 | +5% | 0.0000 |
+| 2.1 || 2110.74 | 1909.75 | -10% || 3.74 | 3.94 | +5% | 0.0000 |
+| 2.2 || 1110.95 | 941.54 | -15% || 3.74 | 3.94 | +5% | 0.0000 |
+| 2.3 || 382.51 | 287.25 | -25% || 3.74 | 3.94 | +5% | 0.0000 |
+| 3.1 || 3280.39 | 3202.43 | -2% || 3.73 | 3.93 | +5% | 0.0179 |
+| 3.2 || 978.05 | 879.99 | -10% || 3.74 | 3.94 | +5% | 0.0000 |
+| 3.3 || 474.81 | 426.17 | -10% || 3.74 | 3.94 | +5% | 0.0011 |
+| 3.4 || 466.32 | 442.71 | -5% || 3.74 | 3.94 | +5% | 0.1336 |
+| 4.1 || 3310.98 | 3105.99 | -6% || 3.73 | 3.93 | +5% | 0.0000 |
+| 4.2 || 2493.69 | 2394.84 | -4% || 3.73 | 3.94 | +5% | 0.0036 |
+| 4.3 || 752.92 | 711.98 | -5% || 3.74 | 3.94 | +5% | 0.0412 |
+---------++----------+----------+--------++----------+----------+--------+---------+
+| Sum || 17090.81 | 16205.99 | -5% || | | | |
+| Geomean || | | || | | +5% | |
+---------++----------+----------+--------++----------+----------+--------+---------+ |
Master vs. PR (int:FoR)SegmentEncodingSpec auto_select_segment_encoding_spec(const DataType& type, const bool segment_values_are_unique) {
switch (type) {
case DataType::Int:
return SegmentEncodingSpec{EncodingType::FrameOfReference};
case DataType::String:
case DataType::Long:
case DataType::Double:
case DataType::Float:
if (segment_values_are_unique) {
return SegmentEncodingSpec{EncodingType::Unencoded};
} else {
return SegmentEncodingSpec{EncodingType::Dictionary};
}
default:
Fail("Unknown DataType when trying to select encoding for column.");
}
}System cx17 - click to expand
Commit Info and Build Time
hyriseBenchmarkTPCH - single-threaded, SF 10.0 Sum of avg. item runtimes: -14% || Geometric mean of throughput changes: +11%Configuration Overview - click to expand +Configuration Overview----+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCH_0bcfa0250faed47181d2591d19daefc98bfcd5a4_st.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCH_2f72cba186290ca85834639abc0ef6c44b272856_st.json |
+--------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4-dirty | 2f72cba186290ca85834639abc0ef6c44b272856-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 12:04:57 | 2025-06-08 06:03:20 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+--------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+ +----------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| TPC-H 01 || 5528.68 | 5547.69 | +0% || 0.17 | 0.17 | +0% | (run time too short) |
-| TPC-H 02 || 40.56 | 42.70 | +5%˄ || 24.66 | 23.42 | -5%˄ | (run time too short) |
+| TPC-H 03 || 1263.52 | 1191.72 | -6%˄ || 0.78 | 0.84 | +7%˄ | 0.0000 |
| TPC-H 04 || 1382.00 | 1348.35 | -2% || 0.72 | 0.73 | +2% | 0.0000 |
+| TPC-H 05 || 2273.47 | 1911.69 | -16% || 0.43 | 0.52 | +19% | 0.0000 |
| TPC-H 06 || 170.52 | 170.42 | -0%˄ || 5.86 | 5.87 | +0%˄ | (run time too short) |
+| TPC-H 07 || 703.81 | 587.63 | -17%˄ || 1.42 | 1.70 | +20%˄ | (run time too short) |
+| TPC-H 08 || 537.71 | 425.25 | -21%˄ || 1.86 | 2.35 | +26%˄ | (run time too short) |
+| TPC-H 09 || 6533.99 | 5145.02 | -21% || 0.15 | 0.18 | +22% | (run time too short) |
+| TPC-H 10 || 1386.61 | 1289.36 | -7% || 0.72 | 0.77 | +7% | 0.0000 |
-| TPC-H 11 || 50.89 | 54.64 | +7%˄ || 19.65 | 18.30 | -7%˄ | (run time too short) |
+| TPC-H 12 || 942.18 | 888.24 | -6%˄ || 1.06 | 1.13 | +6%˄ | (run time too short) |
+| TPC-H 13 || 7360.10 | 5323.27 | -28% || 0.13 | 0.18 | +38% | (run time too short) |
+| TPC-H 14 || 492.69 | 455.21 | -8%˄ || 2.03 | 2.20 | +8%˄ | (run time too short) |
+| TPC-H 15 || 183.11 | 162.19 | -11%˄ || 5.46 | 6.17 | +13%˄ | (run time too short) |
| TPC-H 16 || 530.69 | 538.11 | +1%˄ || 1.88 | 1.86 | -1%˄ | (run time too short) |
+| TPC-H 17 || 220.02 | 142.75 | -35%˄ || 4.55 | 7.00 | +54%˄ | (run time too short) |
| TPC-H 18 || 1568.85 | 1541.55 | -2% || 0.63 | 0.63 | +0% | (run time too short) |
| TPC-H 19 || 230.76 | 228.11 | -1%˄ || 4.33 | 4.38 | +1%˄ | (run time too short) |
+| TPC-H 20 || 392.62 | 281.24 | -28%˄ || 2.55 | 3.56 | +40%˄ | (run time too short) |
+| TPC-H 21 || 4267.09 | 3683.23 | -14% || 0.23 | 0.27 | +14% | (run time too short) |
+| TPC-H 22 || 482.40 | 460.98 | -4%˄ || 2.07 | 2.17 | +5%˄ | (run time too short) |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
+| Sum || 36542.26 | 31419.34 | -14% || | | | |
+| Geomean || | | || | | +11% | |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+----------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCH - single-threaded, SF 0.01 Sum of avg. item runtimes: -0% || Geometric mean of throughput changes: -2%Configuration Overview - click to expand +Configuration Overview----+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCH_0bcfa0250faed47181d2591d19daefc98bfcd5a4_st_s01.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCH_2f72cba186290ca85834639abc0ef6c44b272856_st_s01.json |
+--------------------------+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4-dirty | 2f72cba186290ca85834639abc0ef6c44b272856-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 12:21:50 | 2025-06-08 06:19:33 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 0.009999999776482582 | 0.009999999776482582 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+--------------------------+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+ +----------++----------+---------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+----------++----------+---------+--------++----------+----------+--------+----------------------+
| TPC-H 01 || 5.24 | 5.42 | +3%˄ || 190.64 | 184.40 | -3%˄ | (run time too short) |
-| TPC-H 02 || 3.19 | 3.38 | +6%˄ || 313.71 | 296.17 | -6%˄ | (run time too short) |
| TPC-H 03 || 0.58 | 0.60 | +4%˄ || 1721.40 | 1658.22 | -4%˄ | (run time too short) |
-| TPC-H 04 || 0.37 | 0.40 | +8%˄ || 2675.72 | 2482.15 | -7%˄ | (run time too short) |
-| TPC-H 05 || 0.95 | 1.02 | +7%˄ || 1050.28 | 981.15 | -7%˄ | (run time too short) |
| TPC-H 06 || 0.19 | 0.20 | +2%˄ || 5138.39 | 5037.57 | -2%˄ | (run time too short) |
+| TPC-H 07 || 9.60 | 8.83 | -8%˄ || 104.11 | 113.19 | +9%˄ | (run time too short) |
-| TPC-H 08 || 12.91 | 13.89 | +8%˄ || 77.45 | 72.00 | -7%˄ | (run time too short) |
+| TPC-H 09 || 3.96 | 2.90 | -27%˄ || 252.38 | 344.49 | +36%˄ | (run time too short) |
| TPC-H 10 || 0.70 | 0.70 | +0%˄ || 1434.57 | 1430.03 | -0%˄ | (run time too short) |
-| TPC-H 11 || 0.17 | 0.18 | +7%˄ || 5771.75 | 5416.59 | -6%˄ | (run time too short) |
| TPC-H 12 || 0.62 | 0.62 | +1%˄ || 1615.42 | 1602.37 | -1%˄ | (run time too short) |
| TPC-H 13 || 2.15 | 2.13 | -1%˄ || 465.29 | 470.04 | +1%˄ | (run time too short) |
| TPC-H 14 || 0.29 | 0.31 | +4%˄ || 3401.75 | 3262.95 | -4%˄ | (run time too short) |
| TPC-H 15 || 1.07 | 1.07 | -0%˄ || 929.03 | 928.10 | -0%˄ | (run time too short) |
| TPC-H 16 || 1.92 | 1.93 | +0%˄ || 520.95 | 518.96 | -0%˄ | (run time too short) |
-| TPC-H 17 || 0.46 | 0.66 | +44%˄ || 2178.75 | 1510.16 | -31%˄ | (run time too short) |
+| TPC-H 18 || 1.32 | 1.19 | -9%˄ || 758.50 | 836.51 | +10%˄ | (run time too short) |
| TPC-H 19 || 4.51 | 4.54 | +1%˄ || 221.63 | 220.29 | -1%˄ | (run time too short) |
| TPC-H 20 || 2.38 | 2.39 | +1%˄ || 420.72 | 418.56 | -1%˄ | (run time too short) |
| TPC-H 21 || 1.11 | 1.07 | -3%˄ || 901.66 | 933.36 | +4%˄ | (run time too short) |
| TPC-H 22 || 1.06 | 1.09 | +2%˄ || 939.30 | 920.22 | -2%˄ | (run time too short) |
+----------++----------+---------+--------++----------+----------+--------+----------------------+
| Sum || 54.76 | 54.51 | -0% || | | | |
| Geomean || | | || | | -2% | |
+----------++----------+---------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+----------++----------+---------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCH - multi-threaded, ordered, 1 client, 64 cores, SF 10.0 Sum of avg. item runtimes: -13% || Geometric mean of throughput changes: +9%Configuration Overview - click to expand +Configuration Overview---------+----------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCH_0bcfa0250faed47181d2591d19daefc98bfcd5a4_mt_ordered.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCH_2f72cba186290ca85834639abc0ef6c44b272856_mt_ordered.json |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4-dirty | 2f72cba186290ca85834639abc0ef6c44b272856-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 12:22:17 | 2025-06-08 06:20:01 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------+ +----------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| TPC-H 01 || 4647.84 | 4693.39 | +1% || 0.20 | 0.20 | +0% | (run time too short) |
+| TPC-H 02 || 58.37 | 53.74 | -8%˄ || 17.12 | 18.59 | +9%˄ | (run time too short) |
| TPC-H 03 || 664.16 | 645.14 | -3%˄ || 1.51 | 1.55 | +3%˄ | (run time too short) |
| TPC-H 04 || 653.10 | 632.40 | -3%˄ || 1.53 | 1.58 | +3%˄ | (run time too short) |
+| TPC-H 05 || 614.53 | 518.56 | -16%˄ || 1.63 | 1.93 | +19%˄ | (run time too short) |
| TPC-H 06 || 64.23 | 65.23 | +2%˄ || 15.56 | 15.32 | -2%˄ | (run time too short) |
| TPC-H 07 || 248.96 | 247.96 | -0%˄ || 4.02 | 4.03 | +0%˄ | (run time too short) |
+| TPC-H 08 || 234.85 | 219.48 | -7%˄ || 4.26 | 4.56 | +7%˄ | (run time too short) |
+| TPC-H 09 || 2207.70 | 1929.83 | -13% || 0.45 | 0.52 | +15% | 0.0000 |
+| TPC-H 10 || 643.54 | 594.56 | -8%˄ || 1.55 | 1.68 | +8%˄ | (run time too short) |
| TPC-H 11 || 88.09 | 84.44 | -4%˄ || 11.35 | 11.84 | +4%˄ | (run time too short) |
+| TPC-H 12 || 502.42 | 462.92 | -8%˄ || 1.99 | 2.16 | +9%˄ | (run time too short) |
+| TPC-H 13 || 3827.23 | 2002.00 | -48% || 0.25 | 0.48 | +93% | (run time too short) |
| TPC-H 14 || 150.42 | 152.32 | +1%˄ || 6.65 | 6.56 | -1%˄ | (run time too short) |
+| TPC-H 15 || 147.53 | 128.85 | -13%˄ || 6.78 | 7.76 | +14%˄ | (run time too short) |
| TPC-H 16 || 580.92 | 564.92 | -3%˄ || 1.72 | 1.77 | +3%˄ | (run time too short) |
+| TPC-H 17 || 88.43 | 72.67 | -18%˄ || 11.30 | 13.75 | +22%˄ | (run time too short) |
| TPC-H 18 || 1745.15 | 1738.55 | -0% || 0.57 | 0.57 | +0% | 0.7937 |
| TPC-H 19 || 109.64 | 108.59 | -1%˄ || 9.12 | 9.21 | +1%˄ | (run time too short) |
+| TPC-H 20 || 193.82 | 179.60 | -7%˄ || 5.16 | 5.57 | +8%˄ | (run time too short) |
+| TPC-H 21 || 1120.78 | 1041.01 | -7%˄ || 0.89 | 0.96 | +8%˄ | (run time too short) |
| TPC-H 22 || 161.23 | 158.60 | -2%˄ || 6.20 | 6.30 | +2%˄ | (run time too short) |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
+| Sum || 18752.92 | 16294.76 | -13% || | | | |
+| Geomean || | | || | | +9% | |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+----------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCH - multi-threaded, shuffled, 64 clients, 64 cores, SF 10.0 Sum of avg. item runtimes: -10% || Geometric mean of throughput changes: +11%Configuration Overview - click to expand +Configuration Overview---------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCH_0bcfa0250faed47181d2591d19daefc98bfcd5a4_mt.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCH_2f72cba186290ca85834639abc0ef6c44b272856_mt.json |
+-------------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4-dirty | 2f72cba186290ca85834639abc0ef6c44b272856-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| clustering | None | None |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 12:34:06 | 2025-06-08 06:31:25 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+ +----------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+----------++----------+----------+--------++----------+----------+--------+---------+
+| TPC-H 01 || 6094.00 | 6357.31 | +4% || 1.03 | 1.14 | +11% | 0.0011 |
+| TPC-H 02 || 470.12 | 365.40 | -22% || 1.04 | 1.15 | +11% | 0.0174 |
+| TPC-H 03 || 2815.11 | 2721.65 | -3% || 1.04 | 1.15 | +11% | 0.4632 |
+| TPC-H 04 || 2293.11 | 2297.65 | +0% || 1.04 | 1.15 | +11% | 0.9683 |
+| TPC-H 05 || 4194.02 | 3899.71 | -7% || 1.03 | 1.15 | +11% | 0.0725 |
+| TPC-H 06 || 784.96 | 782.62 | -0% || 1.04 | 1.15 | +11% | 0.9754 |
+| TPC-H 07 || 3379.16 | 3129.01 | -7% || 1.03 | 1.15 | +11% | 0.1085 |
+| TPC-H 08 || 2547.08 | 2080.01 | -18% || 1.03 | 1.15 | +11% | 0.0004 |
+| TPC-H 09 || 6472.87 | 5534.21 | -15% || 1.03 | 1.15 | +11% | 0.0000 |
+| TPC-H 10 || 3425.93 | 3217.01 | -6% || 1.03 | 1.15 | +11% | 0.1592 |
+| TPC-H 11 || 494.08 | 467.12 | -5% || 1.04 | 1.15 | +11% | 0.6168 |
+| TPC-H 12 || 2681.55 | 2334.98 | -13% || 1.03 | 1.15 | +11% | 0.0029 |
+| TPC-H 13 || 7630.22 | 5024.79 | -34% || 1.03 | 1.14 | +11% | 0.0000 |
+| TPC-H 14 || 1096.15 | 1079.17 | -2% || 1.04 | 1.15 | +11% | 0.8247 |
+| TPC-H 15 || 682.01 | 573.57 | -16% || 1.04 | 1.15 | +11% | 0.0375 |
+| TPC-H 16 || 2536.14 | 2197.64 | -13% || 1.04 | 1.15 | +11% | 0.0053 |
+| TPC-H 17 || 850.76 | 708.67 | -17% || 1.04 | 1.15 | +11% | 0.0656 |
+| TPC-H 18 || 3630.39 | 3633.80 | +0% || 1.03 | 1.15 | +11% | 0.9688 |
+| TPC-H 19 || 1140.60 | 1094.53 | -4% || 1.03 | 1.15 | +11% | 0.5922 |
+| TPC-H 20 || 1760.96 | 1539.16 | -13% || 1.04 | 1.15 | +11% | 0.0246 |
+| TPC-H 21 || 5284.28 | 5102.02 | -3% || 1.03 | 1.14 | +11% | 0.3093 |
+| TPC-H 22 || 1110.97 | 1079.84 | -3% || 1.04 | 1.15 | +11% | 0.7096 |
+----------++----------+----------+--------++----------+----------+--------+---------+
+| Sum || 61374.47 | 55219.86 | -10% || | | | |
+| Geomean || | | || | | +11% | |
+----------++----------+----------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCDS - single-threaded Sum of avg. item runtimes: +4% || Geometric mean of throughput changes: -9%Configuration Overview - click to expand +Configuration Overview---+---------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCDS_0bcfa0250faed47181d2591d19daefc98bfcd5a4_st.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCDS_2f72cba186290ca85834639abc0ef6c44b272856_st.json |
+-------------------------+---------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4-dirty | 2f72cba186290ca85834639abc0ef6c44b272856-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 12:55:34 | 2025-06-08 06:52:57 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+---------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
+| 01 || 224.59 | 211.79 | -6%˄ || 4.45 | 4.72 | +6%˄ | (run time too short) |
+| 03 || 62.68 | 57.54 | -8%˄ || 15.95 | 17.38 | +9%˄ | (run time too short) |
+| 06 || 198.18 | 185.08 | -7%˄ || 5.05 | 5.40 | +7%˄ | (run time too short) |
-| 07 || 253.36 | 281.82 | +11%˄ || 3.95 | 3.55 | -10%˄ | (run time too short) |
-| 09 || 720.91 | 1371.54 | +90%˄ || 1.39 | 0.72 | -48%˄ | (run time too short) |
-| 10 || 120.63 | 155.37 | +29%˄ || 8.29 | 6.44 | -22%˄ | (run time too short) |
-| 13 || 464.50 | 497.33 | +7%˄ || 2.15 | 2.01 | -7%˄ | (run time too short) |
| 15 || 124.21 | 126.56 | +2%˄ || 8.05 | 7.90 | -2%˄ | (run time too short) |
-| 16 || 55.91 | 74.73 | +34%˄ || 17.88 | 13.38 | -25%˄ | (run time too short) |
+| 17 || 323.16 | 294.47 | -9%˄ || 3.09 | 3.40 | +10%˄ | (run time too short) |
-| 19 || 97.81 | 109.90 | +12%˄ || 10.22 | 9.10 | -11%˄ | (run time too short) |
-| 25 || 167.80 | 176.53 | +5%˄ || 5.96 | 5.66 | -5%˄ | (run time too short) |
-| 26 || 114.68 | 126.62 | +10%˄ || 8.72 | 7.90 | -9%˄ | (run time too short) |
-| 28 || 574.95 | 1156.06 | +101%˄ || 1.74 |
10000
0.87 | -50%˄ | (run time too short) |
+| 29 || 484.05 | 463.06 | -4%˄ || 2.07 | 2.16 | +5%˄ | (run time too short) |
-| 31 || 1316.64 | 1392.88 | +6% || 0.75 | 0.72 | -4% | 0.0000 |
-| 32 || 30.32 | 39.37 | +30%˄ || 32.98 | 25.40 | -23%˄ | (run time too short) |
-| 34 || 140.58 | 163.07 | +16%˄ || 7.11 | 6.13 | -14%˄ | (run time too short) |
-| 35 || 604.65 | 636.05 | +5%˄ || 1.65 | 1.57 | -5%˄ | (run time too short) |
-| 37 || 653.81 | 1206.99 | +85%˄ || 1.53 | 0.82 | -47%˄ | (run time too short) |
-| 39a || 1704.00 | 1866.10 | +10% || 0.58 | 0.53 | -9% | 0.0000 |
-| 39b || 1682.21 | 1863.45 | +11% || 0.58 | 0.53 | -9% | (run time too short) |
| 41 || 281.49 | 283.51 | +1%˄ || 3.55 | 3.53 | -1%˄ | (run time too short) |
-| 42 || 78.54 | 92.68 | +18%˄ || 12.73 | 10.79 | -15%˄ | (run time too short) |
| 43 || 974.60 | 1004.89 | +3%˄ || 1.03 | 1.00 | -3%˄ | (run time too short) |
+| 45 || 126.38 | 110.71 | -12%˄ || 7.91 | 9.03 | +14%˄ | (run time too short) |
| 48 || 1164.93 | 1189.87 | +2%˄ || 0.86 | 0.84 | -2%˄ | (run time too short) |
| 50 || 125.44 | 128.08 | +2%˄ || 7.97 | 7.81 | -2%˄ | (run time too short) |
-| 52 || 79.38 | 93.57 | +18%˄ || 12.60 | 10.69 | -15%˄ | (run time too short) |
-| 55 || 74.51 | 88.62 | +19%˄ || 13.42 | 11.28 | -16%˄ | (run time too short) |
| 62 || 554.59 | 557.75 | +1%˄ || 1.80 | 1.79 | -1%˄ | (run time too short) |
| 65 || 1924.75 | 1878.98 | -2% || 0.52 | 0.52 | +0% | (run time too short) |
-| 69 || 139.66 | 169.76 | +22%˄ || 7.16 | 5.89 | -18%˄ | (run time too short) |
-| 73 || 77.37 | 98.11 | +27%˄ || 12.92 | 10.19 | -21%˄ | (run time too short) |
| 79 || 491.32 | 505.27 | +3%˄ || 2.04 | 1.98 | -3%˄ | (run time too short) |
+| 81 || 155.98 | 145.88 | -6%˄ || 6.41 | 6.85 | +7%˄ | (run time too short) |
-| 82 || 700.59 | 1251.71 | +79%˄ || 1.43 | 0.78 | -45%˄ | (run time too short) |
| 83 || 38.43 | 38.94 | +1%˄ || 26.02 | 25.68 | -1%˄ | (run time too short) |
+| 84 || 13.88 | 12.32 | -11%˄ || 72.03 | 81.12 | +13%˄ | (run time too short) |
| 85 || 161.74 | 158.62 | -2%˄ || 6.18 | 6.30 | +2%˄ | (run time too short) |
-| 88 || 638.78 | 795.56 | +25%˄ || 1.57 | 1.26 | -20%˄ | (run time too short) |
| 91 || 17.79 | 17.36 | -2%˄ || 56.21 | 57.58 | +2%˄ | (run time too short) |
+| 92 || 35.59 | 33.44 | -6%˄ || 28.09 | 29.90 | +6%˄ | (run time too short) |
+| 93 || 3751.76 | 2388.54 | -36% || 0.25 | 0.42 | +67% | (run time too short) |
-| 94 || 35.40 | 45.54 | +29%˄ || 28.25 | 21.96 | -22%˄ | (run time too short) |
| 95 || 5159.89 | 5208.19 | +1% || 0.18 | 0.18 | +0% | (run time too short) |
-| 96 || 60.98 | 80.53 | +32%˄ || 16.40 | 12.42 | -24%˄ | (run time too short) |
+| 97 || 4040.15 | 3615.54 | -11% || 0.23 | 0.27 | +14% | (run time too short) |
| 99 || 1085.28 | 1095.35 | +1%˄ || 0.92 | 0.91 | -1%˄ | (run time too short) |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Sum || 32108.83 | 33545.62 | +4% || | | | |
-| Geomean || | | || | | -9% | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCDS - multi-threaded, ordered, 1 client, 64 cores Sum of avg. item runtimes: -1% || Geometric mean of throughput changes: -1%Configuration Overview - click to expand +Configuration Overview---------+-----------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCDS_0bcfa0250faed47181d2591d19daefc98bfcd5a4_mt_ordered.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCDS_2f72cba186290ca85834639abc0ef6c44b272856_mt_ordered.json |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4-dirty | 2f72cba186290ca85834639abc0ef6c44b272856-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 13:16:21 | 2025-06-08 07:15:56 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| 01 || 241.09 | 232.16 | -4%˄ || 4.15 | 4.31 | +4%˄ | (run time too short) |
+| 03 || 33.52 | 31.40 | -6%˄ || 29.80 | 31.81 | +7%˄ | (run time too short) |
+| 06 || 192.36 | 167.38 | -13%˄ || 5.20 | 5.97 | +15%˄ | (run time too short) |
| 07 || 191.04 | 192.51 | +1%˄ || 5.23 | 5.19 | -1%˄ | (run time too short) |
-| 09 || 112.75 | 154.31 | +37%˄ || 8.87 | 6.48 | -27%˄ | (run time too short) |
-| 10 || 36.49 | 40.76 | +12%˄ || 27.37 | 24.51 | -10%˄ | (run time too short) |
| 13 || 257.93 | 250.92 | -3%˄ || 3.88 | 3.98 | +3%˄ | (run time too short) |
| 15 || 75.62 | 76.08 | +1%˄ || 13.22 | 13.14 | -1%˄ | (run time too short) |
-| 16 || 30.90 | 32.42 | +5%˄ || 32.32 | 30.81 | -5%˄ | (run time too short) |
+| 17 || 143.10 | 123.10 | -14%˄ || 6.99 | 8.12 | +16%˄ | (run time too short) |
-| 19 || 68.54 | 74.68 | +9%˄ || 14.58 | 13.38 | -8%˄ | (run time too short) |
+| 25 || 102.63 | 92.93 | -9%˄ || 9.74 | 10.76 | +10%˄ | (run time too short) |
| 26 || 87.87 | 90.00 | +2%˄ || 11.38 | 11.11 | -2%˄ | (run time too short) |
-| 28 || 147.32 | 156.55 | +6%˄ || 6.79 | 6.39 | -6%˄ | (run time too short) |
+| 29 || 458.69 | 422.42 | -8%˄ || 2.18 | 2.37 | +9%˄ | (run time too short) |
| 31 || 477.48 | 466.36 | -2%˄ || 2.09 | 2.14 | +2%˄ | (run time too short) |
| 32 || 34.03 | 34.28 | +1%˄ || 29.35 | 29.14 | -1%˄ | (run time too short) |
| 34 || 94.61 | 97.33 | +3%˄ || 10.57 | 10.27 | -3%˄ | (run time too short) |
| 35 || 388.22 | 381.12 | -2%˄ || 2.58 | 2.62 | +2%˄ | (run time too short) |
-| 37 || 197.37 | 250.52 | +27%˄ || 5.07 | 3.99 | -21%˄ | (run time too short) |
-| 39a || 767.67 | 835.06 | +9%˄ || 1.30 | 1.20 | -8%˄ | (run time too short) |
| 39b || 744.15 | 735.59 | -1%˄ || 1.34 | 1.36 | +1%˄ | (run time too short) |
| 41 || 365.65 | 363.00 | -1%˄ || 2.73 | 2.75 | +1%˄ | (run time too short) |
-| 42 || 49.54 | 53.31 | +8%˄ || 20.17 | 18.74 | -7%˄ | (run time too short) |
| 43 || 446.83 | 451.06 | +1%˄ || 2.24 | 2.22 | -1%˄ | (run time too short) |
| 45 || 54.19 | 53.44 | -1%˄ || 18.44 | 18.70 | +1%˄ | (run time too short) |
| 48 || 536.30 | 536.55 | +0%˄ || 1.86 | 1.86 | -0%˄ | (run time too short) |
-| 50 || 102.96 | 108.26 | +5%˄ || 9.71 | 9.23 | -5%˄ | (run time too short) |
| 52 || 51.71 | 53.92 | +4%˄ || 19.33 | 18.53 | -4%˄ | (run time too short) |
-| 55 || 44.58 | 47.41 | +6%˄ || 22.41 | 21.08 | -6%˄ | (run time too short) |
| 62 || 348.42 | 349.06 | +0%˄ || 2.87 | 2.86 | -0%˄ | (run time too short) |
| 65 || 1487.32 | 1471.84 | -1% || 0.67 | 0.67 | +0% | (run time too short) |
| 69 || 71.95 | 74.20 | +3%˄ || 13.89 | 13.47 | -3%˄ | (run time too short) |
-| 73 || 54.34 | 58.28 | +7%˄ || 18.39 | 17.15 | -7%˄ | (run time too short) |
| 79 || 482.39 | 474.30 | -2%˄ || 2.07 | 2.11 | +2%˄ | (run time too short) |
| 81 || 192.05 | 184.75 | -4%˄ || 5.21 | 5.41 | +4%˄ | (run time too short) |
-| 82 || 224.64 | 280.92 | +25%˄ || 4.45 | 3.56 | -20%˄ | (run time too short) |
| 83 || 46.69 | 46.22 | -1%˄ || 21.40 | 21.62 | +1%˄ | (run time too short) |
| 84 || 10.09 | 9.94 | -1%˄ || 98.82 | 100.27 | +1%˄ | (run time too short) |
+| 85 || 71.04 | 67.80 | -5%˄ || 14.07 | 14.74 | +5%˄ | (run time too short) |
-| 88 || 82.46 | 90.69 | +10%˄ || 12.12 | 11.02 | -9%˄ | (run time too short) |
+| 91 || 18.25 | 16.70 | -8%˄ || 54.68 | 59.75 | +9%˄ | (run time too short) |
+| 92 || 43.78 | 38.48 | -12%˄ || 22.82 | 25.96 | +14%˄ | (run time too short) |
+| 93 || 753.37 | 546.97 | -27%˄ || 1.33 | 1.83 | +38%˄ | (run time too short) |
-| 94 || 30.53 | 32.99 | +8%˄ || 32.71 | 30.28 | -7%˄ | (run time too short) |
| 95 || 712.51 | 724.93 | +2%˄ || 1.40 | 1.38 | -2%˄ | (run time too short) |
-| 96 || 46.38 | 49.79 | +7%˄ || 21.54 | 20.07 | -7%˄ | (run time too short) |
+| 97 || 1373.25 | 1305.13 | -5% || 0.72 | 0.75 | +5% | (run time too short) |
| 99 || 574.74 | 566.04 | -2%˄ || 1.74 | 1.77 | +2%˄ | (run time too short) |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Sum || 13159.36 | 12993.90 | -1% || | | | |
| Geomean || | | || | | -1% | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCDS - multi-threaded, shuffled, 64 clients, 64 cores Sum of avg. item runtimes: -1% || Geometric mean of throughput changes: +1%Configuration Overview - click to expand +Configuration Overview---------+---------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCDS_0bcfa0250faed47181d2591d19daefc98bfcd5a4_mt.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCDS_2f72cba186290ca85834639abc0ef6c44b272856_mt.json |
+-------------------------------+---------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4-dirty | 2f72cba186290ca85834639abc0ef6c44b272856-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 13:28:30 | 2025-06-08 07:27:58 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+---------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+---------+
+| 01 || 857.64 | 748.02 | -13% || 1.00 | 1.02 | +1% | 0.0414 |
| 03 || 302.59 | 297.27 | -2% || 1.00 | 1.02 | +1% | 0.8759 |
+| 06 || 933.97 | 860.25 | -8% || 1.00 | 1.02 | +1% | 0.2304 |
| 07 || 1070.54 | 1038.43 | -3% || 1.00 | 1.02 | +1% | 0.6290 |
-| 09 || 892.05 | 1151.60 | +29% || 1.00 | 1.01 | +1% | 0.0002 |
| 10 || 810.43 | 795.52 | -2% || 1.00 | 1.02 | +1% | 0.8149 |
| 13 || 1758.12 | 1818.83 | +3% || 1.00 | 1.02 | +1% | 0.4398 |
| 15 || 529.36 | 510.28 | -4% || 1.00 | 1.02 | +1% | 0.6422 |
+| 16 || 505.42 | 403.56 | -20% || 1.00 | 1.02 | +1% | 0.0214 |
+| 17 || 1456.84 | 1330.69 | -9% || 1.00 | 1.02 | +1% | 0.1066 |
-| 19 || 684.03 | 741.95 | +8% || 1.00 | 1.02 | +1% | 0.2816 |
+| 25 || 1067.12 | 998.65 | -6% || 1.00 | 1.02 | +1% | 0.3113 |
| 26 || 517.34 | 529.69 | +2% || 1.00 | 1.02 | +1% | 0.7502 |
-| 28 || 1513.45 | 1724.46 | +14% || 1.00 | 1.01 | +1% | 0.0155 |
| 29 || 1867.95 | 1844.33 | -1% || 1.00 | 1.02 | +1% | 0.7819 |
| 31 || 2665.98 | 2654.15 | -0% || 1.00 | 1.01 | +1% | 0.9131 |
-| 32 || 188.89 | 199.39 | +6% || 1.00 | 1.02 | +1% | 0.6700 |
-| 34 || 793.81 | 840.41 | +6% || 1.00 | 1.02 | +1% | 0.3798 |
+| 35 || 2277.05 | 2091.72 | -8% || 1.00 | 1.01 | +1% | 0.0330 |
| 37 || 958.69 | 998.40 | +4% || 1.00 | 1.02 | +1% | 0.4702 |
| 39a || 2877.21 | 2931.22 | +2% || 1.00 | 1.01 | +1% | 0.5423 |
| 39b || 2838.66 | 2917.17 | +3% || 1.00 | 1.01 | +1% | 0.3554 |
+| 41 || 2118.50 | 1911.98 | -10% || 1.00 | 1.02 | +1% | 0.0248 |
| 42 || 549.85 | 567.97 | +3% || 1.00 | 1.02 | +1% | 0.6981 |
| 43 || 1634.02 | 1613.46 | -1% || 1.00 | 1.02 | +1% | 0.7608 |
+| 45 || 832.95 | 785.97 | -6% || 1.00 | 1.02 | +1% | 0.4460 |
+| 48 || 2839.71 | 2706.30 | -5% || 1.00 | 1.01 | +1% | 0.1996 |
| 50 || 1125.65 | 1146.79 | +2% || 1.00 | 1.02 | +1% | 0.7299 |
| 52 || 561.00 | 537.33 | -4% || 1.00 | 1.02 | +1% | 0.6280 |
-| 55 || 454.83 | 504.40 | +11% || 1.00 | 1.02 | +1% | 0.2131 |
-| 62 || 1040.44 | 1138.89 | +9% || 1.00 | 1.01 | +1% | 0.0622 |
| 65 || 4417.71 | 4368.09 | -1% || 1.00 | 1.01 | +1% | 0.4710 |
| 69 || 1045.11 | 1065.88 | +2% || 1.00 | 1.01 | +1% | 0.7720 |
+| 73 || 591.78 | 547.77 | -7% || 1.00 | 1.02 | +1% | 0.3269 |
| 79 || 1648.38 | 1617.76 | -2% || 1.00 | 1.01 | +1% | 0.6482 |
+| 81 || 619.10 | 542.48 | -12% || 1.00 | 1.02 | +1% | 0.0477 |
-| 82 || 1013.07 | 1116.49 | +10% || 1.00 | 1.01 | +1% | 0.0508 |
+| 83 || 349.02 | 292.92 | -16% || 1.00 | 1.02 | +1% | 0.1411 |
| 84 || 131.22 | 126.48 | -4% || 1.00 | 1.02 | +1% | 0.8291 |
+| 85 || 898.51 | 813.63 | -9% || 1.00 | 1.02 | +1% | 0.1472 |
-| 88 || 2663.77 | 2965.25 | +11% || 1.00 | 1.01 | +1% | 0.0150 |
| 91 || 214.04 | 216.55 | +1% || 1.00 | 1.02 | +1% | 0.9369 |
-| 92 || 287.15 | 302.16 | +5% || 1.00 | 1.02 | +1% | 0.6626 |
+| 93 || 2283.35 | 1655.26 | -28% || 1.00 | 1.02 | +1% | 0.0000 |
| 94 || 470.70 | 479.09 | +2% || 1.00 | 1.02 | +1% | 0.8586 |
| 95 || 2204.25 | 2262.60 | +3% || 1.00 | 1.01 | +1% | 0.4743 |
-| 96 || 416.60 | 485.53 | +17% || 1.00 | 1.02 | +1% | 0.0752 |
+| 97 || 4515.32 | 4200.82 | -7% || 1.00 | 1.01 | +1% | 0.0015 |
| 99 || 1444.88 | 1495.28 | +3% || 1.00 | 1.01 | +1% | 0.3824 |
+---------++----------+----------+--------++----------+----------+--------+---------+
| Sum || 63738.05 | 62893.10 | -1% || | | | |
| Geomean || | | || | | +1% | |
+---------++----------+----------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCC - single-threaded Sum of avg. item runtimes: +15% || Geometric mean of throughput changes: -16%Configuration Overview - click to expand +Configuration Overview---+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCC_0bcfa0250faed47181d2591d19daefc98bfcd5a4_st.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCC_2f72cba186290ca85834639abc0ef6c44b272856_st.json |
+-------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4-dirty | 2f72cba186290ca85834639abc0ef6c44b272856-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 13:48:45 | 2025-06-08 07:48:15 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10 | 10 |
| time_unit | ns
10000
| ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+ +--------------++----------+---------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+--------------++----------+---------+--------++----------+----------+--------+---------+
-| Delivery || 25.50 | 29.30 | +15% || 4.85 | 4.52 | -7% | 0.0000 |
-| New-Order || 12.07 | 14.19 | +18% || 60.41 | 52.13 | -14% | 0.0000 |
-| Order-Status || 1.16 | 1.44 | +25% || 5.46 | 4.03 | -26% | 0.0000 |
-| Payment || 2.20 | 2.23 | +1% || 58.26 | 49.27 | -15% | 0.0000 |
-| Stock-Level || 1.93 | 2.23 | +15% || 5.18 | 4.35 | -16% | 0.0000 |
+--------------++----------+---------+--------++----------+----------+--------+---------+
-| Sum || 42.85 | 49.40 | +15% || | | | |
-| Geomean || | | || | | -16% | |
+--------------++----------+---------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCC - multi-threaded, shuffled, 64 clients, 10 warehouses, 64 cores (high contention) Sum of avg. item runtimes: -2% || Geometric mean of throughput changes: +3%Configuration Overview - click to expand +Configuration Overview---------+-----------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCC_0bcfa0250faed47181d2591d19daefc98bfcd5a4_mt_highcont.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCC_2f72cba186290ca85834639abc0ef6c44b272856_mt_highcont.json |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4-dirty | 2f72cba186290ca85834639abc0ef6c44b272856-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 13:56:23 | 2025-06-08 07:56:02 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 600000000000 | 600000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10 | 10 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------+ +--------------++----------+---------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+--------------++----------+---------+--------++----------+----------+--------+---------+
| Delivery || 181.26 | 176.58 | -3% || 33.75 | 34.58 | +2% | 0.0000 |
| unsucc.: || 3.31 | 3.27 | -1% || 50.88 | 51.82 | +2% | |
| New-Order || 93.42 | 91.90 | -2% || 471.42 | 482.50 | +2% | 0.0000 |
| unsucc.: || 8.90 | 8.25 | -7% || 476.66 | 488.80 | +3% | |
| Order-Status || 9.53 | 9.46 | -1% || 85.20 | 86.27 | +1% | 0.5905 |
+| Payment || 15.67 | 14.91 | -5% || 239.31 | 247.19 | +3% | 0.0000 |
| unsucc.: || 5.48 | 5.27 | -4% || 665.74 | 681.48 | +2% | |
| Stock-Level || 13.87 | 13.74 | -1% || 83.49 | 86.30 | +3% | 0.4709 |
+--------------++----------+---------+--------++----------+----------+--------+---------+
| Sum || 313.75 | 306.59 | -2% || | | | |
| Geomean || | | || | | +3% | |
+--------------++----------+---------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCC - multi-threaded, shuffled, 10 clients, 10 warehouses, 64 cores (low contention) Sum of avg. item runtimes: +3% || Geometric mean of throughput changes: -4%Configuration Overview - click to expand +Configuration Overview---------+----------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCC_0bcfa0250faed47181d2591d19daefc98bfcd5a4_mt_lowcont.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCC_2f72cba186290ca85834639abc0ef6c44b272856_mt_lowcont.json |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4-dirty | 2f72cba186290ca85834639abc0ef6c44b272856-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 10 | 10 |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 14:06:35 | 2025-06-08 08:06:14 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 600000000000 | 600000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10 | 10 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------+ +--------------++----------+---------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+--------------++----------+---------+--------++----------+----------+--------+---------+
| Delivery || 75.34 | 77.43 | +3% || 16.40 | 16.00 | -2% | 0.0000 |
| unsucc.: || 0.85 | 0.99 | +16% || 2.12 | 1.97 | -7% | |
-| New-Order || 37.40 | 39.49 | +6% || 190.10 | 182.46 | -4% | 0.0000 |
| unsucc.: || 3.55 | 3.18 | -10% || 18.28 | 17.37 | -5% | |
| Order-Status || 4.29 | 4.41 | +3% || 18.60 | 17.82 | -4% | 0.0000 |
| Payment || 8.11 | 7.90 | -3% || 162.49 | 157.12 | -3% | 0.0000 |
| unsucc.: || 2.04 | 2.03 | -0% || 36.34 | 34.17 | -6% | |
| Stock-Level || 5.56 | 5.52 | -1% || 18.45 | 17.71 | -4% | 0.0005 |
+--------------++----------+---------+--------++----------+----------+--------+---------+
| Sum || 130.70 | 134.74 | +3% || | | | |
| Geomean || | | || | | -4% | |
+--------------++----------+---------+--------++----------+----------+--------+---------+hyriseBenchmarkJoinOrder - single-threaded Sum of avg. item runtimes: -6% || Geometric mean of throughput changes: -2%Configuration Overview - click to expand +Configuration Overview---+-------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkJoinOrder_0bcfa0250faed47181d2591d19daefc98bfcd5a4_st.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkJoinOrder_2f72cba186290ca85834639abc0ef6c44b272856_st.json |
+-------------------------+-------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4-dirty | 2f72cba186290ca85834639abc0ef6c44b272856-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 14:16:42 | 2025-06-08 08:16:21 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+-------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| 10a || 156.28 | 152.87 | -2%˄ || 6.40 | 6.54 | +2%˄ | (run time too short) |
| 10b || 94.97 | 92.83 | -2%˄ || 10.53 | 10.77 | +2%˄ | (run time too short) |
+| 10c || 359.64 | 329.60 | -8%˄ || 2.78 | 3.03 | +9%˄ | (run time too short) |
-| 11a || 29.57 | 37.41 | +26%˄ || 33.81 | 26.73 | -21%˄ | (run time too short) |
-| 11b || 25.70 | 31.48 | +22%˄ || 38.90 | 31.77 | -18%˄ | (run time too short) |
-| 11c || 24.61 | 26.22 | +7%˄ || 40.64 | 38.13 | -6%˄ | (run time too short) |
-| 11d || 23.54 | 25.26 | +7%˄ || 42.48 | 39.59 | -7%˄ | (run time too short) |
-| 12a || 31.96 | 47.24 | +48%˄ || 31.28 | 21.17 | -32%˄ | (run time too short) |
-| 12b || 27.71 | 37.07 | +34%˄ || 36.09 | 26.98 | -25%˄ | (run time too short) |
-| 12c || 74.30 | 80.47 | +8%˄ || 13.46 | 12.43 | -8%˄ | (run time too short) |
| 13a || 182.97 | 182.48 | -0%˄ || 5.47 | 5.48 | +0%˄ | (run time too short) |
| 13b || 236.04 | 241.84 | +2%˄ || 4.24 | 4.13 | -2%˄ | (run time too short) |
-| 13c || 32.07 | 41.81 | +30%˄ || 31.18 | 23.91 | -23%˄ | (run time too short) |
| 13d || 532.31 | 529.21 | -1%˄ || 1.88 | 1.89 | +1%˄ | (run time too short) |
| 14a || 103.47 | 102.54 | -1%˄ || 9.66 | 9.75 | +1%˄ | (run time too short) |
-| 14b || 110.68 | 116.42 | +5%˄ || 9.03 | 8.59 | -5%˄ | (run time too short) |
| 14c || 184.29 | 182.20 | -1%˄ || 5.43 | 5.49 | +1%˄ | (run time too short) |
| 15a || 76.45 | 76.27 | -0%˄ || 13.08 | 13.11 | +0%˄ | (run time too short) |
-| 15b || 80.24 | 92.16 | +15%˄ || 12.46 | 10.85 | -13%˄ | (run time too short) |
| 15c || 52.04 | 53.26 | +2%˄ || 19.21 | 18.78 | -2%˄ | (run time too short) |
| 15d || 49.36 | 49.39 | +0%˄ || 20.26 | 20.25 | -0%˄ | (run time too short) |
+| 16a || 1445.42 | 1265.75 | -12% || 0.68 | 0.78 | +15% | 0.0000 |
+| 16b || 2709.47 | 2446.96 | -10% || 0.37 | 0.40 | +9% | (run time too short) |
+| 16c || 1621.40 | 1428.64 | -12% || 0.62 | 0.68 | +11% | (run time too short) |
+| 16d || 1575.46 | 1389.53 | -12% || 0.63 | 0.72 | +13% | 0.0000 |
+| 17a || 462.60 | 390.07 | -16%˄ || 2.16 | 2.56 | +19%˄ | (run time too short) |
+| 17b || 366.49 | 309.27 | -16%˄ || 2.73 | 3.23 | +19%˄ | (run time too short) |
+| 17c || 345.77 | 288.56 | -17%˄ || 2.89 | 3.47 | +20%˄ | (run time too short) |
+| 17d || 428.13 | 367.96 | -14%˄ || 2.34 | 2.72 | +16%˄ | (run time too short) |
+| 17e || 1674.18 | 1478.54 | -12% || 0.58 | 0.67 | +14% | (run time too short) |
+| 17f || 946.83 | 843.78 | -11%˄ || 1.06 |
10000
1.19 | +12%˄ | (run time too short) |
-| 18a || 143.70 | 152.93 | +6%˄ || 6.96 | 6.54 | -6%˄ | (run time too short) |
| 18b || 107.32 | 110.26 | +3%˄ || 9.32 | 9.07 | -3%˄ | (run time too short) |
+| 18c || 199.17 | 184.75 | -7%˄ || 5.02 | 5.41 | +8%˄ | (run time too short) |
| 19a || 221.40 | 229.19 | +4%˄ || 4.52 | 4.36 | -3%˄ | (run time too short) |
-| 19b || 192.93 | 204.41 | +6%˄ || 5.18 | 4.89 | -6%˄ | (run time too short) |
| 19c || 266.70 | 256.27 | -4%˄ || 3.75 | 3.90 | +4%˄ | (run time too short) |
| 19d || 749.25 | 719.40 | -4%˄ || 1.33 | 1.39 | +4%˄ | (run time too short) |
-| 1a || 10.27 | 11.77 | +15%˄ || 97.39 | 84.92 | -13%˄ | (run time too short) |
-| 1b || 16.44 | 29.16 | +77%˄ || 60.81 | 34.29 | -44%˄ | (run time too short) |
-| 1c || 21.63 | 24.83 | +15%˄ || 46.22 | 40.26 | -13%˄ | (run time too short) |
-| 1d || 9.47 | 10.96 | +16%˄ || 105.55 | 91.24 | -14%˄ | (run time too short) |
+| 20a || 554.43 | 522.06 | -6%˄ || 1.80 | 1.92 | +6%˄ | (run time too short) |
+| 20b || 602.99 | 573.69 | -5%˄ || 1.66 | 1.74 | +5%˄ | (run time too short) |
+| 20c || 435.79 | 396.66 | -9%˄ || 2.29 | 2.52 | +10%˄ | (run time too short) |
-| 21a || 44.65 | 51.35 | +15%˄ || 22.39 | 19.47 | -13%˄ | (run time too short) |
-| 21b || 34.60 | 44.78 | +29%˄ || 28.90 | 22.33 | -23%˄ | (run time too short) |
| 21c || 40.86 | 41.22 | +1%˄ || 24.47 | 24.26 | -1%˄ | (run time too short) |
| 22a || 184.53 | 182.33 | -1%˄ || 5.42 | 5.48 | +1%˄ | (run time too short) |
| 22b || 167.60 | 165.43 | -1%˄ || 5.97 | 6.04 | +1%˄ | (run time too short) |
| 22c || 250.95 | 243.59 | -3%˄ || 3.98 | 4.11 | +3%˄ | (run time too short) |
| 22d || 366.64 | 357.22 | -3%˄ || 2.73 | 2.80 | +3%˄ | (run time too short) |
| 23a || 55.36 | 57.31 | +4%˄ || 18.06 | 17.45 | -3%˄ | (run time too short) |
| 23b || 60.46 | 61.89 | +2%˄ || 16.54 | 16.16 | -2%˄ | (run time too short) |
| 23c || 58.79 | 59.85 | +2%˄ || 17.01 | 16.71 | -2%˄ | (run time too short) |
| 24a || 219.28 | 225.31 | +3%˄ || 4.56 | 4.44 | -3%˄ | (run time too short) |
| 24b || 203.05 | 207.93 | +2%˄ || 4.92 | 4.81 | -2%˄ | (run time too short) |
+| 25a || 104.68 | 98.39 | -6%˄ || 9.55 | 10.16 | +6%˄ | (run time too short) |
| 25b || 64.12 | 63.74 | -1%˄ || 15.59 | 15.69 | +1%˄ | (run time too short) |
+| 25c || 241.92 | 230.48 | -5%˄ || 4.13 | 4.34 | +5%˄ | (run time too short) |
+| 26a || 170.91 | 138.47 | -19%˄ || 5.85 | 7.22 | +23%˄ | (run time too short) |
+| 26b || 142.08 | 121.16 | -15%˄ || 7.04 | 8.25 | +17%˄ | (run time too short) |
+| 26c || 320.37 | 250.80 | -22%˄ || 3.12 | 3.99 | +28%˄ | (run time too short) |
-| 27a || 37.56 | 47.28 | +26%˄ || 26.62 | 21.15 | -21%˄ | (run time too short) |
-| 27b || 26.49 | 34.26 | +29%˄ || 37.75 | 29.18 | -23%˄ | (run time too short) |
| 27c || 40.93 | 41.56 | +2%˄ || 24.43 | 24.06 | -2%˄ | (run time too short) |
| 28a || 212.25 | 210.39 | -1%˄ || 4.71 | 4.75 | +1%˄ | (run time too short) |
-| 28b || 80.16 | 86.72 | +8%˄ || 12.47 | 11.53 | -8%˄ | (run time too short) |
| 28c || 186.96 | 189.75 | +1%˄ || 5.35 | 5.27 | -1%˄ | (run time too short) |
-| 29a || 178.86 | 211.21 | +18%˄ || 5.59 | 4.73 | -15%˄ | (run time too short) |
| 29b || 930.66 | 953.08 | +2%˄ || 1.07 | 1.05 | -2%˄ | (run time too short) |
-| 29c || 222.11 | 233.08 | +5%˄ || 4.50 | 4.29 | -5%˄ | (run time too short) |
| 2a || 29.20 | 29.56 | +1%˄ || 34.24 | 33.83 | -1%˄ | (run time too short) |
| 2b || 26.55 | 27.67 | +4%˄ || 37.66 | 36.14 | -4%˄ | (run time too short) |
-| 2c || 21.95 | 24.06 | +10%˄ || 45.56 | 41.56 | -9%˄ | (run time too short) |
| 2d || 57.77 | 56.07 | -3%˄ || 17.31 | 17.83 | +3%˄ | (run time too short) |
| 30a || 90.03 | 87.18 | -3%˄ || 11.11 | 11.47 | +3%˄ | (run time too short) |
| 30b || 92.51 | 91.29 | -1%˄ || 10.81 | 10.95 | +1%˄ | (run time too short) |
+| 30c || 159.61 | 149.38 | -6%˄ || 6.27 | 6.69 | +7%˄ | (run time too short) |
| 31a || 79.45 | 77.15 | -3%˄ || 12.59 | 12.96 | +3%˄ | (run time too short) |
| 31b || 84.05 | 82.36 | -2%˄ || 11.90 | 12.14 | +2%˄ | (run time too short) |
| 31c || 90.35 | 87.96 | -3%˄ || 11.07 | 11.37 | +3%˄ | (run time too short) |
| 32a || 14.96 | 15.43 | +3%˄ || 66.85 | 64.80 | -3%˄ | (run time too short) |
+| 32b || 36.31 | 33.68 | -7%˄ || 27.54 | 29.68 | +8%˄ | (run time too short) |
-| 33a || 34.06 | 51.34 | +51%˄ || 29.36 | 19.48 | -34%˄ | (run time too short) |
-| 33b || 22.84 | 29.74 | +30%˄ || 43.78 | 33.62 | -23%˄ | (run time too short) |
-| 33c || 45.43 | 56.37 | +24%˄ || 22.01 | 17.74 | -19%˄ | (run time too short) |
| 3a || 71.03 | 71.53 | +1%˄ || 14.08 | 13.98 | -1%˄ | (run time too short) |
-| 3b || 19.87 | 25.00 | +26%˄ || 50.32 | 40.00 | -21%˄ | (run time too short) |
| 3c || 223.76 | 214.21 | -4%˄ || 4.47 | 4.67 | +4%˄ | (run time too short) |
| 4a || 150.45 | 150.49 | +0%˄ || 6.65 | 6.64 | -0%˄ | (run time too short) |
-| 4b || 18.45 | 23.77 | +29%˄ || 54.18 | 42.06 | -22%˄ | (run time too short) |
| 4c || 191.03 | 186.47 | -2%˄ || 5.23 | 5.36 | +2%˄ | (run time too short) |
| 5a || 64.67 | 67.19 | +4%˄ || 15.46 | 14.88 | -4%˄ | (run time too short) |
-| 5b || 61.21 | 65.19 | +7%˄ || 16.34 | 15.34 | -6%˄ | (run time too short) |
| 5c || 99.55 | 97.39 | -2%˄ || 10.04 | 10.27 | +2%˄ | (run time too short) |
+| 6a || 167.34 | 150.00 | -10%˄ || 5.98 | 6.67 | +12%˄ | (run time too short) |
+| 6b || 178.05 | 159.09 | -11%˄ || 5.62 | 6.29 | +12%˄ | (run time too short) |
+| 6c || 157.83 | 139.36 | -12%˄ || 6.34 | 7.18 | +13%˄ | (run time too short) |
+| 6d || 389.69 | 350.34 | -10%˄ || 2.57 | 2.85 | +11%˄ | (run time too short) |
+| 6e || 164.69 | 143.07 | -13%˄ || 6.07 | 6.99 | +15%˄ | (run time too short) |
+| 6f || 721.47 | 643.67 | -11%˄ || 1.39 | 1.55 | +12%˄ | (run time too short) |
-| 7a || 92.60 | 121.07 | +31%˄ || 10.80 | 8.26 | -24%˄ | (run time too short) |
-| 7b || 86.43 | 115.79 | +34%˄ || 11.57 | 8.64 | -25%˄ | (run time too short) |
| 7c || 576.79 | 565.65 | -2%˄ || 1.73 | 1.77 | +2%˄ | (run time too short) |
| 8a || 202.35 | 194.88 | -4%˄ || 4.94 | 5.13 | +4%˄ | (run time too short) |
-| 8b || 188.95 | 198.42 | +5%˄ || 5.29 | 5.04 | -5%˄ | (run time too short) |
+| 8c || 1863.54 | 1744.73 | -6% || 0.53 | 0.57 | +6% | 0.0000 |
| 8d || 488.32 | 480.60 | -2%˄ || 2.05 | 2.08 | +2%˄ | (run time too short) |
+| 9a || 257.35 | 242.71 | -6%˄ || 3.89 | 4.12 | +6%˄ | (run time too short) |
| 9b || 165.70 | 164.41 | -1%˄ || 6.03 | 6.08 | +1%˄ | (run time too short) |
+| 9c || 311.21 | 288.24 | -7%˄ || 3.21 | 3.47 | +8%˄ | (run time too short) |
| 9d || 457.28 | 452.85 | -1%˄ || 2.19 | 2.21 | +1%˄ | (run time too short) |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
+| Sum || 30496.95 | 28727.32 | -6% || | | | |
| Geomean || | | || | | -2% | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkJoinOrder - multi-threaded, ordered, 1 client, 64 cores Sum of avg. item runtimes: -4% || Geometric mean of throughput changes: +1%Configuration Overview - click to expand +Configuration Overview---------+---------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkJoinOrder_0bcfa0250faed47181d2591d19daefc98bfcd5a4_mt_ordered.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkJoinOrder_2f72cba186290ca85834639abc0ef6c44b272856_mt_ordered.json |
+-------------------------------+---------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4-dirty | 2f72cba186290ca85834639abc0ef6c44b272856-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 14:41:54 | 2025-06-08 08:40:58 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------------+---------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| 10a || 39.83 | 38.16 | -4%˄ || 25.08 | 26.18 | +4%˄ | (run time too short) |
+| 10b || 18.33 | 17.36 | -5%˄ || 54.46 | 57.50 | +6%˄ | (run time too short) |
+| 10c || 120.65 | 107.88 | -11%˄ || 8.29 | 9.27 | +12%˄ | (run time too short) |
| 11a || 10.54 | 10.71 | +2%˄ || 94.59 | 93.03 | -2%˄ | (run time too short) |
| 11b || 8.37 | 8.62 | +3%˄ || 119.00 | 115.52 | -3%˄ | (run time too short) |
| 11c || 23.23 | 24.03 | +3%˄ || 42.98 | 41.56 | -3%˄ | (run time too short) |
| 11d || 27.18 | 27.68 | +2%˄ || 36.74 | 36.09 | -2%˄ | (run time too short) |
| 12a || 21.55 | 20.82 | -3%˄ || 46.32 | 47.96 | +4%˄ | (run time too short) |
-| 12b || 12.03 | 12.65 | +5%˄ || 82.86 | 78.78 | -5%˄ | (run time too short) |
| 12c || 51.14 | 49.90 | -2%˄ || 19.54 | 20.02 | +2%˄ | (run time too short) |
| 13a || 134.71 | 129.92 | -4%˄ || 7.42 | 7.69 | +4%˄ | (run time too short) |
| 13b || 96.71 | 95.06 | -2%˄ || 10.34 | 10.52 | +2%˄ | (run time too short) |
-| 13c || 15.59 | 16.60 | +7%˄ || 63.99 | 60.09 | -6%˄ | (run time too short) |
| 13d || 372.34 | 365.58 | -2%˄ || 2.69 | 2.74 | +2%˄ | (run time too short) |
| 14a || 57.08 | 56.13 | -2%˄ || 17.51 | 17.80 | +2%˄ | (run time too short) |
| 14b || 72.00 | 72.25 | +0%˄ || 13.88 | 13.83 | -0%˄ | (run time too short) |
| 14c || 118.28 | 114.50 | -3%˄ || 8.45 | 8.73 | +3%˄ | (run time too short) |
| 15a || 30.30 | 29.57 | -2%˄ || 32.97 | 33.78 | +2%˄ | (run time too short) |
| 15b || 24.94 | 25.12 | +1%˄ || 40.03 | 39.75 | -1%˄ | (run time too short) |
| 15c || 23.12 | 22.28 | -4%˄ || 43.18 | 44.81 | +4%˄ | (run time too short) |
| 15d || 28.99 | 27.86 | -4%˄ || 34.45 | 35.85 | +4%˄ | (run time too short) |
+| 16a || 846.11 | 766.78 | -9%˄ || 1.18 | 1.30 | +10%˄ | (run time too short) |
+| 16b || 2054.41 | 1959.82 | -5% || 0.48 | 0.50 | +3% | (run time too short) |
+| 16c || 1005.65 | 925.91 | -8%˄ || 0.99 | 1.08 | +9%˄ | (run time too short) |
+| 16d || 967.56 | 888.33 | -8%˄ || 1.03 | 1.13 | +9%˄ | (run time too short) |
| 17a || 187.95 | 182.84 | -3%˄ || 5.32 | 5.47 | +3%˄ | (run time too short) |
| 17b || 155.80 | 153.74 | -1%˄ || 6.42 | 6.50 | +1%˄ | (run time too short) |
| 17c || 128.35 | 131.05 | +2%˄ || 7.79 | 7.63 | -2%˄ | (run time too short) |
| 17d || 126.57 | 122.82 | -3%˄ || 7.90 | 8.14 | +3%˄ | (run time too short) |
+| 17e || 846.50 | 791.35 | -7%˄ || 1.18 | 1.26 | +7%˄ | (run time too short) |
| 17f || 322.94 | 313.02 | -3%˄ || 3.10 | 3.19 | +3%˄ | (run time too short) |
| 18a || 52.67 | 51.72 | -2%˄ || 18.97 | 19.32 | +2%˄ | (run time too short) |
| 18b || 50.23 | 49.19 | -2%˄ || 19.89 | 20.31 | +2%˄ | (run time too short) |
| 18c || 99.03 | 99.40 | +0%˄ || 10.09 | 10.06 | -0%˄ | (run time too short) |
| 19a || 100.42 | 98.76 | -2%˄ || 9.95 | 10.12 | +2%˄ | (run time too short) |
| 19b || 62.93 | 61.03 | -3%˄ || 15.88 | 16.38 | +3%˄ | (run time too short) |
| 19c || 113.80 | 113.06 | -1%˄ || 8.78 | 8.84 | +1%˄ | (run time too short) |
| 19d || 520.87 | 513.48 | -1%˄ || 1.92 | 1.95 | +1%˄ | (run time too short) |
| 1a || 6.36 | 6.49 | +2%˄ || 156.53 | 153.39 | -2%˄ | (run time too short) |
-| 1b || 4.48 | 7.48 | +67%˄ || 221.24 | 133.01 | -40%˄ | (run time too short) |
-| 1c || 4.00 | 5.00 | +25%˄ || 247.71 | 198.54 | -20%˄ | (run time too short) |
| 1d || 5.02 | 5.21 | +4%˄ || 198.07 | 190.94 | -4%˄ | (run time too short) |
| 20a || 83.48 | 83.38 | -0%˄ || 11.97 | 11.99 | +0%˄ | (run time too short) |
| 20b || 72.40 | 73.96 | +2%˄ || 13.81 | 13.51 | -2%˄ | (run time too short) |
+| 20c || 79.82 | 75.95 | -5%˄ || 12.52 | 13.16 | +5%˄ | (run time too short) |
| 21a || 16.66 | 16.57 | -1%˄ || 59.89 | 60.21 | +1%˄ | (run time too short) |
| 21b || 15.15 | 15.12 | -0%˄ || 65.86 | 65.98 | +0%˄ | (run time too short) |
| 21c || 18.69 | 18.29 | -2%˄ || 53.39 | 54.55 | +2%˄ | (run time too short) |
| 22a || 73.07 | 72.46 | -1%˄ || 13.68 | 13.79 | +1%˄ | (run time too short) |
| 22b || 54.81 | 53.37 | -3%˄ || 18.23 | 18.72 | +3%˄ | (run time too short) |
+| 22c || 123.41 | 118.02 | -4%˄ || 8.10 | 8.47 | +5%˄ | (run time too short) |
+| 22d || 223.78 | 212.94 | -5%˄ || 4.47 | 4.70 | +5%˄ | (run time too short) |
| 23a || 16.50 | 16.09 | -2%˄ || 60.47 | 62.01 | +3%˄ | (run time too short) |
| 23b || 27.03 | 26.53 | -2%˄ || 36.94 | 37.64 | +2%˄ | (run time too short) |
| 23c || 18.76 | 18.48 | -2%˄ || 53.19 | 54.02 | +2%˄ | (run time too short) |
| 24a || 60.07 | 59.90 | -0%˄ || 16.63 | 16.68 | +0%˄ | (run time too short) |
| 24b || 60.36 | 59.91 | -1%˄ || 16.55 | 16.68 | +1%˄ | (run time too short) |
| 25a || 57.48 | 55.89 | -3%˄ || 17.38 | 17.88 | +3%˄ | (run time too short) |
| 25b || 32.64 | 32.14 | -2%˄ || 30.60 | 31.08 | +2%˄ | (run time too short) |
| 25c || 157.31 | 152.13 | -3%˄ || 6.36 | 6.57 | +3%˄ | (run time too short) |
+| 26a || 86.84 | 80.31 | -8%˄ || 11.51 | 12.45 | +8%˄ | (run time too short) |
+| 26b || 64.08 | 57.52 | -10%˄ || 15.59 | 17.37 | +11%˄ | (run time too short) |
+| 26c || 131.43 | 119.70 | -9%˄ || 7.61 | 8.35 | +10%˄ | (run time too short) |
| 27a || 19.60 | 19.49 | -1%˄ || 50.93 | 51.22 | +1%˄ | (run time too short) |
| 27b || 18.21 | 18.30 | +0%˄ || 54.80 | 54.55 | -0%˄ | (run time too short) |
| 27c || 18.26 | 18.04 | -1%˄ || 54.65 | 55.33 | +1%˄ | (run time too short) |
| 28a || 126.69 | 124.61 | -2%˄ || 7.89 | 8.02 | +2%˄ | (run time too short) |
| 28b || 27.56 | 27.11 | -2%˄ || 36.24 | 36.83 | +2%˄ | (run time too short) |
| 28c || 105.64 | 102.54 | -3%˄ || 9.46 | 9.75 | +3%˄ | (run time too short) |
| 29a || 52.78 | 53.78 | +2%˄ || 18.93 | 18.58 | -2%˄ | (run time too short) |
| 29b || 133.17 | 134.24 | +1%˄ || 7.51 | 7.45 | -1%˄ | (run time too short) |
| 29c || 65.92 | 66.22 | +0%˄ || 15.16 | 15.09 | -0%˄ | (run time too short) |
| 2a || 22.42 | 22.87 | +2%˄ || 44.53 | 43.66 | -2%˄ | (run time too short) |
| 2b || 19.70 | 19.71 | +0%˄ || 50.67 | 50.66 | -0%˄ | (run time too short) |
| 2c || 13.85 | 14.30 | +3%˄ || 72.06 | 69.78 | -3%˄ | (run time too short) |
+| 2d || 52.65 | 47.59 | -10%˄ || 18.98 | 21.00 | +11%˄ | (run time too short) |
| 30a || 48.40 | 47.00 | -3%˄ || 20.64 | 21.26 | +3%˄ | (run time too short) |
| 30b || 37.02 | 36.81 | -1%˄ || 26.98 | 27.14 | +1%˄ | (run time too short) |
| 30c || 115.23 | 112.12 | -3%˄ || 8.67 | 8.92 | +3%˄ | (run time too short) |
| 31a || 38.97 | 37.91 | -3%˄ || 25.63 | 26.35 | +3%˄ | (run time too short) |
| 31b || 34.28 | 33.58 | -2%˄ || 29.14 | 29.74 | +2%˄ | (run time too short) |
| 31c || 43.18 | 41.36 | -4%˄ || 23.14 | 24.15 | +4%˄ | (run time too short) |
-| 32a || 6.39 | 6.70 | +5%˄ || 155.84 | 148.55 | -5%˄ | (run time too short) |
| 32b || 28.36 | 29.60 | +4%˄ || 35.22 | 33.75 | -4%˄ | (run time too short) |
-| 33a || 10.56 | 13.99 | +33%˄ || 94.40 | 71.29 | -24%˄ | (run time too short) |
-| 33b || 8.44 | 9.81 | +16%˄ || 117.95 | 101.56 | -14%˄ | (run time too short) |
-| 33c || 18.82 | 20.93 | +11%˄ || 53.03 | 47.69 | -10%˄ | (run time too short) |
+| 3a || 38.67 | 32.17 | -17%˄ || 25.83 | 31.05 | +20%˄ | (run time too short) |
| 3b || 6.60 | 6.69 | +1%˄ || 150.76 | 148.74 | -1%˄ | (run time too short) |
| 3c || 71.85 | 70.30 | -2%˄ || 13.91 | 14.22 | +2%˄ | (run time too short) |
| 4a || 69.52 | 66.99 | -4%˄ || 14.38 | 14.92 | +4%˄ | (run time too short) |
-| 4b || 5.19 | 5.57 | +7%˄ || 191.35 | 178.57 | -7%˄ | (run time too short) |
| 4c || 86.15 | 84.41 | -2%˄ || 11.60 | 11.84 | +2%˄ | (run time too short) |
| 5a || 24.54 | 24.76 | +1%˄ || 40.69 | 40.33 | -1%˄ | (run time too short) |
| 5b || 20.66 | 20.46 | -1%˄ || 48.32 | 48.80 | +1%˄ | (run time too short) |
| 5c || 48.59 | 48.18 | -1%˄ || 20.56 | 20.74 | +1%˄ | (run time too short) |
+| 6a || 29.21 | 24.86 | -15%˄ || 34.19 | 40.16 | +17%˄ | (run time too short) |
+| 6b || 50.78 | 45.72 | -10%˄ || 19.68 | 21.86 | +11%˄ | (run time too short) |
+| 6c || 26.47 | 23.07 | -13%˄ || 37.72 | 43.28 | +15%˄ | (run time too short) |
| 6d || 129.28 | 128.60 | -1%˄ || 7.73 | 7.77 | +1%˄ | (run time too short) |
+| 6e || 28.77 | 24.99 | -13%˄ || 34.72 | 39.95 | +15%˄ | (run time too short) |
| 6f || 479.70 | 470.00 | -2%˄ || 2.08 | 2.13 | +2%˄ | (run time too short) |
| 7a || 27.26 | 28.36 | +4%˄ || 36.63 | 35.22 | -4%˄ | (run time too short) |
| 7b || 25.77 | 26.83 | +4%˄ || 38.76 | 37.22 | -4%˄ | (run time too short) |
| 7c || 257.05 | 261.65 | +2%˄ || 3.89 | 3.82 | -2%˄ | (run time too short) |
| 8a || 41.73 | 40.56 | -3%˄ || 23.94 | 24.63 | +3%˄ | (run time too short) |
| 8b || 40.17 | 39.43 | -2%˄ || 24.87 | 25.33 | +2%˄ | (run time too short) |
| 8c || 1133.53 | 1085.16 | -4%˄ || 0.88 | 0.92 | +4%˄ | (run time too short) |
| 8d || 278.75 | 274.09 | -2%˄ || 3.59 | 3.65 | +2%˄ | (run time too short) |
| 9a || 132.07 | 127.07 | -4%˄ || 7.57 | 7.87 | +4%˄ | (run time too short) |
| 9b || 74.63 | 71.82 | -4%˄ || 13.39 | 13.92 | +4%˄ | (run time too short) |
| 9c || 149.21 | 144.59 | -3%˄ || 6.70 | 6.91 | +3%˄ | (run time too short) |
| 9d || 353.48 | 349.10 | -1%˄ || 2.83 | 2.86 | +1%˄ | (run time too short) |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Sum || 15138.04 | 14521.85 | -4% || | | | |
| Geomean || | | || | | +1% | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkJoinOrder - multi-threaded, shuffled, 64 clients, 64 cores Sum of avg. item runtimes: -8% || Geometric mean of throughput changes: +8%Configuration Overview - click to expand +Configuration Overview---------+-------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkJoinOrder_0bcfa0250faed47181d2591d19daefc98bfcd5a4_mt.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkJoinOrder_2f72cba186290ca85834639abc0ef6c44b272856_mt.json |
+-------------------------------+-------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4-dirty | 2f72cba186290ca85834639abc0ef6c44b272856-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 14:56:30 | 2025-06-08 08:55:08 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+-------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+---------+
+| 10a || 207.30 | 200.53 | -3% || 1.18 | 1.27 | +8% | 0.7126 |
+| 10b || 146.27 | 133.78 | -9% || 1.18 | 1.27 | +8% | 0.4936 |
+| 10c || 709.92 | 578.88 | -18% || 1.18 | 1.27 | +8% | 0.0000 |
+| 11a || 90.30 | 81.98 | -9% || 1.18 | 1.27 | +8% | 0.5149 |
+| 11b || 77.36 | 76.56 | -1% || 1.18 | 1.27 | +8% | 0.9378 |
+| 11c || 125.80 | 128.92 | +2% || 1.18 | 1.27 | +8% | 0.7976 |
+| 11d || 95.39 | 80.39 | -16% || 1.18 | 1.27 | +8% | 0.0917 |
+| 12a || 161.32 | 162.08 | +0% || 1.18 | 1.27 | +8% | 0.9572 |
+| 12b || 86.09 | 74.28 | -14% || 1.18 | 1.27 | +8% | 0.2779 |
+| 12c || 396.66 | 332.30 | -16% || 1.18 | 1.27 | +8% | 0.0082 |
+| 13a || 541.77 | 478.30 | -12% || 1.18 | 1.27 | +8% | 0.0163 |
+| 13b || 366.20 | 340.58 | -7% || 1.18 | 1.27 | +8% | 0.2752 |
+| 13c || 90.68 | 93.32 | +3% || 1.18 | 1.27 | +8% | 0.8127 |
+| 13d || 941.54 | 894.26 | -5% || 1.18 | 1.27 | +8% | 0.0959 |
+| 14a || 441.14 | 407.11 | -8% || 1.18 | 1.27 | +8% | 0.1844 |
+| 14b || 486.85 | 438.01 | -10% || 1.18 | 1.27 | +8% | 0.0846 |
+| 14c || 656.58 | 591.87 | -10% || 1.18 | 1.27 | +8% | 0.0322 |
+| 15a || 129.97 | 123.51 | -5% || 1.18 | 1.27 | +8% | 0.6134 |
+| 15b || 119.85 | 117.75 | -2% || 1.18 | 1.27 | +8% | 0.8632 |
+| 15c || 139.26 | 140.83 | +1% || 1.18 | 1.27 | +8% | 0.9119 |
+| 15d || 159.80 | 141.54 | -11% || 1.18 | 1.27 | +8% | 0.1788 |
+| 16a || 1796.01 | 1623.85 | -10% || 1.18 | 1.27 | +8% | 0.0000 |
+| 16b || 3316.65 | 3079.23 | -7% || 1.17 | 1.27 | +8% | 0.0000 |
+| 16c || 1990.67 | 1860.30 | -7% || 1.18 | 1.27 | +8% | 0.0010 |
+| 16d || 1981.54 | 1804.90 | -9% || 1.18 | 1.27 | +8% | 0.0000 |
+| 17a || 925.80 | 848.60 | -8% || 1.18 | 1.27 | +8% | 0.0309 |
+| 17b || 711.79 | 623.05 | -12% || 1.18 | 1.27 | +8% | 0.0038 |
+| 17c || 640.32 | 548.32 | -14% || 1.18 | 1.27 | +8% | 0.0024 |
+| 17d || 607.26 | 547.33 | -10% || 1.18 | 1.27 | +8% | 0.0248 |
+| 17e || 1770.67 | 1674.66 | -5% || 1.18 | 1.27 | +8% | 0.0082 |
+| 17f || 1228.37 | 1107.58 | -10% || 1.18 | 1.27 | +8% | 0.0009 |
+| 18a || 274.17 | 232.66 | -15% || 1.18 | 1.27 | +8% | 0.0187 |
+| 18b || 433.79 | 390.78 | -10% || 1.18 | 1.27 | +8% | 0.1239 |
+| 18c || 679.02 | 622.60 | -8% || 1.18 | 1.27 | +8% | 0.0977 |
+| 19a || 569.58 | 576.03 | +1% || 1.18 | 1.27 | +8% | 0.8375 |
+| 19b || 434.99 | 423.32 | -3% || 1.18 | 1.27 | +8% | 0.6710 |
+| 19c || 676.73 | 638.64 | -6% || 1.18 | 1.27 | +8% | 0.2949 |
+| 19d || 1445.51 | 1384.81 | -4% || 1.18 | 1.27 | +8% | 0.1141 |
+| 1a || 38.64 | 34.87 | -10% || 1.18 | 1.27 | +8% | 0.4147 |
+| 1b || 48.16 | 49.22 | +2% || 1.18 | 1.27 | +8% | 0.8907 |
+| 1c || 68.71 | 52.59 | -23% || 1.18 | 1.27 | +8% | 0.0847 |
+| 1d || 40.25 | 34.21 | -15% || 1.18 | 1.27 | +8% | 0.4463 |
+| 20a || 488.60 | 424.68 | -13% || 1.18 | 1.27 | +8% | 0.0155 |
+| 20b || 427.24 | 407.97 | -5% || 1.18 | 1.27 | +8% | 0.4578 |
+| 20c || 423.66 | 340.83 | -20% || 1.18 | 1.27 | +8% | 0.0003 |
+| 21a || 187.68 | 206.51 | +10% || 1.18 | 1.27 | +8% | 0.3772 |
+| 21b || 133.19 | 124.69 | -6% || 1.18 | 1.27 | +8% | 0.5153 |
+| 21c || 228.41 | 188.43 | -18% || 1.18 | 1.27 | +8% | 0.0784 |
+| 22a || 489.12 | 512.57 | +5% || 1.18 | 1.27 | +8% | 0.4161 |
+| 22b || 448.85 | 404.25 | -10% || 1.18 | 1.27 | +8% | 0.0883 |
+| 22c || 715.90 | 678.31 | -5% || 1.18 | 1.27 | +8% | 0.2777 |
+| 22d || 967.71 | 883.26 | -9% || 1.18 | 1.27 | +8% | 0.0193 |
+| 23a || 156.52 | 164.24 | +5% || 1.18 | 1.27 | +8% | 0.6306 |
+| 23b || 135.68 | 145.36 | +7% || 1.18 | 1.27 | +8% | 0.5101 |
+| 23c || 174.25 | 148.94 | -15% || 1.18 | 1.27 | +8% | 0.1033 |
+| 24a || 437.08 | 401.41 | -8% || 1.18 | 1.27 | +8% | 0.2035 |
+| 24b || 315.19 | 322.35 | +2% || 1.18 | 1.27 | +8% | 0.7722 |
+| 25a || 474.67 | 385.02 | -19% || 1.18 | 1.27 | +8% | 0.0033 |
+| 25b || 248.57 | 253.15 | +2% || 1.18 | 1.27 | +8% | 0.8416 |
+| 25c || 966.56 | 855.29 | -12% || 1.18 | 1.27 | +8% | 0.0016 |
+| 26a || 425.47 | 375.03 | -12% || 1.18 | 1.27 | +8% | 0.0197 |
+| 26b || 279.03 | 236.94 | -15% || 1.18 | 1.27 | +8% | 0.0336 |
+| 26c || 655.79 | 603.41 | -8% || 1.18 | 1.27 | +8% | 0.0555 |
+| 27a || 171.75 | 154.39 | -10% || 1.18 | 1.27 | +8% | 0.2339 |
+| 27b || 174.04 | 134.37 | -23% || 1.18 | 1.27 | +8% | 0.0097 |
+| 27c || 200.48 | 194.41 | -3% || 1.18 | 1.27 | +8% | 0.7672 |
+| 28a || 672.36 | 633.80 | -6% || 1.18 | 1.27 | +8% | 0.1556 |
+| 28b || 252.00 | 218.80 | -13% || 1.18 | 1.27 | +8% | 0.0720 |
+| 28c || 696.21 | 633.78 | -9% || 1.18 | 1.27 | +8% | 0.0536 |
+| 29a || 307.12 | 285.80 | -7% || 1.18 | 1.27 | +8% | 0.3830 |
+| 29b || 369.39 | 347.78 | -6% || 1.18 | 1.27 | +8% | 0.3732 |
+| 29c || 401.55 | 328.50 | -18% || 1.18 | 1.27 | +8% | 0.0038 |
+| 2a || 147.76 | 124.43 | -16% || 1.18 | 1.27 | +8% | 0.0612 |
+| 2b || 138.11 | 116.53 | -16% || 1.18 | 1.27 | +8% | 0.0739 |
+| 2c || 90.14 | 111.22 | +23% || 1.18 | 1.27 | +8% | 0.1174 |
+| 2d || 210.40 | 203.73 | -3% || 1.18 | 1.27 | +8% | 0.6422 |
+| 30a || 374.76 | 338.00 | -10% || 1.18 | 1.27 | +8% | 0.1368 |
+| 30b || 316.48 | 330.72 | +5% || 1.18 | 1.27 | +8% | 0.5381 |
+| 30c || 720.14 | 613.69 | -15% || 1.18 | 1.27 | +8% | 0.0016 |
+| 31a || 296.20 | 293.71 | -1% || 1.18 | 1.27 | +8% | 0.9171 |
+| 31b || 261.70 | 257.85 | -1% || 1.18 | 1.27 | +8% | 0.8705 |
+| 31c || 325.66 | 335.31 | +3% || 1.18 | 1.27 | +8% | 0.7039 |
+| 32a || 52.34 | 45.41 | -13% || 1.18 | 1.27 | +8% | 0.2841 |
+| 32b || 161.95 | 161.66 | -0% || 1.18 | 1.27 | +8% | 0.9839 |
+| 33a || 138.99 | 126.21 | -9% || 1.18 | 1.27 | +8% | 0.5115 |
+| 33b || 75.18 | 88.15 | +17% || 1.18 | 1.27 | +8% | 0.2120 |
+| 33c || 153.11 | 153.69 | +0% || 1.18 | 1.27 | +8% | 0.9706 |
+| 3a || 321.56 | 277.32 | -14% || 1.18 | 1.27 | +8% | 0.0708 |
+| 3b || 75.63 | 75.93 | +0% || 1.18 | 1.27 | +8% | 0.9801 |
+| 3c || 487.07 | 446.32 | -8% || 1.18 | 1.27 | +8% | 0.1588 |
+| 4a || 297.69 | 278.22 | -7% || 1.18 | 1.27 | +8% | 0.3162 |
+| 4b || 57.29 | 64.12 | +12% || 1.18 | 1.27 | +8% | 0.4177 |
+| 4c || 298.11 | 325.71 | +9% || 1.18 | 1.27 | +8% | 0.1677 |
+| 5a || 249.90 | 232.98 | -7% || 1.18 | 1.27 | +8% | 0.4334 |
+| 5b || 159.53 | 157.51 | -1% || 1.18 | 1.27 | +8% | 0.9010 |
+| 5c || 351.50 | 334.90 | -5% || 1.18 | 1.27 | +8% | 0.5392 |
+| 6a || 161.91 | 130.76 | -19% || 1.18 | 1.27 | +8% | 0.0442 |
+| 6b || 229.00 | 197.67 | -14% || 1.18 | 1.27 | +8% | 0.0803 |
+| 6c || 120.14 | 115.96 | -3% || 1.18 | 1.27 | +8% | 0.7347 |
+| 6d || 573.43 | 547.91 | -4% || 1.18 | 1.27 | +8% | 0.3458 |
+| 6e || 154.70 | 126.10 | -18% || 1.18 | 1.27 | +8% | 0.0491 |
+| 6f || 1253.69 | 1204.33 | -4% || 1.18 | 1.27 | +8% | 0.1206 |
+| 7a || 165.54 | 179.53 | +8% || 1.18 | 1.27 | +8% | 0.4540 |
+| 7b || 167.67 | 138.76 | -17% || 1.18 | 1.27 | +8% | 0.0692 |
+| 7c || 1073.04 | 996.08 | -7% || 1.18 | 1.27 | +8% | 0.0143 |
+| 8a || 218.28 | 192.05 | -12% || 1.18 | 1.27 | +8% | 0.1785 |
+| 8b || 160.39 | 139.82 | -13% || 1.18 | 1.27 | +8% | 0.2924 |
+| 8c || 2396.25 | 2238.74 | -7% || 1.18 | 1.27 | +8% | 0.0002 |
+| 8d || 891.97 | 892.44 | +0% || 1.18 | 1.27 | +8% | 0.9867 |
+| 9a || 709.94 | 627.14 | -12% || 1.18 | 1.27 | +8% | 0.0079 |
+| 9b || 379.06 | 345.10 | -9% || 1.18 | 1.27 | +8% | 0.0852 |
+| 9c || 810.26 | 742.47 | -8% || 1.18 | 1.27 | +8% | 0.0445 |
+| 9d || 1152.33 | 1088.04 | -6% || 1.18 | 1.27 | +8% | 0.0648 |
+---------++----------+----------+--------++----------+----------+--------+---------+
+| Sum || 54251.56 | 50164.83 | -8% || | | | |
+| Geomean || | | || | | +8% | |
+---------++----------+----------+--------++----------+----------+--------+---------+hyriseBenchmarkStarSchema - single-threaded Sum of avg. item runtimes: +8% || Geometric mean of throughput changes: -12%Configuration Overview - click to expand +Configuration Overview---+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkStarSchema_0bcfa0250faed47181d2591d19daefc98bfcd5a4_st.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkStarSchema_2f72cba186290ca85834639abc0ef6c44b272856_st.json |
+-------------------------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4-dirty | 2f72cba186290ca85834639abc0ef6c44b272856-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 15:16:50 | 2025-06-08 09:15:30 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+ +---------++----------+---------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
-| 1.1 || 418.70 | 600.06 | +43%˄ || 2.39 | 1.67 | -30%˄ | (run time too short) |
-| 1.2 || 231.42 | 652.42 | +182%˄ || 4.32 | 1.53 | -65%˄ | (run time too short) |
-| 1.3 || 226.28 | 657.15 | +190%˄ || 4.42 | 1.52 | -66%˄ | (run time too short) |
+| 2.1 || 512.39 | 411.96 | -20%˄ || 1.95 | 2.43 | +24%˄ | (run time too short) |
+| 2.2 || 279.38 | 208.45 | -25%˄ || 3.58 | 4.80 | +34%˄ | (run time too short) |
+| 2.3 || 175.89 | 123.18 | -30%˄ || 5.69 | 8.12 | +43%˄ | (run time too short) |
| 3.1 || 2621.47 | 2646.51 | +1% || 0.37 | 0.37 | +0% | (run time too short) |
+| 3.2 || 286.32 | 266.16 | -7%˄ || 3.49 | 3.76 | +8%˄ | (run time too short) |
-| 3.3 || 117.36 | 127.31 | +8%˄ || 8.52 | 7.85 | -8%˄ | (run time too short) |
-| 3.4 || 110.91 | 124.55 | +12%˄ || 9.02 | 8.03 | -11%˄ | (run time too short) |
+| 4.1 || 2454.42 | 2341.40 | -5% || 0.40 | 0.42 | +4% | (run time too short) |
| 4.2 || 778.59 | 746.20 | -4%˄ || 1.28 | 1.34 | +4%˄ | (run time too short) |
| 4.3 || 214.97 | 212.05 | -1%˄ || 4.65 | 4.72 | +1%˄ | (run time too short) |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
-| Sum || 8428.10 | 9117.39 | +8% || | | | |
-| Geomean || | | || | | -12% | |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+---------+--------++----------+----------+--------+----------------------+hyriseBenchmarkStarSchema - multi-threaded, ordered, 1 client, 64 cores Sum of avg. item runtimes: +2% || Geometric mean of throughput changes: -9%Configuration Overview - click to expand +Configuration Overview---------+----------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkStarSchema_0bcfa0250faed47181d2591d19daefc98bfcd5a4_mt_ordered.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkStarSchema_2f72cba186290ca85834639abc0ef6c44b272856_mt_ordered.json |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4-dirty | 2f72cba186290ca85834639abc0ef6c44b272856-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 15:25:47 | 2025-06-08 09:21:37 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------+ +---------++----------+---------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
-| 1.1 || 127.14 | 164.39 | +29%˄ || 7.86 | 6.08 | -23%˄ | (run time too short) |
-| 1.2 || 83.90 | 164.05 | +96%˄ || 11.91 | 6.09 | -49%˄ | (run time too short) |
-| 1.3 || 80.81 | 162.01 | +100%˄ || 12.37 | 6.17 | -50%˄ | (run time too short) |
+| 2.1 || 329.47 | 305.14 | -7%˄ || 3.03 | 3.28 | +8%˄ | (run time too short) |
+| 2.2 || 156.14 | 148.74 | -5%˄ || 6.40 | 6.72 | +5%˄ | (run time too short) |
+| 2.3 || 63.94 | 52.44 | -18%˄ || 15.63 | 19.05 | +22%˄ | (run time too short) |
+| 3.1 || 805.70 | 748.71 | -7%˄ || 1.24 | 1.34 | +8%˄ | (run time too short) |
+| 3.2 || 150.06 | 141.68 | -6%˄ || 6.66 | 7.06 | +6%˄ | (run time too short) |
| 3.3 || 77.71 | 77.54 | -0%˄ || 12.86 | 12.89 | +0%˄ | (run time too short) |
| 3.4 || 69.96 | 71.72 | +3%˄ || 14.29 | 13.94 | -2%˄ | (run time too short) |
+| 4.1 || 867.68 | 824.43 | -5%˄ || 1.15 | 1.21 | +5%˄ | (run time too short) |
| 4.2 || 348.80 | 349.17 | +0%˄ || 2.87 | 2.86 | -0%˄ | (run time too short) |
| 4.3 || 111.56 | 113.33 | +2%˄ || 8.96 | 8.82 | -2%˄ | (run time too short) |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| Sum || 3272.85 | 3323.36 | +2% || | | | |
-| Geomean || | | || | | -9% | |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+---------+--------++----------+----------+--------+----------------------+hyriseBenchmarkStarSchema - multi-threaded, shuffled, 64 clients, 64 cores Sum of avg. item runtimes: -5% || Geometric mean of throughput changes: +5%Configuration Overview - click to expand +Configuration Overview---------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkStarSchema_0bcfa0250faed47181d2591d19daefc98bfcd5a4_mt.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkStarSchema_2f72cba186290ca85834639abc0ef6c44b272856_mt.json |
+-------------------------------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4-dirty | 2f72cba186290ca85834639abc0ef6c44b272856-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 64
F41A
| 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 15:29:06 | 2025-06-08 09:25:01 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+---------+
+| 1.1 || 844.00 | 892.35 | +6% || 3.74 | 3.94 | +5% | 0.0153 |
+| 1.2 || 463.76 | 540.67 | +17% || 3.74 | 3.95 | +6% | 0.0000 |
+| 1.3 || 421.70 | 545.56 | +29% || 3.74 | 3.95 | +6% | 0.0000 |
+| 2.1 || 2110.74 | 1906.59 | -10% || 3.74 | 3.94 | +5% | 0.0000 |
+| 2.2 || 1110.95 | 927.58 | -17% || 3.74 | 3.94 | +6% | 0.0000 |
+| 2.3 || 382.51 | 299.49 | -22% || 3.74 | 3.95 | +5% | 0.0000 |
+| 3.1 || 3280.39 | 3171.10 | -3% || 3.73 | 3.94 | +6% | 0.0009 |
+| 3.2 || 978.05 | 889.23 | -9% || 3.74 | 3.94 | +5% | 0.0000 |
+| 3.3 || 474.81 | 454.34 | -4% || 3.74 | 3.94 | +5% | 0.1897 |
+| 3.4 || 466.32 | 433.25 | -7% || 3.74 | 3.94 | +5% | 0.0325 |
+| 4.1 || 3310.98 | 3098.09 | -6% || 3.73 | 3.94 | +6% | 0.0000 |
+| 4.2 || 2493.69 | 2349.66 | -6% || 3.73 | 3.94 | +5% | 0.0000 |
+| 4.3 || 752.92 | 695.78 | -8% || 3.74 | 3.94 | +5% | 0.0036 |
+---------++----------+----------+--------++----------+----------+--------+---------+
+| Sum || 17090.81 | 16203.70 | -5% || | | | |
+| Geomean || | | || | | +5% | |
+---------++----------+----------+--------++----------+----------+--------+---------+ |
Master vs. PR (all:Un or Dict)SegmentEncodingSpec auto_select_segment_encoding_spec(const DataType& type, const bool segment_values_are_unique) {
switch (type) {
case DataType::Int:
case DataType::String:
case DataType::Long:
case DataType::Double:
case DataType::Float:
if (segment_values_are_unique) {
return SegmentEncodingSpec{EncodingType::Unencoded};
} else {
return SegmentEncodingSpec{EncodingType::Dictionary};
}
default:
Fail("Unknown DataType when trying to select encoding for column.");
}
}System cx17 - click to expand
Commit Info and Build Time
hyriseBenchmarkTPCH - single-threaded, SF 10.0 Sum of avg. item runtimes: -11% || Geometric mean of throughput changes: +6%Configuration Overview - click to expand +Configuration Overview----+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCH_0bcfa0250faed47181d2591d19daefc98bfcd5a4_st.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCH_bb1319be18bfe505d05247307f454accd4e27f5d_st.json |
+--------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4-dirty | bb1319be18bfe505d05247307f454accd4e27f5d-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 12:04:57 | 2025-06-07 20:55:39 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+--------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+ +----------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
-| TPC-H 01 || 5528.68 | 5856.19 | +6% || 0.17 | 0.17 | +0% | (run time too short) |
+| TPC-H 02 || 40.56 | 33.07 | -18%˄ || 24.66 | 30.23 | +23%˄ | (run time too short) |
| TPC-H 03 || 1263.52 | 1262.31 | -0% || 0.78 | 0.78 | +0% | 0.8362 |
| TPC-H 04 || 1382.00 | 1363.76 | -1% || 0.72 | 0.72 | +0% | (run time too short) |
| TPC-H 05 || 2273.47 | 2177.74 | -4% || 0.43 | 0.45 | +4% | (run time too short) |
| TPC-H 06 || 170.52 | 171.02 | +0%˄ || 5.86 | 5.85 | -0%˄ | (run time too short) |
| TPC-H 07 || 703.81 | 714.46 | +2%˄ || 1.42 | 1.40 | -1%˄ | (run time too short) |
| TPC-H 08 || 537.71 | 519.43 | -3%˄ || 1.86 | 1.93 | +4%˄ | (run time too short) |
+| TPC-H 09 || 6533.99 | 5882.93 | -10% || 0.15 | 0.17 | +11% | (run time too short) |
+| TPC-H 10 || 1386.61 | 1313.39 | -5% || 0.72 | 0.75 | +5% | 0.0000 |
| TPC-H 11 || 50.89 | 50.41 | -1%˄ || 19.65 | 19.84 | +1%˄ | (run time too short) |
+| TPC-H 12 || 942.18 | 859.78 | -9%˄ || 1.06 | 1.16 | +10%˄ | (run time too short) |
+| TPC-H 13 || 7360.10 | 4319.93 | -41% || 0.13 | 0.22 | +62% | (run time too short) |
| TPC-H 14 || 492.69 | 472.15 | -4%˄ || 2.03 | 2.12 | +4%˄ | (run time too short) |
+| TPC-H 15 || 183.11 | 173.40 | -5%˄ || 5.46 | 5.77 | +6%˄ | (run time too short) |
+| TPC-H 16 || 530.69 | 503.09 | -5%˄ || 1.88 | 1.99 | +5%˄ | (run time too short) |
+| TPC-H 17 || 220.02 | 210.52 | -4%˄ || 4.55 | 4.75 | +5%˄ | (run time too short) |
| TPC-H 18 || 1568.85 | 1606.67 | +2% || 0.63 | 0.62 | -3% | 0.1073 |
| TPC-H 19 || 230.76 | 234.14 | +1%˄ || 4.33 | 4.27 | -1%˄ | (run time too short) |
+| TPC-H 20 || 392.62 | 363.49 | -7%˄ || 2.55 | 2.75 | +8%˄ | (run time too short) |
+| TPC-H 21 || 4267.09 | 3814.60 | -11% || 0.23 | 0.25 | +7% | (run time too short) |
| TPC-H 22 || 482.40 | 472.58 | -2%˄ || 2.07 | 2.12 | +2%˄ | (run time too short) |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
+| Sum || 36542.26 | 32375.04 | -11% || | | | |
+| Geomean || | | || | | +6% | |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+----------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCH - single-threaded, SF 0.01 Sum of avg. item runtimes: +0% || Geometric mean of throughput changes: -0%Configuration Overview - click to expand +Configuration Overview----+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCH_0bcfa0250faed47181d2591d19daefc98bfcd5a4_st_s01.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCH_bb1319be18bfe505d05247307f454accd4e27f5d_st_s01.json |
+--------------------------+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4-dirty | bb1319be18bfe505d05247307f454accd4e27f5d-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 12:21:50 | 2025-06-07 21:10:55 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 0.009999999776482582 | 0.009999999776482582 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+--------------------------+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+ +----------++----------+---------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+----------++----------+---------+--------++----------+----------+--------+----------------------+
| TPC-H 01 || 5.24 | 5.43 | +4%˄ || 190.64 | 184.04 | -3%˄ | (run time too short) |
-| TPC-H 02 || 3.19 | 3.63 | +14%˄ || 313.71 | 275.15 | -12%˄ | (run time too short) |
+| TPC-H 03 || 0.58 | 0.55 | -4%˄ || 1721.40 | 1800.37 | +5%˄ | (run time too short) |
| TPC-H 04 || 0.37 | 0.36 | -4%˄ || 2675.72 | 2779.99 | +4%˄ | (run time too short) |
| TPC-H 05 || 0.95 | 0.96 | +1%˄ || 1050.28 | 1040.76 | -1%˄ | (run time too short) |
-| TPC-H 06 || 0.19 | 0.21 | +8%˄ || 5138.39 | 4777.02 | -7%˄ | (run time too short) |
+| TPC-H 07 || 9.60 | 9.09 | -5%˄ || 104.11 | 109.98 | +6%˄ | (run time too short) |
| TPC-H 08 || 12.91 | 13.48 | +4%˄ || 77.45 | 74.17 | -4%˄ | (run time too short) |
+| TPC-H 09 || 3.96 | 3.71 | -6%˄ || 252.38 | 269.32 | +7%˄ | (run time too short) |
| TPC-H 10 || 0.70 | 0.69 | -1%˄ || 1434.57 | 1456.20 | +2%˄ | (run time too short) |
| TPC-H 11 || 0.17 | 0.17 | -0%˄ || 5771.75 | 5788.91 | +0%˄ | (run time too short) |
| TPC-H 12 || 0.62 | 0.61 | -1%˄ || 1615.42 | 1628.40 | +1%˄ | (run time too short) |
+| TPC-H 13 || 2.15 | 1.99 | -7%˄ || 465.29 | 501.25 | +8%˄ | (run time too short) |
-| TPC-H 14 || 0.29 | 0.31 | +7%˄ || 3401.75 | 3179.79 | -7%˄ | (run time too short) |
| TPC-H 15 || 1.07 | 1.11 | +4%˄ || 929.03 | 895.67 | -4%˄ | (run time too short) |
| TPC-H 16 || 1.92 | 1.93 | +1%˄ || 520.95 | 517.19 | -1%˄ | (run time too short) |
-| TPC-H 17 || 0.46 | 0.56 | +23%˄ || 2178.75 | 1774.29 | -19%˄ | (run time too short) |
+| TPC-H 18 || 1.32 | 1.12 | -15%˄ || 758.50 | 888.77 | +17%˄ | (run time too short) |
| TPC-H 19 || 4.51 | 4.54 | +1%˄ || 221.63 | 220.35 | -1%˄ | (run time too short) |
| TPC-H 20 || 2.38 | 2.39 | +0%˄ || 420.72 | 418.86 | -0%˄ | (run time too short) |
+| TPC-H 21 || 1.11 | 0.99 | -10%˄ || 901.66 | 1007.09 | +12%˄ | (run time too short) |
| TPC-H 22 || 1.06 | 1.09 | +2%˄ || 939.30 | 917.80 | -2%˄ | (run time too short) |
+----------++----------+---------+--------++----------+----------+--------+----------------------+
| Sum || 54.76 | 54.95 | +0% || | | | |
| Geomean || | | || | | -0% | |
+----------++----------+---------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+----------++----------+---------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCH - multi-threaded, ordered, 1 client, 64 cores, SF 10.0 Sum of avg. item runtimes: -14% || Geometric mean of throughput changes: +7%Configuration Overview - click to expand +Configuration Overview---------+----------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCH_0bcfa0250faed47181d2591d19daefc98bfcd5a4_mt_ordered.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCH_bb1319be18bfe505d05247307f454accd4e27f5d_mt_ordered.json |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4-dirty | bb1319be18bfe505d05247307f454accd4e27f5d-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 12:22:17 | 2025-06-07 21:11:20 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------+ +----------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| TPC-H 01 || 4647.84 | 4703.09 | +1% || 0.20 | 0.20 | +0% | (run time too short) |
+| TPC-H 02 || 58.37 | 52.45 | -10%˄ || 17.12 | 19.05 | +11%˄ | (run time too short) |
| TPC-H 03 || 664.16 | 641.87 | -3%˄ || 1.51 | 1.56 | +3%˄ | (run time too short) |
| TPC-H 04 || 653.10 | 631.45 | -3%˄ || 1.53 | 1.58 | +3%˄ | (run time too short) |
+| TPC-H 05 || 614.53 | 570.93 | -7%˄ || 1.63 | 1.75 | +8%˄ | (run time too short) |
| TPC-H 06 || 64.23 | 63.12 | -2%˄ || 15.56 | 15.83 | +2%˄ | (run time too short) |
| TPC-H 07 || 248.96 | 245.00 | -2%˄ || 4.02 | 4.08 | +2%˄ | (run time too short) |
| TPC-H 08 || 234.85 | 224.88 | -4%˄ || 4.26 | 4.45 | +4%˄ | (run time too short) |
+| TPC-H 09 || 2207.70 | 2107.66 | -5% || 0.45 | 0.47 | +4% | 0.0000 |
+| TPC-H 10 || 643.54 | 597.84 | -7%˄ || 1.55 | 1.67 | +8%˄ | (run time too short) |
| TPC-H 11 || 88.09 | 88.34 | +0%˄ || 11.35 | 11.32 | -0%˄ | (run time too short) |
+| TPC-H 12 || 502.42 | 452.94 | -10%˄ || 1.99 | 2.21 | +11%˄ | (run time too short) |
+| TPC-H 13 || 3827.23 | 1659.33 | -57% || 0.25 | 0.60 | +140% | (run time too short) |
| TPC-H 14 || 150.42 | 149.73 | -0%˄ || 6.65 | 6.68 | +0%˄ | (run time too short) |
+| TPC-H 15 || 147.53 | 140.74 | -5%˄ || 6.78 | 7.10 | +5%˄ | (run time too short) |
| TPC-H 16 || 580.92 | 562.54 | -3%˄ || 1.72 | 1.78 | +3%˄ | (run time too short) |
| TPC-H 17 || 88.43 | 88.19 | -0%˄ || 11.30 | 11.33 | +0%˄ | (run time too short) |
| TPC-H 18 || 1745.15 | 1715.68 | -2% || 0.57 | 0.57 | +0% | (run time too short) |
-| TPC-H 19 || 109.64 | 114.84 | +5%˄ || 9.12 | 8.70 | -5%˄ | (run time too short) |
| TPC-H 20 || 193.82 | 190.73 | -2%˄ || 5.16 | 5.24 | +2%˄ | (run time too short) |
+| TPC-H 21 || 1120.78 | 1050.39 | -6%˄ || 0.89 | 0.95 | +7%˄ | (run time too short) |
| TPC-H 22 || 161.23 | 158.49 | -2%˄ || 6.20 | 6.31 | +2%˄ | (run time too short) |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
+| Sum || 18752.92 | 16210.21 | -14% || | | | |
+| Geomean || | | || | | +7% | |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+----------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCH - multi-threaded, shuffled, 64 clients, 64 cores, SF 10.0 Sum of avg. item runtimes: -6% || Geometric mean of throughput changes: +7%Configuration Overview - click to expand +Configuration Overview---------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCH_0bcfa0250faed47181d2591d19daefc98bfcd5a4_mt.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCH_bb1319be18bfe505d05247307f454accd4e27f5d_mt.json |
+-------------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4-dirty | bb1319be18bfe505d05247307f454accd4e27f5d-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| clustering | None | None |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 12:34:06 | 2025-06-07 21:22:41 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+ +----------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+----------++----------+----------+--------++----------+----------+--------+---------+
+| TPC-H 01 || 6094.00 | 6284.39 | +3% || 1.03 | 1.10 | +7% | 0.0080 |
+| TPC-H 02 || 470.12 | 359.32 | -24% || 1.04 | 1.11 | +7% | 0.0249 |
+| TPC-H 03 || 2815.11 | 2580.15 | -8% || 1.04 | 1.11 | +7% | 0.0484 |
+| TPC-H 04 || 2293.11 | 2325.71 | +1% || 1.04 | 1.11 | +7% | 0.7812 |
+| TPC-H 05 || 4194.02 | 4155.34 | -1% || 1.03 | 1.11 | +7% | 0.8092 |
+| TPC-H 06 || 784.96 | 984.84 | +25% || 1.04 | 1.11 | +7% | 0.0185 |
+| TPC-H 07 || 3379.16 | 3384.25 | +0% || 1.03 | 1.11 | +7% | 0.9752 |
+| TPC-H 08 || 2547.08 | 2468.28 | -3% || 1.03 | 1.11 | +7% | 0.5774 |
+| TPC-H 09 || 6472.87 | 6124.44 | -5% || 1.03 | 1.10 | +7% | 0.0383 |
+| TPC-H 10 || 3425.93 | 3511.77 | +3% || 1.03 | 1.11 | +7% | 0.5618 |
+| TPC-H 11 || 494.08 | 444.16 | -10% || 1.04 | 1.11 | +7% | 0.3060 |
+| TPC-H 12 || 2681.55 | 2492.97 | -7% || 1.03 | 1.11 | +7% | 0.1143 |
+| TPC-H 13 || 7630.22 | 3936.30 | -48% || 1.03 | 1.11 | +7% | 0.0000 |
+| TPC-H 14 || 1096.15 | 1201.42 | +10% || 1.04 | 1.11 | +7% | 0.1802 |
+| TPC-H 15 || 682.01 | 687.13 | +1% || 1.04 | 1.11 | +7% | 0.9261 |
+| TPC-H 16 || 2536.14 | 2264.70 | -11% || 1.04 | 1.11 | +7% | 0.0268 |
+| TPC-H 17 || 850.76 | 796.69 | -6% || 1.04 | 1.11 | +7% | 0.4517 |
+| TPC-H 18 || 3630.39 | 3678.23 | +1% || 1.03 | 1.11 | +7% | 0.5888 |
+| TPC-H 19 || 1140.60 | 1213.60 | +6% || 1.03 | 1.11 | +7% | 0.4186 |
+| TPC-H 20 || 1760.96 | 1723.68 | -2% || 1.04 | 1.11 | +7% | 0.7259 |
+| TPC-H 21 || 5284.28 | 5513.32 | +4% || 1.03 | 1.10 | +7% | 0.2060 |
+| TPC-H 22 || 1110.97 | 1255.25 | +13% || 1.04 | 1.11 | +7% | 0.1168 |
+----------++----------+----------+--------++----------+----------+--------+---------+
+| Sum || 61374.47 | 57385.95 | -6% || | | | |
+| Geomean || | | || | | +7% | |
+----------++----------+----------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCDS - single-threaded Sum of avg. item runtimes: -10% || Geometric mean of throughput changes: +8%Configuration Overview - click to expand +Configuration Overview---+---------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCDS_0bcfa0250faed47181d2591d19daefc98bfcd5a4_st.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCDS_bb1319be18bfe505d05247307f454accd4e27f5d_st.json |
+-------------------------+---------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4-dirty | bb1319be18bfe505d05247307f454accd4e27f5d-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 12:55:34 | 2025-06-07 21:44:08 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+---------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| 01 || 224.59 | 222.10 | -1%˄ || 4.45 | 4.50 | +1%˄ | (run time too short) |
+| 03 || 62.68 | 36.88 | -41%˄ || 15.95 | 27.11 | +70%˄ | (run time too short) |
+| 06 || 198.18 | 164.80 | -17%˄ || 5.05 | 6.07 | +20%˄ | (run time too short) |
-| 07 || 253.36 | 265.51 | +5%˄ || 3.95 | 3.77 | -5%˄ | (run time too short) |
| 09 || 720.91 | 739.21 | +3%˄ || 1.39 | 1.35 | -2%˄ | (run time too short) |
| 10 || 120.63 | 122.88 | +2%˄ || 8.29 | 8.14 | -2%˄ | (run time too short) |
-| 13 || 464.50 | 496.34 | +7%˄ || 2.15 | 2.01 | -6%˄ | (run time too short) |
| 15 || 124.21 | 122.54 | -1%˄ || 8.05 | 8.16 | +1%˄ | (run time too short) |
| 16 || 55.91 | 56.79 | +2%˄ || 17.88 | 17.61 | -2%˄ | (run time too short) |
+| 17 || 323.16 | 268.58 | -17%˄ || 3.09 | 3.72 | +20%˄ | (run time too short) |
+| 19 || 97.81 | 88.35 | -10%˄ || 10.22 | 11.32 | +11%˄ | (run time too short) |
+| 25 || 167.80 | 147.03 | -12%˄ || 5.96 | 6.80 | +14%˄ | (run time too short) |
-| 26 || 114.68 | 121.58 | +6%˄ || 8.72 | 8.23 | -6%˄ | (run time too short) |
| 28 || 574.95 | 578.27 | +1%˄ || 1.74 | 1.73 | -1%˄ | (run time too short) |
+| 29 || 484.05 | 420.00 | -13%˄ || 2.07 | 2.38 | +15%˄ | (run time too short) |
| 31 || 1316.64 | 1314.16 | -0% || 0.75 | 0.75 | +0% | 0.1813 |
| 32 || 30.32 | 29.96 | -1%˄ || 32.98 | 33.37 | +1%˄ | (run time too short) |
| 34 || 140.58 | 146.01 | +4%˄ || 7.11 | 6.85 | -4%˄ | (run time too short) |
| 35 || 604.65 | 597.22 | -1%˄ || 1.65 | 1.67 | +1%˄ | (run time too short) |
| 37 || 653.81 | 670.65 | +3%˄ || 1.53 | 1.49 | -3%˄ | (run time too short) |
| 39a || 1704.00 | 1664.12 | -2% || 0.58 | 0.60 | +3% | 0.0000 |
| 39b || 1682.21 | 1632.37 | -3% || 0.58 | 0.60 | +3% | (run time too short) |
| 41 || 281.49 | 280.70 | -0%˄ || 3.55 | 3.56 | +0%˄ | (run time too short) |
+| 42 || 78.54 | 67.31 | -14%˄ || 12.73 | 14.86 | +17%˄ | (run time too short) |
| 43 || 974.60 | 988.07 | +1%˄ || 1.03 | 1.01 | -1%˄ | (run time too short) |
+| 45 || 126.38 | 103.64 | -18%˄ || 7.91 | 9.65 | +22%˄ | (run time too short) |
| 48 || 1164.93 | 1180.49 | +1%˄ || 0.86 | 0.85 | -1%˄ | (run time too short) |
+| 50 || 125.44 | 106.95 | -15%˄ || 7.97 | 9.35 | +17%˄ | (run time too short) |
+| 52 || 79.38 | 67.60 | -15%˄ || 12.60 | 14.79 | +17%˄ | (run time too short) |
+| 55 || 74.51 | 62.70 | -16%˄ || 13.42 | 15.95 | +19%˄ | (run time too short) |
| 62 || 554.59 | 548.22 | -1%˄ || 1.80 | 1.82 | +1%˄ | (run time too short) |
+| 65 || 1924.75 | 1799.48 | -7% || 0.52 | 0.55 | +6% | 0.0000 |
| 69 || 139.66 | 136.04 | -3%˄ || 7.16 | 7.35 | +3%˄ | (run time too short) |
| 73 || 77.37 | 75.87 | -2%˄ || 12.92 | 13.18 | +2%˄ | (run time too short) |
| 79 || 491.32 | 485.48 | -1%˄ || 2.04 | 2.06 | +1%˄ | (run time too short) |
| 81 || 155.98 | 151.09 | -3%˄ || 6.41 | 6.62 | +3%˄ | (run time too short) |
| 82 || 700.59 | 695.77 | -1%˄ || 1.43 | 1.44 | +1%˄ | (run time too short) |
+| 83 || 38.43 | 36.70 | -4%˄ || 26.02 | 27.25 | +5%˄ | (run time too short) |
+| 84 || 13.88 | 13.16 | -5%˄ || 72.03 | 75.96 | +5%˄ | (run time too short) |
| 85 || 161.74 | 158.45 | -2%˄ || 6.18 | 6.31 | +2%˄ | (run time too short) |
| 88 || 638.78 | 629.95 | -1%˄ || 1.57 | 1.59 | +1%˄ | (run time too short) |
+| 91 || 17.79 | 16.59 | -7%˄ || 56.21 | 60.26 | +7%˄ | (run time too short) |
+| 92 || 35.59 | 26.82 | -25%˄ || 28.09 | 37.27 | +33%˄ | (run time too short) |
+| 93 || 3751.76 | 2151.30 | -43% || 0.25 | 0.45 | +80% | (run time too short) |
+| 94 || 35.40 | 33.33 | -6%˄ || 28.25 | 30.00 | +6%˄
10000
| (run time too short) |
+| 95 || 5159.89 | 4636.60 | -10% || 0.18 | 0.20 | +9% | (run time too short) |
| 96 || 60.98 | 58.90 | -3%˄ || 16.40 | 16.98 | +4%˄ | (run time too short) |
+| 97 || 4040.15 | 3295.49 | -18% || 0.23 | 0.30 | +29% | (run time too short) |
| 99 || 1085.28 | 1079.93 | -0%˄ || 0.92 | 0.93 | +0%˄ | (run time too short) |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
+| Sum || 32108.83 | 28791.96 | -10% || | | | |
+| Geomean || | | || | | +8% | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCDS - multi-threaded, ordered, 1 client, 64 cores Sum of avg. item runtimes: -5% || Geometric mean of throughput changes: +4%Configuration Overview - click to expand +Configuration Overview---------+-----------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCDS_0bcfa0250faed47181d2591d19daefc98bfcd5a4_mt_ordered.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCDS_bb1319be18bfe505d05247307f454accd4e27f5d_mt_ordered.json |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4-dirty | bb1319be18bfe505d05247307f454accd4e27f5d-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 13:16:21 | 2025-06-07 22:02:53 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| 01 || 241.09 | 237.85 | -1%˄ || 4.15 | 4.20 | +1%˄ | (run time too short) |
+| 03 || 33.52 | 29.79 | -11%˄ || 29.80 | 33.53 | +13%˄ | (run time too short) |
+| 06 || 192.36 | 163.10 | -15%˄ || 5.20 | 6.13 | +18%˄ | (run time too short) |
| 07 || 191.04 | 190.21 | -0%˄ || 5.23 | 5.26 | +0%˄ | (run time too short) |
| 09 || 112.75 | 113.07 | +0%˄ || 8.87 | 8.84 | -0%˄ | (run time too short) |
| 10 || 36.49 | 36.19 | -1%˄ || 27.37 | 27.60 | +1%˄ | (run time too short) |
| 13 || 257.93 | 259.09 | +0%˄ || 3.88 | 3.86 | -0%˄ | (run time too short) |
| 15 || 75.62 | 74.18 | -2%˄ || 13.22 | 13.47 | +2%˄ | (run time too short) |
| 16 || 30.90 | 31.01 | +0%˄ || 32.32 | 32.21 | -0%˄ | (run time too short) |
+| 17 || 143.10 | 115.89 | -19%˄ || 6.99 | 8.63 | +23%˄ | (run time too short) |
| 19 || 68.54 | 68.72 | +0%˄ || 14.58 | 14.54 | -0%˄ | (run time too short) |
+| 25 || 102.63 | 89.35 | -13%˄ || 9.74 | 11.19 | +15%˄ | (run time too short) |
-| 26 || 87.87 | 93.96 | +7%˄ || 11.38 | 10.64 | -6%˄ | (run time too short) |
| 28 || 147.32 | 145.42 | -1%˄ || 6.79 | 6.87 | +1%˄ | (run time too short) |
+| 29 || 458.69 | 401.61 | -12%˄ || 2.18 | 2.49 | +14%˄ | (run time too short) |
| 31 || 477.48 | 472.38 | -1%˄ || 2.09 | 2.12 | +1%˄ | (run time too short) |
+| 32 || 34.03 | 32.39 | -5%˄ || 29.35 | 30.84 | +5%˄ | (run time too short) |
| 34 || 94.61 | 93.65 | -1%˄ || 10.57 | 10.67 | +1%˄ | (run time too short) |
| 35 || 388.22 | 380.87 | -2%˄ || 2.58 | 2.63 | +2%˄ | (run time too short) |
| 37 || 197.37 | 189.86 | -4%˄ || 5.07 | 5.27 | +4%˄ | (run time too short) |
| 39a || 767.67 | 745.41 | -3%˄ || 1.30 | 1.34 | +3%˄ | (run time too short) |
+| 39b || 744.15 | 711.09 | -4%˄ || 1.34 | 1.41 | +5%˄ | (run time too short) |
| 41 || 365.65 | 361.35 | -1%˄ || 2.73 | 2.77 | +1%˄ | (run time too short) |
| 42 || 49.54 | 49.30 | -0%˄ || 20.17 | 20.27 | +1%˄ | (run time too short) |
| 43 || 446.83 | 446.26 | -0%˄ || 2.24 | 2.24 | +0%˄ | (run time too short) |
| 45 || 54.19 | 53.16 | -2%˄ || 18.44 | 18.80 | +2%˄ | (run time too short) |
| 48 || 536.30 | 530.34 | -1%˄ || 1.86 | 1.89 | +1%˄ | (run time too short) |
-| 50 || 102.96 | 108.31 | +5%˄ || 9.71 | 9.23 | -5%˄ | (run time too short) |
| 52 || 51.71 | 51.44 | -1%˄ || 19.33 | 19.43 | +1%˄ | (run time too short) |
| 55 || 44.58 | 44.74 | +0%˄ || 22.41 | 22.33 | -0%˄ | (run time too short) |
| 62 || 348.42 | 342.73 | -2%˄ || 2.87 | 2.92 | +2%˄ | (run time too short) |
| 65 || 1487.32 | 1462.21 | -2% || 0.67 | 0.68 | +3% | 0.0006 |
| 69 || 71.95 | 69.98 | -3%˄ || 13.89 | 14.28 | +3%˄ | (run time too short) |
| 73 || 54.34 | 53.90 | -1%˄ || 18.39 | 18.54 | +1%˄ | (run time too short) |
| 79 || 482.39 | 479.31 | -1%˄ || 2.07 | 2.09 | +1%˄ | (run time too short) |
| 81 || 192.05 | 186.00 | -3%˄ || 5.21 | 5.38 | +3%˄ | (run time too short) |
| 82 || 224.64 | 221.89 | -1%˄ || 4.45 | 4.51 | +1%˄ | (run time too short) |
+| 83 || 46.69 | 44.36 | -5%˄ || 21.40 | 22.52 | +5%˄ | (run time too short) |
| 84 || 10.09 | 9.95 | -1%˄ || 98.82 | 100.25 | +1%˄ | (run time too short) |
| 85 || 71.04 | 68.68 | -3%˄ || 14.07 | 14.55 | +3%˄ | (run time too short) |
-| 88 || 82.46 | 88.08 | +7%˄ || 12.12 | 11.35 | -6%˄ | (run time too short) |
+| 91 || 18.25 | 17.28 | -5%˄ || 54.68 | 57.76 | +6%˄ | (run time too short) |
+| 92 || 43.78 | 38.26 | -13%˄ || 22.82 | 26.11 | +14%˄ | (run time too short) |
+| 93 || 753.37 | 521.32 | -31%˄ || 1.33 | 1.92 | +45%˄ | (run time too short) |
| 94 || 30.53 | 31.42 | +3%˄ || 32.71 | 31.80 | -3%˄ | (run time too short) |
| 95 || 712.51 | 683.62 | -4%˄ || 1.40 | 1.46 | +4%˄ | (run time too short) |
| 96 || 46.38 | 44.65 | -4%˄ || 21.54 | 22.38 | +4%˄ | (run time too short) |
+| 97 || 1373.25 | 1275.50 | -7% || 0.72 | 0.78 | +9% | 0.0000 |
| 99 || 574.74 | 579.78 | +1%˄ || 1.74 | 1.72 | -1%˄ | (run time too short) |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
+| Sum || 13159.36 | 12538.91 | -5% || | | | |
| Geomean || | | || | | +4% | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCDS - multi-threaded, shuffled, 64 clients, 64 cores Sum of avg. item runtimes: -2% || Geometric mean of throughput changes: +2%Configuration Overview - click to expand +Configuration Overview---------+---------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCDS_0bcfa0250faed47181d2591d19daefc98bfcd5a4_mt.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCDS_bb1319be18bfe505d05247307f454accd4e27f5d_mt.json |
+-------------------------------+---------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4-dirty | bb1319be18bfe505d05247307f454accd4e27f5d-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 13:28:30 | 2025-06-07 22:14:28 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+---------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+---------+
| 01 || 857.64 | 847.24 | -1% || 1.00 | 1.02 | +2% | 0.8538 |
| 03 || 302.59 | 297.52 | -2% || 1.00 | 1.02 | +2% | 0.8786 |
+| 06 || 933.97 | 792.85 | -15% || 1.00 | 1.02 | +2% | 0.0158 |
+| 07 || 1070.54 | 996.35 | -7% || 1.00 | 1.02 | +2% | 0.2563 |
-| 09 || 892.05 | 957.18 | +7% || 1.00 | 1.02 | +2% | 0.3028 |
| 10 || 810.43 | 826.01 | +2% || 1.00 | 1.02 | +2% | 0.8128 |
| 13 || 1758.12 | 1776.95 | +1% || 1.00 | 1.02 | +2% | 0.8090 |
| 15 || 529.36 | 510.32 | -4% || 1.00 | 1.02 | +2% | 0.6744 |
+| 16 || 505.42 | 407.86 | -19% || 1.00 | 1.02 | +2% | 0.0289 |
| 17 || 1456.84 | 1404.28 | -4% || 1.00 | 1.02 | +2% | 0.5135 |
| 19 || 684.03 | 680.00 | -1% || 1.00 | 1.02 | +2% | 0.9351 |
+| 25 || 1067.12 | 983.63 | -8% || 1.00 | 1.02 | +2% | 0.1949 |
| 26 || 517.34 | 515.83 | -0% || 1.00 | 1.02 | +2% | 0.9688 |
| 28 || 1513.45 | 1573.08 | +4% || 1.00 | 1.02 | +2% | 0.4883 |
| 29 || 1867.95 | 1788.18 | -4% || 1.00 | 1.02 | +2% | 0.3249 |
| 31 || 2665.98 | 2723.46 | +2% || 1.00 | 1.02 | +2% | 0.6027 |
-| 32 || 188.89 | 200.93 | +6% || 1.00 | 1.02 | +2% | 0.6462 |
+| 34 || 793.81 | 726.92 | -8% || 1.00 | 1.02 | +2% | 0.1648 |
| 35 || 2277.05 | 2195.45 | -4% || 1.00 | 1.02 | +2% | 0.3665 |
+| 37 || 958.69 | 890.68 | -7% || 1.00 | 1.02 | +2% | 0.2227 |
-| 39a || 2877.21 | 3083.38 | +7% || 1.00 | 1.02 | +2% | 0.0228 |
| 39b || 2838.66 | 2937.02 | +3% || 1.00 | 1.02 | +2% | 0.2287 |
+| 41 || 2118.50 | 1883.83 | -11% || 1.00 | 1.02 | +2% | 0.0121 |
+| 42 || 549.85 | 438.34 | -20% || 1.00 | 1.02 | +2% | 0.0052 |
+| 43 || 1634.02 | 1485.81 | -9% || 1.00 | 1.02 | +2% | 0.0252 |
+| 45 || 832.95 | 769.30 | -8% || 1.00 | 1.02 | +2% | 0.3034 |
| 48 || 2839.71 | 2897.14 | +2% || 1.00 | 1.02 | +2% | 0.5878 |
+| 50 || 1125.65 | 1024.35 | -9% || 1.00 | 1.02 | +2% | 0.0954 |
+| 52 || 561.00 | 461.64 | -18% || 1.00 | 1.02 | +2% | 0.0264 |
| 55 || 454.83 | 452.93 | -0% || 1.00 | 1.02 | +2% | 0.9574 |
-| 62 || 1040.44 | 1113.33 | +7% || 1.00 | 1.02 | +2% | 0.1336 |
-| 65 || 4417.71 | 4643.03 | +5% || 1.00 | 1.02 | +2% | 0.0023 |
| 69 || 1045.11 | 1080.23 | +3% || 1.00 | 1.02 | +2% | 0.6346 |
+| 73 || 591.78 | 530.01 | -10% || 1.00 | 1.02 | +2% | 0.1812 |
| 79 || 1648.38 | 1625.83 | -1% || 1.00 | 1.02 | +2% | 0.7433 |
| 81 || 619.10 | 634.51 | +2% || 1.00 | 1.02 | +2% | 0.6921 |
-| 82 || 1013.07 | 1060.78 | +5% || 1.00 | 1.02 | +2% | 0.4252 |
+| 83 || 349.02 | 293.21 | -16% || 1.00 | 1.02 | +2% | 0.1176 |
| 84 || 131.22 | 134.47 | +2% || 1.00 | 1.02 | +2% | 0.8905 |
+| 85 || 898.51 | 788.31 | -12% || 1.00 | 1.02 | +2% | 0.0516 |
| 88 || 2663.77 | 2639.66 | -1% || 1.00 | 1.02 | +2% | 0.8355 |
+| 91 || 214.04 | 190.28 | -11% || 1.00 | 1.02 | +2% | 0.4277 |
+| 92 || 287.15 | 232.01 | -19% || 1.00 | 1.02 | +2% | 0.0416 |
+| 93 || 2283.35 | 1709.61 | -25% || 1.00 | 1.02 | +2% | 0.0000 |
+| 94 || 470.70 | 423.36 | -10% || 1.00 | 1.02 | +2% | 0.3231 |
-| 95 || 2204.25 | 2310.13 | +5% || 1.00 | 1.02 | +2% | 0.1891 |
-| 96 || 416.60 | 442.31 | +6% || 1.00 | 1.02 | +2% | 0.4836 |
| 97 || 4515.32 | 4503.45 | -0% || 1.00 | 1.02 | +2% | 0.9093 |
| 99 || 1444.88 | 1427.48 | -1% || 1.00 | 1.02 | +2% | 0.7545 |
+---------++----------+----------+--------++----------+----------+--------+---------+
| Sum || 63738.05 | 62310.45 | -2% || | | | |
| Geomean || | | || | | +2% | |
+---------++----------+----------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCC - single-threaded Sum of avg. item runtimes: +2% || Geometric mean of throughput changes: -1%Configuration Overview - click to expand +Configuration Overview---+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCC_0bcfa0250faed47181d2591d19daefc98bfcd5a4_st.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCC_bb1319be18bfe505d05247307f454accd4e27f5d_st.json |
+-------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4-dirty | bb1319be18bfe505d05247307f454accd4e27f5d-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 13:48:45 | 2025-06-07 22:34:44 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10 | 10 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+ +--------------++----------+---------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+--------------++----------+---------+--------++----------+----------+--------+---------+
| Delivery || 25.50 | 26.14 | +3% || 4.85 | 5.05 | +4% | 0.0000 |
| New-Order || 12.07 | 12.21 | +1% || 60.41 | 59.34 | -2% | 0.0959 |
-| Order-Status || 1.16 | 1.18 | +2% || 5.46 | 5.08 | -7% | 0.0168 |
| Payment || 2.20 | 2.19 | -0% || 58.26 | 56.97 | -2% | 0.3168 |
| Stock-Level || 1.93 | 1.87 | -3% || 5.18 | 5.30 | +2% | 0.0005 |
+--------------++----------+---------+--------++----------+----------+--------+---------+
| Sum || 42.85 | 43.59 | +2% || | | | |
| Geomean || | | || | | -1% | |
+--------------++----------+---------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCC - multi-threaded, shuffled, 64 clients, 10 warehouses, 64 cores (high contention) Sum of avg. item runtimes: -1% || Geometric mean of throughput changes: +1%Configuration Overview - click to expand +Configuration Overview---------+-----------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCC_0bcfa0250faed47181d2591d19daefc98bfcd5a4_mt_highcont.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCC_bb1319be18bfe505d05247307f454accd4e27f5d_mt_highcont.json |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4-dirty | bb1319be18bfe505d05247307f454accd4e27f5d-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 13:56:23 | 2025-06-07 22:42:41 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 600000000000 | 600000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10 | 10 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------+ +--------------++----------+---------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+--------------++----------+---------+--------++----------+----------+--------+---------+
| Delivery || 181.26 | 178.95 | -1% || 33.75 | 34.15 | +1% | 0.0012 |
| unsucc.: || 3.31 | 3.49 | +6% || 50.88 | 52.02 | +2% | |
| New-Order || 93.42 | 91.99 | -2% || 471.42 | 477.73 | +1% | 0.0000 |
| unsucc.: || 8.90 | 8.83 | -1% || 476.66 | 483.92 | +2% | |
| Order-Status || 9.53 | 9.48 | -1% || 85.20 | 86.13 | +1% | 0.6632 |
| Payment || 15.67 | 15.54 | -1% || 239.31 | 241.44 | +1% | 0.0466 |
| unsucc.: || 5.48 | 5.41 | -1% || 665.74 | 678.92 | +2% | |
| Stock-Level || 13.87 | 13.79 | -1% || 83.49 | 85.23 | +2% | 0.6212 |
+--------------++----------+---------+--------++----------+----------+--------+---------+
| Sum || 313.75 | 309.74 | -1% || | | | |
| Geomean || | | || | | +1% | |
+--------------++----------+---------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCC - multi-threaded, shuffled, 10 clients, 10 warehouses, 64 cores (low contention) Sum of avg. item runtimes: -0% || Geometric mean of throughput changes: -0%Configuration Overview - click to expand +Configuration Overview---------+----------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCC_0bcfa0250faed47181d2591d19daefc98bfcd5a4_mt_lowcont.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCC_bb1319be18bfe505d05247307f454accd4e27f5d_mt_lowcont.json |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4-dirty | bb1319be18bfe505d05247307f454accd4e27f5d-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 10 | 10 |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 14:06:35 | 2025-06-07 22:52:53 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 600000000000 | 600000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10 | 10 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------+ +--------------++----------+---------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+--------------++----------+---------+--------++----------+----------+--------+---------+
| Delivery || 75.34 | 75.17 | -0% || 16.40 | 16.55 | +1% | 0.0385 |
| unsucc.: || 0.85 | 0.90 | +6% || 2.12 | 2.08 | -2% | |
| New-Order || 37.40 | 37.56 | +0% || 190.10 | 190.23 | +0% | 0.0009 |
| unsucc.: || 3.55 | 3.01 | -15% || 18.28 | 17.70 | -3% | |
| Order-Status || 4.29 | 4.16 | -3% || 18.60 | 18.21 | -2% | 0.0000 |
| Payment || 8.11 | 7.96 | -2% || 162.49 | 162.37 | -0% | 0.0000 |
| unsucc.: || 2.04 | 2.03 | -0% || 36.34 | 36.46 | +0% | |
| Stock-Level || 5.56 | 5.54 | -0% || 18.45 | 18.56 | +1% | 0.0638 |
+--------------++----------+---------+--------++----------+----------+--------+---------+
| Sum || 130.70 | 130.38 | -0% || | | | |
| Geomean || | | || | | -0% | |
+--------------++----------+---------+--------++----------+----------+--------+---------+hyriseBenchmarkJoinOrder - single-threaded Sum of avg. item runtimes: -8% || Geometric mean of throughput changes: +14%Configuration Overview - click to expand +Configuration Overview---+-------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkJoinOrder_0bcfa0250faed47181d2591d19daefc98bfcd5a4_st.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkJoinOrder_bb1319be18bfe505d05247307f454accd4e27f5d_st.json |
+-------------------------+-------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4-dirty | bb1319be18bfe505d05247307f454accd4e27f5d-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 14:16:42 | 2025-06-07 23:03:00 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+-------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
+| 10a || 156.28 | 102.03 | -35%˄ || 6.40 | 9.80 | +53%˄ | (run time too short) |
+| 10b || 94.97 | 58.48 | -38%˄ || 10.53 | 17.10 | +62%˄ | (run time too short) |
+| 10c || 359.64 | 320.71 | -11%˄ || 2.78 | 3.12 | +12%˄ | (run time too short) |
+| 11a || 29.57 | 26.69 | -10%˄ || 33.81 | 37.46 | +11%˄ | (run time too short) |
| 11b || 25.70 | 25.24 | -2%˄ || 38.90 | 39.61 | +2%˄ | (run time too short) |
+| 11c || 24.61 | 21.13 | -14%˄ || 40.64 | 47.33 | +16%˄ | (run time too short) |
+| 11d || 23.54 | 19.93 | -15%˄ || 42.48 | 50.16 | +18%˄ | (run time too short) |
+| 12a || 31.96 | 29.55 | -8%˄ || 31.28 | 33.84 | +8%˄ | (run time too short) |
+| 12b || 27.71 | 24.08 | -13%˄ || 36.09 | 41.53 | +15%˄ | (run time too short) |
+| 12c || 74.30 | 69.18 | -7%˄ || 13.46 | 14.45 | +7%˄ | (run time too short) |
+| 13a || 182.97 | 173.14 | -5%˄ || 5.47 | 5.78 | +6%˄ | (run time too short) |
| 13b || 236.04 | 230.52 | -2%˄ || 4.24 | 4.34 | +2%˄ | (run time too short) |
+| 13c || 32.07 | 30.46 | -5%˄ || 31.18 | 32.83 | +5%˄ | (run time too short) |
| 13d || 532.31 | 513.74 | -3%˄ || 1.88 | 1.95 | +4%˄ | (run time too short) |
+| 14a || 103.47 | 95.56 | -8%˄ || 9.66 | 10.46 | +8%˄ | (run time too short) |
| 14b || 110.68 | 107.93 | -2%˄ || 9.03 | 9.26 | +3%˄ | (run time too short) |
+| 14c || 184.29 | 172.48 | -6%˄ || 5.43 | 5.80 | +7%˄ | (run time too short) |
+| 15a || 76.45 | 49.74 | -35%˄ || 13.08 | 20.10 | +54%˄ | (run time too short) |
+| 15b || 80.24 | 54.51 | -32%˄ || 12.46 | 18.34 | +47%˄ | (run time too short) |
+| 15c || 52.04 | 40.07 | -23%˄ || 19.21 | 24.96 | +30%˄ | (run time too short) |
+| 15d || 49.36 | 36.92 | -25%˄ || 20.26 | 27.08 | +34%˄ | (run time too short) |
+| 16a || 1445.42 | 1368.79 | -5% || 0.68 | 0.72 | +5% | (run time too short) |
+| 16b || 2709.47 | 2555.94 | -6% || 0.37 | 0.38 | +5% | (run time too short) |
+| 16c || 1621.40 | 1539.14 | -5% || 0.62 | 0.63 | +3% | (run time too short) |
+| 16d || 1575.46 | 1502.31 | -5% || 0.63 | 0.65 | +3% | (run time too short) |
| 17a || 462.60 | 442.73 | -4%˄ || 2.16 | 2.26 | +4%˄ | (run time too short) |
| 17b || 366.49 | 360.55 | -2%˄ || 2.73 | 2.77 | +2%˄ | (run time too short) |
| 17c || 345.77 | 340.67 | -1%˄ || 2.89 | 2.94 | +1%˄ | (run time too short) |
+| 17d || 428.13 | 403.16 | -6%˄ || 2.34 | 2.48 | +6%˄ | (run time too short) |
+| 17e || 1674.18 | 1587.92 | -5% || 0.58 | 0.62 | +6% | (run time too short) |
+| 17f || 946.83 | 890.55 | -6%˄ || 1.06 | 1.12 | +6%˄ | (run time too short) |
+| 18a || 143.70 | 126.35 | -12%˄ || 6.96 | 7.91 | +14%˄ | (run time too short) |
+| 18b || 107.32 | 99.80 | -7%˄ || 9.32 | 10.02 | +8%˄ | (run time too short) |
+| 18c || 199.17 | 184.21 | -8%˄ || 5.02 | 5.43 | +8%˄ | (run time too short) |
+| 19a || 221.40 | 199.33 | -10%˄ || 4.52 | 5.02 | +11%˄ | (run time too short) |
+| 19b || 192.93 | 166.58 | -14%˄ || 5.18 | 6.00 | +16%˄ | (run time too short) |
+| 19c || 266.70 | 239.94 | -10%˄ || 3.75 | 4.17 | +11%˄ | (run time too short) |
+| 19d || 749.25 | 708.12 | -5%˄ || 1.33 | 1.41 | +6%˄ | (run time too short) |
+| 1a || 10.27 | 7.03 | -32%˄ || 97.39 | 142.25 | +46%˄ | (run time too short) |
+| 1b || 16.44 | 13.62 | -17%˄ || 60.81 | 73.42 | +21%˄ | (run time too short) |
+| 1c || 21.63 | 14.96 | -31%˄ || 46.22 | 66.82 | +45%˄ | (run time too short) |
+| 1d || 9.47 | 6.43 | -32%˄ || 105.55 | 155.45 | +47%˄ | (run time too short) |
+| 20a || 554.43 | 507.47 | -8%˄ || 1.80 | 1.97 | +9%˄ | (run time too short) |
+| 20b || 602.99 | 544.04 | -10%˄ || 1.66 | 1.84 | +11%˄ | (run time too short) |
+| 20c || 435.79 | 359.32 | -18%˄ || 2.29 | 2.78 | +21%˄ | (run time too short) |
+| 21a || 44.65 | 40.62 | -9%˄ || 22.39 | 24.62 | +10%˄ | (run time too short) |
+| 21b || 34.60 | 31.08 | -10%˄ || 28.90 | 32.18 | +11%˄ | (run time too short) |
+| 21c || 40.86 | 36.82 | -10%˄ || 24.47 | 27.16 | +11%˄ | (run time too short) |
+| 22a || 184.53 | 163.84 | -11%˄ || 5.42 | 6.10 | +13%˄ | (run time too short) |
+| 22b || 167.60 | 146.29 | -13%˄ || 5.97 | 6.84 | +15%˄ | (run time too short) |
+| 22c || 250.95 | 224.35 | -11%˄ || 3.98 | 4.46 | +12%˄ | (run time too short) |
+| 22d || 366.64 | 348.15 | -5%˄ || 2.73 | 2.87 | +5%˄ | (run time too short) |
+| 23a || 55.36 | 43.23 | -22%˄ || 18.06 | 23.13 | +28%˄ | (run time too short) |
+| 23b || 60.46 | 50.84 | -16%˄ || 16.54 | 19.67 | +19%˄ | (run time too short) |
+| 23c || 58.79 | 45.93 | -22%˄ || 17.01 | 21.77 | +28%˄ | (run time too short) |
+| 24a || 219.28 | 200.15 | -9%˄ || 4.56 | 5.00 | +10%˄ | (run time too short) |
+| 24b || 203.05 | 185.53 | -9%˄ || 4.92 | 5.39 | +9%˄ | (run time too short) |
+| 25a || 104.68 | 94.92 | -9%˄ || 9.55 | 10.53 | +10%˄ | (run time too short) |
+| 25b || 64.12 | 60.82 | -5%˄ || 15.59 | 16.44 | +5%˄ | (run time too short) |
+| 25c || 241.92 | 224.06 | -7%˄ || 4.13 | 4.46 | +8%˄ | (run time too short) |
+| 26a || 170.91 | 160.66 | -6%˄ || 5.85 | 6.22 | +6%˄ | (run time too short) |
+| 26b || 142.08 | 130.89 | -8%˄ || 7.04 | 7.64 | +9%˄ | (ru
10000
n time too short) |
+| 26c || 320.37 | 303.66 | -5%˄ || 3.12 | 3.29 | +6%˄ | (run time too short) |
+| 27a || 37.56 | 34.06 | -9%˄ || 26.62 | 29.35 | +10%˄ | (run time too short) |
+| 27b || 26.49 | 24.78 | -6%˄ || 37.75 | 40.34 | +7%˄ | (run time too short) |
+| 27c || 40.93 | 36.55 | -11%˄ || 24.43 | 27.35 | +12%˄ | (run time too short) |
+| 28a || 212.25 | 188.33 | -11%˄ || 4.71 | 5.31 | +13%˄ | (run time too short) |
+| 28b || 80.16 | 67.47 | -16%˄ || 12.47 | 14.82 | +19%˄ | (run time too short) |
+| 28c || 186.96 | 164.00 | -12%˄ || 5.35 | 6.10 | +14%˄ | (run time too short) |
+| 29a || 178.86 | 162.73 | -9%˄ || 5.59 | 6.15 | +10%˄ | (run time too short) |
+| 29b || 930.66 | 756.13 | -19%˄ || 1.07 | 1.32 | +23%˄ | (run time too short) |
+| 29c || 222.11 | 198.49 | -11%˄ || 4.50 | 5.04 | +12%˄ | (run time too short) |
+| 2a || 29.20 | 25.22 | -14%˄ || 34.24 | 39.65 | +16%˄ | (run time too short) |
+| 2b || 26.55 | 23.02 | -13%˄ || 37.66 | 43.43 | +15%˄ | (run time too short) |
+| 2c || 21.95 | 19.02 | -13%˄ || 45.56 | 52.56 | +15%˄ | (run time too short) |
+| 2d || 57.77 | 51.67 | -11%˄ || 17.31 | 19.35 | +12%˄ | (run time too short) |
+| 30a || 90.03 | 82.26 | -9%˄ || 11.11 | 12.16 | +9%˄ | (run time too short) |
+| 30b || 92.51 | 86.12 | -7%˄ || 10.81 | 11.61 | +7%˄ | (run time too short) |
+| 30c || 159.61 | 145.74 | -9%˄ || 6.27 | 6.86 | +10%˄ | (run time too short) |
+| 31a || 79.45 | 72.19 | -9%˄ || 12.59 | 13.85 | +10%˄ | (run time too short) |
+| 31b || 84.05 | 71.26 | -15%˄ || 11.90 | 14.03 | +18%˄ | (run time too short) |
+| 31c || 90.35 | 82.40 | -9%˄ || 11.07 | 12.14 | +10%˄ | (run time too short) |
+| 32a || 14.96 | 9.81 | -34%˄ || 66.85 | 101.90 | +52%˄ | (run time too short) |
+| 32b || 36.31 | 27.87 | -23%˄ || 27.54 | 35.87 | +30%˄ | (run time too short) |
+| 33a || 34.06 | 28.97 | -15%˄ || 29.36 | 34.52 | +18%˄ | (run time too short) |
+| 33b || 22.84 | 18.26 | -20%˄ || 43.78 | 54.76 | +25%˄ | (run time too short) |
+| 33c || 45.43 | 39.53 | -13%˄ || 22.01 | 25.30 | +15%˄ | (run time too short) |
+| 3a || 71.03 | 64.58 | -9%˄ || 14.08 | 15.48 | +10%˄ | (run time too short) |
+| 3b || 19.87 | 16.40 | -17%˄ || 50.32 | 60.97 | +21%˄ | (run time too short) |
+| 3c || 223.76 | 208.28 | -7%˄ || 4.47 | 4.80 | +7%˄ | (run time too short) |
+| 4a || 150.45 | 142.04 | -6%˄ || 6.65 | 7.04 | +6%˄ | (run time too short) |
+| 4b || 18.45 | 15.14 | -18%˄ || 54.18 | 66.04 | +22%˄ | (run time too short) |
+| 4c || 191.03 | 180.31 | -6%˄ || 5.23 | 5.55 | +6%˄ | (run time too short) |
+| 5a || 64.67 | 48.82 | -25%˄ || 15.46 | 20.48 | +32%˄ | (run time too short) |
+| 5b || 61.21 | 49.42 | -19%˄ || 16.34 | 20.23 | +24%˄ | (run time too short) |
+| 5c || 99.55 | 87.52 | -12%˄ || 10.04 | 11.43 | +14%˄ | (run time too short) |
+| 6a || 167.34 | 146.71 | -12%˄ || 5.98 | 6.82 | +14%˄ | (run time too short) |
+| 6b || 178.05 | 160.05 | -10%˄ || 5.62 | 6.25 | +11%˄ | (run time too short) |
+| 6c || 157.83 | 138.31 | -12%˄ || 6.34 | 7.23 | +14%˄ | (run time too short) |
+| 6d || 389.69 | 362.62 | -7%˄ || 2.57 | 2.76 | +7%˄ | (run time too short) |
+| 6e || 164.69 | 141.56 | -14%˄ || 6.07 | 7.06 | +16%˄ | (run time too short) |
+| 6f || 721.47 | 689.05 | -4%˄ || 1.39 | 1.45 | +5%˄ | (run time too short) |
+| 7a || 92.60 | 81.23 | -12%˄ || 10.80 | 12.31 | +14%˄ | (run time too short) |
+| 7b || 86.43 | 77.05 | -11%˄ || 11.57 | 12.98 | +12%˄ | (run time too short) |
+| 7c || 576.79 | 547.30 | -5%˄ || 1.73 | 1.83 | +5%˄ | (run time too short) |
+| 8a || 202.35 | 169.08 | -16%˄ || 4.94 | 5.91 | +20%˄ | (run time too short) |
+| 8b || 188.95 | 160.91 | -15%˄ || 5.29 | 6.21 | +17%˄ | (run time too short) |
+| 8c || 1863.54 | 1754.17 | -6% || 0.53 | 0.57 | +6% | 0.0000 |
+| 8d || 488.32 | 450.62 | -8%˄ || 2.05 | 2.22 | +8%˄ | (run time too short) |
+| 9a || 257.35 | 235.49 | -8%˄ || 3.89 | 4.25 | +9%˄ | (run time too short) |
+| 9b || 165.70 | 135.02 | -19%˄ || 6.03 | 7.41 | +23%˄ | (run time too short) |
+| 9c || 311.21 | 283.70 | -9%˄ || 3.21 | 3.52 | +10%˄ | (run time too short) |
+| 9d || 457.28 | 431.76 | -6%˄ || 2.19 | 2.32 | +6%˄ | (run time too short) |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
+| Sum || 30496.95 | 28055.90 | -8% || | | | |
+| Geomean || | | || | | +14% | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkJoinOrder - multi-threaded, ordered, 1 client, 64 cores Sum of avg. item runtimes: -3% || Geometric mean of throughput changes: +3%Configuration Overview - click to expand +Configuration Overview---------+---------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkJoinOrder_0bcfa0250faed47181d2591d19daefc98bfcd5a4_mt_ordered.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkJoinOrder_bb1319be18bfe505d05247307f454accd4e27f5d_mt_ordered.json |
+-------------------------------+---------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4-dirty | bb1319be18bfe505d05247307f454accd4e27f5d-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 14:41:54 | 2025-06-07 23:26:17 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------------+---------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
+| 10a || 39.83 | 37.90 | -5%˄ || 25.08 | 26.36 | +5%˄ | (run time too short) |
+| 10b || 18.33 | 17.35 | -5%˄ || 54.46 | 57.51 | +6%˄ | (run time too short) |
| 10c || 120.65 | 119.19 | -1%˄ || 8.29 | 8.39 | +1%˄ | (run time too short) |
| 11a || 10.54 | 10.21 | -3%˄ || 94.59 | 97.64 | +3%˄ | (run time too short) |
| 11b || 8.37 | 8.16 | -3%˄ || 119.00 | 122.12 | +3%˄ | (run time too short) |
| 11c || 23.23 | 22.58 | -3%˄ || 42.98 | 44.22 | +3%˄ | (run time too short) |
| 11d || 27.18 | 26.54 | -2%˄ || 36.74 | 37.63 | +2%˄ | (run time too short) |
| 12a || 21.55 | 20.96 | -3%˄ || 46.32 | 47.63 | +3%˄ | (run time too short) |
| 12b || 12.03 | 11.91 | -1%˄ || 82.86 | 83.68 | +1%˄ | (run time too short) |
| 12c || 51.14 | 49.97 | -2%˄ || 19.54 | 20.00 | +2%˄ | (run time too short) |
+| 13a || 134.71 | 128.43 | -5%˄ || 7.42 | 7.78 | +5%˄ | (run time too short) |
| 13b || 96.71 | 92.64 | -4%˄ || 10.34 | 10.79 | +4%˄ | (run time too short) |
| 13c || 15.59 | 15.72 | +1%˄ || 63.99 | 63.46 | -1%˄ | (run time too short) |
| 13d || 372.34 | 364.41 | -2%˄ || 2.69 | 2.74 | +2%˄ | (run time too short) |
| 14a || 57.08 | 55.51 | -3%˄ || 17.51 | 18.00 | +3%˄ | (run time too short) |
| 14b || 72.00 | 71.35 | -1%˄ || 13.88 | 14.01 | +1%˄ | (run time too short) |
| 14c || 118.28 | 113.20 | -4%˄ || 8.45 | 8.83 | +4%˄ | (run time too short) |
| 15a || 30.30 | 29.04 | -4%˄ || 32.97 | 34.40 | +4%˄ | (run time too short) |
| 15b || 24.94 | 24.94 | -0%˄ || 40.03 | 40.05 | +0%˄ | (run time too short) |
+| 15c || 23.12 | 21.84 | -6%˄ || 43.18 | 45.72 | +6%˄ | (run time too short) |
+| 15d || 28.99 | 27.59 | -5%˄ || 34.45 | 36.21 | +5%˄ | (run time too short) |
| 16a || 846.11 | 819.64 | -3%˄ || 1.18 | 1.22 | +3%˄ | (run time too short) |
| 16b || 2054.41 | 1999.27 | -3% || 0.48 | 0.48 | +0% | (run time too short) |
| 16c || 1005.65 | 977.34 | -3%˄ || 0.99 | 1.02 | +3%˄ | (run time too short) |
| 16d || 967.56 | 937.89 | -3%˄ || 1.03 | 1.07 | +3%˄ | (run time too short) |
| 17a || 187.95 | 183.64 | -2%˄ || 5.32 | 5.44 | +2%˄ | (run time too short) |
| 17b || 155.80 | 154.74 | -1%˄ || 6.42 | 6.46 | +1%˄ | (run time too short) |
| 17c || 128.35 | 126.05 | -2%˄ || 7.79 | 7.93 | +2%˄ | (run time too short) |
| 17d || 126.57 | 122.10 | -4%˄ || 7.90 | 8.19 | +4%˄ | (run time too short) |
| 17e || 846.50 | 811.66 | -4%˄ || 1.18 | 1.23 | +4%˄ | (run time too short) |
| 17f || 322.94 | 314.65 | -3%˄ || 3.10 | 3.18 | +3%˄ | (run time too short) |
| 18a || 52.67 | 51.16 | -3%˄ || 18.97 | 19.53 | +3%˄ | (run time too short) |
| 18b || 50.23 | 49.40 | -2%˄ || 19.89 | 20.23 | +2%˄ | (run time too short) |
| 18c || 99.03 | 101.00 | +2%˄ || 10.09 | 9.90 | -2%˄ | (run time too short) |
| 19a || 100.42 | 97.29 | -3%˄ || 9.95 | 10.27 | +3%˄ | (run time too short) |
+| 19b || 62.93 | 59.96 | -5%˄ || 15.88 | 16.67 | +5%˄ | (run time too short) |
| 19c || 113.80 | 111.76 | -2%˄ || 8.78 | 8.94 | +2%˄ | (run time too short) |
| 19d || 520.87 | 512.67 | -2%˄ || 1.92 | 1.95 | +2%˄ | (run time too short) |
+| 1a || 6.36 | 6.06 | -5%˄ || 156.53 | 164.11 | +5%˄ | (run time too short) |
| 1b || 4.48 | 4.32 | -4%˄ || 221.24 | 229.68 | +4%˄ | (run time too short) |
+| 1c || 4.00 | 3.78 | -6%˄ || 247.71 | 262.11 | +6%˄ | (run time too short) |
+| 1d || 5.02 | 4.76 | -5%˄ || 198.07 | 208.58 | +5%˄ | (run time too short) |
| 20a || 83.48 | 81.14 | -3%˄ || 11.97 | 12.32 | +3%˄ | (run time too short) |
| 20b || 72.40 | 71.03 | -2%˄ || 13.81 | 14.07 | +2%˄ | (run time too short) |
| 20c || 79.82 | 77.77 | -3%˄ || 12.52 | 12.85 | +3%˄ | (run time too short) |
| 21a || 16.66 | 16.37 | -2%˄ || 59.89 | 60.94 | +2%˄ | (run time too short) |
| 21b || 15.15 | 14.72 | -3%˄ || 65.86 | 67.80 | +3%˄ | (run time too short) |
| 21c || 18.69 | 18.09 | -3%˄ || 53.39 | 55.16 | +3%˄ | (run time too short) |
+| 22a || 73.07 | 69.56 | -5%˄ || 13.68 | 14.37 | +5%˄ | (run time too short) |
+| 22b || 54.81 | 52.31 | -5%˄ || 18.23 | 19.10 | +5%˄ | (run time too short) |
| 22c || 123.41 | 121.28 | -2%˄ || 8.10 | 8.24 | +2%˄ | (run time too short) |
+| 22d || 223.78 | 213.33 | -5%˄ || 4.47 | 4.69 | +5%˄ | (run time too short) |
+| 23a || 16.50 | 15.35 | -7%˄ || 60.47 | 65.00 | +7%˄ | (run time too short) |
| 23b || 27.03 | 26.30 | -3%˄ || 36.94 | 37.98 | +3%˄ | (run time too short) |
+| 23c || 18.76 | 17.28 | -8%˄ || 53.19 | 57.77 | +9%˄ | (run time too short) |
| 24a || 60.07 | 59.44 | -1%˄ || 16.63 | 16.81 | +1%˄ | (run time too short) |
| 24b || 60.36 | 59.76 | -1%˄ || 16.55 | 16.72 | +1%˄ | (run time too short) |
| 25a || 57.48 | 56.04 | -3%˄ || 17.38 | 17.83 | +3%˄ | (run time too short) |
| 25b || 32.64 | 32.08 | -2%˄ || 30.60 | 31.13 | +2%˄ | (run time too short) |
| 25c || 157.31 | 154.23 | -2%˄ || 6.36 | 6.48 | +2%˄ | (run time too short) |
| 26a || 86.84 | 84.30 | -3%˄ || 11.51 | 11.86 | +3%˄ | (run time too short) |
| 26b || 64.08 | 62.16 | -3%˄ || 15.59 | 16.08 | +3%˄ | (run time too short) |
| 26c || 131.43 | 129.07 | -2%˄ || 7.61 | 7.75 | +2%˄ | (run time too short) |
| 27a || 19.60 | 19.32 | -1%˄ || 50.93 | 51.66 | +1%˄ | (run time too short) |
| 27b || 18.21 | 17.96 | -1%˄ || 54.80 | 55.58 | +1%˄ | (run time too short) |
| 27c || 18.26 | 17.59 | -4%˄ || 54.65 | 56.74 | +4%˄ | (run time too short) |
+| 28a || 126.69 | 120.49 | -5%˄ || 7.89 | 8.30 | +5%˄ | (run time too short) |
| 28b || 27.56 | 26.69 | -3%˄ || 36.24 | 37.41 | +3%˄ | (run time too short) |
+| 28c || 105.64 | 100.59 | -5%˄ || 9.46 | 9.94 | +5%˄ | (run time too short) |
| 29a || 52.78 | 52.55 | -0%˄ || 18.93 | 19.02 | +0%˄ | (run time too short) |
| 29b || 133.17 | 129.47 | -3%˄ || 7.51 | 7.72 | +3%˄ | (run time too short) |
| 29c || 65.92 | 65.39 | -1%˄ || 15.16 | 15.28 | +1%˄ | (run time too short) |
| 2a || 22.42 | 21.73 | -3%˄ || 44.53 | 45.96 | +3%˄ | (run time too short) |
| 2b || 19.70 | 18.91 | -4%˄ || 50.67 | 52.79 | +4%˄ | (run time too short) |
| 2c || 13.85 | 13.48 | -3%˄ || 72.06 | 74.00 | +3%˄ | (run time too short) |
+| 2d || 52.65 | 49.61 | -6%˄ || 18.98 | 20.15 | +6%˄ | (run time too short) |
| 30a || 48.40 | 46.94 | -3%˄ || 20.64 | 21.29 | +3%˄ | (run time too short) |
| 30b || 37.02 | 35.88 | -3%˄ || 26.98 | 27.84 | +3%˄ | (run time too short) |
| 30c || 115.23 | 111.63 | -3%˄ || 8.67 | 8.95 | +3%˄ | (run time too short) |
| 31a || 38.97 | 38.51 | -1%˄ || 25.63 | 25.94 | +1%˄ | (run time too short) |
| 31b || 34.28 | 34.08 | -1%˄ || 29.14 | 29.31 | +1%˄ | (run time too short) |
| 31c || 43.18 | 42.20 | -2%˄ || 23.14 | 23.67 | +2%˄ | (run time too short) |
+| 32a || 6.39 | 5.94 | -7%˄ || 155.84 | 167.52 | +7%˄ | (run time too short) |
| 32b || 28.36 | 28.83 | +2%˄ || 35.22 | 34.65 | -2%˄ | (run time too short) |
+| 33a || 10.56 | 10.10 | -4%˄ || 94.40 | 98.69 | +5%˄ | (run time too short) |
| 33b || 8.44 | 8.31 | -2%˄ || 117.95 | 119.88 | +2%˄ | (run time too short) |
| 33c || 18.82 | 18.27 | -3%˄ || 53.03 | 54.63 | +3%˄ | (run time too short) |
| 3a || 38.67 | 37.62 | -3%˄ || 25.83 | 26.55 | +3%˄ | (run time too short) |
| 3b || 6.60 | 6.46 | -2%˄ || 150.76 | 154.13 | +2%˄ | (run time too short) |
| 3c || 71.85 | 74.32 | +3%˄ || 13.91 | 13.45 | -3%˄ | (run time too short) |
| 4a || 69.52 | 66.96 | -4%˄ || 14.38 | 14.93 | +4%˄ | (run time too short) |
| 4b || 5.19 | 5.12 | -1%˄ || 191.35 | 194.20 | +1%˄ | (run time too short) |
| 4c || 86.15 | 85.14 | -1%˄ || 11.60 | 11.74 | +1%˄ | (run time too short) |
| 5a || 24.54 | 25.02 | +2%˄ || 40.69 | 39.91 | -2%˄ | (run time too short) |
| 5b || 20.66 | 20.43 | -1%˄ || 48.32 | 48.86 | +1%˄ | (run time too short) |
| 5c || 48.59 | 47.89 | -1%˄ || 20.56 | 20.87 | +1%˄ | (run time too short) |
| 6a || 29.21 | 28.90 | -1%˄ || 34.19 | 34.56 | +1%˄ | (run time too short) |
| 6b || 50.78 | 49.31 | -3%˄ || 19.68 | 20.27 | +3%˄ | (run time too short) |
-| 6c || 26.47 | 27.92 | +5%˄ || 37.72 | 35.77 | -5%˄ | (run time too short) |
| 6d || 129.28 | 127.98 | -1%˄ || 7.73 | 7.81 | +1%˄ | (run time too short) |
| 6e || 28.77 | 29.35 | +2%˄ || 34.72 | 34.03 | -2%˄ | (run time too short) |
| 6f || 479.70 | 476.52 | -1%˄ || 2.08 | 2.10 | +1%˄ | (run time too short) |
| 7a || 27.26 | 27.15 | -0%˄ || 36.63 | 36.78 | +0%˄ | (run time too short) |
| 7b || 25.77 | 26.08 | +1%˄ || 38.76 | 38.29 | -1%˄ | (run time too short) |
| 7c || 257.05 | 258.30 | +0%˄ || 3.89 | 3.87 | -0%˄ | (run time too short) |
| 8a || 41.73 | 40.44 | -3%˄ || 23.94 | 24.71 | +3%˄ | (run time too short) |
| 8b || 40.17 | 39.28 | -2%˄ || 24.87 | 25.43 | +2%˄ | (run time too short) |
+| 8c || 1133.53 | 1084.71 | -4%˄ || 0.88 | 0.92 | +5%˄ | (run time too short) |
| 8d || 278.75 | 267.79 | -4%˄ || 3.59 | 3.73 | +4%˄ | (run time too short) |
| 9a || 132.07 | 128.40 | -3%˄ || 7.57 | 7.79 | +3%˄ | (run time too short) |
| 9b || 74.63 | 71.60 | -4%˄ || 13.39 | 13.96 | +4%˄ | (run time too short) |
| 9c || 149.21 | 144.78 | -3%˄ || 6.70 | 6.91 | +3%˄ | (run time too short) |
| 9d || 353.48 | 352.11 | -0%˄ || 2.83 | 2.84 | +0%˄ | (run time too short) |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Sum || 15138.04 | 14734.20 | -3% || | | | |
| Geomean || | | || | | +3% | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkJoinOrder - multi-threaded, shuffled, 64 clients, 64 cores Sum of avg. item runtimes: -4% || Geometric mean of throughput changes: +4%Configuration Overview - click to expand +Configuration Overview---------+-------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkJoinOrder_0bcfa0250faed47181d2591d19daefc98bfcd5a4_mt.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkJoinOrder_bb1319be18bfe505d05247307f454accd4e27f5d_mt.json |
+-------------------------------+-------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4-dirty | bb1319be18bfe505d05247307f454accd4e27f5d-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 14:56:30 | 2025-06-07 23:40:29 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+-------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+---------+
+| 10a || 207.30 | 187.07 | -10% || 1.18 | 1.22 | +4% | 0.2742 |
+| 10b || 146.27 | 126.90 | -13% || 1.18 | 1.22 | +4% | 0.2017 |
+| 10c || 709.92 | 656.36 | -8% || 1.18 | 1.22 | +4% | 0.1041 |
| 11a || 90.30 | 93.11 | +3% || 1.18 | 1.22 | +4% | 0.8415 |
-| 11b || 77.36 | 96.35 | +25% || 1.18 | 1.22 | +4% | 0.1034 |
| 11c || 125.80 | 122.77 | -2% || 1.18 | 1.22 | +4% | 0.8045 |
+| 11d || 95.39 | 90.01 | -6% || 1.18 | 1.22 | +4% | 0.5779 |
+| 12a || 161.32 | 152.21 | -6% || 1.18 | 1.22 | +4% | 0.4984 |
+| 12b || 86.09 | 75.17 | -13% || 1.18 | 1.22 | +4% | 0.3270 |
+| 12c || 396.66 | 339.94 | -14% || 1.18 | 1.22 | +4% | 0.0309 |
+| 13a || 541.77 | 459.04 | -15% || 1.18 | 1.22 | +4% | 0.0015 |
| 13b || 366.20 | 352.44 | -4% || 1.18 | 1.22 | +4% | 0.5919 |
-| 13c || 90.68 | 96.26 | +6% || 1.18 | 1.22 | +4% | 0.6187 |
| 13d || 941.54 | 907.78 | -4% || 1.18 | 1.22 | +4% | 0.2494 |
| 14a || 441.14 | 423.50 | -4% || 1.18 | 1.22 | +4% | 0.5057 |
+| 14b || 486.85 | 434.53 | -11% || 1.18 | 1.22 | +4% | 0.0705 |
+| 14c || 656.58 | 622.74 | -5% || 1.18 | 1.22 | +4% | 0.2811 |
+| 15a || 129.97 | 106.57 | -18% || 1.18 | 1.22 | +4% | 0.0575 |
-| 15b || 119.85 | 132.99 | +11% || 1.18 | 1.22 | +4% | 0.3932 |
+| 15c || 139.26 | 121.60 | -13% || 1.18 | 1.22 | +4% | 0.1361 |
+| 15d || 159.80 | 150.74 | -6% || 1.18 | 1.22 | +4% | 0.5056 |
+| 16a || 1796.01 | 1698.35 | -5% || 1.18 | 1.22 | +4% | 0.0135 |
| 16b || 3316.65 | 3213.15 | -3% || 1.17 | 1.22 | +4% | 0.0148 |
| 16c || 1990.67 | 1964.38 | -1% || 1.18 | 1.22 | +4% | 0.5104 |
| 16d || 1981.54 | 1910.46 | -4% || 1.18 | 1.22 | +4% | 0.1008 |
| 17a || 925.80 | 920.68 | -1% || 1.18 | 1.22 | +4% | 0.8888 |
| 17b || 711.79 | 683.28 | -4% || 1.18 | 1.22 | +4% | 0.3803 |
| 17c || 640.32 | 633.04 | -1% || 1.18 | 1.22 | +4% | 0.8234 |
-| 17d || 607.26 | 634.88 | +5% || 1.18 | 1.22 | +4% | 0.3660 |
| 17e || 1770.67 | 1736.23 | -2% || 1.18 | 1.22 | +4% | 0.3665 |
| 17f || 1228.37 | 1220.81 | -1% || 1.18 | 1.22 | +4% | 0.8553 |
| 18a || 274.17 | 271.72 | -1% || 1.18 | 1.22 | +4% | 0.9028 |
+| 18b || 433.79 | 399.27 | -8% || 1.18 | 1.22 | +4% | 0.2352 |
| 18c || 679.02 | 688.79 | +1% || 1.18 | 1.22 | +4% | 0.7916 |
| 19a || 569.58 | 592.42 | +4% || 1.18 | 1.22 | +4% | 0.4754 |
| 19b || 434.99 | 417.84 | -4% || 1.18 | 1.22 | +4% | 0.5626 |
+| 19c || 676.73 | 595.37 | -12% || 1.18 | 1.22 | +4% | 0.0126 |
| 19d || 1445.51 | 1459.11 | +1% || 1.18 | 1.22 | +4% | 0.7347 |
| 1a || 38.64 | 37.11 | -4% || 1.18 | 1.22 | +4% | 0.8172 |
+| 1b || 48.16 | 39.35 | -18% || 1.18 | 1.22 | +4% | 0.1969 |
| 1c || 68.71 | 67.39 | -2% || 1.18 | 1.22 | +4% | 0.9165 |
+| 1d || 40.25 | 30.85 | -23% || 1.18 | 1.22 | +4% | 0.2188 |
+| 20a || 488.60 | 440.67 | -10% || 1.18 | 1.22 | +4% | 0.0783 |
+| 20b || 427.24 | 405.77 | -5% || 1.18 | 1.22 | +4% | 0.4305 |
+| 20c || 423.66 | 385.86 | -9% || 1.18 | 1.22 | +4% | 0.1414 |
| 21a || 187.68 | 185.97 | -1% || 1.18 | 1.22 | +4% | 0.9303 |
| 21b || 133.19 | 128.17 | -4% || 1.18 | 1.22 | +4% | 0.7247 |
+| 21c || 228.41 | 170.99 | -25% || 1.18 | 1.22 | +4% | 0.0096 |
| 22a || 489.12 | 494.07 | +1% || 1.18 | 1.22 | +4% | 0.8582 |
-| 22b || 448.85 | 469.93 | +5% || 1.18 | 1.22 | +4% | 0.4889 |
| 22c || 715.90 | 687.47 | -4% || 1.18 | 1.22 | +4% | 0.4130 |
| 22d || 967.71 | 961.51 | -1% || 1.18 | 1.22 | +4% | 0.8692 |
+| 23a || 156.52 | 140.23 | -10% || 1.18 | 1.22 | +4% | 0.2636 |
+| 23b || 135.68 | 124.87 | -8% || 1.18 | 1.22 | +4% | 0.4237 |
| 23c || 174.25 | 169.38 | -3% || 1.18 | 1.22 | +4% | 0.7946 |
+| 24a || 437.08 | 414.16 | -5% || 1.18 | 1.22 | +4% | 0.4486 |
-| 24b || 315.19 | 331.44 | +5% || 1.18 | 1.22 | +4% | 0.5190 |
+| 25a || 474.67 | 420.24 | -11% || 1.18 | 1.22 | +4% | 0.0942 |
| 25b || 248.57 | 258.00 | +4% || 1.18 | 1.22 | +4% | 0.7027 |
| 25c || 966.56 | 928.69 | -4% || 1.18 | 1.22 | +4% | 0.3110 |
+| 26a || 425.47 | 403.65 | -5% || 1.18 | 1.22 | +4% | 0.3219 |
+| 26b || 279.03 | 244.16 | -12% || 1.18 | 1.22 | +4% | 0.0754 |
+| 26c || 655.79 | 622.69 | -5% || 1.18 | 1.22 | +4% | 0.2474 |
| 27a || 171.75 | 168.63 | -2% || 1.18 | 1.22 | +4% | 0.8506 |
+| 27b || 174.04 | 149.71 | -14% || 1.18 | 1.22 | +4% | 0.1459 |
| 27c || 200.48 | 206.01 | +3% || 1.18 | 1.22 | +4% | 0.8031 |
| 28a || 672.36 | 655.90 | -2% || 1.18 | 1.22 | +4% | 0.5680 |
-| 28b || 252.00 | 264.71 | +5% || 1.18 | 1.22 | +4% | 0.5926 |
+| 28c || 696.21 | 636.22 | -9% || 1.18 | 1.22 | +4% | 0.0684 |
+| 29a || 307.12 | 283.20 | -8% || 1.18 | 1.22 | +4% | 0.3075 |
| 29b || 369.39 | 360.37 | -2% || 1.18 | 1.22 | +4% | 0.7209 |
+| 29c || 401.55 | 365.48 | -9% || 1.18 | 1.22 | +4% | 0.1796 |
+| 2a || 147.76 | 130.10 | -12% || 1.18 | 1.22 | +4% | 0.2386 |
+| 2b || 138.11 | 124.67 | -10% || 1.18 | 1.22 | +4% | 0.3081 |
| 2c || 90.14 | 92.83 | +3% || 1.18 | 1.22 | +4% | 0.8010 |
| 2d || 210.40 | 204.79 | -3% || 1.18 | 1.22 | +4% | 0.7050 |
+| 30a || 374.76 | 335.22 | -11% || 1.18 | 1.22 | +4% | 0.1124 |
-| 30b || 316.48 | 378.55 | +20% || 1.18 | 1.22 | +4% | 0.0198 |
+| 30c || 720.14 | 649.05 | -10% || 1.18 | 1.22 | +4% | 0.0334 |
+| 31a || 296.20 | 281.06 | -5% || 1.18 | 1.22 | +4% | 0.4869 |
| 31b || 261.70 | 250.37 | -4% || 1.18 | 1.22 | +4% | 0.6303 |
-| 31c || 325.66 | 359.21 | +10% || 1.18 | 1.22 | +4% | 0.2500 |
+| 32a || 52.34 | 36.33 | -31% || 1.18 | 1.22 | +4% | 0.0013 |
+| 32b || 161.95 | 138.54 | -14% || 1.18 | 1.22 | +4% | 0.0745 |
+| 33a || 138.99 | 107.00 | -23% || 1.18 | 1.22 | +4% | 0.0737 |
-| 33b || 75.18 | 100.94 | +34% || 1.18 | 1.22 | +4% | 0.0398 |
+| 33c || 153.11 | 126.63 | -17% || 1.18 | 1.22 | +4% | 0.0623 |
+| 3a || 321.56 | 279.12 | -13% || 1.18 | 1.22 | +4% | 0.0887 |
| 3b || 75.63 | 72.57 | -4% || 1.18 | 1.22 | +4% | 0.7830 |
| 3c || 487.07 | 489.51 | +0% || 1.18 | 1.22 | +4% | 0.9368 |
| 4a || 297.69 | 285.43 | -4% || 1.18 | 1.22 | +4% | 0.5401 |
-| 4b || 57.29 | 66.05 | +15% || 1.18 | 1.22 | +4% | 0.4272 |
-| 4c || 298.11 | 332.24 | +11% || 1.18 | 1.22 | +4% | 0.0826 |
+| 5a || 249.90 | 229.43 | -8% || 1.18 | 1.22 | +4% | 0.3089 |
-| 5b || 159.53 | 167.58 | +5% || 1.18 | 1.22 | +4% | 0.6499 |
| 5c || 351.50 | 362.31 | +3% || 1.18 | 1.22 | +4% | 0.7022 |
+| 6a || 161.91 | 148.83 | -8% || 1.18 | 1.22 | +4% | 0.4190 |
+| 6b || 229.00 | 189.00 | -17% || 1.18 | 1.22 | +4% | 0.0128 |
-| 6c || 120.14 | 132.90 | +11% || 1.18 | 1.22 | +4% | 0.3806 |
| 6d || 573.43 | 566.58 | -1% || 1.18 | 1.22 | +4% | 0.8046 |
| 6e || 154.70 | 152.30 | -2% || 1.18 | 1.22 | +4% | 0.8891 |
| 6f || 1253.69 | 1231.35 | -2% || 1.18 | 1.22 | +4% | 0.4908 |
| 7a || 165.54 | 166.76 | +1% || 1.18 | 1.22 | +4% | 0.9481 |
+| 7b || 167.67 | 153.38 | -9% || 1.18 | 1.22 | +4% | 0.3910 |
+| 7c || 1073.04 | 1010.61 | -6% || 1.18 | 1.22 | +4% | 0.0590 |
+| 8a || 218.28 | 186.31 | -15% || 1.18 | 1.22 | +4% | 0.1011 |
+| 8b || 160.39 | 151.41 | -6% || 1.18 | 1.22 | +4% | 0.6859 |
| 8c || 2396.25 | 2321.59 | -3% || 1.18 | 1.22 | +4% | 0.0864 |
| 8d || 891.97 | 861.89 | -3% || 1.18 | 1.22 | +4% | 0.2873 |
+| 9a || 709.94 | 656.75 | -7% || 1.18 | 1.22 | +4% | 0.1028 |
+| 9b || 379.06 | 348.06 | -8% || 1.18 | 1.22 | +4% | 0.1107 |
| 9c || 810.26 | 814.29 | +0% || 1.18 | 1.22 | +4% | 0.9158 |
+| 9d || 1152.33 | 1098.07 | -5% || 1.18 | 1.22 | +4% | 0.1014 |
+---------++----------+----------+--------++----------+----------+--------+---------+
| Sum || 54251.56 | 52230.29 | -4% || | | | |
| Geomean || | | || | | +4% | |
+---------++----------+----------+--------++----------+----------+--------+---------+hyriseBenchmarkStarSchema - single-threaded Sum of avg. item runtimes: -0% || Geometric mean of throughput changes: +1%Configuration Overview - click to expand +Configuration Overview---+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkStarSchema_0bcfa0250faed47181d2591d19daefc98bfcd5a4_st.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkStarSchema_bb1319be18bfe505d05247307f454accd4e27f5d_st.json |
+-------------------------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4-dirty | bb1319be18bfe505d05247307f454accd4e27f5d-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 15:16:50 | 2025-06-08 00:00:50 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+ +---------++----------+---------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| 1.1 || 418.70 | 412.23 | -2%˄ || 2.39 | 2.43 | +2%˄ | (run time too short) |
| 1.2 || 231.42 | 230.64 | -0%˄ || 4.32 | 4.34 | +0%˄ | (run time too short) |
| 1.3 || 226.28 | 220.58 | -3%˄ || 4.42 | 4.53 | +3%˄ | (run time too short) |
| 2.1 || 512.39 | 517.62 | +1%˄ || 1.95 | 1.93 | -1%˄ | (run time too short) |
| 2.2 || 279.38 | 282.06 | +1%˄ || 3.58 | 3.55 | -1%˄ | (run time too short) |
| 2.3 || 175.89 | 178.54 | +2%˄ || 5.69 | 5.60 | -1%˄ | (run time too short) |
| 3.1 || 2621.47 | 2632.20 | +0% || 0.37 | 0.37 | +0% | (run time too short) |
| 3.2 || 286.32 | 277.59 | -3%˄ || 3.49 | 3.60 | +3%˄ | (run time too short) |
| 3.3 || 117.36 | 114.87 | -2%˄ || 8.52 | 8.71 | +2%˄ | (run time too short) |
| 3.4 || 110.91 | 108.69 | -2%˄ || 9.02 | 9.20 | +2%˄ | (run time too short) |
| 4.1 || 2454.42 | 2466.56 | +0% || 0.40 | 0.40 | +0% | (run time too short) |
| 4.2 || 778.59 | 773.97 | -1%˄ || 1.28 | 1.29 | +1%˄ | (run time too short) |
| 4.3 || 214.97 | 209.22 | -3%˄ || 4.65 | 4.78 | +3%˄ | (run time too short) |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| Sum || 8428.10 | 8424.78 | -0% || | | | |
| Geomean || | | || | | +1% | |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+---------+--------++----------+----------+--------+----------------------+hyriseBenchmarkStarSchema - multi-threaded, ordered, 1 client, 64 cores Sum of avg. item runtimes: -0% || Geometric mean of throughput changes: -0%Configuration Overview - click to expand +Configuration Overview---------+----------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkStarSchema_0bcfa0250faed47181d2591d19daefc98bfcd5a4_mt_ordered.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkStarSchema_bb1319be18bfe505d05247307f454accd4e27f5d_mt_ordered.json |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4-dirty | bb1319be18bfe505d05247307f454accd4e27f5d-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 15:25:47 | 2025-06-08 00:06:15 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}} | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------+ +---------++----------+---------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| 1.1 || 127.14 | 128.98 | +1%˄ || 7.86 | 7.75 | -1%˄ | (run time too short) |
| 1.2 || 83.90 | 85.44 | +2%˄ || 11.91 | 11.70 | -2%˄ | (run time too short) |
| 1.3 || 80.81 | 83.39 | +3%˄ || 12.37 | 11.99 | -3%˄ | (run time too short) |
| 2.1 || 329.47 | 327.76 | -1%˄ || 3.03 | 3.05 | +1%˄ | (run time too short) |
| 2.2 || 156.14 | 159.16 | +2%˄ || 6.40 | 6.28 | -2%˄ | (run time too short) |
| 2.3 || 63.94 | 63.41 | -1%˄ || 15.63 | 15.76 | +1%˄ | (run time too short) |
| 3.1 || 805.70 | 805.53 | -0%˄ || 1.24 | 1.24 | +0%˄ | (run time too short) |
| 3.2 || 150.06 | 149.21 | -1%˄ || 6.66 | 6.70 | +1%˄ | (run time too short) |
| 3.3 || 77.71 | 77.06 | -1%˄ || 12.86 | 12.97 | +1%˄ | (run time too short) |
| 3.4 || 69.96 | 69.63 | -0%˄ || 14.29 | 14.35 | +0%˄ | (run time too short) |
| 4.1 || 867.68 | 859.83 | -1%˄ || 1.15 | 1.16 | +1%˄ | (run time too short) |
| 4.2 || 348.80 | 350.12 | +0%˄ || 2.87 | 2.86 | -0%˄ | (run time too short) |
| 4.3 || 111.56 | 110.22 | -1%˄ || 8.96 | 9.07 | +1%˄ | (run time too short) |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| Sum || 3272.85 | 3269.74 | -0% || | | | |
| Geomean || | | || | | -0% | |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+---------+--------++----------+----------+--------+----------------------+hyriseBenchmarkStarSchema - multi-threaded, shuffled, 64 clients, 64 cores Sum of avg. item runtimes: -0% || Geometric mean of throughput changes: +0%Configuration Overview - click to expand +Configuration Overview---------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkStarSchema_0bcfa0250faed47181d2591d19daefc98bfcd5a4_mt.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkStarSchema_bb1319be18bfe505d05247307f454accd4e27f5d_mt.json |
+-------------------------------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 0bcfa0250faed47181d2591d19daefc98bfcd5a4-dirty | bb1319be18bfe505d05247307f454accd4e27f5d-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-06 15:29:06 | 2025-06-08 00:09:29 |
-| ≠encoding | {'default': {'encoding': 'Dictionary'}}
10000
| None |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+---------+
| 1.1 || 844.00 | 830.99 | -2% || 3.74 | 3.74 | +0% | 0.5070 |
| 1.2 || 463.76 | 464.03 | +0% || 3.74 | 3.74 | +0% | 0.9855 |
| 1.3 || 421.70 | 413.57 | -2% || 3.74 | 3.74 | +0% | 0.5059 |
| 2.1 || 2110.74 | 2083.07 | -1% || 3.74 | 3.74 | +0% | 0.4228 |
+| 2.2 || 1110.95 | 1060.60 | -5% || 3.74 | 3.74 | +0% | 0.0405 |
| 2.3 || 382.51 | 366.36 | -4% || 3.74 | 3.74 | +0% | 0.2126 |
| 3.1 || 3280.39 | 3250.93 | -1% || 3.73 | 3.74 | +0% | 0.3796 |
| 3.2 || 978.05 | 1001.48 | +2% || 3.74 | 3.74 | +0% | 0.2903 |
| 3.3 || 474.81 | 474.97 | +0% || 3.74 | 3.74 | +0% | 0.9918 |
| 3.4 || 466.32 | 478.23 | +3% || 3.74 | 3.75 | +0% | 0.4778 |
| 4.1 || 3310.98 | 3360.17 | +1% || 3.73 | 3.73 | +0% | 0.1647 |
| 4.2 || 2493.69 | 2515.50 | +1% || 3.73 | 3.74 | +0% | 0.5402 |
| 4.3 || 752.92 | 759.39 | +1% || 3.74 | 3.74 | +0% | 0.7585 |
+---------++----------+----------+--------++----------+----------+--------+---------+
| Sum || 17090.81 | 17059.30 | -0% || | | | |
| Geomean || | | || | | +0% | |
+---------++----------+----------+--------++----------+----------+--------+---------+ |
|
First: FixedStringD is out due to its memory footprint for JOB. Second, I think the question boils down on whether to use FoR or not. |
PR (int:FoR) vs. PR (all:Un or Dict)System cx17 - click to expand
Commit Info and Build Time
hyriseBenchmarkTPCH - single-threaded, SF 10.0 Sum of avg. item runtimes: +3% || Geometric mean of throughput changes: -5%Configuration Overview - click to expand +Configuration Overview----+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCH_2f72cba186290ca85834639abc0ef6c44b272856_st.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCH_bb1319be18bfe505d05247307f454accd4e27f5d_st.json |
+--------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 2f72cba186290ca85834639abc0ef6c44b272856-dirty | bb1319be18bfe505d05247307f454accd4e27f5d-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-08 06:03:20 | 2025-06-07 20:55:39 |
| encoding | None | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+--------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+ +----------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
-| TPC-H 01 || 5547.69 | 5856.19 | +6% || 0.17 | 0.17 | +0% | (run time too short) |
+| TPC-H 02 || 42.70 | 33.07 | -23%˄ || 23.42 | 30.23 | +29%˄ | (run time too short) |
-| TPC-H 03 || 1191.72 | 1262.31 | +6%˄ || 0.84 | 0.78 | -7%˄ | 0.0000 |
| TPC-H 04 || 1348.35 | 1363.76 | +1% || 0.73 | 0.72 | -2% | (run time too short) |
-| TPC-H 05 || 1911.69 | 2177.74 | +14% || 0.52 | 0.45 | -13% | (run time too short) |
| TPC-H 06 || 170.42 | 171.02 | +0%˄ || 5.87 | 5.85 | -0%˄ | (run time too short) |
-| TPC-H 07 || 587.63 | 714.46 | +22%˄ || 1.70 | 1.40 | -18%˄ | (run time too short) |
-| TPC-H 08 || 425.25 | 519.43 | +22%˄ || 2.35 | 1.93 | -18%˄ | (run time too short) |
-| TPC-H 09 || 5145.02 | 5882.93 | +14% || 0.18 | 0.17 | -9% | (run time too short) |
| TPC-H 10 || 1289.36 | 1313.39 | +2% || 0.77 | 0.75 | -2% | 0.0097 |
+| TPC-H 11 || 54.64 | 50.41 | -8%˄ || 18.30 | 19.84 | +8%˄ | (run time too short) |
| TPC-H 12 || 888.24 | 859.78 | -3%˄ || 1.13 | 1.16 | +3%˄ | (run time too short) |
+| TPC-H 13 || 5323.27 | 4319.93 | -19% || 0.18 | 0.22 | +18% | (run time too short) |
| TPC-H 14 || 455.21 | 472.15 | +4%˄ || 2.20 | 2.12 | -4%˄ | (run time too short) |
-| TPC-H 15 || 162.19 | 173.40 | +7%˄ || 6.17 | 5.77 | -6%˄ | (run time too short) |
+| TPC-H 16 || 538.11 | 503.09 | -7%˄ || 1.86 | 1.99 | +7%˄ | (run time too short) |
-| TPC-H 17 || 142.75 | 210.52 | +47%˄ || 7.00 | 4.75 | -32%˄ | (run time too short) |
| TPC-H 18 || 1541.55 | 1606.67 | +4% || 0.63 | 0.62 | -3% | (run time too short) |
| TPC-H 19 || 228.11 | 234.14 | +3%˄ || 4.38 | 4.27 | -3%˄ | (run time too short) |
-| TPC-H 20 || 281.24 | 363.49 | +29%˄ || 3.56 | 2.75 | -23%˄ | (run time too short) |
-| TPC-H 21 || 3683.23 | 3814.60 | +4% || 0.27 | 0.25 | -6% | (run time too short) |
| TPC-H 22 || 460.98 | 472.58 | +3%˄ || 2.17 | 2.12 | -2%˄ | (run time too short) |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| Sum || 31419.34 | 32375.04 | +3% || | | | |
-| Geomean || | | || | | -5% | |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+----------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCH - single-threaded, SF 0.01 Sum of avg. item runtimes: +1% || Geometric mean of throughput changes: +1%Configuration Overview - click to expand +Configuration Overview----+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCH_2f72cba186290ca85834639abc0ef6c44b272856_st_s01.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCH_bb1319be18bfe505d05247307f454accd4e27f5d_st_s01.json |
+--------------------------+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 2f72cba186290ca85834639abc0ef6c44b272856-dirty | bb1319be18bfe505d05247307f454accd4e27f5d-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-08 06:19:33 | 2025-06-07 21:10:55 |
| encoding | None | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 0.009999999776482582 | 0.009999999776482582 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+--------------------------+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+ +----------++----------+---------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+----------++----------+---------+--------++----------+----------+--------+----------------------+
| TPC-H 01 || 5.42 | 5.43 | +0%˄ || 184.40 | 184.04 | -0%˄ | (run time too short) |
-| TPC-H 02 || 3.38 | 3.63 | +8%˄ || 296.17 | 275.15 | -7%˄ | (run time too short) |
+| TPC-H 03 || 0.60 | 0.55 | -8%˄ || 1658.22 | 1800.37 | +9%˄ | (run time too short) |
+| TPC-H 04 || 0.40 | 0.36 | -11%˄ || 2482.15 | 2779.99 | +12%˄ | (run time too short) |
+| TPC-H 05 || 1.02 | 0.96 | -6%˄ || 981.15 | 1040.76 | +6%˄ | (run time too short) |
-| TPC-H 06 || 0.20 | 0.21 | +5%˄ || 5037.57 | 4777.02 | -5%˄ | (run time too short) |
| TPC-H 07 || 8.83 | 9.09 | +3%˄ || 113.19 | 109.98 | -3%˄ | (run time too short) |
| TPC-H 08 || 13.89 | 13.48 | -3%˄ || 72.00 | 74.17 | +3%˄ | (run time too short) |
-| TPC-H 09 || 2.90 | 3.71 | +28%˄ || 344.49 | 269.32 | -22%˄ | (run time too short) |
| TPC-H 10 || 0.70 | 0.69 | -2%˄ || 1430.03 | 1456.20 | +2%˄ | (run time too short) |
+| TPC-H 11 || 0.18 | 0.17 | -6%˄ || 5416.59 | 5788.91 | +7%˄ | (run time too short) |
| TPC-H 12 || 0.62 | 0.61 | -2%˄ || 1602.37 | 1628.40 | +2%˄ | (run time too short) |
+| TPC-H 13 || 2.13 | 1.99 | -6%˄ || 470.04 | 501.25 | +7%˄ | (run time too short) |
| TPC-H 14 || 0.31 | 0.31 | +3%˄ || 3262.95 | 3179.79 | -3%˄ | (run time too short) |
| TPC-H 15 || 1.07 | 1.11 | +4%˄ || 928.10 | 895.67 | -3%˄ | (run time too short) |
| TPC-H 16 || 1.93 | 1.93 | +0%˄ || 518.96 | 517.19 | -0%˄ | (run time too short) |
+| TPC-H 17 || 0.66 | 0.56 | -15%˄ || 1510.16 | 1774.29 | +17%˄ | (run time too short) |
+| TPC-H 18 || 1.19 | 1.12 | -6%˄ || 836.51 | 888.77 | +6%˄ | (run time too short) |
| TPC-H 19 || 4.54 | 4.54 | -0%˄ || 220.29 | 2
10000
20.35 | +0%˄ | (run time too short) |
| TPC-H 20 || 2.39 | 2.39 | -0%˄ || 418.56 | 418.86 | +0%˄ | (run time too short) |
+| TPC-H 21 || 1.07 | 0.99 | -7%˄ || 933.36 | 1007.09 | +8%˄ | (run time too short) |
| TPC-H 22 || 1.09 | 1.09 | +0%˄ || 920.22 | 917.80 | -0%˄ | (run time too short) |
+----------++----------+---------+--------++----------+----------+--------+----------------------+
| Sum || 54.51 | 54.95 | +1% || | | | |
| Geomean || | | || | | +1% | |
+----------++----------+---------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+----------++----------+---------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCH - multi-threaded, ordered, 1 client, 64 cores, SF 10.0 Sum of avg. item runtimes: -1% || Geometric mean of throughput changes: -2%Configuration Overview - click to expand +Configuration Overview---------+----------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCH_2f72cba186290ca85834639abc0ef6c44b272856_mt_ordered.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCH_bb1319be18bfe505d05247307f454accd4e27f5d_mt_ordered.json |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 2f72cba186290ca85834639abc0ef6c44b272856-dirty | bb1319be18bfe505d05247307f454accd4e27f5d-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-08 06:20:01 | 2025-06-07 21:11:20 |
| encoding | None | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------+ +----------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| TPC-H 01 || 4693.39 | 4703.09 | +0% || 0.20 | 0.20 | +0% | (run time too short) |
| TPC-H 02 || 53.74 | 52.45 | -2%˄ || 18.59 | 19.05 | +2%˄ | (run time too short) |
| TPC-H 03 || 645.14 | 641.87 | -1%˄ || 1.55 | 1.56 | +1%˄ | (run time too short) |
| TPC-H 04 || 632.40 | 631.45 | -0%˄ || 1.58 | 1.58 | +0%˄ | (run time too short) |
-| TPC-H 05 || 518.56 | 570.93 | +10%˄ || 1.93 | 1.75 | -9%˄ | (run time too short) |
| TPC-H 06 || 65.23 | 63.12 | -3%˄ || 15.32 | 15.83 | +3%˄ | (run time too short) |
| TPC-H 07 || 247.96 | 245.00 | -1%˄ || 4.03 | 4.08 | +1%˄ | (run time too short) |
| TPC-H 08 || 219.48 | 224.88 | +2%˄ || 4.56 | 4.45 | -2%˄ | (run time too short) |
-| TPC-H 09 || 1929.83 | 2107.66 | +9% || 0.52 | 0.47 | -10% | 0.0000 |
| TPC-H 10 || 594.56 | 597.84 | +1%˄ || 1.68 | 1.67 | -1%˄ | (run time too short) |
-| TPC-H 11 || 84.44 | 88.34 | +5%˄ || 11.84 | 11.32 | -4%˄ | (run time too short) |
| TPC-H 12 || 462.92 | 452.94 | -2%˄ || 2.16 | 2.21 | +2%˄ | (run time too short) |
+| TPC-H 13 || 2002.00 | 1659.33 | -17% || 0.48 | 0.60 | +24% | (run time too short) |
| TPC-H 14 || 152.32 | 149.73 | -2%˄ || 6.56 | 6.68 | +2%˄ | (run time too short) |
-| TPC-H 15 || 128.85 | 140.74 | +9%˄ || 7.76 | 7.10 | -8%˄ | (run time too short) |
| TPC-H 16 || 564.92 | 562.54 | -0%˄ || 1.77 | 1.78 | +0%˄ | (run time too short) |
-| TPC-H 17 || 72.67 | 88.19 | +21%˄ || 13.75 | 11.33 | -18%˄ | (run time too short) |
| TPC-H 18 || 1738.55 | 1715.68 | -1% || 0.57 | 0.57 | +0% | (run time too short) |
-| TPC-H 19 || 108.59 | 114.84 | +6%˄ || 9.21 | 8.70 | -5%˄ | (run time too short) |
-| TPC-H 20 || 179.60 | 190.73 | +6%˄ || 5.57 | 5.24 | -6%˄ | (run time too short) |
| TPC-H 21 || 1041.01 | 1050.39 | +1%˄ || 0.96 | 0.95 | -1%˄ | (run time too short) |
| TPC-H 22 || 158.60 | 158.49 | -0%˄ || 6.30 | 6.31 | +0%˄ | (run time too short) |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| Sum || 16294.76 | 16210.21 | -1% || | | | |
| Geomean || | | || | | -2% | |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+----------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCH - multi-threaded, shuffled, 64 clients, 64 cores, SF 10.0 Sum of avg. item runtimes: +4% || Geometric mean of throughput changes: -3%Configuration Overview - click to expand +Configuration Overview---------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCH_2f72cba186290ca85834639abc0ef6c44b272856_mt.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCH_bb1319be18bfe505d05247307f454accd4e27f5d_mt.json |
+-------------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 2f72cba186290ca85834639abc0ef6c44b272856-dirty | bb1319be18bfe505d05247307f454accd4e27f5d-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| clustering | None | None |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-08 06:31:25 | 2025-06-07 21:22:41 |
| encoding | None | None |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+ +----------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+----------++----------+----------+--------++----------+----------+--------+---------+
| TPC-H 01 || 6357.31 | 6284.39 | -1% || 1.14 | 1.10 | -4% | 0.3778 |
| TPC-H 02 || 365.40 | 359.32 | -2% || 1.15 | 1.11 | -3% | 0.8892 |
+| TPC-H 03 || 2721.65 | 2580.15 | -5% || 1.15 | 1.11 | -3% | 0.2134 |
| TPC-H 04 || 2297.65 | 2325.71 | +1% || 1.15 | 1.11 | -4% | 0.7959 |
-| TPC-H 05 || 3899.71 | 4155.34 | +7% || 1.15 | 1.11 | -4% | 0.0840 |
-| TPC-H 06 || 782.62 | 984.84 | +26% || 1.15 | 1.11 | -3% | 0.0162 |
-| TPC-H 07 || 3129.01 | 3384.25 | +8% || 1.15 | 1.11 | -4% | 0.0818 |
-| TPC-H 08 || 2080.01 | 2468.28 | +19% || 1.15 | 1.11 | -3% | 0.0015 |
-| TPC-H 09 || 5534.21 | 6124.44 | +11% || 1.15 | 1.10 | -4% | 0.0001 |
-| TPC-H 10 || 3217.01 | 3511.77 | +9% || 1.15 | 1.11 | -4% | 0.0380 |
+| TPC-H 11 || 467.12 | 444.16 | -5% || 1.15 | 1.11 | -4% | 0.6328 |
-| TPC-H 12 || 2334.98 | 2492.97 | +7% || 1.15 | 1.11 | -4% | 0.1314 |
+| TPC-H 13 || 5024.79 | 3936.30 | -22% || 1.14 | 1.11 | -3% | 0.0000 |
-| TPC-H 14 || 1079.17 | 1201.42 | +11% || 1.15 | 1.11 | -4% | 0.1196 |
-| TPC-H 15 || 573.57 | 687.13 | +20% || 1.15 | 1.11 | -4% | 0.0259 |
| TPC-H 16 || 2197.64 | 2264.70 | +3% || 1.15 | 1.11 | -3% | 0.5148 |
-| TPC-H 17 || 708.67 | 796.69 | +12% || 1.15 | 1.11 | -4% | 0.2100 |
| TPC-H 18 || 3633.80 | 3678.23 | +1% || 1.15 | 1.11 | -3% | 0.5753 |
-| TPC-H 19 || 1094.53 | 1213.60 | +11% || 1.15 | 1.11 | -4% | 0.1688 |
-| TPC-H 20 || 1539.16 | 1723.68 | +12% || 1.15 | 1.11 | -3% | 0.0644 |
-| TPC-H 21 || 5102.02 | 5513.32 | +8% || 1.14 | 1.10 | -3% | 0.0148 |
-| TPC-H 22 || 1079.84 | 1255.25 | +16% || 1.15 | 1.11 | -3% | 0.0363 |
+----------++----------+----------+--------++----------+----------+--------+---------+
| Sum || 55219.86 | 57385.95 | +4% || | | | |
| Geomean || | | || | | -3% | |
+----------++----------+----------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCDS - single-threaded Sum of avg. item runtimes: -14% || Geometric mean of throughput changes: +18%Configuration Overview - click to expand +Configuration Overview---+---------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCDS_2f72cba186290ca85834639abc0ef6c44b272856_st.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCDS_bb1319be18bfe505d05247307f454accd4e27f5d_st.json |
+-------------------------+---------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 2f72cba186290ca85834639abc0ef6c44b272856-dirty | bb1319be18bfe505d05247307f454accd4e27f5d-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-08 06:52:57 | 2025-06-07 21:44:08 |
| encoding | None | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+---------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
-| 01 || 211.79 | 222.10 | +5%˄ || 4.72 | 4.50 | -5%˄ | (run time too short) |
+| 03 || 57.54 | 36.88 | -36%˄ || 17.38 | 27.11 | +56%˄ | (run time too short) |
+| 06 || 185.08 | 164.80 | -11%˄ || 5.40 | 6.07 | +12%˄ | (run time too short) |
+| 07 || 281.82 | 265.51 | -6%˄ || 3.55 | 3.77 | +6%˄ | (run time too short) |
+| 09 || 1371.54 | 739.21 | -46%˄ || 0.72 | 1.35 | +89%˄ | (run time too short) |
+| 10 || 155.37 | 122.88 | -21%˄ || 6.44 | 8.14 | +26%˄ | (run time too short) |
| 13 || 497.33 | 496.34 | -0%˄ || 2.01 | 2.01 | +0%˄ | (run time too short) |
| 15 || 126.56 | 122.54 | -3%˄ || 7.90 | 8.16 | +3%˄ | (run time too short) |
+| 16 || 74.73 | 56.79 | -24%˄ || 13.38 | 17.61 | +32%˄ | (run time too short) |
+| 17 || 294.47 | 268.58 | -9%˄ || 3.40 | 3.72 | +10%˄ | (run time too short) |
+| 19 || 109.90 | 88.35 | -20%˄ || 9.10 | 11.32 | +24%˄ | (run time too short) |
+| 25 || 176.53 | 147.03 | -17%˄ || 5.66 | 6.80 | +20%˄ | (run time too short) |
| 26 || 126.62 | 121.58 | -4%˄ || 7.90 | 8.23 | +4%˄ | (run time too short) |
+| 28 || 1156.06 | 578.27 | -50%˄ || 0.87 | 1.73 | +100%˄ | (run time too short) |
+| 29 || 463.06 | 420.00 | -9%˄ || 2.16 | 2.38 | +10%˄ | (run time too short) |
+| 31 || 1392.88 | 1314.16 | -6% || 0.72 | 0.75 | +5% | 0.0000 |
+| 32 || 39.37 | 29.96 | -24%˄ || 25.40 | 33.37 | +31%˄ | (run time too short) |
+| 34 || 163.07 | 146.01 | -10%˄ || 6.13 | 6.85 | +12%˄ | (run time too short) |
+| 35 || 636.05 | 597.22 | -6%˄ || 1.57 | 1.67 | +7%˄ | (run time too short) |
+| 37 || 1206.99 | 670.65 | -44%˄ || 0.82 | 1.49 | +83%˄ | (run time too short) |
+| 39a || 1866.10 | 1664.12 | -11% || 0.53 | 0.60 | +12% | 0.0000 |
+| 39b || 1863.45 | 1632.37 | -12% || 0.53 | 0.60 | +12% | (run time too short) |
| 41 || 283.51 | 280.70 | -1%˄ || 3.53 | 3.56 | +1%˄ | (run time too short) |
+| 42 || 92.68 | 67.31 | -27%˄ || 10.79 | 14.86 | +38%˄ | (run time too short) |
| 43 || 1004.89 | 988.07 | -2%˄ || 1.00 | 1.01 | +2%˄ | (run time too short) |
+| 45 || 110.71 | 103.64 | -6%˄ || 9.03 | 9.65 | +7%˄ | (run time too short) |
| 48 || 1189.87 | 1180.49 | -1%˄ || 0.84 | 0.85 | +1%˄ | 0.0007 |
+| 50 || 128.08 | 106.95 | -16%˄ || 7.81 | 9.35 | +20%˄ | (run time too short) |
+| 52 || 93.57 | 67.60 | -28%˄ || 10.69 | 14.79 | +38%˄ | (run time too short) |
+| 55 || 88.62 | 62.70 | -29%˄ || 11.28 | 15.95 | +41%˄ | (run time too short) |
| 62 || 557.75 | 548.22 | -2%˄ || 1.79 | 1.82 | +2%˄ | (run time too short) |
+| 65 || 1878.98 | 1799.48 | -4% || 0.52 | 0.55 | +6% | (run time too short) |
+| 69 || 169.76 | 136.04 | -20%˄ || 5.89 | 7.35 | +25%˄ | (run time too short) |
+| 73 || 98.11 | 75.87 | -23%˄ || 10.19 | 13.18 | +29%˄ | (run time too short) |
| 79 || 505.27 | 485.48 | -4%˄ || 1.98 | 2.06 | +4%˄ | (run time too short) |
| 81 || 145.88 | 151.09 | +4%˄ || 6.85 | 6.62 | -3%˄ | (run time too short) |
+| 82 || 1251.71 | 695.77 | -44%˄ || 0.78 | 1.44 | +83%˄ | (run time too short) |
+| 83 || 38.94 | 36.70 | -6%˄ || 25.68 | 27.25 | +6%˄ | (run time too short) |
-| 84 || 12.32 | 13.16 | +7%˄ || 81.12 | 75.96 | -6%˄ | (run time too short) |
| 85 || 158.62 | 158.45 | -0%˄ || 6.30 | 6.31 | +0%˄ | (run time too short) |
+| 88 || 795.56 | 629.95 | -21%˄ || 1.26 | 1.59 | +26%˄ | (run time too short)
10000
|
+| 91 || 17.36 | 16.59 | -4%˄ || 57.58 | 60.26 | +5%˄ | (run time too short) |
+| 92 || 33.44 | 26.82 | -20%˄ || 29.90 | 37.27 | +25%˄ | (run time too short) |
+| 93 || 2388.54 | 2151.30 | -10% || 0.42 | 0.45 | +8% | (run time too short) |
+| 94 || 45.54 | 33.33 | -27%˄ || 21.96 | 30.00 | +37%˄ | (run time too short) |
+| 95 || 5208.19 | 4636.60 | -11% || 0.18 | 0.20 | +9% | (run time too short) |
+| 96 || 80.53 | 58.90 | -27%˄ || 12.42 | 16.98 | +37%˄ | (run time too short) |
+| 97 || 3615.54 | 3295.49 | -9% || 0.27 | 0.30 | +12% | (run time too short) |
| 99 || 1095.35 | 1079.93 | -1%˄ || 0.91 | 0.93 | +1%˄ | (run time too short) |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
+| Sum || 33545.62 | 28791.96 | -14% || | | | |
+| Geomean || | | || | | +18% | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCDS - multi-threaded, ordered, 1 client, 64 cores Sum of avg. item runtimes: -4% || Geometric mean of throughput changes: +5%Configuration Overview - click to expand +Configuration Overview---------+-----------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCDS_2f72cba186290ca85834639abc0ef6c44b272856_mt_ordered.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCDS_bb1319be18bfe505d05247307f454accd4e27f5d_mt_ordered.json |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 2f72cba186290ca85834639abc0ef6c44b272856-dirty | bb1319be18bfe505d05247307f454accd4e27f5d-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-08 07:15:56 | 2025-06-07 22:02:53 |
| encoding | None | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| 01 || 232.16 | 237.85 | +2%˄ || 4.31 | 4.20 | -2%˄ | (run time too short) |
+| 03 || 31.40 | 29.79 | -5%˄ || 31.81 | 33.53 | +5%˄ | (run time too short) |
| 06 || 167.38 | 163.10 | -3%˄ || 5.97 | 6.13 | +3%˄ | (run time too short) |
| 07 || 192.51 | 190.21 | -1%˄ || 5.19 | 5.26 | +1%˄ | (run time too short) |
+| 09 || 154.31 | 113.07 | -27%˄ || 6.48 | 8.84 | +36%˄ | (run time too short) |
+| 10 || 40.76 | 36.19 | -11%˄ || 24.51 | 27.60 | +13%˄ | (run time too short) |
| 13 || 250.92 | 259.09 | +3%˄ || 3.98 | 3.86 | -3%˄ | (run time too short) |
| 15 || 76.08 | 74.18 | -2%˄ || 13.14 | 13.47 | +3%˄ | (run time too short) |
+| 16 || 32.42 | 31.01 | -4%˄ || 30.81 | 32.21 | +5%˄ | (run time too short) |
+| 17 || 123.10 | 115.89 | -6%˄ || 8.12 | 8.63 | +6%˄ | (run time too short) |
+| 19 || 74.68 | 68.72 | -8%˄ || 13.38 | 14.54 | +9%˄ | (run time too short) |
| 25 || 92.93 | 89.35 | -4%˄ || 10.76 | 11.19 | +4%˄ | (run time too short) |
| 26 || 90.00 | 93.96 | +4%˄ || 11.11 | 10.64 | -4%˄ | (run time too short) |
+| 28 || 156.55 | 145.42 | -7%˄ || 6.39 | 6.87 | +8%˄ | (run time too short) |
+| 29 || 422.42 | 401.61 | -5%˄ || 2.37 | 2.49 | +5%˄ | (run time too short) |
| 31 || 466.36 | 472.38 | +1%˄ || 2.14 | 2.12 | -1%˄ | (run time too short) |
+| 32 || 34.28 | 32.39 | -6%˄ || 29.14 | 30.84 | +6%˄ | (run time too short) |
| 34 || 97.33 | 93.65 | -4%˄ || 10.27 | 10.67 | +4%˄ | (run time too short) |
| 35 || 381.12 | 380.87 | -0%˄ || 2.62 | 2.63 | +0%˄ | (run time too short) |
+| 37 || 250.52 | 189.86 | -24%˄ || 3.99 | 5.27 | +32%˄ | (run time too short) |
+| 39a || 835.06 | 745.41 | -11%˄ || 1.20 | 1.34 | +12%˄ | (run time too short) |
| 39b || 735.59 | 711.09 | -3%˄ || 1.36 | 1.41 | +3%˄ | (run time too short) |
| 41 || 363.00 | 361.35 | -0%˄ || 2.75 | 2.77 | +0%˄ | (run time too short) |
+| 42 || 53.31 | 49.30 | -8%˄ || 18.74 | 20.27 | +8%˄ | (run time too short) |
| 43 || 451.06 | 446.26 | -1%˄ || 2.22 | 2.24 | +1%˄ | (run time too short) |
| 45 || 53.44 | 53.16 | -1%˄ || 18.70 | 18.80 | +1%˄ | (run time too short) |
| 48 || 536.55 | 530.34 | -1%˄ || 1.86 | 1.89 | +1%˄ | (run time too short) |
| 50 || 108.26 | 108.31 | +0%˄ || 9.23 | 9.23 | -0%˄ | (run time too short) |
+| 52 || 53.92 | 51.44 | -5%˄ || 18.53 | 19.43 | +5%˄ | (run time too short) |
+| 55 || 47.41 | 44.74 | -6%˄ || 21.08 | 22.33 | +6%˄ | (run time too short) |
| 62 || 349.06 | 342.73 | -2%˄ || 2.86 | 2.92 | +2%˄ | (run time too short) |
| 65 || 1471.84 | 1462.21 | -1% || 0.67 | 0.68 | +3% | (run time too short) |
+| 69 || 74.20 | 69.98 | -6%˄ || 13.47 | 14.28 | +6%˄ | (run time too short) |
+| 73 || 58.28 | 53.90 | -8%˄ || 17.15 | 18.54 | +8%˄ | (run time too short) |
| 79 || 474.30 | 479.31 | +1%˄ || 2.11 | 2.09 | -1%˄ | (run time too short) |
| 81 || 184.75 | 186.00 | +1%˄ || 5.41 | 5.38 | -1%˄ | (run time too short) |
+| 82 || 280.92 | 221.89 | -21%˄ || 3.56 | 4.51 | +27%˄ | (run time too short) |
| 83 || 46.22 | 44.36 | -4%˄ || 21.62 | 22.52 | +4%˄ | (run time too short) |
| 84 || 9.94 | 9.95 | +0%˄ || 100.27 | 100.25 | -0%˄ | (run time too short) |
| 85 || 67.80 | 68.68 | +1%˄ || 14.74 | 14.55 | -1%˄ | (run time too short) |
| 88 || 90.69 | 88.08 | -3%˄ || 11.02 | 11.35 | +3%˄ | (run time too short) |
| 91 || 16.70 | 17.28 | +3%˄ || 59.75 | 57.76 | -3%˄ | (run time too short) |
| 92 || 38.48 | 38.26 | -1%˄ || 25.96 | 26.11 | +1%˄ | (run time too short) |
+| 93 || 546.97 | 521.32 | -5%˄ || 1.83 | 1.92 | +5%˄ | (run time too short) |
+| 94 || 32.99 | 31.42 | -5%˄ || 30.28 | 31.80 | +5%˄ | (run time too short) |
+| 95 || 724.93 | 683.62 | -6%˄ || 1.38 | 1.46 | +6%˄ | (run time too short) |
+| 96 || 49.79 | 44.65 | -10%˄ || 20.07 | 22.38 | +11%˄ | (run time too short) |
| 97 || 1305.13 | 1275.50 | -2% || 0.75 | 0.78 | +4% | (run time too short) |
| 99 || 566.04 | 579.78 | +2%˄ || 1.77 | 1.72 | -2%˄ | (run time too short) |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Sum || 12993.90 | 12538.91 | -4% || | | | |
+| Geomean || | | || | | +5% | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCDS - multi-threaded, shuffled, 64 clients, 64 cores Sum of avg. item runtimes: -1% || Geometric mean of throughput changes: +1%Configuration Overview - click to expand +Configuration Overview---------+---------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCDS_2f72cba186290ca85834639abc0ef6c44b272856_mt.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCDS_bb1319be18bfe505d05247307f454accd4e27f5d_mt.json |
+-------------------------------+---------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 2f72cba186290ca85834639abc0ef6c44b272856-dirty | bb1319be18bfe505d05247307f454accd4e27f5d-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-08 07:27:58 | 2025-06-07 22:14:28 |
| encoding | None | None |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+---------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+---------+
-| 01 || 748.02 | 847.24 | +13% || 1.02 | 1.02 | +1% | 0.0311 |
| 03 || 297.27 | 297.52 | +0% || 1.02 | 1.02 | +1% | 0.9947 |
+| 06 || 860.25 | 792.85 | -8% || 1.02 | 1.02 | +1% | 0.2378 |
| 07 || 1038.43 | 996.35 | -4% || 1.02 | 1.02 | +1% | 0.4808 |
+| 09 || 1151.60 | 957.18 | -17% || 1.01 | 1.02 | +1% | 0.0074 |
| 10 || 795.52 | 826.01 | +4% || 1.02 | 1.02 | +1% | 0.6312 |
| 13 || 1818.83 | 1776.95 | -2% || 1.02 | 1.02 | +1% | 0.5900 |
| 15 || 510.28 | 510.32 | +0% || 1.02 | 1.02 | +1% | 0.9994 |
| 16 || 403.56 | 407.86 | +1% || 1.02 | 1.02 | +1% | 0.9023 |
-| 17 || 1330.69 | 1404.28 | +6% || 1.02 | 1.02 | +1% | 0.3283 |
+| 19 || 741.95 | 680.00 | -8% || 1.02 | 1.02 | +1% | 0.2404 |
| 25 || 998.65 | 983.63 | -2% || 1.02 | 1.02 | +1% | 0.8230 |
| 26 || 529.69 | 515.83 | -3% || 1.02 | 1.02 | +1% | 0.7312 |
+| 28 || 1724.46 | 1573.08 | -9% || 1.01 | 1.02 | +1% | 0.0844 |
| 29 || 1844.33 | 1788.18 | -3% || 1.02 | 1.02 | +1% | 0.5075 |
| 31 || 2654.15 | 2723.46 | +3% || 1.01 | 1.02 | +1% | 0.5239 |
| 32 || 199.39 | 200.93 | +1% || 1.02 | 1.02 | +1% | 0.9537 |
+| 34 || 840.41 | 726.92 | -14% || 1.02 | 1.02 | +1% | 0.0192 |
-| 35 || 2091.72 | 2195.45 | +5% || 1.01 | 1.02 | +1% | 0.2409 |
+| 37 || 998.40 | 890.68 | -11% || 1.02 | 1.02 | +1% | 0.0291 |
-| 39a || 2931.22 | 3083.38 | +5% || 1.01 | 1.02 | +1% | 0.0744 |
| 39b || 2917.17 | 2937.02 | +1% || 1.01 | 1.02 | +1% | 0.8068 |
| 41 || 1911.98 | 1883.83 | -1% || 1.02 | 1.02 | +1% | 0.7308 |
+| 42 || 567.97 | 438.34 | -23% || 1.02 | 1.02 | +1% | 0.0015 |
+| 43 || 1613.46 | 1485.81 | -8% || 1.02 | 1.02 | +1% | 0.0476 |
| 45 || 785.97 | 769.30 | -2% || 1.02 | 1.02 | +1% | 0.7789 |
-| 48 || 2706.30 | 2897.14 | +7% || 1.01 | 1.02 | +1% | 0.0635 |
+| 50 || 1146.79 | 1024.35 | -11% || 1.02 | 1.02 | +1% | 0.0396 |
+| 52 || 537.33 | 461.64 | -14% || 1.02 | 1.02 | +1% | 0.0596 |
+| 55 || 504.40 | 452.93 | -10% || 1.02 | 1.02 | +1% | 0.2124 |
| 62 || 1138.89 | 1113.33 | -2% || 1.01 | 1.02 | +1% | 0.6458 |
-| 65 || 4368.09 | 4643.03 | +6% || 1.01 | 1.02 | +1% | 0.0001 |
| 69 || 1065.88 | 1080.23 | +1% || 1.01 | 1.02 | +1% | 0.8426 |
| 73 || 547.77 | 530.01 | -3% || 1.02 | 1.02 | +1% | 0.6643 |
| 79 || 1617.76 | 1625.83 | +0% || 1.01 | 1.02 | +1% | 0.9019 |
-| 81 || 542.48 | 634.51 | +17% || 1.02 | 1.02 | +1% | 0.0132 |
+| 82 || 1116.49 | 1060.78 | -5% || 1.01 | 1.02 | +1% | 0.3470 |
| 83 || 292.92 | 293.21 | +0% || 1.02 | 1.02 | +1% | 0.9935 |
-| 84 || 126.48 | 134.47 | +6% || 1.02 | 1.02 | +1% | 0.7448 |
| 85 || 813.63 | 788.31 | -3% || 1.02 | 1.02 | +1% | 0.6375 |
+| 88 || 2965.25 | 2639.66 | -11% || 1.01 | 1.02 | +1% | 0.0075 |
+| 91 || 216.55 | 190.28 | -12% || 1.02 | 1.02 | +1% | 0.3873 |
+| 92 || 302.16 | 232.01 | -23% || 1.02 | 1.02 | +1% | 0.0299 |
| 93 || 1655.26 | 1709.61 | +3% || 1.02 | 1.02 | +1% | 0.3850 |
+| 94 || 479.09 | 423.36 | -12% || 1.02 | 1.02 | +1% | 0.2112 |
| 95 || 2262.60 | 2310.13 | +2% || 1.01 | 1.02 | +1% | 0.5741 |
+| 96 || 485.53 | 442.31 | -9% || 1.02 | 1.02 | +1% | 0.2771 |
-| 97 || 4200.82 | 4503.45 | +7% || 1.01 | 1.02 | +1% | 0.0017 |
+| 99 || 1495.28 | 1427.48 | -5% || 1.01 | 1.02 | +1% | 0.2048 |
+---------++----------+----------+--------++----------+----------+--------+---------+
| Sum || 62893.10 | 62310.45 | -1% || | | | |
| Geomean || | | || | | +1% | |
+---------++----------+----------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCC - single-threaded Sum of avg. item runtimes: -12% || Geometric mean of throughput changes: +18%Configuration Overview - click to expand +Configuration Overview---+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCC_2f72cba186290ca85834639abc0ef6c44b272856_st.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCC_bb1319be18bfe505d05247307f454accd4e27f5d_st.json |
+-------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 2f72cba186290ca85834639abc0ef6c44b272856-dirty | bb1319be18bfe505d05247307f454accd4e27f5d-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-08 07:48:15 | 2025-06-07 22:34:44 |
| encoding | None | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10 | 10 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+ +--------------++----------+---------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+--------------++----------+---------+--------++----------+----------+--------+---------+
+| Delivery || 29.30 | 26.14 | -11% || 4.52 | 5.05 | +12% | 0.0000 |
+| New-Order || 14.19 | 12.21 | -14% || 52.13 | 59.34 | +14% | 0.0000 |
+| Order-Status || 1.44 | 1.18 | -18% || 4.03 | 5.08 | +26% | 0.0000 |
+| Payment || 2.23 | 2.19 | -2% || 49.27 | 56.97 | +16% | 0.0000 |
+| Stock-Level || 2.23 | 1.87 | -16% || 4.35 | 5.30 | +22% | 0.0000 |
+--------------++----------+---------+--------++----------+----------+--------+---------+
+| Sum || 49.40 | 43.59 | -12% || | | |
10000
|
+| Geomean || | | || | | +18% | |
+--------------++----------+---------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCC - multi-threaded, shuffled, 64 clients, 10 warehouses, 64 cores (high contention) Sum of avg. item runtimes: +1% || Geometric mean of throughput changes: -1%Configuration Overview - click to expand +Configuration Overview---------+-----------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCC_2f72cba186290ca85834639abc0ef6c44b272856_mt_highcont.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCC_bb1319be18bfe505d05247307f454accd4e27f5d_mt_highcont.json |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 2f72cba186290ca85834639abc0ef6c44b272856-dirty | bb1319be18bfe505d05247307f454accd4e27f5d-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-08 07:56:02 | 2025-06-07 22:42:41 |
| encoding | None | None |
| max_duration | 600000000000 | 600000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10 | 10 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------+ +--------------++----------+---------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+--------------++----------+---------+--------++----------+----------+--------+---------+
| Delivery || 176.58 | 178.95 | +1% || 34.58 | 34.15 | -1% | 0.0010 |
| unsucc.: || 3.27 | 3.49 | +7% || 51.82 | 52.02 | +0% | |
| New-Order || 91.90 | 91.99 | +0% || 482.50 | 477.73 | -1% | 0.5440 |
| unsucc.: || 8.25 | 8.83 | +7% || 488.80 | 483.92 | -1% | |
| Order-Status || 9.46 | 9.48 | +0% || 86.27 | 86.13 | -0% | 0.9133 |
| Payment || 14.91 | 15.54 | +4% || 247.19 | 241.44 | -2% | 0.0000 |
| unsucc.: || 5.27 | 5.41 | +3% || 681.48 | 678.92 | -0% | |
| Stock-Level || 13.74 | 13.79 | +0% || 86.30 | 85.23 | -1% | 0.8091 |
+--------------++----------+---------+--------++----------+----------+--------+---------+
| Sum || 306.59 | 309.74 | +1% || | | | |
| Geomean || | | || | | -1% | |
+--------------++----------+---------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCC - multi-threaded, shuffled, 10 clients, 10 warehouses, 64 cores (low contention) Sum of avg. item runtimes: -3% || Geometric mean of throughput changes: +4%Configuration Overview - click to expand +Configuration Overview---------+----------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCC_2f72cba186290ca85834639abc0ef6c44b272856_mt_lowcont.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCC_bb1319be18bfe505d05247307f454accd4e27f5d_mt_lowcont.json |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 2f72cba186290ca85834639abc0ef6c44b272856-dirty | bb1319be18bfe505d05247307f454accd4e27f5d-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 10 | 10 |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-08 08:06:14 | 2025-06-07 22:52:53 |
| encoding | None | None |
| max_duration | 600000000000 | 600000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10 | 10 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------+ +--------------++----------+---------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+--------------++----------+---------+--------++----------+----------+--------+---------+
| Delivery || 77.43 | 75.17 | -3% || 16.00 | 16.55 | +3% | 0.0000 |
| unsucc.: || 0.99 | 0.90 | -9% || 1.97 | 2.08 | +6% | |
+| New-Order || 39.49 | 37.56 | -5% || 182.46 | 190.23 | +4% | 0.0000 |
| unsucc.: || 3.18 | 3.01 | -6% || 17.37 | 17.70 | +2% | |
+| Order-Status || 4.41 | 4.16 | -6% || 17.82 | 18.21 | +2% | 0.0000 |
| Payment || 7.90 | 7.96 | +1% || 157.12 | 162.37 | +3% | 0.0000 |
| unsucc.: || 2.03 | 2.03 | -0% || 34.17 | 36.46 | +7% | |
+| Stock-Level || 5.52 | 5.54 | +0% || 17.71 | 18.56 | +5% | 0.0969 |
+--------------++----------+---------+--------++----------+----------+--------+---------+
| Sum || 134.74 | 130.38 | -3% || | | | |
| Geomean || | | || | | +4% | |
+--------------++----------+---------+--------++----------+----------+--------+---------+hyriseBenchmarkJoinOrder - single-threaded Sum of avg. item runtimes: -2% || Geometric mean of throughput changes: +17%Configuration Overview - click to expand +Configuration Overview---+-------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkJoinOrder_2f72cba186290ca85834639abc0ef6c44b272856_st.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkJoinOrder_bb1319be18bfe505d05247307f454accd4e27f5d_st.json |
+-------------------------+-------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 2f72cba186290ca85834639abc0ef6c44b272856-dirty | bb1319be18bfe505d05247307f454accd4e27f5d-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-08 08:16:21 | 2025-06-07 23:03:00 |
| encoding | None | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+-------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
+| 10a || 152.87 | 102.03 | -33%˄ || 6.54 | 9.80 | +50%˄ | (run time too short) |
+| 10b || 92.83 | 58.48 | -37%˄ || 10.77 | 17.10 | +59%˄ | (run time too short) |
| 10c || 329.60 | 320.71 | -3%˄ || 3.03 | 3.12 | +3%˄ | (run time too short) |
+| 11a || 37.41 | 26.69 | -29%˄ || 26.73 | 37.46 | +40%˄ | (run time too short) |
+| 11b || 31.48 | 25.24 | -20%˄ || 31.77 | 39.61 | +25%˄ | (run time too short) |
+| 11c || 26.22 | 21.13 | -19%˄ || 38.13 | 47.33 | +24%˄ | (run time too short) |
+| 11d || 25.26 | 19.93 | -21%˄ || 39.59 | 50.16 | +27%˄ | (run time too short) |
+| 12a || 47.24 | 29.55 | -37%˄ || 21.17 | 33.84 | +60%˄ | (run time too short) |
+| 12b || 37.07 | 24.08 | -35%˄ || 26.98 | 41.53 | +54%˄ | (run time too short) |
+| 12c || 80.47 | 69.18 | -14%˄ || 12.43 | 14.45 | +16%˄ | (run time too short) |
+| 13a || 182.48 | 173.14 | -5%˄ || 5.48 | 5.78 | +5%˄ | (run time too short) |
+| 13b || 241.84 | 230.52 | -5%˄ || 4.13 | 4.34 | +5%˄ | (run time too short) |
+| 13c || 41.81 | 30.46 | -27%˄ || 23.91 | 32.83 | +37%˄ | (run time too short) |
| 13d || 529.21 | 513.74 | -3%˄ || 1.89 | 1.95 | +3%˄ | (run time too short) |
+| 14a || 102.54 | 95.56 | -7%˄ || 9.75 | 10.46 | +7%˄ | (run time too short) |
+| 14b || 116.42 | 107.93 | -7%˄ || 8.59 | 9.26 | +8%˄ | (run time too short) |
+| 14c || 182.20 | 172.48 | -5%˄ || 5.49 | 5.80 | +6%˄ | (run time too short) |
+| 15a || 76.27 | 49.74 | -35%˄ || 13.11 | 20.10 | +53%˄ | (run time too short) |
+| 15b || 92.16 | 54.51 | -41%˄ || 10.85 | 18.34 | +69%˄ | (run time too short) |
+| 15c || 53.26 | 40.07 | -25%˄ || 18.78 | 24.96 | +33%˄ | (run time too short) |
+| 15d || 49.39 | 36.92 | -25%˄ || 20.25 | 27.08 | +34%˄ | (run time too short) |
-| 16a || 1265.75 | 1368.79 | +8% || 0.78 | 0.72 | -9% | (run time too short) |
| 16b || 2446.96 | 2555.94 | +4% || 0.40 | 0.38 | -4% | (run time too short) |
-| 16c || 1428.64 | 1539.14 | +8% || 0.68 | 0.63 | -7% | (run time too short) |
-| 16d || 1389.53 | 1502.31 | +8% || 0.72 | 0.65 | -9% | (run time too short) |
-| 17a || 390.07 | 442.73 | +14%˄ || 2.56 | 2.26 | -12%˄ | (run time too short) |
-| 17b || 309.27 | 360.55 | +17%˄ || 3.23 | 2.77 | -14%˄ | (run time too short) |
-| 17c || 288.56 | 340.67 | +18%˄ || 3.47 | 2.94 | -15%˄ | (run time too short) |
-| 17d || 367.96 | 403.16 | +10%˄ || 2.72 | 2.48 | -9%˄ | (run time too short) |
-| 17e || 1478.54 | 1587.92 | +7% || 0.67 | 0.62 | -7% | (run time too short) |
-| 17f || 843.78 | 890.55 | +6%˄ || 1.19 | 1.12 | -5%˄ | (run time too short) |
+| 18a || 152.93 | 126.35 | -17%˄ || 6.54 | 7.91 | +21%˄ | (run time too short) |
+| 18b || 110.26 | 99.80 | -9%˄ || 9.07 | 10.02 | +10%˄ | (run time too short) |
| 18c || 184.75 | 184.21 | -0%˄ || 5.41 | 5.43 | +0%˄ | (run time too short) |
+| 19a || 229.19 | 199.33 | -13%˄ || 4.36 | 5.02 | +15%˄ | (run time too short) |
+| 19b || 204.41 | 166.58 | -19%˄ || 4.89 | 6.00 | +23%˄ | (run time too short) |
+| 19c || 256.27 | 239.94 | -6%˄ || 3.90 | 4.17 | +7%˄ | (run time too short) |
| 19d || 719.40 | 708.12 | -2%˄ || 1.39 | 1.41 | +2%˄ | (run time too short) |
+| 1a || 11.77 | 7.03 | -40%˄ || 84.92 | 142.25 | +68%˄ | (run time too short) |
+| 1b || 29.16 | 13.62 | -53%˄ || 34.29 | 73.42 | +114%˄ | (run time too short) |
+| 1c || 24.83 | 14.96 | -40%˄ || 40.26 | 66.82 | +66%˄ | (run time too short) |
+| 1d || 10.96 | 6.43 | -41%˄ || 91.24 | 155.45 | +70%˄ | (run time too short) |
| 20a || 522.06 | 507.47 | -3%˄ || 1.92 | 1.97 | +3%˄ | (run time too short) |
+| 20b || 573.69 | 544.04 | -5%˄ || 1.74 | 1.84 | +5%˄ | (run time too short) |
+| 20c || 396.66 | 359.32 | -9%˄ || 2.52 | 2.78 | +10%˄ | (run time too short) |
+| 21a || 51.35 | 40.62 | -21%˄ || 19.47 | 24.62 | +26%˄ | (run time too short) |
+| 21b || 44.78 | 31.08 | -31%˄ || 22.33 | 32.18 | +44%˄ | (run time too short) |
+| 21c || 41.22 | 36.82 | -11%˄ || 24.26 | 27.16 | +12%˄ | (run time too short) |
+| 22a || 182.33 | 163.84 | -10%˄ || 5.48 | 6.10 | +11%˄ | (run time too short) |
+| 22b || 165.43 | 146.29 | -12%˄ || 6.04 | 6.84 | +13%˄ | (run time too short) |
+| 22c || 243.59 | 224.35 | -8%˄ || 4.11 | 4.46 | +9%˄ | (run time too short) |
| 22d || 357.22 | 348.15 | -3%˄ || 2.80 | 2.87 | +3%˄ | (run time too short) |
+| 23a || 57.31 | 43.23 | -25%˄ || 17.45 | 23.13 | +33%˄ | (run time too short) |
+| 23b || 61.89 | 50.84 | -18%˄ || 16.16 | 19.67 | +22%˄ | (run time too short) |
+| 23c || 59.85 | 45.93 | -23%˄
10000
|| 16.71 | 21.77 | +30%˄ | (run time too short) |
+| 24a || 225.31 | 200.15 | -11%˄ || 4.44 | 5.00 | +13%˄ | (run time too short) |
+| 24b || 207.93 | 185.53 | -11%˄ || 4.81 | 5.39 | +12%˄ | (run time too short) |
| 25a || 98.39 | 94.92 | -4%˄ || 10.16 | 10.53 | +4%˄ | (run time too short) |
+| 25b || 63.74 | 60.82 | -5%˄ || 15.69 | 16.44 | +5%˄ | (run time too short) |
| 25c || 230.48 | 224.06 | -3%˄ || 4.34 | 4.46 | +3%˄ | (run time too short) |
-| 26a || 138.47 | 160.66 | +16%˄ || 7.22 | 6.22 | -14%˄ | (run time too short) |
-| 26b || 121.16 | 130.89 | +8%˄ || 8.25 | 7.64 | -7%˄ | (run time too short) |
-| 26c || 250.80 | 303.66 | +21%˄ || 3.99 | 3.29 | -17%˄ | (run time too short) |
+| 27a || 47.28 | 34.06 | -28%˄ || 21.15 | 29.35 | +39%˄ | (run time too short) |
+| 27b || 34.26 | 24.78 | -28%˄ || 29.18 | 40.34 | +38%˄ | (run time too short) |
+| 27c || 41.56 | 36.55 | -12%˄ || 24.06 | 27.35 | +14%˄ | (run time too short) |
+| 28a || 210.39 | 188.33 | -10%˄ || 4.75 | 5.31 | +12%˄ | (run time too short) |
+| 28b || 86.72 | 67.47 | -22%˄ || 11.53 | 14.82 | +29%˄ | (run time too short) |
+| 28c || 189.75 | 164.00 | -14%˄ || 5.27 | 6.10 | +16%˄ | (run time too short) |
+| 29a || 211.21 | 162.73 | -23%˄ || 4.73 | 6.15 | +30%˄ | (run time too short) |
+| 29b || 953.08 | 756.13 | -21%˄ || 1.05 | 1.32 | +26%˄ | (run time too short) |
+| 29c || 233.08 | 198.49 | -15%˄ || 4.29 | 5.04 | +17%˄ | (run time too short) |
+| 2a || 29.56 | 25.22 | -15%˄ || 33.83 | 39.65 | +17%˄ | (run time too short) |
+| 2b || 27.67 | 23.02 | -17%˄ || 36.14 | 43.43 | +20%˄ | (run time too short) |
+| 2c || 24.06 | 19.02 | -21%˄ || 41.56 | 52.56 | +26%˄ | (run time too short) |
+| 2d || 56.07 | 51.67 | -8%˄ || 17.83 | 19.35 | +8%˄ | (run time too short) |
+| 30a || 87.18 | 82.26 | -6%˄ || 11.47 | 12.16 | +6%˄ | (run time too short) |
+| 30b || 91.29 | 86.12 | -6%˄ || 10.95 | 11.61 | +6%˄ | (run time too short) |
| 30c || 149.38 | 145.74 | -2%˄ || 6.69 | 6.86 | +2%˄ | (run time too short) |
+| 31a || 77.15 | 72.19 | -6%˄ || 12.96 | 13.85 | +7%˄ | (run time too short) |
+| 31b || 82.36 | 71.26 | -13%˄ || 12.14 | 14.03 | +16%˄ | (run time too short) |
+| 31c || 87.96 | 82.40 | -6%˄ || 11.37 | 12.14 | +7%˄ | (run time too short) |
+| 32a || 15.43 | 9.81 | -36%˄ || 64.80 | 101.90 | +57%˄ | (run time too short) |
+| 32b || 33.68 | 27.87 | -17%˄ || 29.68 | 35.87 | +21%˄ | (run time too short) |
+| 33a || 51.34 | 28.97 | -44%˄ || 19.48 | 34.52 | +77%˄ | (run time too short) |
+| 33b || 29.74 | 18.26 | -39%˄ || 33.62 | 54.76 | +63%˄ | (run time too short) |
+| 33c || 56.37 | 39.53 | -30%˄ || 17.74 | 25.30 | +43%˄ | (run time too short) |
+| 3a || 71.53 | 64.58 | -10%˄ || 13.98 | 15.48 | +11%˄ | (run time too short) |
+| 3b || 25.00 | 16.40 | -34%˄ || 40.00 | 60.97 | +52%˄ | (run time too short) |
| 3c || 214.21 | 208.28 | -3%˄ || 4.67 | 4.80 | +3%˄ | (run time too short) |
+| 4a || 150.49 | 142.04 | -6%˄ || 6.64 | 7.04 | +6%˄ | (run time too short) |
+| 4b || 23.77 | 15.14 | -36%˄ || 42.06 | 66.04 | +57%˄ | (run time too short) |
| 4c || 186.47 | 180.31 | -3%˄ || 5.36 | 5.55 | +3%˄ | (run time too short) |
+| 5a || 67.19 | 48.82 | -27%˄ || 14.88 | 20.48 | +38%˄ | (run time too short) |
+| 5b || 65.19 | 49.42 | -24%˄ || 15.34 | 20.23 | +32%˄ | (run time too short) |
+| 5c || 97.39 | 87.52 | -10%˄ || 10.27 | 11.43 | +11%˄ | (run time too short) |
| 6a || 150.00 | 146.71 | -2%˄ || 6.67 | 6.82 | +2%˄ | (run time too short) |
| 6b || 159.09 | 160.05 | +1%˄ || 6.29 | 6.25 | -1%˄ | (run time too short) |
| 6c || 139.36 | 138.31 | -1%˄ || 7.18 | 7.23 | +1%˄ | (run time too short) |
| 6d || 350.34 | 362.62 | +4%˄ || 2.85 | 2.76 | -3%˄ | (run time too short) |
| 6e || 143.07 | 141.56 | -1%˄ || 6.99 | 7.06 | +1%˄ | (run time too short) |
-| 6f || 643.67 | 689.05 | +7%˄ || 1.55 | 1.45 | -7%˄ | (run time too short) |
+| 7a || 121.07 | 81.23 | -33%˄ || 8.26 | 12.31 | +49%˄ | (run time too short) |
+| 7b || 115.79 | 77.05 | -33%˄ || 8.64 | 12.98 | +50%˄ | (run time too short) |
| 7c || 565.65 | 547.30 | -3%˄ || 1.77 | 1.83 | +3%˄ | (run time too short) |
+| 8a || 194.88 | 169.08 | -13%˄ || 5.13 | 5.91 | +15%˄ | (run time too short) |
+| 8b || 198.42 | 160.91 | -19%˄ || 5.04 | 6.21 | +23%˄ | (run time too short) |
| 8c || 1744.73 | 1754.17 | +1% || 0.57 | 0.57 | +0% | 0.0020 |
+| 8d || 480.60 | 450.62 | -6%˄ || 2.08 | 2.22 | +7%˄ | (run time too short) |
| 9a || 242.71 | 235.49 | -3%˄ || 4.12 | 4.25 | +3%˄ | (run time too short) |
+| 9b || 164.41 | 135.02 | -18%˄ || 6.08 | 7.41 | +22%˄ | (run time too short) |
| 9c || 288.24 | 283.70 | -2%˄ || 3.47 | 3.52 | +2%˄ | (run time too short) |
+| 9d || 452.85 | 431.76 | -5%˄ || 2.21 | 2.32 | +5%˄ | (run time too short) |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Sum || 28727.32 | 28055.90 | -2% || | | | |
+| Geomean || | | || | | +17% | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkJoinOrder - multi-threaded, ordered, 1 client, 64 cores Sum of avg. item runtimes: +1% || Geometric mean of throughput changes: +1%Configuration Overview - click to expand +Configuration Overview---------+---------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkJoinOrder_2f72cba186290ca85834639abc0ef6c44b272856_mt_ordered.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkJoinOrder_bb1319be18bfe505d05247307f454accd4e27f5d_mt_ordered.json |
+-------------------------------+---------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 2f72cba186290ca85834639abc0ef6c44b272856-dirty | bb1319be18bfe505d05247307f454accd4e27f5d-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-08 08:40:58 | 2025-06-07 23:26:17 |
| encoding | None | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------------+---------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| 10a || 38.16 | 37.90 | -1%˄ || 26.18 | 26.36 | +1%˄ | (run time too short) |
| 10b || 17.36 | 17.35 | -0%˄ || 57.50 | 57.51 | +0%˄ | (run time too short) |
-| 10c || 107.88 | 119.19 | +10%˄ || 9.27 | 8.39 | -9%˄ | (run time too short) |
+| 11a || 10.71 | 10.21 | -5%˄ || 93.03 | 97.64 | +5%˄ | (run time too short) |
+| 11b || 8.62 | 8.16 | -5%˄ || 115.52 | 122.12 | +6%˄ | (run time too short) |
+| 11c || 24.03 | 22.58 | -6%˄ || 41.56 | 44.22 | +6%˄ | (run time too short) |
| 11d || 27.68 | 26.54 | -4%˄ || 36.09 | 37.63 | +4%˄ | (run time too short) |
| 12a || 20.82 | 20.96 | +1%˄ || 47.96 | 47.63 | -1%˄ | (run time too short) |
+| 12b || 12.65 | 11.91 | -6%˄ || 78.78 | 83.68 | +6%˄ | (run time too short) |
| 12c || 49.90 | 49.97 | +0%˄ || 20.02 | 20.00 | -0%˄ | (run time too short) |
| 13a || 129.92 | 128.43 | -1%˄ || 7.69 | 7.78 | +1%˄ | (run time too short) |
| 13b || 95.06 | 92.64 | -3%˄ || 10.52 | 10.79 | +3%˄ | (run time too short) |
+| 13c || 16.60 | 15.72 | -5%˄ || 60.09 | 63.46 | +6%˄ | (run time too short) |
| 13d || 365.58 | 364.41 | -0%˄ || 2.74 | 2.74 | +0%˄ | (run time too short) |
| 14a || 56.13 | 55.51 | -1%˄ || 17.80 | 18.00 | +1%˄ | (run time too short) |
| 14b || 72.25 | 71.35 | -1%˄ || 13.83 | 14.01 | +1%˄ | (run time too short) |
| 14c || 114.50 | 113.20 | -1%˄ || 8.73 | 8.83 | +1%˄ | (run time too short) |
| 15a || 29.57 | 29.04 | -2%˄ || 33.78 | 34.40 | +2%˄ | (run time too short) |
| 15b || 25.12 | 24.94 | -1%˄ || 39.75 | 40.05 | +1%˄ | (run time too short) |
| 15c || 22.28 | 21.84 | -2%˄ || 44.81 | 45.72 | +2%˄ | (run time too short) |
| 15d || 27.86 | 27.59 | -1%˄ || 35.85 | 36.21 | +1%˄ | (run time too short) |
-| 16a || 766.78 | 819.64 | +7%˄ || 1.30 | 1.22 | -6%˄ | (run time too short) |
| 16b || 1959.82 | 1999.27 | +2% || 0.50 | 0.48 | -3% | (run time too short) |
-| 16c || 925.91 | 977.34 | +6%˄ || 1.08 | 1.02 | -5%˄ | (run time too short) |
-| 16d || 888.33 | 937.89 | +6%˄ || 1.13 | 1.07 | -5%˄ | (run time too short) |
| 17a || 182.84 | 183.64 | +0%˄ || 5.47 | 5.44 | -0%˄ | (run time too short) |
| 17b || 153.74 | 154.74 | +1%˄ || 6.50 | 6.46 | -1%˄ | (run time too short) |
| 17c || 131.05 | 126.05 | -4%˄ || 7.63 | 7.93 | +4%˄ | (run time too short) |
| 17d || 122.82 | 122.10 | -1%˄ || 8.14 | 8.19 | +1%˄ | (run time too short) |
| 17e || 791.35 | 811.66 | +3%˄ || 1.26 | 1.23 | -3%˄ | (run time too short) |
| 17f || 313.02 | 314.65 | +1%˄ || 3.19 | 3.18 | -1%˄ | (run time too short) |
| 18a || 51.72 | 51.16 | -1%˄ || 19.32 | 19.53 | +1%˄ | (run time too short) |
| 18b || 49.19 | 49.40 | +0%˄ || 20.31 | 20.23 | -0%˄ | (run time too short) |
| 18c || 99.40 | 101.00 | +2%˄ || 10.06 | 9.90 | -2%˄ | (run time too short) |
| 19a || 98.76 | 97.29 | -1%˄ || 10.12 | 10.27 | +2%˄ | (run time too short) |
| 19b || 61.03 | 59.96 | -2%˄ || 16.38 | 16.67 | +2%˄ | (run time too short) |
| 19c || 113.06 | 111.76 | -1%˄ || 8.84 | 8.94 | +1%˄ | (run time too short) |
| 19d || 513.48 | 512.67 | -0%˄ || 1.95 | 1.95 | +0%˄ | (run time too short) |
+| 1a || 6.49 | 6.06 | -7%˄ || 153.39 | 164.11 | +7%˄ | (run time too short) |
+| 1b || 7.48 | 4.32 | -42%˄ || 133.01 | 229.68 | +73%˄ | (run time too short) |
+| 1c || 5.00 | 3.78 | -24%˄ || 198.54 | 262.11 | +32%˄ | (run time too short) |
+| 1d || 5.21 | 4.76 | -9%˄ || 190.94 | 208.58 | +9%˄ | (run time too short) |
| 20a || 83.38 | 81.14 | -3%˄ || 11.99 | 12.32 | +3%˄ | (run time too short) |
| 20b || 73.96 | 71.03 | -4%˄ || 13.51 | 14.07 | +4%˄ | (run time too short) |
| 20c || 75.95 | 77.77 | +2%˄ || 13.16 | 12.85 | -2%˄ | (run time too short) |
| 21a || 16.57 | 16.37 | -1%˄ || 60.21 | 60.94 | +1%˄ | (run time too short) |
| 21b || 15.12 | 14.72 | -3%˄ || 65.98 | 67.80 | +3%˄ | (run time too short) |
| 21c || 18.29 | 18.09 | -1%˄ || 54.55 | 55.16 | +1%˄ | (run time too short) |
| 22a || 72.46 | 69.56 | -4%˄ || 13.79 | 14.37 | +4%˄ | (run time too short) |
| 22b || 53.37 | 52.31 | -2%˄ || 18.72 | 19.10 | +2%˄ | (run time too short) |
| 22c || 118.02 | 121.28 | +3%˄ || 8.47 | 8.24 | -3%˄ | (run time too short) |
| 22d || 212.94 | 213.33 | +0%˄ || 4.70 | 4.69 | -0%˄ | (run time too short) |
+| 23a || 16.09 | 15.35 | -5%˄ || 62.01 | 65.00 | +5%˄ | (run time too short) |
| 23b || 26.53 | 26.30 | -1%˄ || 37.64 | 37.98 | +1%˄ | (run time too short) |
+| 23c || 18.48 | 17.28 | -6%˄ || 54.02 | 57.77 | +7%˄ | (run time too short) |
| 24a || 59.90 | 59.44 | -1%˄ || 16.68 | 16.81 | +1%˄ | (run time too short) |
| 24b || 59.91 | 59.76 | -0%˄ || 16.68 | 16.72 | +0%˄ | (run time too short) |
| 25a || 55.89 | 56.04 | +0%˄ || 17.88 | 17.83 | -0%˄ | (run time too short) |
| 25b || 32.14 | 32.08 | -0%˄ || 31.08 | 31.13 | +0%˄ | (run time too short) |
| 25c || 152.13 | 154.23 | +1%˄ || 6.57 | 6.48 | -1%˄ | (run time too short) |
-| 26a || 80.31 | 84.30 | +5%˄ || 12.45 | 11.86 | -5%˄ | (run time too short) |
-| 26b || 57.52 | 62.16 | +8%˄ || 17.37 | 16.08 | -7%˄ | (run time too short) |
-| 26c || 119.70 | 129.07 | +8%˄ || 8.35 | 7.75 | -7%˄ | (run time too short) |
| 27a || 19.49 | 19.32 | -1%˄ || 51.22 | 51.66 | +1%˄ | (run time too short) |
| 27b || 18.30 | 17.96 | -2%˄ || 54.55 | 55.58 | +2%˄ | (run time too short) |
| 27c || 18.04 | 17.59 | -2%˄ || 55.33 | 56.74 | +3%˄ | (run time too short) |
| 28a || 124.61 | 120.49 | -3%˄ || 8.02 | 8.30 | +3%˄ | (run time too short) |
| 28b || 27.11 | 26.69 | -2%˄ || 36.83 | 37.41 | +2%˄ | (run time too short) |
| 28c || 102.54 | 100.59 | -2%˄ || 9.75 | 9.94 | +2%˄ | (run time too short) |
| 29a || 53.78 | 52.55 | -2%˄ || 18.58 | 19.02 | +2%˄ | (run time too short) |
| 29b || 134.24 | 129.47 | -4%˄ || 7.45 | 7.72 | +4%˄ | (run time too short) |
| 29c || 66.22 | 65.39 | -1%˄ || 15.09 | 15.28 | +1%˄ | (run time too short) |
+| 2a || 22.87 | 21.73 | -5%˄ || 43.66 | 45.96 | +5%˄ | (run time too short) |
| 2b || 19.71 | 18.91 | -4%˄ || 50.66 | 52.79 | +4%˄ | (run time too short) |
+| 2c || 14.30 | 13.48 | -6%˄ || 69.78 | 74.00 | +6%˄ | (run time too short) |
| 2d || 47.59 | 49.61 | +4%˄ || 21.00 | 20.15 | -4%˄ | (run time too short) |
| 30a || 47.00 | 46.94 | -0%˄ || 21.26 | 21.29 | +0%˄ | (run time too short) |
| 30b || 36.81 | 35.88 | -3%˄ || 27.14 | 27.84 | +3%˄ | (run time too short) |
| 30c || 112.12 | 111.63 | -0%˄ || 8.92 | 8.95 | +0%˄ | (run time too short) |
| 31a || 37.91 | 38.51 | +2%˄ || 26.35 | 25.94 | -2%˄ | (run time too short) |
| 31b || 33.58 | 34.08 | +1%˄ || 29.74 | 29.31 | -1%˄ | (run time too short) |
| 31c || 41.36 | 42.20 | +2%˄ || 24.15 | 23.67 | -2%˄ | (run time too short) |
+| 32a || 6.70 | 5.94 | -11%˄ || 148.55 | 167.52 | +13%˄ | (run time too short) |
| 32b || 29.60 | 28.83 | -3%˄ || 33.75 | 34.65 | +3%˄ | (run time too short) |
+| 33a || 13.99 | 10.10 | -28%˄ || 71.29 | 98.69 | +38%˄ | (run time too short) |
+| 33b || 9.81 | 8.31 | -15%˄ || 101.56 | 119.88 | +18%˄ | (run time too short) |
+| 33c || 20.93 | 18.27 | -13%˄ || 47.69 | 54.63 | +15%˄ | (run time too short) |
-| 3a || 32.17 | 37.62 | +17%˄ || 31.05 | 26.55 | -14%˄ | (run time too short) |
| 3b || 6.69 | 6.46 | -3%˄ || 148.74 | 154.13 | +4%˄ | (run time too short) |
-| 3c || 70.30 | 74.32 | +6%˄ || 14.22 | 13.45 | -5%˄ | (run time too short) |
| 4a || 66.99 | 66.96 | -0%˄ || 14.92 | 14.93 | +0%˄ | (run time too short) |
+| 4b || 5.57 | 5.12 | -8%˄ || 178.57 | 194.20 | +9%˄ | (run time too short) |
| 4c || 84.41 | 85.14 | +1%˄ || 11.84 | 11.74 | -1%˄ | (run time too short) |
| 5a || 24.76 | 25.02 | +1%˄ || 40.33 | 39.91 | -1%˄ | (run time too short) |
| 5b || 20.46 | 20.43 | -0%˄ || 48.80 | 48.86 | +0%˄ | (run time too short) |
| 5c || 48.18 | 47.89 | -1%˄ || 20.74 | 20.87 | +1%˄ | (run time too short) |
-| 6a || 24.86 | 28.90 | +16%˄ || 40.16 | 34.56 | -14%˄ | (run time too short) |
-| 6b || 45.72 | 49.31 | +8%˄ || 21.86 | 20.27 | -7%˄ | (run time too short) |
-| 6c || 23.07 | 27.92 | +21%˄ || 43.28 | 35.77 | -17%˄ | (run time too short) |
| 6d || 128.60 | 127.98 | -0%˄ || 7.77 | 7.81 | +0%˄ | (run time too short) |
-| 6e || 24.99 | 29.35 | +17%˄ || 39.95 | 34.03 | -15%˄ | (run time too short) |
| 6f || 470.00 | 476.52 | +1%˄ || 2.13 | 2.10 | -1%˄ | (run time too short) |
| 7a || 28.36 | 27.15 | -4%˄ || 35.22 | 36.78 | +4%˄ | (run time too short) |
| 7b || 26.83 | 26.08 | -3%˄ || 37.22 | 38.29 | +3%˄ | (run time too short) |
| 7c || 261.65 | 258.30 | -1%˄ || 3.82 | 3.87 | +1%˄ | (run time too short) |
| 8a || 40.56 | 40.44 | -0%˄ || 24.63 | 24.71 | +0%˄ | (run time too short) |
| 8b || 39.43 | 39.28 | -0%˄ || 25.33 | 25.43 | +0%˄ | (run time too short) |
| 8c || 1085.16 | 1084.71 | -0%˄ || 0.92 | 0.92 | +0%˄ | (run time too short) |
| 8d || 274.09 | 267.79 | -2%˄ || 3.65 | 3.73 | +2%˄ | (run time too short) |
| 9a || 127.07 | 128.40 | +1%˄ || 7.87 | 7.79 | -1%˄ | (run time too short) |
| 9b || 71.82 | 71.60 | -0%˄ || 13.92 | 13.96 | +0%˄ | (run time too short) |
| 9c || 144.59 | 144.78 | +0%˄ || 6.91 | 6.91 | -0%˄ | (run time too short) |
| 9d || 349.10 | 352.11 | +1%˄ || 2.86 | 2.84 | -1%˄ | (run time too short) |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Sum || 14521.85 | 14734.20 | +1% || | | | |
| Geomean || | | || | | +1% | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkJoinOrder - multi-threaded, shuffled, 64 clients, 64 cores Sum of avg. item runtimes: +4% || Geometric mean of throughput changes: -4%Configuration Overview - click to expand +Configuration Overview---------+-------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkJoinOrder_2f72cba186290ca85834639abc0ef6c44b272856_mt.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkJoinOrder_bb1319be18bfe505d05247307f454accd4e27f5d_mt.json |
+-------------------------------+-------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 2f72cba186290ca85834639abc0ef6c44b272856-dirty | bb1319be18bfe505d05247307f454accd4e27f5d-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-08 08:55:08 | 2025-06-07 23:40:29 |
| encoding | None | None |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+-------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+---------+
+| 10a || 200.53 | 187.07 | -7% || 1.27 | 1.22 | -4% | 0.4174 |
+| 10b || 133.78 | 126.90 | -5% || 1.27 | 1.22 | -4% | 0.6886 |
-| 10c || 578.88 | 656.36 | +13% || 1.27 | 1.22 | -4% | 0.0056 |
-| 11a || 81.98 | 93.11 | +14% || 1.27 | 1.22 | -4% | 0.3935 |
-| 11b || 76.56 | 96.35 | +26% || 1.27 | 1.22 | -4% | 0.0917 |
+| 11c || 128.92 | 122.77 | -5% || 1.27 | 1.22 | -4% | 0.6350 |
-| 11d || 80.39 | 90.01 | +12% || 1.27 | 1.22 | -4% | 0.2919 |
+| 12a || 162.08 | 152.21 | -6% || 1.27 | 1.22 | -4% | 0.4829 |
| 12b || 74.28 | 75.17 | +1% || 1.27 | 1.22 | -4% | 0.9234 |
| 12c || 332.30 | 339.94 | +2% || 1.27 | 1.22 | -4% | 0.7326 |
| 13a || 478.30 | 459.04 | -4% || 1.27 | 1.22 | -4% | 0.4005 |
| 13b || 340.58 | 352.44 | +3% || 1.27 | 1.22 | -4% | 0.5846 |
| 13c || 93.32 | 96.26 | +3% || 1.27 | 1.22 | -4% | 0.7953 |
| 13d || 894.26 | 907.78 | +2% || 1.27 | 1.22 | -4% | 0.6233 |
| 14a || 407.11 | 423.50 | +4% || 1.27 | 1.22 | -4% | 0.5303 |
| 14b || 438.01 | 434.53 | -1% || 1.27 | 1.22 | -4% | 0.8996 |
-| 14c || 591.87 | 622.74 | +5% || 1.27 | 1.22 | -4% | 0.2895 |
+| 15a || 123.51 | 106.57 | -14% || 1.27 | 1.22 | -4% | 0.1729 |
-| 15b || 117.75 | 132.99 | +13% || 1.27 | 1.22 | -4% | 0.3274 |
+| 15c || 140.83 | 121.60 | -14% || 1.27 | 1.22 | -4% | 0.1664 |
-| 15d || 141.54 | 150.74 | +6% || 1.27 | 1.22 | -4% | 0.4954 |
-| 16a || 1623.85 | 1698.35 | +5% || 1.27 | 1.22 | -4% | 0.0472 |
| 16b || 3079.23 | 3213.15 | +4% || 1.27 | 1.22 | -4% | 0.0012 |
-| 16c || 1860.30 | 1964.38 | +6% || 1.27 | 1.22 | -4% | 0.0103 |
-| 16d || 1804.90 | 1910.46 | +6% || 1.27 | 1.22 | -4% | 0.0092 |
-| 17a || 848.60 | 920.68 | +8% || 1.27 | 1.22 | -4% | 0.0389 |
-| 17b || 623.05 | 683.28 | +10% || 1.27 | 1.22 | -4% | 0.0470 |
-| 17c || 548.32 | 633.04 | +15% || 1.27 | 1.22 | -4% | 0.0073 |
-| 17d || 547.33 | 634.88 | +16% || 1.27 | 1.22 | -4% | 0.0027 |
| 17e || 1674.66 | 1736.23 | +4% || 1.27 | 1.22 | -4% | 0.0839 |
-| 17f || 1107.58 | 1220.81 | +10% || 1.27 | 1.22 | -4% | 0.0037 |
-| 18a || 232.66 | 271.72 | +17% || 1.27 | 1.22 | -4% | 0.0332 |
| 18b || 390.78 | 399.27 | +2% || 1.27 | 1.22 | -4% | 0.7398 |
-| 18c || 622.60 | 688.79 | +11% || 1.27 | 1.22 | -4% | 0.0604 |
| 19a || 576.03 | 592.42 | +3% || 1.27 | 1.22 | -4% | 0.6280 |
| 19b || 423.32 | 417.84 | -1% || 1.27 | 1.22 | -4% | 0.8476 |
+| 19c || 638.64 | 595.37 | -7% || 1.27 | 1.22 | -4% | 0.1815 |
-| 19d || 1384.81 | 1459.11 | +5% || 1.27 | 1.22 | -4% | 0.0647 |
-| 1a || 34.87 | 37.11 | +6% || 1.27 | 1.22 | -4% | 0.7244 |
+| 1b || 49.22 | 39.35 | -20% || 1.27 | 1.22 | -4% | 0.1714 |
-| 1c || 52.59 | 67.39 | +28% || 1.27 | 1.22 | -4% | 0.1829 |
+| 1d || 34.21 | 30.85 | -10% || 1.27 | 1.22 | -4% | 0.6072 |
| 20a || 424.68 | 440.67 | +4% || 1.27 | 1.22 | -4% | 0.4987 |
| 20b || 407.97 | 405.77 | -1% || 1.27 | 1.22 | -4% | 0.9325 |
-| 20c || 340.83 | 385.86 | +13% || 1.27 | 1.22 | -4% | 0.0438 |
+| 21a || 206.51 | 185.97 | -10% || 1.27 | 1.22 | -4% | 0.3320 |
| 21b || 124.69 | 128.17 | +3% || 1.27 | 1.22 | -4% | 0.7890 |
+| 21c || 188.43 | 170.99 | -9% || 1.27 | 1.22 | -4% | 0.3947 |
| 22a || 512.57 | 494.07 | -4% || 1.27 | 1.22 | -4% | 0.5335 |
-| 22b || 404.25 | 469.93 | +16% || 1.27 | 1.22 | -4% | 0.0219 |
| 22c || 678.31 | 687.47 | +1% || 1.27 | 1.22 | -4% | 0.7918 |
-| 22d || 883.26 | 961.51 | +9% || 1.27 | 1.22 | -4% | 0.0358 |
+| 23a || 164.24 | 140.23 | -15% || 1.27 | 1.22 | -4% | 0.0970 |
+| 23b || 145.36 | 124.87 | -14% || 1.27 | 1.22 | -4% | 0.1210 |
-| 23c || 148.94 | 169.38 | +14% || 1.27 | 1.22 | -4% | 0.2239 |
| 24a || 401.41 | 414.16 | +3% || 1.27 | 1.22 | -4% | 0.6440 |
| 24b || 322.35 | 331.44 | +3% || 1.27 | 1.22 | -4% | 0.7274 |
-| 25a || 385.02 | 420.24 | +9% || 1.27 | 1.22 | -4% | 0.1969 |
| 25b || 253.15 | 258.00 | +2% || 1.27 | 1.22 | -4% | 0.8465 |
-| 25c || 855.29 | 928.69 | +9% || 1.27 | 1.22 | -4% | 0.0411 |
-| 26a || 375.03 | 403.65 | +8% || 1.27 | 1.22 | -4% | 0.1907 |
| 26b || 236.94 | 244.16 | +3% || 1.27 | 1.22 | -4% | 0.6845 |
| 26c || 603.41 | 622.69 | +3% || 1.27 | 1.22 | -4% | 0.4690 |
-| 27a || 154.39 | 168.63 | +9% || 1.27 | 1.22 | -4% | 0.3708 |
-| 27b || 134.37 | 149.71 | +11% || 1.27 | 1.22 | -4% | 0.2871 |
-| 27c || 194.41 | 206.01 | +6% || 1.27 | 1.22 | -4% | 0.5845 |
| 28a || 633.80 | 655.90 | +3% || 1.27 | 1.22 | -4% | 0.4417 |
-| 28b || 218.80 | 264.71 | +21% || 1.27 | 1.22 | -4% | 0.0395 |
| 28c || 633.78 | 636.22 | +0% || 1.27 | 1.22 | -4% | 0.9366 |
| 29a || 285.80 | 283.20 | -1% || 1.27 | 1.22 | -4% | 0.9028 |
| 29b || 347.78 | 360.37 | +4% || 1.27 | 1.22 | -4% | 0.5964 |
-| 29c || 328.50 | 365.48 | +11% || 1.27 | 1.22 | -4% | 0.1343 |
-| 2a || 124.43 | 130.10 | +5% || 1.27 | 1.22 | -4% | 0.6549 |
-| 2b || 116.53 | 124.67 | +7% || 1.27 | 1.22 | -4% | 0.5174 |
+| 2c || 111.22 | 92.83 | -17% || 1.27 | 1.22 | -4% | 0.2044 |
| 2d || 203.73 | 204.79 | +1% || 1.27 | 1.22 | -4% | 0.9384 |
| 30a || 338.00 | 335.22 | -1% || 1.27 | 1.22 | -4% | 0.9069 |
-| 30b || 330.72 | 378.55 | +14% || 1.27 | 1.22 | -4% | 0.0734 |
-| 30c || 613.69 | 649.05 | +6% || 1.27 | 1.22 | -4% | 0.2582 |
| 31a || 293.71 | 281.06 | -4% || 1.27 | 1.22 | -4% | 0.5844 |
| 31b || 257.85 | 250.37 | -3% || 1.27 | 1.22 | -4% | 0.7356 |
-| 31c || 335.31 | 359.21 | +7% || 1.27 | 1.22 | -4% | 0.4026 |
+| 32a || 45.41 | 36.33 | -20% || 1.27 | 1.22 | -4% | 0.1368 |
+| 32b || 161.66 | 138.54 | -14% || 1.27 | 1.22 | -4% | 0.0779 |
+| 33a || 126.21 | 107.00 | -15% || 1.27 | 1.22 | -4% | 0.2326 |
-| 33b || 88.15 | 100.94 | +15% || 1.27 | 1.22 | -4% | 0.3642 |
+| 33c || 153.69 | 126.63 | -18% || 1.27 | 1.22 | -4% | 0.0478 |
| 3a || 277.32 | 279.12 | +1% || 1.27 | 1.22 | -4% | 0.9367 |
| 3b || 75.93 | 72.57 | -4% || 1.27 | 1.22 | -4% | 0.7785 |
-| 3c || 446.32 | 489.51 | +10% || 1.27 | 1.22 | -4% | 0.1424 |
| 4a || 278.22 | 285.43 | +3% || 1.27 | 1.22 | -4% | 0.7254 |
| 4b || 64.12 | 66.05 | +3% || 1.27 | 1.22 | -4% | 0.8614 |
| 4c || 325.71 | 332.24 | +2% || 1.27 | 1.22 | -4% | 0.7750 |
| 5a || 232.98 | 229.43 | -2% || 1.27 | 1.22 | -4% | 0.8646 |
-| 5b || 157.51 | 167.58 | +6% || 1.27 | 1.22 | -4% | 0.5671 |
-| 5c || 334.90 | 362.31 | +8% || 1.27 | 1.22 | -4% | 0.3012 |
-| 6a || 130.76 | 148.83 | +14% || 1.27 | 1.22 | -4% | 0.2099 |
| 6b || 197.67 | 189.00 | -4% || 1.27 | 1.22 | -4% | 0.5561 |
-| 6c || 115.96 | 132.90 | +15% || 1.27 | 1.22 | -4% | 0.2668 |
| 6d || 547.91 | 566.58 | +3% || 1.27 | 1.22 | -4% | 0.4876 |
-| 6e || 126.10 | 152.30 | +21% || 1.27 | 1.22 | -4% | 0.1277 |
| 6f || 1204.33 | 1231.35 | +2% || 1.27 | 1.22 | -4% | 0.3923 |
+| 7a || 179.53 | 166.76 | -7% || 1.27 | 1.22 | -4% | 0.5034 |
-| 7b || 138.76 | 153.38 | +11% || 1.27 | 1.22 | -4% | 0.2859 |
| 7c || 996.08 | 1010.61 | +1% || 1.27 | 1.22 | -4% | 0.6435 |
| 8a || 192.05 | 186.31 | -3% || 1.27 | 1.22 | -4% | 0.7454 |
-| 8b || 139.82 | 151.41 | +8% || 1.27 | 1.22 | -4% | 0.5228 |
| 8c || 2238.74 | 2321.59 | +4% || 1.27 | 1.22 | -4% | 0.0400 |
| 8d || 892.44 | 861.89 | -3% || 1.27 | 1.22 | -4% | 0.2748 |
-| 9a || 627.14 | 656.75 | +5% || 1.27 | 1.22 | -4% | 0.3263 |
| 9b || 345.10 | 348.06 | +1% || 1.27 | 1.22 | -4% | 0.8814 |
-| 9c || 742.47 | 814.29 | +10% || 1.27 | 1.22 | -4% | 0.0416 |
| 9d || 1088.04 | 1098.07 | +1% || 1.27 | 1.22 | -4% | 0.7617 |
+---------++----------+----------+--------++----------+----------+--------+---------+
| Sum || 50164.83 | 52230.29 | +4% || | | | |
| Geomean || | | || | | -4% | |
+---------++----------+----------+--------++----------+----------+--------+---------+hyriseBenchmarkStarSchema - single-threaded Sum of avg. item runtimes: -8% || Geometric mean of throughput changes: +14%Configuration Overview - click to expand +Configuration Overview---+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkStarSchema_2f72cba186290ca85834639abc0ef6c44b272856_st.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkStarSchema_bb1319be18bfe505d05247307f454accd4e27f5d_st.json |
+-------------------------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 2f72cba186290ca85834639abc0ef6c44b272856-dirty | bb1319be18bfe505d05247307f454accd4e27f5d-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-08 09:15:30 | 2025-06-08 00:00:50 |
| encoding | None | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+ +---------++----------+---------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
+| 1.1 || 600.06 | 412.23 | -31%˄ || 1.67 | 2.43 | +46%˄ | (run time too short) |
+| 1.2 || 652.42 | 230.64 | -65%˄ || 1.53 | 4.34 | +183%˄ | (run time too short) |
+| 1.3 || 657.15 | 220.58 | -66%˄ || 1.52 | 4.53 | +198%˄ | (run time too short) |
-| 2.1 || 411.96 | 517.62 | +26%˄ || 2.43 | 1.93 | -20%˄ | (run time too short) |
-| 2.2 || 208.45 | 282.06 | +35%˄ || 4.80 | 3.55 | -26%˄ | (run time too short) |
-| 2.3 || 123.18 | 178.54 | +45%˄ || 8.12 | 5.60 | -31%˄ | (run time too short) |
| 3.1 || 2646.51 | 2632.20 | -1% || 0.37 | 0.37 | +0% | (run time too short) |
| 3.2 || 266.16 | 277.59 | +4%˄ || 3.76 | 3.60 | -4%˄ | (run time too short) |
+| 3.3 || 127.31 | 114.87 | -10%˄ || 7.85 | 8.71 | +11%˄ | (run time too short) |
+| 3.4 || 124.55 | 108.69 | -13%˄ || 8.03 | 9.20 | +15%˄ | (run time too short) |
-| 4.1 || 2341.40 | 2466.56 | +5% || 0.42 | 0.40 | -4% | (run time too short) |
| 4.2 || 746.20 | 773.97 | +4%˄ || 1.34 | 1.29 | -4%˄ | (run time too short) |
| 4.3 || 212.05 | 209.22 | -1%˄ || 4.72 | 4.78 | +1%˄ | (run time too short) |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
+| Sum || 9117.39 | 8424.78 | -8% || | | | |
+| Geomean || | | || | | +14% | |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+---------+--------++----------+----------+--------+----------------------+hyriseBenchmarkStarSchema - multi-threaded, ordered, 1 client, 64 cores Sum of avg. item runtimes: -2% || Geometric mean of throughput changes: +9%Configuration Overview - click to expand +Configuration Overview---------+----------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkStarSchema_2f72cba186290ca85834639abc0ef6c44b272856_mt_ordered.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkStarSchema_bb1319be18bfe505d05247307f454accd4e27f5d_mt_ordered.json |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 2f72cba186290ca85834639abc0ef6c44b272856-dirty | bb1319be18bfe505d05247307f454accd4e27f5d-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-08 09:21:37 | 2025-06-08 00:06:15 |
| encoding | None | None |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------+ +---------++----------+---------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
+| 1.1 || 164.39 | 128.98 | -22%˄ || 6.08 | 7.75 | +27%˄ | (run time too short) |
+| 1.2 || 164.05 | 85.44 | -48%˄ || 6.09 | 11.70 | +92%˄ | (run time too short) |
+| 1.3 || 162.01 | 83.39 | -49%˄ || 6.17 | 11.99 | +94%˄ | (run time too short) |
-| 2.1 || 305.14 | 327.76 | +7%˄ || 3.28 | 3.05 | -7%˄ | (run time too short) |
-| 2.2 || 148.74 | 159.16 | +7%˄ || 6.72 | 6.28 | -7%˄ | (run time too short) |
-| 2.3 || 52.44 | 63.41 | +21%˄ || 19.05 | 15.76 | -17%˄ | (run time too short) |
-| 3.1 || 748.71 | 805.53 | +8%˄ || 1.34 | 1.24 | -7%˄ | (run time too short) |
-| 3.2 || 141.68 | 149.21 | +5%˄ || 7.06 | 6.70 | -5%˄ | (run time too short) |
| 3.3 || 77.54 | 77.06 | -1%˄ || 12.89 | 12.97 | +1%˄ | (run time too short) |
| 3.4 || 71.72 | 69.63 | -3%˄ || 13.94 | 14.35 | +3%˄ | (run time too short) |
| 4.1 || 824.43 | 859.83 | +4%˄ || 1.21 | 1.16 | -4%˄ | (run time too short) |
| 4.2 || 349.17 | 350.12 | +0%˄ || 2.86 | 2.86 | -0%˄ | (run time too short) |
| 4.3 || 113.33 | 110.22 | -3%˄ || 8.82 | 9.07 | +3%˄ | (run time too short) |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| Sum || 3323.36 | 3269.74 | -2% || | | | |
+| Geomean || | | || | | +9% | |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+---------+--------++----------+----------+--------+----------------------+hyriseBenchmarkStarSchema - multi-threaded, shuffled, 64 clients, 64 cores Sum of avg. item runtimes: +5% || Geometric mean of throughput changes: -5%Configuration Overview - click to expand +Configuration Overview---------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkStarSchema_2f72cba186290ca85834639abc0ef6c44b272856_mt.json | /hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkStarSchema_bb1319be18bfe505d05247307f454accd4e27f5d_mt.json |
+-------------------------------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 2f72cba186290ca85834639abc0ef6c44b272856-dirty | bb1319be18bfe505d05247307f454accd4e27f5d-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535
AF2E
|
| clients | 64 | 64 |
| compiler | clang 18.1.3 | clang 18.1.3 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2025-06-08 09:25:01 | 2025-06-08 00:09:29 |
| encoding | None | None |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+---------+
+| 1.1 || 892.35 | 830.99 | -7% || 3.94 | 3.74 | -5% | 0.0018 |
+| 1.2 || 540.67 | 464.03 | -14% || 3.95 | 3.74 | -5% | 0.0000 |
+| 1.3 || 545.56 | 413.57 | -24% || 3.95 | 3.74 | -5% | 0.0000 |
-| 2.1 || 1906.59 | 2083.07 | +9% || 3.94 | 3.74 | -5% | 0.0000 |
-| 2.2 || 927.58 | 1060.60 | +14% || 3.94 | 3.74 | -5% | 0.0000 |
-| 2.3 || 299.49 | 366.36 | +22% || 3.95 | 3.74 | -5% | 0.0000 |
-| 3.1 || 3171.10 | 3250.93 | +3% || 3.94 | 3.74 | -5% | 0.0127 |
-| 3.2 || 889.23 | 1001.48 | +13% || 3.94 | 3.74 | -5% | 0.0000 |
-| 3.3 || 454.34 | 474.97 | +5% || 3.94 | 3.74 | -5% | 0.1825 |
-| 3.4 || 433.25 | 478.23 | +10% || 3.94 | 3.75 | -5% | 0.0040 |
-| 4.1 || 3098.09 | 3360.17 | +8% || 3.94 | 3.73 | -5% | 0.0000 |
-| 4.2 || 2349.66 | 2515.50 | +7% || 3.94 | 3.74 | -5% | 0.0000 |
-| 4.3 || 695.78 | 759.39 | +9% || 3.94 | 3.74 | -5% | 0.0014 |
+---------++----------+----------+--------++----------+----------+--------+---------+
-| Sum || 16203.70 | 17059.30 | +5% || | | | |
-| Geomean || | | || | | -5% | |
+---------++----------+----------+--------++----------+----------+--------+---------+ |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This PR changes the default encoding from dictionary to a type and uniqueness dependent encoding. The import operator and the benchmark table encoder both now consult a helper function to decide the encoding of the columns.