Fix scheduler issues on NUMA servers #2610
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
You mean if they should steal until all tasks are done before shutting down? Seems to be reasonable not to wait for the busiest node to finish but to distribute the work better, doesn't it? |
Sorry, typed that in the train. Need to reformulate. What I wrote was wrong. |
dey4ss
reviewed
Aug 24, 2023
dey4ss
reviewed
Aug 24, 2023
dismiss until we figure out a good timeout
|
I hoped for improved performance, but there are basically no changes. System nemea - click to expand
Commit Info and Build Time
hyriseBenchmarkTPCH - single-threaded, SF 10.0 Sum of avg. item runtimes: -1% || Geometric mean of throughput changes: +1%Configuration Overview - click to expand +Configuration Overview----+------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Martin.Boissier/hyrise_master/rel_clang/benchmark_all_results/hyriseBenchmarkTPCH_46f13fa510aa7e8b232b3081ee1a25b7f0958e55_st.json | /home/Martin.Boissier/hyrise_master/rel_clang/benchmark_all_results/hyriseBenchmarkTPCH_e58fc4007c6ee2e8a35c5eb048411805135eb715_st.json |
+--------------------------+------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 46f13fa510aa7e8b232b3081ee1a25b7f0958e55-dirty | e58fc4007c6ee2e8a35c5eb048411805135eb715-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 14.0.0 | clang 14.0.0 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2023-09-19 21:14:08 | 2023-09-19 17:25:19 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 100 | 100 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+--------------------------+------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------+ +----------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+----------++----------+----------+--------++----------+----------+--------+---------+
| TPC-H 01 || 6063.47 | 5985.89 | -1% || 0.16 | 0.17 | +1% | 0.5736 |
| TPC-H 02 || 43.90 | 43.91 | +0%˄ || 22.78 | 22.77 | -0%˄ | 0.9836 |
| TPC-H 03 || 2276.99 | 2214.52 | -3% || 0.44 | 0.45 | +3% | 0.0051 |
| TPC-H 04 || 1473.37 | 1433.83 | -3% || 0.68 | 0.70 | +3% | 0.0096 |
| TPC-H 05 || 3105.70 | 3093.92 | -0% || 0.32 | 0.32 | +0% | 0.7225 |
| TPC-H 06 || 156.41 | 149.69 | -4%˄ || 6.39 | 6.68 | +4%˄ | 0.0000 |
| TPC-H 07 || 944.52 | 926.31 | -2% || 1.06 | 1.08 | +2% | 0.0000 |
| TPC-H 08 || 705.74 | 698.55 | -1% || 1.42 | 1.43 | +1% | 0.0000 |
| TPC-H 09 || 5254.14 | 5177.70 | -1% || 0.19 | 0.19 | +1% | 0.0038 |
| TPC-H 10 || 2942.86 | 2953.74 | +0% || 0.34 | 0.34 | -0% | 0.7879 |
| TPC-H 11 || 71.94 | 72.09 | +0%˄ || 13.90 | 13.87 | -0%˄ | 0.6656 |
| TPC-H 12 || 1000.46 | 982.15 | -2% || 1.00 | 1.02 | +2% | 0.0003 |
| TPC-H 13 || 4812.85 | 4703.78 | -2% || 0.21 | 0.21 | +2% | 0.0034 |
| TPC-H 14 || 421.44 | 414.87 | -2%˄ || 2.37 | 2.41 | +2%˄ | 0.0000 |
| TPC-H 15 || 195.99 | 193.11 | -1%˄ || 5.10 | 5.18 | +1%˄ | 0.0000 |
| TPC-H 16 || 631.21 | 642.28 | +2% || 1.58 | 1.56 | -2% | 0.0000 |
| TPC-H 17 || 215.22 | 214.27 | -0%˄ || 4.65 | 4.67 | +0%˄ | 0.0120 |
| TPC-H 18 || 1464.21 | 1489.25 | +2% || 0.68 | 0.67 | -2% | 0.0103 |
| TPC-H 19 || 262.67 | 258.76 | -1%˄ || 3.81 | 3.86 | +2%˄ | 0.0031 |
| TPC-H 20 || 398.80 | 395.55 | -1%˄ || 2.51 | 2.53 | +1%˄ | 0.0810 |
| TPC-H 21 || 4726.54 | 4906.59 | +4% || 0.21 | 0.20 | -4% | 0.0142 |
| TPC-H 22 || 428.49 | 427.43 | -0%˄ || 2.33 | 2.34 | +0%˄ | 0.1335 |
+----------++----------+----------+--------++----------+----------+--------+---------+
| Sum || 37596.91 | 37378.21 | -1% || | | | |
| Geomean || | | || | | +1% | |
+----------++----------+----------+--------++----------+----------+--------+---------+
| Notes || ˄ Execution stopped due to max runs reached |
+----------++----------+----------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCH - single-threaded, SF 0.01 Sum of avg. item runtimes: -0% || Geometric mean of throughput changes: -1%Configuration Overview - click to expand +Configuration Overview----+----------------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Martin.Boissier/hyrise_master/rel_clang/benchmark_all_results/hyriseBenchmarkTPCH_46f13fa510aa7e8b232b3081ee1a25b7f0958e55_st_s01.json | /home/Martin.Boissier/hyrise_master/rel_clang/benchmark_all_results/hyriseBenchmarkTPCH_e58fc4007c6ee2e8a35c5eb048411805135eb715_st_s01.json |
+--------------------------+----------------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 46f13fa510aa7e8b232b3081ee1a25b7f0958e55-dirty | e58fc4007c6ee2e8a35c5eb048411805135eb715-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 14.0.0 | clang 14.0.0 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2023-09-19 21:33:24 | 2023-09-19 17:44:46 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 100 | 100 |
| scale_factor | 0.009999999776482582 | 0.009999999776482582 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+--------------------------+----------------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------+ +----------++----------+---------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+----------++----------+---------+--------++----------+----------+--------+---------+
| TPC-H 01 || 4.82 | 4.88 | +1%˄ || 207.27 | 204.74 | -1%˄ | 0.0000 |
| TPC-H 02 || 3.79 | 3.84 | +1%˄ || 263.95 | 260.34 | -1%˄ | 0.8272 |
| TPC-H 03 || 0.65 | 0.65 | -1%˄ || 1528.04 | 1537.74 | +1%˄ | 0.5714 |
| TPC-H 04 || 0.43 | 0.43 | +1%˄ || 2329.18 | 2296.88 | -1%˄ | 0.0008 |
| TPC-H 05 || 1.00 | 1.00 | +0%˄ || 998.51 | 994.94 | -0%˄ | 0.6772 |
| TPC-H 06 || 0.18 | 0.18 | -1%˄ || 5623.93 | 5654.58 | +1%˄ | 0.2842 |
+| TPC-H 07 || 11.50 | 10.94 | -5%˄ || 86.96 | 91.42 | +5%˄ | 0.4293 |
| TPC-H 08 || 16.08 | 15.98 | -1%˄ || 62.17 | 62.56 | +1%˄ | 0.7116 |
-| TPC-H 09 || 3.81 | 4.16 | +9%˄ || 262.34 | 240.47 | -8%˄ | 0.5571 |
| TPC-H 10 || 0.79 | 0.79 | -0%˄ || 1258.44 | 1261.60 | +0%˄ | 0.6240 |
| TPC-H 11 || 0.21 | 0.21 | +1%˄ || 4707.37 | 4684.01 | -0%˄ | 0.6573 |
| TPC-H 12 || 0.60 | 0.60 | -0%˄ || 1653.43 | 1660.27 | +0%˄ | 0.2721 |
| TPC-H 13 || 1.99 | 2.01 | +1%˄ || 501.45 | 497.84 | -1%˄ | 0.0513 |
| TPC-H 14 || 0.34 | 0.34 | +1%˄ || 2969.78 | 2928.40 | -1%˄ | 0.1419 |
| TPC-H 15 || 1.25 | 1.25 | -0%˄ || 797.63 | 798.75 | +0%˄ | 0.5391 |
| TPC-H 16 || 1.99 | 2.01 | +1%˄ || 501.65 | 497.87 | -1%˄ | 0.0186 |
-| TPC-H 17 || 0.66 | 0.73 | +11%˄ || 1513.53 | 1365.18 | -10%˄ | 0.3793 |
| TPC-H 18 || 1.12 | 1.15 | +2%˄ || 889.74 | 870.61 | -2%˄ | 0.0000 |
| TPC-H 19 || 4.99 | 4.99 | -0%˄ || 200.17 | 200.52 | +0%˄ | 0.1067 |
| TPC-H 20 || 2.14 | 2.13 | -1%˄ || 466.40 | 469.46 | +1%˄ | 0.7805 |
| TPC-H 21 || 1.48 | 1.42 | -4%˄ || 675.67 | 702.57 | +4%˄ | 0.3467 |
| TPC-H 22 || 1.05 | 1.02 | -3%˄ || 950.82 | 978.71 | +3%˄ | 0.0000 |
+----------++----------+---------+--------++----------+----------+--------+---------+
| Sum || 60.88 | 60.70 | -0% || | | | |
| Geomean || | | || | | -1% | |
+----------++----------+---------+--------++----------+----------+--------+---------+
| Notes || ˄ Execution stopped due to max runs reached |
+----------++----------+---------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCH - multi-threaded, ordered, 1 client, 28 cores, SF 10.0 Sum of avg. item runtimes: +1% || Geometric mean of throughput changes: -1%Configuration Overview - click to expand +Configuration Overview---------+--------------------------------------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Martin.Boissier/hyrise_master/rel_clang/benchmark_all_results/hyriseBenchmarkTPCH_46f13fa510aa7e8b232b3081ee1a25b7f0958e55_mt_ordered.json | /home/Martin.Boissier/hyrise_master/rel_clang/benchmark_all_results/hyriseBenchmarkTPCH_e58fc4007c6ee2e8a35c5eb048411805135eb715_mt_ordered.json |
+-------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 46f13fa510aa7e8b232b3081ee1a25b7f0958e55-dirty | e58fc4007c6ee2e8a35c5eb048411805135eb715-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 14.0.0 | clang 14.0.0 |
| cores | 28 | 28 |
| data_preparation_cores | 0 | 0 |
| date | 2023-09-19 21:33:52 | 2023-09-19 17:45:14 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [28] | [28] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------+ +----------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| TPC-H 01 || 4290.63 | 4404.88 | +3% || 0.22 | 0.22 | -0% | (run time too short) |
| TPC-H 02 || 52.46 | 52.92 | +1% || 17.80 | 17.63 | -1% | 0.3606 |
| TPC-H 03 || 1042.83 | 1036.88 | -1% || 0.95 | 0.95 | +0% | 0.5179 |
-| TPC-H 04 || 549.80 | 571.90 | +4% || 1.80 | 1.72 | -5% | 0.0036 |
| TPC-H 05 || 747.42 | 762.14 | +2% || 1.32 | 1.30 | -1% | 0.1187 |
| TPC-H 06 || 59.52 | 59.30 | -0% || 15.78 | 15.85 | +0% | 0.3269 |
| TPC-H 07 || 324.28 | 327.57 | +1% || 3.03 | 3.00 | -1% | 0.1006 |
| TPC-H 08 || 347.80 | 349.71 | +1% || 2.83 | 2.82 | -1% | 0.2528 |
| TPC-H 09 || 1749.08 | 1721.01 | -2% || 0.57 | 0.57 | -0% | (run time too short) |
| TPC-H 10 || 1465.49 | 1463.47 | -0% || 0.67 | 0.67 | +0% | (run time too short) |
| TPC-H 11 || 70.92 | 71.13 | +0% || 13.05 | 13.02 | -0% | 0.5733 |
| TPC-H 12 || 477.98 | 480.09 | +0% || 2.07 | 2.05 | -1% | 0.1892 |
| TPC-H 13 || 2292.18 | 2293.19 | +0% || 0.43 | 0.43 | +0% | 0.8963 |
| TPC-H 14 || 148.14 | 148.05 | -0% || 6.52 | 6.53 | +0% | 0.8143 |
| TPC-H 15 || 150.87 | 150.69 | -0% || 6.43 | 6.45 | +0% | 0.7100 |
| TPC-H 16 || 719.98 | 732.26 | +2% || 1.37 | 1.35 | -1% | 0.0011 |
| TPC-H 17 || 73.48 | 73.76 | +0% || 12.63 | 12.60 | -0% | 0.3197 |
| TPC-H 18 || 2518.98 | 2527.35 | +0% || 0.38 | 0.38 | +0% | (run time too short) |
| TPC-H 19 || 111.35 | 111.27 | -0% || 8.65 | 8.65 | +0% | 0.8955 |
| TPC-H 20 || 206.05 | 204.02 | -1% || 4.73 | 4.77 | +1% | 0.0571 |
| TPC-H 21 || 1067.25 | 1088.62 | +2% || 0.92 | 0.90 | -2% | (run time too short) |
| TPC-H 22 || 138.85 | 138.77 | -0% || 6.93 | 6.93 | +0% | 0.8470 |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| Sum || 18605.35 | 18768.97 | +1% || | | | |
| Geomean || | | || | | -1% | |
+----------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCH - multi-threaded, shuffled, 28 clients, 28 cores, SF 10.0 Sum of avg. item runtimes: +0% || Geometric mean of throughput changes: -0%Configuration Overview - click to expand +Configuration Overview---------+------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Martin.Boissier/hyrise_master/rel_clang/benchmark_all_results/hyriseBenchmarkTPCH_46f13fa510aa7e8b232b3081ee1a25b7f0958e55_mt.json | /home/Martin.Boissier/hyrise_master/rel_clang/benchmark_all_results/hyriseBenchmarkTPCH_e58fc4007c6ee2e8a35c5eb048411805135eb715_mt.json |
+-------------------------------+------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 46f13fa510aa7e8b232b3081ee1a25b7f0958e55-dirty | e58fc4007c6ee2e8a35c5eb048411805135eb715-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 28 | 28 |
| clustering | None | None |
| compiler | clang 14.0.0 | clang 14.0.0 |
| cores | 28 | 28 |
| data_preparation_cores | 0 | 0 |
| date | 2023-09-19 21:57:30 | 2023-09-19 18:08:52 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [28] | [28] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------+ +----------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+----------++----------+----------+--------++----------+----------+--------+---------+
| TPC-H 01 || 6078.07 | 5989.99 | -1% || 0.46 | 0.46 | -0% | 0.6102 |
-| TPC-H 02 || 436.36 | 519.49 | +19% || 0.47 | 0.47 | -0% | 0.5129 |
-| TPC-H 03 || 3329.92 | 3526.57 | +6% || 0.47 | 0.47 | -0% | 0.3629 |
-| TPC-H 04 || 2283.37 | 2403.86 | +5% || 0.47 | 0.46 | -0% | 0.5628 |
| TPC-H 05 || 3681.92 | 3793.88 | +3% || 0.47 | 0.46 | -0% | 0.6556 |
| TPC-H 06 || 815.14 | 784.95 | -4% || 0.47 | 0.47 | -0% | 0.8269 |
-| TPC-H 07 || 3041.13 | 3206.35 | +5% || 0.47 | 0.47 | -0% | 0.5374 |
| TPC-H 08 || 2520.41 | 2427.81 | -4% || 0.47 | 0.47 | +0% | 0.7057 |
-| TPC-H 09 || 5726.44 | 6058.13 | +6% || 0.47 | 0.46 | -1% | 0.2519 |
+| TPC-H 10 || 4862.75 | 4412.23 | -9% || 0.47 | 0.46 | -0% | 0.1044 |
-| TPC-H 11 || 389.28 | 454.99 | +17% || 0.47 | 0.47 | -0% | 0.5719 |
+| TPC-H 12 || 2624.50 | 2481.10 | -5% || 0.47 | 0.46 | -0% | 0.4580 |
| TPC-H 13 || 5292.90 | 5374.64 | +2% || 0.47 | 0.46 | -0% | 0.6534 |
+| TPC-H 14 || 1230.15 | 1160.86 | -6% || 0.47 | 0.46 | -0% | 0.6650 |
+| TPC-H 15 || 803.73 | 720.43 | -10% || 0.47 | 0.47 | -0% | 0.5036 |
+| TPC-H 16 || 2191.60 | 1993.32 | -9% || 0.47 | 0.46 | -0% | 0.2440 |
-| TPC-H 17 || 740.45 | 883.54 | +19% || 0.47 | 0.47 | -0% | 0.3312 |
-| TPC-H 18 || 3507.72 | 3698.72 | +5% || 0.47 | 0.46 | -0% | 0.1674 |
| TPC-H 19 || 988.38 | 1032.80 | +4% || 0.47 | 0.47 | -0% | 0.8140 |
+| TPC-H 20 || 2086.70 | 1971.40 | -6% || 0.47 | 0.46 | -0% | 0.6055 |
| TPC-H 21 || 5835.36 | 5717.37 | -2% || 0.47 | 0.46 | -0% | 0.7029 |
-| TPC-H 22 || 938.77 | 1061.34 | +13% || 0.47 | 0.47 | -0% | 0.3502 |
+----------++----------+----------+--------++----------+----------+--------+---------+
| Sum || 59405.06 | 59673.77 | +0% || | | | |
| Geomean || | | || | | -0% | |
+----------++----------+----------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCDS - single-threaded Sum of avg. item runtimes: -0% || Geometric mean of throughput changes: +1%Configuration Overview - click to expand +Configuration Overview---+-------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Martin.Boissier/hyrise_master/rel_clang/benchmark_all_results/hyriseBenchmarkTPCDS_46f13fa510aa7e8b232b3081ee1a25b7f0958e55_st.json | /home/Martin.Boissier/hyrise_master/rel_clang/benchmark_all_results/hyriseBenchmarkTPCDS_e58fc4007c6ee2e8a35c5eb048411805135eb715_st.json |
+-------------------------+-------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 46f13fa510aa7e8b232b3081ee1a25b7f0958e55-dirty | e58fc4007c6ee2e8a35c5eb048411805135eb715-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 14.0.0 | clang 14.0.0 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2023-09-19 22:19:07 | 2023-09-19 18:30:29 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 100 | 100 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+-------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+---------+
| 01 || 259.17 | 260.23 | +0%˄ || 3.86 | 3.84 | -0%˄ | 0.3827 |
| 03 || 69.55 | 69.02 | -1%˄ || 14.38 | 14.49 | +1%˄ | 0.0017 |
| 06 || 110.00 | 110.75 | +1%˄ || 9.09 | 9.03 | -1%˄ | 0.0105 |
| 07 || 301.21 | 298.88 | -1%˄ || 3.32 | 3.35 | +1%˄ | 0.3705 |
| 09 || 666.97 | 660.69 | -1% || 1.50 | 1.51 | +1% | 0.0932 |
| 10 || 135.48 | 132.37 | -2%˄ || 7.38 | 7.55 | +2%˄ | 0.0005 |
| 13 || 436.13 | 422.68 | -3%˄ || 2.29 | 2.37 | +3%˄ | 0.0000 |
| 15 || 106.86 | 104.19 | -3%˄ || 9.36 | 9.60 | +3%˄ | 0.0000 |
| 16 || 154.82 | 155.65 | +1%˄ || 6.46 | 6.42 | -1%˄ | 0.1734 |
| 17 || 303.61 | 302.40 | -0%˄ || 3.29 | 3.31 | +0%˄ | 0.0304 |
| 19 || 99.31 | 97.83 | -1%˄ || 10.07 | 10.22 | +2%˄ | 0.0000 |
| 25 || 163.29 | 161.26 | -1%˄ || 6.12 | 6.20 | +1%˄ | 0.0000 |
| 26 || 133.62 | 134.05 | +0%˄ || 7.48 | 7.46 | -0%˄ | 0.5981 |
| 28 || 586.81 | 592.12 | +1%˄ || 1.70 | 1.69 | -1%˄ | 0.0000 |
| 29 || 480.75 | 465.52 | -3%˄ || 2.08 | 2.15 | +3%˄ | 0.0000 |
| 31 || 1277.99 | 1260.54 | -1% || 0.78 | 0.79 | +1% | 0.0000 |
| 32 || 42.83 | 42.28 | -1%˄ || 23.35 | 23.65 | +1%˄ | 0.0084 |
+| 34 || 167.48 | 155.81 | -7%˄ || 5.97 | 6.42 | +7%˄ | 0.0000 |
| 35 || 621.80 | 608.27 | -2% || 1.61 | 1.64 | +2% | 0.0000 |
| 37 || 281.18 | 282.69 | +1%˄ || 3.56 | 3.54 | -1%˄ | 0.5633 |
| 39a || 1707.79 | 1691.21 | -1% || 0.59 | 0.59 | +1% | 0.1608 |
| 39b || 1712.02 | 1684.32 | -2% || 0.58 | 0.59 | +2% | 0.0361 |
| 41 || 301.08 | 299.50 | -1%˄ || 3.32 | 3.34 | +1%˄ | 0.0001 |
| 42 || 83.49 | 80.62 | -3%˄ || 11.98 | 12.40 | +4%˄ | 0.0000 |
| 43 || 945.86 | 934.76 | -1% || 1.06 | 1.07 | +1% | 0.0121 |
| 45 || 115.31 | 113.58 | -2%˄ || 8.67 | 8.80 | +2%˄ | 0.0000 |
| 48 || 1016.23 | 1024.78 | +1% || 0.98 | 0.98 | -1% | 0.2363 |
| 50 || 110.06 | 108.23 | -2%˄ || 9.09 | 9.24 | +2%˄ | 0.0000 |
| 52 || 80.46 | 78.59 | -2%˄ || 12.43 | 12.72 | +2%˄ | 0.0000 |
| 55 || 76.88 | 75.48 | -2%˄ || 13.01 | 13.25 | +2%˄ | 0.0000 |
| 62 || 533.12 | 532.99 | -0%˄ || 1.88 | 1.88 | +0%˄ | 0.7527 |
| 65 || 1756.66 | 1725.79 | -2% || 0.57 | 0.58 | +2% | 0.0118 |
| 69 || 119.63 | 119.07 | -0%˄ || 8.36 | 8.40 | +0%˄ | 0.0541 |
| 73 || 77.23 | 76.60 | -1%˄ || 12.95 | 13.05 | +1%˄ | 0.0000 |
| 79 || 464.85 | 465.26 | +0%˄ || 2.15 | 2.15 | -0%˄ | 0.4830 |
| 81 || 208.52 | 205.04 | -2%˄ || 4.80 | 4.88 | +2%˄ | 0.0000 |
| 82 || 358.04 | 355.93 | -1%˄ || 2.79 | 2.81 | +1%˄ | 0.4654 |
| 83 || 40.89 | 39.97 | -2%˄ || 24.45 | 25.02 | +2%˄ | 0.0810 |
| 85 || 132.52 | 133.67 | +1%˄ || 7.55 | 7.48 | -1%˄ | 0.0001 |
| 88 || 633.10 | 620.13 | -2% || 1.58 | 1.61 | +2% | 0.0000 |
| 91 || 15.32 | 15.29 | -0%˄ || 65.28 | 65.37 | +0%˄ | 0.6404 |
| 92 || 34.81 | 34.78 | -0%˄ || 28.72 | 28.75 | +0%˄ | 0.7978 |
| 93 || 3822.40 | 3825.35 | +0% || 0.26 | 0.26 | -0% | 0.8571 |
| 94 || 97.47 | 98.42 | +1%˄ || 10.26 | 10.16 | -1%˄ | 0.0224 |
| 95 || 9124.42 | 9198.96 | +1% || 0.11 | 0.11 | -1% | ˅ |
| 96 || 57.80 | 58.49 | +1%˄ || 17.30 | 17.10 | -1%˄ | 0.4067 |
| 97 || 3224.07 | 3251.03 | +1% || 0.31 | 0.31 | -1% | 0.3971 |
| 99 || 1023.51 | 1015.70 | -1% || 0.98 | 0.98 | +1% | 0.0000 |
+---------++----------+----------+--------++----------+----------+--------+---------+
| Sum || 34272.38 | 34180.77 | -0% || | | | |
| Geomean || | | || | | +1% | |
+---------++----------+----------+--------++----------+----------+--------+---------+
| Notes || ˄ Execution stopped due to max runs reached |
| || ˅ Insufficient number of runs for p-value calculation |
+---------++----------+----------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCDS - multi-threaded, shuffled, 28 clients, 28 cores Sum of avg. item runtimes: +0% || Geometric mean of throughput changes: -0%Configuration Overview - click to expand +Configuration Overview---------+-------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Martin.Boissier/hyrise_master/rel_clang/benchmark_all_results/hyriseBenchmarkTPCDS_46f13fa510aa7e8b232b3081ee1a25b7f0958e55_mt.json | /home/Martin.Boissier/hyrise_master/rel_clang/benchmark_all_results/hyriseBenchmarkTPCDS_e58fc4007c6ee2e8a35c5eb048411805135eb715_mt.json |
+-------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 46f13fa510aa7e8b232b3081ee1a25b7f0958e55-dirty | e58fc4007c6ee2e8a35c5eb048411805135eb715-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release
1E79
|
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 28 | 28 |
| compiler | clang 14.0.0 | clang 14.0.0 |
| cores | 28 | 28 |
| data_preparation_cores | 0 | 0 |
| date | 2023-09-19 22:45:08 | 2023-09-19 18:56:24 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [28] | [28] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+---------+
+| 01 || 701.75 | 640.14 | -9% || 0.50 | 0.50 | -0% | 0.4502 |
| 03 || 267.76 | 257.96 | -4% || 0.50 | 0.50 | -0% | 0.8448 |
-| 06 || 558.51 | 635.86 | +14% || 0.50 | 0.49 | -1% | 0.3263 |
| 07 || 906.37 | 870.47 | -4% || 0.50 | 0.49 | -0% | 0.6810 |
| 09 || 766.02 | 768.14 | +0% || 0.50 | 0.50 | -0% | 0.9791 |
-| 10 || 637.07 | 725.51 | +14% || 0.50 | 0.50 | -0% | 0.3640 |
| 13 || 1268.28 | 1282.80 | +1% || 0.50 | 0.50 | -0% | 0.8867 |
| 15 || 426.76 | 409.94 | -4% || 0.50 | 0.50 | -0% | 0.8078 |
-| 16 || 612.64 | 662.61 | +8% || 0.50 | 0.50 | -0% | 0.5453 |
| 17 || 970.25 | 951.44 | -2% || 0.50 | 0.50 | -0% | 0.8297 |
| 19 || 649.60 | 631.82 | -3% || 0.50 | 0.49 | -0% | 0.8546 |
-| 25 || 671.39 | 758.40 | +13% || 0.50 | 0.49 | -1% | 0.2892 |
-| 26 || 398.13 | 486.84 | +22% || 0.50 | 0.50 | -0% | 0.1093 |
-| 28 || 1314.76 | 1424.84 | +8% || 0.50 | 0.49 | -0% | 0.4117 |
+| 29 || 1382.57 | 1215.22 | -12% || 0.50 | 0.50 | -0% | 0.1188 |
+| 31 || 2223.41 | 2046.68 | -8% || 0.50 | 0.49 | -0% | 0.2445 |
+| 32 || 276.60 | 225.58 | -18% || 0.50 | 0.50 | -0% | 0.3598 |
+| 34 || 682.62 | 627.75 | -8% || 0.50 | 0.50 | -0% | 0.4912 |
| 35 || 1616.54 | 1659.66 | +3% || 0.50 | 0.50 | -0% | 0.7455 |
-| 37 || 615.75 | 743.59 | +21% || 0.50 | 0.50 | -0% | 0.1971 |
| 39a || 2120.58 | 2213.63 | +4% || 0.50 | 0.49 | -0% | 0.3829 |
| 39b || 2224.11 | 2260.73 | +2% || 0.50 | 0.49 | -0% | 0.7704 |
| 41 || 3305.19 | 3340.91 | +1% || 0.50 | 0.49 | -0% | 0.8624 |
| 42 || 490.69 | 482.92 | -2% || 0.50 | 0.50 | -0% | 0.9104 |
| 43 || 1626.35 | 1648.51 | +1% || 0.50 | 0.50 | -0% | 0.8662 |
-| 45 || 529.96 | 616.81 | +16% || 0.50 | 0.49 | -1% | 0.2005 |
| 48 || 1940.89 | 1957.66 | +1% || 0.50 | 0.49 | -0% | 0.8879 |
-| 50 || 780.42 | 817.28 | +5% || 0.50 | 0.50 | -0% | 0.6907 |
+| 52 || 444.48 | 418.57 | -6% || 0.50 | 0.50 | -0% | 0.7102 |
-| 55 || 416.19 | 461.26 | +11% || 0.50 | 0.50 | -0% | 0.4877 |
| 62 || 955.96 | 955.84 | -0% || 0.50 | 0.50 | -0% | 0.9989 |
| 65 || 3641.43 | 3611.28 | -1% || 0.50 | 0.49 | -0% | 0.7214 |
-| 69 || 662.31 | 784.11 | +18% || 0.50 | 0.50 | -0% | 0.1846 |
+| 73 || 447.59 | 407.46 | -9% || 0.50 | 0.50 | -0% | 0.5545 |
+| 79 || 1362.74 | 1182.62 | -13% || 0.50 | 0.49 | -0% | 0.0400 |
| 81 || 613.94 | 594.84 | -3% || 0.50 | 0.50 | -0% | 0.7659 |
| 82 || 761.62 | 769.89 | +1% || 0.50 | 0.50 | -0% | 0.9045 |
-| 83 || 273.84 | 320.56 | +17% || 0.50 | 0.50 | -0% | 0.4781 |
+| 85 || 860.26 | 614.25 | -29% || 0.50 | 0.50 | -0% | 0.0095 |
-| 88 || 2056.71 | 2226.16 | +8% || 0.50 | 0.49 | -0% | 0.3044 |
+| 91 || 259.55 | 206.23 | -21% || 0.50 | 0.50 | -0% | 0.3340 |
| 92 || 283.83 | 276.62 | -3% || 0.50 | 0.50 | -0% | 0.8814 |
| 93 || 1931.10 | 1923.14 | -0% || 0.50 | 0.50 | -0% | 0.9405 |
-| 94 || 558.93 | 710.42 | +27% || 0.50 | 0.50 | +0% | 0.1474 |
| 95 || 4312.50 | 4403.63 | +2% || 0.50 | 0.49 | -0% | 0.5576 |
+| 96 || 398.45 | 348.21 | -13% || 0.50 | 0.50 | -0% | 0.4169 |
| 97 || 4391.74 | 4251.46 | -3% || 0.49 | 0.49 | +0% | 0.2927 |
| 99 || 1279.06 | 1228.70 | -4% || 0.50 | 0.49 | -0% | 0.5238 |
+---------++----------+----------+--------++----------+----------+--------+---------+
| Sum || 55877.20 | 56058.92 | +0% || | | | |
| Geomean || | | || | | -0% | |
+---------++----------+----------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCC - single-threaded Sum of avg. item runtimes: +0% || Geometric mean of throughput changes: -1%Configuration Overview - click to expand +Configuration Overview---+------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Martin.Boissier/hyrise_master/rel_clang/benchmark_all_results/hyriseBenchmarkTPCC_46f13fa510aa7e8b232b3081ee1a25b7f0958e55_st.json | /home/Martin.Boissier/hyrise_master/rel_clang/benchmark_all_results/hyriseBenchmarkTPCC_e58fc4007c6ee2e8a35c5eb048411805135eb715_st.json |
+-------------------------+------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 46f13fa510aa7e8b232b3081ee1a25b7f0958e55-dirty | e58fc4007c6ee2e8a35c5eb048411805135eb715-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 14.0.0 | clang 14.0.0 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2023-09-19 23:05:33 | 2023-09-19 19:16:49 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10 | 10 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------+------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------+ +--------------++----------+---------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+--------------++----------+---------+--------++----------+----------+--------+----------------------+
| Delivery || 53.97 | 53.45 | -1% || 1.67 | 1.63 | -2% | (run time too short) |
| New-Order || 43.85 | 44.79 | +2% || 18.78 | 18.48 | -2% | 0.1061 |
| Order-Status || 2.39 | 2.29 | -4% || 1.67 | 1.65 | -1% | (run time too short) |
| Payment || 4.18 | 4.17 | -0% || 17.95 | 17.65 | -2% | 0.7652 |
| Stock-Level || 3.97 | 3.99 | +0% || 1.67 | 1.65 | -1% | (run time too short) |
+--------------++----------+---------+--------++----------+----------+--------+----------------------+
| Sum || 108.36 | 108.69 | +0% || | | | |
| Geomean || | | || | | -1% | |
+--------------++----------+---------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCC - multi-threaded, shuffled, 28 clients, 28 cores Sum of avg. item runtimes: +1% || Geometric mean of throughput changes: +0%Configuration Overview - click to expand +Configuration Overview---------+------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Martin.Boissier/hyrise_master/rel_clang/benchmark_all_results/hyriseBenchmarkTPCC_46f13fa510aa7e8b232b3081ee1a25b7f0958e55_mt.json | /home/Martin.Boissier/hyrise_master/rel_clang/benchmark_all_results/hyriseBenchmarkTPCC_e58fc4007c6ee2e8a35c5eb048411805135eb715_mt.json |
+-------------------------------+------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 46f13fa510aa7e8b232b3081ee1a25b7f0958e55-dirty | e58fc4007c6ee2e8a35c5eb048411805135eb715-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 28 | 28 |
| compiler | clang 14.0.0 | clang 14.0.0 |
| cores | 28 | 28 |
| data_preparation_cores | 0 | 0 |
| date | 2023-09-19 23:06:40 | 2023-09-19 19:17:56 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10 | 10 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [28] | [28] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------+ +--------------++----------+---------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+--------------++----------+---------+--------++----------+----------+--------+---------+
| Delivery || 264.79 | 269.36 | +2% || 9.42 | 9.42 | -0% | 0.1488 |
| unsucc.: || 8.67 | 9.53 | +10% || 2.50 | 2.57 | +3% | |
| New-Order || 202.10 | 201.01 | -1% || 102.88 | 103.25 | +0% | 0.1745 |
| unsucc.: || 28.88 | 28.51 | -1% || 31.24 | 31.61 | +1% | |
| Order-Status || 10.94 | 10.86 | -1% || 11.92 | 11.99 | +1% | 0.8139 |
| Payment || 11.93 | 11.88 | -0% || 88.95 | 89.63 | +1% | 0.7123 |
| unsucc.: || 18.04 | 17.71 | -2% || 39.22 | 39.25 | +0% | |
| Stock-Level || 21.77 | 21.69 | -0% || 11.92 | 11.99 | +1% | 0.9105 |
+--------------++----------+---------+--------++----------+----------+--------+---------+
| Sum || 511.54 | 514.81 | +1% || | | | |
| Geomean || | | || | | +0% | |
+--------------++----------+---------+--------++----------+----------+--------+---------+hyriseBenchmarkJoinOrder - single-threaded Sum of avg. item runtimes: +0% || Geometric mean of throughput changes: +0%Configuration Overview - click to expand +Configuration Overview---+-----------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Martin.Boissier/hyrise_master/rel_clang/benchmark_all_results/hyriseBenchmarkJoinOrder_46f13fa510aa7e8b232b3081ee1a25b7f0958e55_st.json | /home/Martin.Boissier/hyrise_master/rel_clang/benchmark_all_results/hyriseBenchmarkJoinOrder_e58fc4007c6ee2e8a35c5eb048411805135eb715_st.json |
+-------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 46f13fa510aa7e8b232b3081ee1a25b7f0958e55-dirty | e58fc4007c6ee2e8a35c5eb048411805135eb715-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 14.0.0 | clang 14.0.0 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2023-09-19 23:26:49 | 2023-09-19 19:38:05 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 100 | 100 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+---------+
| 10a || 164.68 | 165.90 | +1%˄ || 6.07 | 6.03 | -1%˄ | 0.0020 |
| 10b || 115.73 | 115.64 | -0%˄ || 8.64 | 8.65 | +0%˄ | 0.8132 |
| 10c || 318.58 | 320.60 | +1%˄ || 3.14 | 3.12 | -1%˄ | 0.0184 |
| 11a || 15.26 | 15.22 | -0%˄ || 65.50 | 65.69 | +0%˄ | 0.1899 |
| 11b || 15.02 | 15.05 | +0%˄ || 66.58 | 66.43 | -0%˄ | 0.0293 |
| 11c || 20.58 | 20.55 | -0%˄ || 48.59 | 48.65 | +0%˄ | 0.4224 |
| 11d || 23.51 | 23.54 | +0%˄ || 42.53 | 42.48 | -0%˄ | 0.3874 |
| 12a || 48.67 | 48.41 | -1%˄ || 20.55 | 20.66 | +1%˄ | 0.0000 |
| 12b || 29.19 | 29.01 | -1%˄ || 34.26 | 34.47 | +1%˄ | 0.0001 |
| 12c || 83.64 | 83.31 | -0%˄ || 11.95 | 12.00 | +0%˄ | 0.0585 |
| 13a || 274.39 | 272.67 | -1%˄ || 3.64 | 3.67 | +1%˄ | 0.0000 |
| 13b || 154.09 | 152.35 | -1%˄ || 6.49 | 6.56 | +1%˄ | 0.0000 |
| 13c || 116.25 | 116.63 | +0%˄ || 8.60 | 8.57 | -0%˄ | 0.0000 |
| 13d || 584.48 | 581.76 | -0%˄ || 1.71 | 1.72 | +0%˄ | 0.0007 |
| 14a || 402.91 | 400.61 | -1%˄ || 2.48 | 2.50 | +1%˄ | 0.0000 |
| 14b || 228.22 | 226.60 | -1%˄ || 4.38 | 4.41 | +1%˄ | 0.0000 |
| 14c || 482.15 | 476.90 | -1%˄ || 2.07 | 2.10 | +1%˄ | 0.0135 |
+| 15a || 88.62 | 81.04 | -9%˄ || 11.28 | 12.34 | +9%˄ | 0.0000 |
+| 15b || 87.91 | 80.48 | -8%˄ || 11.38 | 12.42 | +9%˄ | 0.0000 |
+| 15c || 91.68 | 85.25 | -7%˄ || 10.91 | 11.73 | +8%˄ | 0.0000 |
+| 15d || 90.06 | 81.99 | -9%˄ || 11.10 | 12.20 | +10%˄ | 0.0000 |
| 16a || 2140.38 | 2156.18 | +1% || 0.47 | 0.46 | -1% | 0.2537 |
| 16b || 3148.37 | 3136.82 | -0% || 0.32 | 0.32 | +0% | 0.4995 |
| 16c || 2248.49 | 2249.22 | +0% || 0.44 | 0.44 | -0% | 0.9518 |
| 16d || 2235.30 | 2229.04 | -0% || 0.45 | 0.45 | +0% | 0.6581 |
| 17a || 574.77 | 576.88 | +0%˄ || 1.74 | 1.73 | -0%˄ | 0.0000 |
| 17b || 455.28 | 456.20 | +0%˄ || 2.20 | 2.19 | -0%˄ | 0.0001 |
| 17c || 433.69 | 435.90 | +1%˄ || 2.31 | 2.29 | -1%˄ | 0.0000 |
| 17d || 515.47 | 513.75 | -0%˄ || 1.94 | 1.95 | +0%˄ | 0.0000 |
| 17e || 1533.26 | 1530.25 | -0% || 0.65 | 0.65 | +0% | 0.3514 |
| 17f || 926.72 | 932.78 | +1% || 1.08 | 1.07 | -1% | 0.0000 |
| 18a || 604.06 | 595.60 | -1%˄ || 1.66 | 1.68 | +1%˄ | 0.0000 |
| 18b || 111.55 | 111.70 | +0%˄ || 8.96 | 8.95 | -0%˄ | 0.1533 |
| 18c || 559.43 | 558.86 | -0%˄ || 1.79 | 1.79 | +0%˄ | 0.1752 |
| 19a || 186.14 | 185.70 | -0%˄ || 5.37 | 5.38 | +0%˄ | 0.0104 |
| 19b || 126.45 | 125.48 | -1%˄ || 7.91 | 7.97 | +1%˄ | 0.0000 |
| 19c || 197.72 | 197.46 | -0%˄ || 5.06 | 5.06 | +0%˄ | 0.0592 |
| 19d || 710.90 | 713.37 | +0% || 1.41 | 1.40 | -0% | 0.0000 |
| 1a || 8.98 | 9.01 | +0%˄ || 111.30 | 111.02 | -0%˄ | 0.4712 |
| 1b || 8.41 | 8.43 | +0%˄ || 118.82 | 118.56 | -0%˄ | 0.5022 |
| 1c || 9.53 | 9.50 | -0%˄ || 104.91 | 105.29 | +0%˄ | 0.0559 |
| 1d || 8.42 | 8.44 | +0%˄ || 118.70 | 118.42 | -0%˄ | 0.1522 |
| 20a || 388.75 | 388.69 | -0%˄ || 2.57 | 2.57 | +0%˄ | 0.7190 |
| 20b || 226.69 | 227.83 | +1%˄ || 4.41 | 4.39 | -1%˄ | 0.0000 |
| 20c || 219.04 | 220.51 | +1%˄ || 4.57 | 4.53 | -1%˄ | 0.0000 |
| 21a || 35.04 | 35.14 | +0%˄ || 28.54 | 28.45 | -0%˄ | 0.0007 |
| 21b || 18.98 | 19.15 | +1%˄ || 52.68 | 52.22 | -1%˄ | 0.0000 |
| 21c || 34.53 | 34.74 | +1%˄ || 28.96 | 28.78 | -1%˄ | 0.0000 |
| 22a || 191.87 | 192.32 | +0%˄ || 5.21 | 5.20 | -0%˄ | 0.0001 |
| 22b || 141.23 | 142.10 | +1%˄ || 7.08 | 7.04 | -1%˄ | 0.0000 |
| 22c || 460.61 | 460.48 | -0%˄ || 2.17 | 2.17 | +0%˄ | 0.9189 |
| 22d || 829.61 | 817.10 | -2% || 1.21 | 1.22 | +2% | 0.0000 |
| 23a || 42.52 | 42.89 | +1%˄ || 23.52 | 23.31 | -1%˄ | 0.0001 |
| 23b || 43.78 | 43.90 | +0%˄ || 22.84 | 22.78 | -0%˄ | 0.1650 |
| 23c || 85.51 | 85.43 | -0%˄ || 11.69 | 11.70 | +0%˄ | 0.7790 |
| 24a || 143.37 | 143.83 | +0%˄ || 6.97 | 6.95 | -0%˄ | 0.0000 |
| 24b || 121.98 | 122.72 | +1%˄ || 8.20 | 8.15 | -1%˄ | 0.0000 |
| 25a || 271.57 | 275.30 | +1%˄ || 3.68 | 3.63 | -1%˄ | 0.0000 |
| 25b || 112.27 | 112.83 | +0%˄ || 8.91 | 8.86 | -0%˄ | 0.0000 |
| 25c || 887.86 | 893.43 | +1% || 1.13 | 1.12 | -1% | 0.0002 |
| 26a || 162.04 | 163.73 | +1%˄ || 6.17 | 6.11 | -1%˄ | 0.0000 |
| 26b || 129.79 | 130.74 | +1%˄ || 7.70 | 7.65 | -1%˄ | 0.0000 |
| 26c || 230.67 | 232.72 | +1%˄ || 4.34 | 4.30 | -1%˄ | 0.0000 |
| 27a || 22.82 | 22.84 | +0%˄ || 43.82 | 43.78 | -0%˄ | 0.7571 |
| 27b || 22.10 | 22.40 | +1%˄ || 45.25 | 44.63 | -1%˄ | 0.0000 |
| 27c || 34.63 | 34.88 | +1%˄ || 28.88 | 28.67 | -1%˄ | 0.0000 |
| 28a || 278.88 | 278.53 | -0%˄ || 3.59 | 3.59 | +0%˄ | 0.0972 |
| 28b || 37.34 | 37.33 | -0%˄ || 26.78 | 26.79 | +0%˄ | 0.8859 |
| 28c || 309.98 | 312.45 | +1%˄ || 3.23 | 3.20 | -1%˄ | 0.0000 |
| 29a || 98.94 | 98.94 | -0%˄ || 10.11 | 10.11 | +0%˄ | 0.9639 |
| 29b || 76.14 | 76.02 | -0%˄ || 13.13 | 13.15 | +0%˄ | 0.1754 |
| 29c || 147.31 | 147.93 | +0%˄ || 6.79 | 6.76 | -0%˄ | 0.0000 |
| 2a || 45.89 | 46.36 | +1%˄ || 21.79 | 21.57 | -1%˄ | 0.0000 |
| 2b || 37.42 | 37.58 | +0%˄ || 26.72 | 26.61 | -0%˄ | 0.0001 |
| 2c || 21.80 | 21.77 | -0%˄ || 45.88 | 45.92 | +0%˄ | 0.2112 |
| 2d || 64.41 | 65.37 | +1%˄ || 15.52 | 15.30 | -1%˄ | 0.0000 |
| 30a || 147.90 | 148.95 | +1%˄ || 6.76 | 6.71 | -1%˄ | 0.0000 |
| 30b || 126.79 | 127.54 | +1%˄ || 7.89 | 7.84 | -1%˄ | 0.0000 |
| 30c || 365.77 | 368.31 | +1%˄ || 2.73 | 2.72 | -1%˄ | 0.0000 |
| 31a || 144.88 | 145.58 | +0%˄ || 6.90 | 6.87 | -0%˄ | 0.0000 |
| 31b || 123.81 | 124.42 | +0%˄ || 8.08 | 8.04 | -0%˄ | 0.0000 |
| 31c || 168.39 | 169.01 | +0%˄ || 5.94 | 5.92 | -0%˄ | 0.0000 |
| 32a || 12.82 | 12.90 | +1%˄ || 77.99 | 77.52 | -1%˄ | 0.0000 |
| 32b || 30.62 | 30.86 | +1%˄ || 32.66 | 32.41 | -1%˄ | 0.0000 |
| 33a || 19.36 | 19.52 | +1%˄ || 51.64 | 51.23 | -1%˄ | 0.0001 |
| 33b || 18.59 | 18.84 | +1%˄ || 53.78 | 53.08 | -1%˄ | 0.0000 |
| 33c || 22.49 | 22.57 | +0%˄ || 44.45 | 44.31 | -0%˄ | 0.0000 |
| 3a || 120.90 | 122.73 | +2%˄ || 8.27 | 8.15 | -1%˄ | 0.0000 |
| 3b || 12.61 | 12.72 | +1%˄ || 79.29 | 78.59 | -1%˄ | 0.0001 |
| 3c || 424.59 | 435.07 | +2%˄ || 2.36 | 2.30 | -2%˄ | 0.0000 |
| 4a || 111.06 | 112.40 | +1%˄ || 9.00 | 8.90 | -1%˄ | 0.0000 |
| 4b || 11.40 | 11.51 | +1%˄ || 87.69 | 86.88 | -1%˄ | 0.0000 |
| 4c || 121.96 | 123.08 | +1%˄ || 8.20 | 8.12 | -1%˄ | 0.0000 |
| 5a || 52.68 | 52.58 | -0%˄ || 18.98 | 19.02 | +0%˄ | 0.3899 |
| 5b || 134.96 | 135.51 | +0%˄ || 7.41 | 7.38 | -0%˄ | 0.0000 |
| 5c || 182.92 | 182.29 | -0%˄ || 5.47 | 5.49 | +0%˄ | 0.0000 |
| 6a || 102.83 | 103.06 | +0%˄ || 9.72 | 9.70 | -0%˄ | 0.0002 |
| 6b || 114.85 | 115.54 | +1%˄ || 8.71 | 8.65 | -1%˄ | 0.0000 |
| 6c || 97.88 | 98.44 | +1%˄ || 10.22 | 10.16 | -1%˄ | 0.0000 |
| 6d || 522.08 | 524.57 | +0%˄ || 1.92 | 1.91 | -0%˄ | 0.0000 |
| 6e || 102.48 | 103.14 | +1%˄ || 9.76 | 9.70 | -1%˄ | 0.0000 |
| 6f || 682.02 | 689.76 | +1% || 1.47 | 1.45 | -1% | 0.0000 |
| 7a || 53.15 | 53.27 | +0%˄ || 18.82 | 18.77 | -0%˄ | 0.0307 |
| 7b || 49.55 | 49.69 | +0%˄ || 20.18 | 20.12 | -0%˄ | 0.0722 |
| 7c || 577.21 | 571.09 | -1%˄ || 1.73 | 1.75 | +1%˄ | 0.0001 |
| 8a || 39.24 | 39.46 | +1%˄ || 25.48 | 25.34 | -1%˄ | 0.0678 |
| 8b || 37.07 | 37.34 | +1%˄ || 26.97 | 26.78 | -1%˄ | 0.0002 |
| 8c || 1799.45 | 1807.43 | +0% || 0.56 | 0.55 | -0% | 0.0263 |
| 8d || 299.65 | 298.96 | -0%˄ || 3.34 | 3.34 | +0%˄ | 0.0000 |
| 9a || 192.07 | 193.45 | +1%˄ || 5.21 | 5.17 | -1%˄ | 0.0000 |
| 9b || 105.76 | 106.30 | +1%˄ || 9.45 | 9.41 | -1%˄ | 0.0000 |
| 9c || 272.72 | 276.36 | +1%˄ || 3.67 | 3.62 | -1%˄ | 0.0000 |
| 9d || 477.58 | 476.72 | -0%˄ || 2.09 | 2.10 | +0%˄ | 0.0056 |
+---------++----------+----------+--------++----------+----------+--------+---------+
| Sum || 34034.36 | 34043.01 | +0% || | | | |
| Geomean || | | || | | +0% | |
+---------++----------+----------+--------++----------+----------+--------+---------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+----------+--------++----------+----------+--------+---------+hyriseBenchmarkJoinOrder - multi-threaded, shuffled, 28 clients, 28 cores Sum of avg. item runtimes: -0% || Geometric mean of throughput changes: -0%Configuration Overview - click to expand +Configuration Overview---------+-----------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Martin.Boissier/hyrise_master/rel_clang/benchmark_all_results/hyriseBenchmarkJoinOrder_46f13fa510aa7e8b232b3081ee1a25b7f0958e55_mt.json | /home/Martin.Boissier/hyrise_master/rel_clang/benchmark_all_results/hyriseBenchmarkJoinOrder_e58fc4007c6ee2e8a35c5eb048411805135eb715_mt.json |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 46f13fa510aa7e8b232b3081ee1a25b7f0958e55-dirty | e58fc4007c6ee2e8a35c5eb048411805135eb715-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 28 | 28 |
| compiler | clang 14.0.0 | clang 14.0.0 |
| cores | 28 | 28 |
| data_preparation_cores | 0 | 0 |
| date | 2023-09-20 00:08:42 | 2023-09-19 20:19:57 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [28] | [28] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+---------+
| 10a || 240.35 | 248.59 | +3% || 0.52 | 0.52 | +0% | 0.8255 |
-| 10b || 147.10 | 170.96 | +16% || 0.52 | 0.52 | -0% | 0.4147 |
-| 10c || 355.50 | 388.33 | +9% || 0.52 | 0.52 | -0% | 0.3708 |
-| 11a || 48.28 | 59.99 | +24% || 0.52 | 0.52 | +0% | 0.4285 |
-| 11b || 46.83 | 79.66 | +70% || 0.52 | 0.52 | -0% | 0.0357 |
+| 11c || 117.40 | 82.92 | -29% || 0.52 | 0.52 | -0% | 0.1297 |
-| 11d || 97.67 | 108.47 | +11% || 0.52 | 0.52 | +0% | 0.6615 |
-| 12a || 159.00 | 168.57 | +6% || 0.52 | 0.52 | -0% | 0.7222 |
-| 12b || 63.04 | 106.26 | +69% || 0.52 | 0.52 | -0% | 0.0657 |
-| 12c || 304.59 | 357.62 | +17% || 0.52 | 0.52 | -0% | 0.2024 |
| 13a || 609.59 | 611.22 | +0% || 0.52 | 0.52 | -0% | 0.9762 |
+| 13b || 234.14 | 193.59 | -17% || 0.52 | 0.52 | -0% | 0.1580 |
-| 13c || 181.59 | 195.32 | +8% || 0.52 | 0.52 | -0% | 0.5820 |
| 13d || 914.73 | 885.09 | -3% || 0.52 | 0.52 | +0% | 0.6218 |
-| 14a || 713.01 | 759.32 | +6% || 0.52 | 0.52 | +0% | 0.3721 |
+| 14b || 436.44 | 410.34 | -6% || 0.52 | 0.52 | -0% | 0.4868 |
+| 14c || 838.81 | 780.12 | -7% || 0.52 | 0.52 | -0% | 0.2898 |
+| 15a || 210.59 | 146.30 | -31% || 0.52 | 0.52 | -0% | 0.0380 |
+| 15b || 147.10 | 138.12 | -6% || 0.52 | 0.52 | -0% | 0.6895 |
| 15c || 148.96 | 144.54 | -3% || 0.52 | 0.52 | -0% | 0.8392 |
+| 15d || 231.09 | 214.11 | -7% || 0.52 | 0.52 | -0% | 0.6596 |
| 16a || 2486.40 | 2424.90 | -2% || 0.52 | 0.52 | -0% | 0.4628 |
| 16b || 3640.41 | 3565.90 | -2% || 0.52 | 0.52 | -0% | 0.3417 |
| 16c || 2491.07 | 2572.95 | +3% || 0.52 | 0.52 | +0% | 0.3077 |
+| 16d || 2682.21 | 2558.16 | -5% || 0.52 | 0.52 | -0% | 0.1410 |
| 17a || 939.27 | 950.91 | +1% || 0.52 | 0.52 | -0% | 0.8624 |
-| 17b || 649.16 | 735.37 | +13% || 0.52 | 0.52 | -0% | 0.1338 |
-| 17c || 594.31 | 687.15 | +16% || 0.52 | 0.52 | -0% | 0.0758 |
-| 17d || 698.30 | 734.75 | +5% || 0.52 | 0.52 | -0% | 0.5505 |
| 17e || 1588.05 | 1569.86 | -1% || 0.52 | 0.52 | +0% | 0.8069 |
+| 17f || 1260.96 | 1193.44 | -5% || 0.52 | 0.52 | -0% | 0.3648 |
| 18a || 655.94 | 675.02 | +3% || 0.52 | 0.52 | +0% | 0.7064 |
-| 18b || 197.80 | 222.16 | +12% || 0.52 | 0.52 | -0% | 0.4925 |
-| 18c || 721.61 | 803.00 | +11% || 0.52 | 0.52 | -0% | 0.1474 |
-| 19a || 541.39 | 588.48 | +9% || 0.52 | 0.52 | -0% | 0.4450 |
| 19b || 407.60 | 399.43 | -2% || 0.52 | 0.52 | -0% | 0.8882 |
+| 19c || 597.34 | 558.07 | -7% || 0.52 | 0.52 | -0% | 0.4462 |
| 19d || 1368.04 | 1341.25 | -2% || 0.52 | 0.52 | -0% | 0.7209 |
-| 1a || 36.43 | 42.03 | +15% || 0.52 | 0.52 | +0% | 0.6717 |
-| 1b || 28.27 | 46.48 | +64% || 0.52 | 0.52 | -0% | 0.1871 |
-| 1c || 33.13 | 40.09 | +21% || 0.52 | 0.52 | +0% | 0.4987 |
-| 1d || 31.10 | 40.56 | +30% || 0.52 | 0.52 | +0% | 0.4894 |
-| 20a || 590.18 | 620.88 | +5% || 0.52 | 0.52 | +0% | 0.5194 |
+| 20b || 447.97 | 421.80 | -6% || 0.52 | 0.52 | -0% | 0.5181 |
-| 20c || 446.96 | 476.98 | +7% || 0.52 | 0.52 | -0% | 0.5712 |
+| 21a || 88.81 | 74.07 | -17% || 0.52 | 0.52 | +0% | 0.3322 |
-| 21b || 94.16 | 129.40 | +37% || 0.52 | 0.52 | +0% | 0.2775 |
| 21c || 118.26 | 114.49 | -3% || 0.52 | 0.52 | -0% | 0.8969 |
+| 22a || 518.70 | 448.47 | -14% || 0.52 | 0.52 | -0% | 0.1181 |
-| 22b || 278.01 | 312.01 | +12% || 0.52 | 0.52 | -0% | 0.3255 |
| 22c || 759.33 | 749.75 | -1% || 0.52 | 0.52 | -0% | 0.8574 |
| 22d || 1028.43 | 1010.80 | -2% || 0.52 | 0.52 | -0% | 0.7865 |
| 23a || 214.40 | 208.19 | -3% || 0.52 | 0.52 | +0% | 0.8613 |
-| 23b || 132.18 | 148.55 | +12% || 0.52 | 0.52 | -0% | 0.5455 |
+| 23c || 210.49 | 193.39 | -8% || 0.52 | 0.52 | -0% | 0.5553 |
-| 24a || 277.70 | 294.15 | +6% || 0.52 | 0.52 | +0% | 0.6647 |
-| 24b || 192.85 | 209.61 | +9% || 0.52 | 0.52 | -0% | 0.6178 |
+| 25a || 518.95 | 465.03 | -10% || 0.52 | 0.52 | -0% | 0.2590 |
-| 25b || 178.82 | 223.26 | +25% || 0.52 | 0.52 | +0% | 0.2083 |
| 25c || 986.30 | 1030.36 | +4% || 0.52 | 0.52 | +0% | 0.5170 |
+| 26a || 368.59 | 351.56 | -5% || 0.52 | 0.52 | -0% | 0.6659 |
+| 26b || 237.12 | 194.27 | -18% || 0.52 | 0.52 | -0% | 0.1305 |
-| 26c || 456.23 | 485.06 | +6% || 0.52 | 0.52 | +0% | 0.5198 |
+| 27a || 118.36 | 88.78 | -25% || 0.52 | 0.52 | -0% | 0.2073 |
| 27b || 126.39 | 125.87 | -0% || 0.52 | 0.52 | -0% | 0.9864 |
-| 27c || 82.80 | 141.39 | +71% || 0.52 | 0.52 | -0% | 0.0512 |
+| 28a || 672.20 | 624.82 | -7% || 0.52 | 0.52 | +0% | 0.3606 |
+| 28b || 180.14 | 167.15 | -7% || 0.52 | 0.52 | -0% | 0.6148 |
+| 28c || 701.69 | 605.01 | -14% || 0.52 | 0.52 | +0% | 0.0854 |
+| 29a || 241.96 | 217.91 | -10% || 0.52 | 0.52 | -0% | 0.4343 |
| 29b || 175.38 | 180.88 | +3% || 0.52 | 0.52 | -0% | 0.8658 |
-| 29c || 249.65 | 291.51 | +17% || 0.52 | 0.52 | -0% | 0.2111 |
+| 2a || 184.45 | 157.52 | -15% || 0.52 | 0.52 | +0% | 0.2941 |
-| 2b || 130.10 | 136.64 | +5% || 0.52 | 0.52 | -0% | 0.7279 |
+| 2c || 106.00 | 78.76 | -26% || 0.52 | 0.52 | -0% | 0.1375 |
| 2d || 215.80 | 212.96 | -1% || 0.52 | 0.52 | +0% | 0.9244 |
-| 30a || 365.00 | 405.81 | +11% || 0.52 | 0.52 | +0% | 0.3820 |
-| 30b || 205.73 | 252.07 | +23% || 0.52 | 0.52 | -0% | 0.1792 |
| 30c || 742.37 | 748.54 | +1% || 0.52 | 0.52 | -0% | 0.9275 |
-| 31a || 303.72 | 360.67 | +19% || 0.52 | 0.52 | -0% | 0.1466 |
-| 31b || 165.95 | 189.99 | +14% || 0.52 | 0.52 | -0% | 0.2975 |
+| 31c || 439.18 | 355.72 | -19% || 0.52 | 0.52 | +0% | 0.0989 |
| 32a || 52.74 | 53.87 | +2% || 0.52 | 0.52 | -0% | 0.9395 |
| 32b || 176.30 | 172.02 | -2% || 0.52 | 0.52 | -0% | 0.9062 |
| 33a || 65.75 | 67.02 | +2% || 0.52 | 0.52 | -0% | 0.9203 |
+| 33b || 69.97 | 62.16 | -11% || 0.52 | 0.52 | -0% | 0.5836 |
+| 33c || 116.95 | 81.16 | -31% || 0.52 | 0.52 | -0% | 0.1845 |
-| 3a || 335.15 | 386.13 | +15% || 0.52 | 0.52 | +0% | 0.2538 |
+| 3b || 61.00 | 53.79 | -12% || 0.52 | 0.52 | -0% | 0.5843 |
| 3c || 522.16 | 529.34 | +1% || 0.52 | 0.52 | +0% | 0.8930 |
-| 4a || 193.99 | 205.38 | +6% || 0.52 | 0.52 | -0% | 0.6919 |
+| 4b || 59.45 | 55.56 | -7% || 0.52 | 0.52 | -0% | 0.7973 |
| 4c || 221.12 | 216.22 | -2% || 0.52 | 0.52 | -0% | 0.8770 |
| 5a || 165.11 | 159.66 | -3% || 0.52 | 0.52 | +0% | 0.8201 |
-| 5b || 174.24 | 195.75 | +12% || 0.52 | 0.52 | -0% | 0.4933 |
-| 5c || 222.90 | 265.40 | +19% || 0.52 | 0.52 | +0% | 0.1410 |
+| 6a || 162.76 | 136.20 | -16% || 0.52 | 0.52 | -0% | 0.3568 |
+| 6b || 199.44 | 173.71 | -13% || 0.52 | 0.52 | -0% | 0.3624 |
+| 6c || 119.99 | 113.67 | -5% || 0.52 | 0.52 | -0% | 0.7494 |
+| 6d || 700.01 | 661.00 | -6% || 0.52 | 0.52 | -0% | 0.5010 |
+| 6e || 135.42 | 120.44 | -11% || 0.52 | 0.52 | -0% | 0.4938 |
| 6f || 1062.64 | 1035.34 | -3% || 0.52 | 0.52 | -0% | 0.5876 |
-| 7a || 121.52 | 133.63 | +10% || 0.52 | 0.52 | -0% | 0.5996 |
-| 7b || 113.02 | 123.82 | +10% || 0.52 | 0.52 | +0% | 0.6193 |
+| 7c || 1161.89 | 1030.99 | -11% || 0.52 | 0.52 | +0% | 0.0706 |
| 8a || 159.98 | 158.62 | -1% || 0.52 | 0.52 | +0% | 0.9664 |
+| 8b || 201.35 | 158.94 | -21% || 0.52 | 0.52 | -0% | 0.1673 |
| 8c || 1979.56 | 1898.86 | -4% || 0.52 | 0.52 | -0% | 0.2518 |
| 8d || 554.83 | 575.46 | +4% || 0.52 | 0.52 | +0% | 0.6538 |
-| 9a || 514.86 | 613.13 | +19% || 0.52 | 0.52 | -0% | 0.1075 |
| 9b || 345.29 | 348.60 | +1% || 0.52 | 0.52 | -0% | 0.9392 |
-| 9c || 692.83 | 768.59 | +11% || 0.52 | 0.52 | -0% | 0.1470 |
| 9d || 1077.57 | 1122.81 | +4% || 0.52 | 0.52 | -0% | 0.5010 |
+---------++----------+----------+--------++----------+----------+--------+---------+
| Sum || 53185.65 | 53180.79 | -0% || | | | |
| Geomean || | | || | | -0% | |
+---------++----------+----------+--------++----------+----------+--------+---------+hyriseBenchmarkStarSchema - single-threaded Sum of avg. item runtimes: -0% || Geometric mean of throughput changes: +1%Configuration Overview - click to expand +Configuration Overview---+------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Martin.Boissier/hyrise_master/rel_clang/benchmark_all_results/hyriseBenchmarkStarSchema_46f13fa510aa7e8b232b3081ee1a25b7f0958e55_st.json | /home/Martin.Boissier/hyrise_master/rel_clang/benchmark_all_results/hyriseBenchmarkStarSchema_e58fc4007c6ee2e8a35c5eb048411805135eb715_st.json |
+-------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------
10000
-----------+
| GIT-HASH | 46f13fa510aa7e8b232b3081ee1a25b7f0958e55-dirty | e58fc4007c6ee2e8a35c5eb048411805135eb715-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 14.0.0 | clang 14.0.0 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2023-09-20 00:29:02 | 2023-09-19 20:40:17 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 100 | 100 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+---------+
| 1.1 || 364.27 | 365.00 | +0%˄ || 2.75 | 2.74 | -0%˄ | 0.8332 |
| 1.2 || 103.78 | 102.54 | -1%˄ || 9.64 | 9.75 | +1%˄ | 0.1930 |
| 1.3 || 100.72 | 100.67 | -0%˄ || 9.93 | 9.93 | +0%˄ | 0.9262 |
| 2.1 || 545.95 | 547.36 | +0%˄ || 1.83 | 1.83 | -0%˄ | 0.3459 |
| 2.2 || 286.67 | 287.51 | +0%˄ || 3.49 | 3.48 | -0%˄ | 0.0317 |
| 2.3 || 188.52 | 188.73 | +0%˄ || 5.30 | 5.30 | -0%˄ | 0.5057 |
| 3.1 || 3027.06 | 3043.82 | +1% || 0.33 | 0.33 | -1% | 0.6464 |
| 3.2 || 270.91 | 268.32 | -1%˄ || 3.69 | 3.73 | +1%˄ | 0.0355 |
| 3.3 || 120.07 | 117.77 | -2%˄ || 8.33 | 8.49 | +2%˄ | 0.0004 |
| 3.4 || 112.71 | 110.47 | -2%˄ || 8.87 | 9.05 | +2%˄ | 0.0000 |
| 4.1 || 3795.20 | 3776.90 | -0% || 0.26 | 0.26 | +0% | 0.5483 |
| 4.2 || 856.05 | 844.03 | -1% || 1.17 | 1.18 | +1% | 0.0272 |
| 4.3 || 269.44 | 266.85 | -1%˄ || 3.71 | 3.75 | +1%˄ | 0.0000 |
+---------++----------+----------+--------++----------+----------+--------+---------+
| Sum || 10041.37 | 10019.96 | -0% || | | | |
| Geomean || | | || | | +1% | |
+---------++----------+----------+--------++----------+----------+--------+---------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+----------+--------++----------+----------+--------+---------+hyriseBenchmarkStarSchema - multi-threaded, shuffled, 28 clients, 28 cores Sum of avg. item runtimes: -0% || Geometric mean of throughput changes: -0%Configuration Overview - click to expand +Configuration Overview---------+------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Martin.Boissier/hyrise_master/rel_clang/benchmark_all_results/hyriseBenchmarkStarSchema_46f13fa510aa7e8b232b3081ee1a25b7f0958e55_mt.json | /home/Martin.Boissier/hyrise_master/rel_clang/benchmark_all_results/hyriseBenchmarkStarSchema_e58fc4007c6ee2e8a35c5eb048411805135eb715_mt.json |
+-------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 46f13fa510aa7e8b232b3081ee1a25b7f0958e55-dirty | e58fc4007c6ee2e8a35c5eb048411805135eb715-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 28 | 28 |
| compiler | clang 14.0.0 | clang 14.0.0 |
| cores | 28 | 28 |
| data_preparation_cores | 0 | 0 |
| date | 2023-09-20 00:36:39 | 2023-09-19 20:47:53 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [28] | [28] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+---------+
+| 1.1 || 693.29 | 629.96 | -9% || 1.95 | 1.95 | -0% | 0.1836 |
| 1.2 || 348.81 | 362.43 | +4% || 1.95 | 1.95 | -0% | 0.7189 |
+| 1.3 || 276.12 | 247.56 | -10% || 1.95 | 1.95 | -0% | 0.2353 |
| 2.1 || 1470.99 | 1477.07 | +0% || 1.95 | 1.95 | -0% | 0.9354 |
| 2.2 || 797.12 | 807.04 | +1% || 1.95 | 1.95 | -0% | 0.8473 |
-| 2.3 || 347.83 | 375.38 | +8% || 1.95 | 1.95 | -0% | 0.4194 |
| 3.1 || 2925.86 | 3036.81 | +4% || 1.95 | 1.94 | -0% | 0.3227 |
| 3.2 || 775.62 | 772.87 | -0% || 1.95 | 1.95 | -0% | 0.9591 |
+| 3.3 || 549.57 | 505.15 | -8% || 1.95 | 1.95 | -0% | 0.4033 |
-| 3.4 || 409.78 | 451.74 | +10% || 1.95 | 1.95 | -0% | 0.2834 |
| 4.1 || 2851.41 | 2812.18 | -1% || 1.95 | 1.95 | -0% | 0.6865 |
| 4.2 || 1963.97 | 1980.48 | +1% || 1.95 | 1.95 | +0% | 0.8647 |
+| 4.3 || 835.62 | 757.86 | -9% || 1.95 | 1.95 | -0% | 0.2015 |
+---------++----------+----------+--------++----------+----------+--------+---------+
| Sum || 14245.98 | 14216.52 | -0% || | | | |
| Geomean || | | || | | -0% | |
+---------++----------+----------+--------++----------+----------+--------+---------+ |
Bouncner
commented
Sep 20, 2023
dey4ss
reviewed
Sep 22, 2023
|
Still measuring with SF 1000. But found another issue when we call |
dey4ss
added a commit
that referenced
this pull request
Sep 23, 2023
…ncner <martin+github@boissier.de>
dey4ss
added a commit
that referenced
this pull request
Sep 23, 2023
Co-authored-by: Bouncner <martin+github@boissier.de>
dey4ss
reviewed
Oct 6, 2023
dey4ss
approved these changes
Oct 7, 2023
nikriek
pushed a commit
that referenced
this pull request
Oct 28, 2023
No longer create TaskQueues for NUMA nodes without any workers and make scheduler shutdown mechanism more fail safe. --------- Co-authored-by: Daniel Lindner <27929897+dey4ss@users.noreply.github.com>
nikriek
pushed a commit
that referenced
this pull request
Nov 6, 2023
No longer create TaskQueues for NUMA nodes without any workers and make scheduler shutdown mechanism more fail safe. --------- Co-authored-by: Daniel Lindner <27929897+dey4ss@users.noreply.github.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Due to the scheduler changes introduced with #2548, we triggered a situation where tasks have not been processed and Hyrise hang with 0% CPU usage. Turns out Hyrise creates TaskQueues for all NUMA nodes even though there might be no local workers to process these tasks (e.g., when using
numactl -n 3).This is a first step (more might be needed) to address such issues. With this PR, we only create queues for nodes that have workers and thus do no longer put tasks on empty queues when these nodes do not have any workers.