Adapt IndexScan to use TableIndexes #2553
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
|
I don't want to block this PR by any means. Just out of curiosity, do you know if the optimizer would pick up your new index and use it? Or do we also need to adapt the optimizer rule? |
|
Currently it doesn't. |
|
I would assume that it barely gives us an advantage in TPC-H, but for TPC-C it might make a quite big difference. |
mweisgut
reviewed
Mar 17, 2023
Bouncner
reviewed
Mar 23, 2023
|
I think we need to discuss how we want to proceed with indexes in the different benchmarks. |
Can you elaborate the discussion points? And also, do you have some performance numbers for query plans that contain index scans when all columns are indexed? |
|
I should have addressed most points. Further, I changed the LQP translator to no longer issue a scan and a union, when the index scan does not have any chunks to scan. Moreover, I changed the include/exclude lists to be shared pointers which are shared among the scans. Before, we created the list and copied them into both operators (not measureable for TPC-C, but should have an impact for large data sets). |
Use 10 warehouses as the default for TPC-C. With upcoming changes to focus more on multi-threading, one warehouse simply doesn't make sense.
dey4ss
approved these changes
Jul 28, 2023
| @@ -393,7 +393,7 @@ void AbstractTableGenerator::_create_table_indexes( | |||
| Assert(index_column_names.size() == 1, "Multi-column indexes are currently not supported."); | |||
|
|
|||
| for (const auto& column_name : index_column_names) { | |||
| std::cout << "- Creating an index on table " << table_name << std::flush; | |||
| std::cout << "- Creating secondary index on '" << table_name << "." << column_name << "'" << std::flush; | |||
There was a problem hiding this comment.
Aren't most (or even all?) indexed we define primary indexes?
There was a problem hiding this comment.
A primary index is a sorted table. We never do that.
There was a problem hiding this comment.
I looked it up and it seems that different definitions disagree on this. Some just rquire primary indexes to be on the primary key columns
A unique index on the primary key of the table. [IBM DB2 doc]
and some require it to determine the position of the tuple
A primary index determines the location of the records of the data file, while a secondary index does not. [Garcia-Molina et al. Database Systems. The Complete Book. 2nd edition, p. 620.]
So just index?
|
Would like to see a TPC-C benchmark though. |
Performance for TPC-C with 10 WarehousesSingle-ThreadedConfiguration Overview - click to expand +Configuration Overview---+------------------------------------------------+----------------------------------------------------------------------------------------------------------+
| Parameter | master_with_sf10_st.json | rel_amd_nolto/benchmark_all_results/hyriseBenchmarkTPCC_efc593082b36f449a1c657b3320e08ab0d74be7c_st.json |
+-------------------------+------------------------------------------------+----------------------------------------------------------------------------------------------------------+
| GIT-HASH | b685721debab96b308d134e8a0c00607b4421490-dirty | efc593082b36f449a1c657b3320e08ab0d74be7c-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 14.0.0 | clang 14.0.0 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2023-08-09 11:52:01 | 2023-08-08 05:36:28 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10 | 10 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------+------------------------------------------------+----------------------------------------------------------------------------------------------------------+ +--------------++----------+---------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+--------------++----------+---------+--------++----------+----------+--------+----------------------+
| Delivery || 58.92 | 61.08 | +4% || 1.48 | 1.47 | -1% | (run time too short) |
| New-Order || 49.11 | 49.73 | +1% || 16.75 | 16.46 | -2% | 0.3832 |
| Order-Status || 2.74 | 2.75 | +0% || 1.48 | 1.45 | -2% | (run time too short) |
-| Payment || 4.59 | 4.82 | +5% || 15.98 | 15.73 | -2% | 0.0000 |
| Stock-Level || 7.63 | 7.47 | -2% || 1.50 | 1.47 | -2% | (run time too short) |
+--------------++----------+---------+--------++----------+----------+--------+----------------------+
| Sum || 123.00 | 125.84 | +2% || | | | |
| Geomean || | | || | | -2% | |
+--------------++----------+---------+--------++----------+----------+--------+----------------------+Multi-ThreadedConfiguration Overview - click to expand +Configuration Overview---------+------------------------------------------------+----------------------------------------------------------------------------------------------------------+
| Parameter | master_with_sf10_mt.json | rel_amd_nolto/benchmark_all_results/hyriseBenchmarkTPCC_efc593082b36f449a1c657b3320e08ab0d74be7c_mt.json |
+-------------------------------+------------------------------------------------+----------------------------------------------------------------------------------------------------------+
| GIT-HASH | b685721debab96b308d134e8a0c00607b4421490-dirty | efc593082b36f449a1c657b3320e08ab0d74be7c-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| compiler | clang 14.0.0 | clang 14.0.0 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2023-08-09 09:04:11 | 2023-08-08 05:37:35 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10 | 10 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+------------------------------------------------+----------------------------------------------------------------------------------------------------------+ +--------------++----------+---------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+--------------++----------+---------+--------++----------+----------+--------+---------+
| Delivery || 455.28 | 466.35 | +2% || 12.13 | 11.84 | -2% | 0.0090 |
| unsucc.: || 12.82 | 12.17 | -5% || 13.12 | 12.88 | -2% | |
| New-Order || 329.28 | 333.60 | +1% || 138.50 | 135.66 | -2% | 0.0000 |
| unsucc.: || 24.74 | 27.17 | +10% || 145.54 | 142.50 | -2% | |
-| Order-Status || 19.72 | 20.71 | +5% || 25.25 | 24.73 | -2% | 0.0516 |
| Payment || 19.39 | 19.58 | +1% || 102.55 | 101.29 | -1% | 0.3334 |
| unsucc.: || 12.39 | 13.60 | +10% || 168.91 | 164.55 | -3% | |
| Stock-Level || 37.58 | 37.26 | -1% || 25.25 | 24.73 | -2% | 0.6388 |
+--------------++----------+---------+--------++----------+----------+--------+---------+
| Sum || 861.26 | 877.50 | +2% || | | | |
| Geomean || | | || | | -2% | |
+- |
Benchmark AllNote: please ignore TPC-C due to the change of the default number of warehousesSystem node-17 - click to expand
Commit Info and Build Time
hyriseBenchmarkTPCH - single-threaded, SF 10.0 Sum of avg. item runtimes: +1% || Geometric mean of throughput changes: +0%Configuration Overview - click to expand +Configuration Overview----+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd_nolto/benchmark_all_results/hyriseBenchmarkTPCH_b685721debab96b308d134e8a0c00607b4421490_st.json | /hyrise/rel_amd_nolto/benchmark_all_results/hyriseBenchmarkTPCH_efc593082b36f449a1c657b3320e08ab0d74be7c_st.json |
+--------------------------+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | b685721debab96b308d134e8a0c00607b4421490-dirty | efc593082b36f449a1c657b3320e08ab0d74be7c-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 14.0.0 | clang 14.0.0 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2023-08-07 23:32:01 | 2023-08-08 03:39:01 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 100 | 100 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+--------------------------+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+ +----------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+----------++----------+----------+--------++----------+----------+--------+---------+
| TPC-H 01 || 5634.52 | 5656.63 | +0% || 0.18 | 0.18 | -0% | 0.6402 |
+| TPC-H 02 || 53.65 | 49.93 | -7%˄ || 18.64 | 20.03 | +7%˄ | 0.0000 |
| TPC-H 03 || 2490.04 | 2544.21 | +2% || 0.40 | 0.39 | -2% | 0.0588 |
| TPC-H 04 || 2119.17 | 2110.52 | -0% || 0.47 | 0.47 | +0% | 0.5209 |
| TPC-H 05 || 4927.00 | 4950.43 | +0% || 0.20 | 0.20 | -0% | 0.7655 |
+| TPC-H 06 || 221.48 | 210.71 | -5%˄ || 4.51 | 4.75 | +5%˄ | 0.0000 |
| TPC-H 07 || 1114.02 | 1127.54 | +1% || 0.90 | 0.89 | -1% | 0.0082 |
| TPC-H 08 || 1022.95 | 1018.09 | -0% || 0.98 | 0.98 | +0% | 0.2038 |
| TPC-H 09 || 7464.54 | 7527.35 | +1% || 0.13 | 0.13 | -1% | ˅ |
| TPC-H 10 || 3171.16 | 3225.00 | +2% || 0.32 | 0.31 | -2% | 0.1679 |
| TPC-H 11 || 86.45 | 86.58 | +0%˄ || 11.57 | 11.55 | -0%˄ | 0.8657 |
| TPC-H 12 || 1907.27 | 1881.24 | -1% || 0.52 | 0.53 | +1% | 0.1179 |
| TPC-H 13 || 6905.91 | 6926.03 | +0% || 0.14 | 0.14 | -0% | ˅ |
| TPC-H 14 || 668.72 | 663.99 | -1% || 1.50 | 1.51 | +1% | 0.0984 |
| TPC-H 15 || 265.21 | 259.95 | -2%˄ || 3.77 | 3.85 | +2%˄ | 0.0000 |
| TPC-H 16 || 813.29 | 843.80 | +4% || 1.23 | 1.19 | -4% | 0.0002 |
| TPC-H 17 || 277.08 | 282.61 | +2%˄ || 3.61 | 3.54 | -2%˄ | 0.0000 |
| TPC-H 18 || 1564.03 | 1577.86 | +1% || 0.64 | 0.63 | -1% | 0.1084 |
| TPC-H 19 || 312.85 | 318.06 | +2%˄ || 3.20 | 3.14 | -2%˄ | 0.0014 |
| TPC-H 20 || 590.61 | 600.71 | +2%˄ || 1.69 | 1.66 | -2%˄ | 0.0057 |
| TPC-H 21 || 7857.80 | 7899.26 | +1% || 0.13 | 0.13 | -1% | ˅ |
| TPC-H 22 || 610.78 | 596.09 | -2%˄ || 1.64 | 1.68 | +2%˄ | 0.0000 |
+----------++----------+----------+--------++----------+----------+--------+---------+
| Sum || 50078.51 | 50356.58 | +1% || | | | |
| Geomean || | | || | | +0% | |
+----------++----------+----------+--------++----------+----------+--------+---------+
| Notes || ˄ Execution stopped due to max runs reached |
| || ˅ Insufficient number of runs for p-value calculation |
+----------++----------+----------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCH - single-threaded, SF 0.01 Sum of avg. item runtimes: +1% || Geometric mean of throughput changes: -0%Configuration Overview - click to expand +Configuration Overview----+----------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd_nolto/benchmark_all_results/hyriseBenchmarkTPCH_b685721debab96b308d134e8a0c00607b4421490_st_s01.json | /hyrise/rel_amd_nolto/benchmark_all_results/hyriseBenchmarkTPCH_efc593082b36f449a1c657b3320e08ab0d74be7c_st_s01.json |
+--------------------------+----------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | b685721debab96b308d134e8a0c00607b4421490-dirty | efc593082b36f449a1c657b3320e08ab0d74be7c-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 14.0.0 | clang 14.0.0 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2023-08-07 23:53:23 | 2023-08-08 04:00:21 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 100 | 100 |
| scale_factor | 0.009999999776482582 | 0.009999999776482582 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+--------------------------+----------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------+ +----------++----------+---------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+----------++----------+---------+--------++----------+----------+--------+---------+
+| TPC-H 01 || 9.02 | 7.14 | -21%˄ || 110.88 | 140.00 | +26%˄ | 0.0000 |
-| TPC-H 02 || 3.74 | 4.33 | +16%˄ || 267.15 | 230.94 | -14%˄ | 0.0069 |
| TPC-H 03 || 0.64 | 0.66 | +3%˄ || 1562.16 | 1516.47 | -3%˄ | 0.0061 |
| TPC-H 04 || 0.43 | 0.43 | -1%˄ || 2301.99 | 2324.96 | +1%˄ | 0.0062 |
| TPC-H 05 || 1.01 | 1.03 | +2%˄ || 986.05 | 970.04 | -2%˄ | 0.0603 |
+| TPC-H 06 || 0.23 | 0.22 | -7%˄ || 4309.11 | 4611.19 | +7%˄ | 0.0000 |
-| TPC-H 07 || 11.20 | 12.15 | +8%˄ || 89.26 | 82.29 | -8%˄ | 0.1282 |
| TPC-H 08 || 15.09 | 15.48 | +3%˄ || 66.25 | 64.59 | -3%˄ | 0.3336 |
| TPC-H 09 || 3.80 | 3.92 | +3%˄ || 262.75 | 254.84 | -3%˄ | 0.8350 |
| TPC-H 10 || 0.72 | 0.74 | +2%˄ || 1387.43 | 1353.76 | -2%˄ | 0.0000 |
| TPC-H 11 || 0.20 | 0.20 | -0%˄ || 5015.33 | 5034.46 | +0%˄ | 0.6837 |
| TPC-H 12 || 0.69 | 0.67 | -3%˄ || 1452.38 | 1498.71 | +3%˄ | 0.0000 |
| TPC-H 13 || 2.10 | 2.11 | +1%˄ || 476.30 | 472.80 | -1%˄ | 0.0222 |
| TPC-H 14 || 0.33 | 0.33 | +0%˄ || 3042.90 | 3027.65 | -1%˄ | 0.6207 |
| TPC-H 15 || 1.24 | 1.24 | +0%˄ || 805.90 | 805.69 | -0%˄ | 0.9656 |
| TPC-H 16 || 2.09 | 2.12 | +2%˄ || 478.28 | 470.90 | -2%˄ | 0.0000 |
| TPC-H 17 || 0.70 | 0.69 | -1%˄ || 1423.62 | 1436.98 | +1%˄ | 0.9374 |
| TPC-H 18 || 1.12 | 1.13 | +1%˄ || 891.92 | 882.42 | -1%˄ | 0.0000 |
| TPC-H 19 || 5.33 | 5.37 | +1%˄ || 187.71 | 186.02 | -1%˄ | 0.0000 |
-| TPC-H 20 || 2.21 | 2.33 | +6%˄ || 453.16 | 429.16 | -5%˄ | 0.0031 |
| TPC-H 21 || 1.45 | 1.45 | -0%˄ || 687.68 | 689.18 | +0%˄ | 0.9608 |
| TPC-H 22 || 1.08 | 1.08 | +0%˄ || 924.75 | 920.95 | -0%˄ | 0.0536 |
+----------++----------+---------+--------++----------+----------+--------+---------+
| Sum || 64.41 | 64.82 | +1% || | | | |
| Geomean || | | || | | -0% | |
+----------++----------+---------+--------++----------+----------+--------+---------+
| Notes || ˄ Execution stopped due to max runs reached |
+----------++----------+---------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCH - multi-threaded, ordered, 1 client, 64 cores, SF 10.0 Sum of avg. item runtimes: +0% || Geometric mean of throughput changes: +0%Configuration Overview - click to expand +Configuration Overview---------+--------------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd_nolto/benchmark_all_results/hyriseBenchmarkTPCH_b685721debab96b308d134e8a0c00607b4421490_mt_ordered.json | /hyrise/rel_amd_nolto/benchmark_all_results/hyriseBenchmarkTPCH_efc593082b36f449a1c657b3320e08ab0d74be7c_mt_ordered.json |
+-------------------------------+--------------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | b685721debab96b308d134e8a0c00607b4421490-dirty | efc593082b36f449a1c657b3320e08ab0d74be7c-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 14.0.0 | clang 14.0.0 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2023-08-07 23:53:52 | 2023-08-08 04:00:50 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+--------------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------+ +----------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| TPC-H 01 || 5238.93 | 5348.49 | +2% || 0.18 | 0.18 | -0% | (run time too short) |
| TPC-H 02 || 55.47 | 55.54 | +0% || 16.35 | 16.28 | -0% | 0.8858 |
| TPC-H 03 || 1167.36 | 1156.37 | -1% || 0.85 | 0.85 | +0% | (run time too short) |
| TPC-H 04 || 885.73 | 893.78 | +1% || 1.12 | 1.10 | -1% | (run time too short) |
| TPC-H 05 || 1191.57 | 1205.87 | +1% || 0.83 | 0.82 | -2% | 0.4509 |
+| TPC-H 06 || 67.85 | 62.59 | -8% || 13.68 | 14.93 | +9% | 0.0000 |
| TPC-H 07 || 358.27 | 359.85 | +0% || 2.75 | 2.73 | -1% | 0.4506 |
| TPC-H 08 || 390.76 | 391.56 | +0% || 2.52 | 2.52 | -0% | 0.7192 |
| TPC-H 09 || 2801.19 | 2776.58 | -1% || 0.35 | 0.35 | +0% | (run time too short) |
| TPC-H 10 || 1841.25 | 1834.46 | -0% || 0.53 | 0.53 | +0% | (run time too short) |
| TPC-H 11 || 91.95 | 91.78 | -0% || 10.32 | 10.33 | +0% | 0.7656 |
| TPC-H 12 || 718.08 | 723.45 | +1% || 1.37 | 1.37 | +0% | (run time too short) |
| TPC-H 13 || 4404.83 | 4371.69 | -1% || 0.22 | 0.22 | +0% | (run time too short) |
| TPC-H 14 || 159.76 | 159.63 | -0% || 6.05 | 6.07 | +0% | 0.8811 |
| TPC-H 15 || 183.48 | 181.61 | -1% || 5.30 | 5.35 | +1% | 0.1377 |
| TPC-H 16 || 980.62 | 994.03 | +1% || 1.00 | 1.00 | +0% | (run time too short) |
| TPC-H 17 || 89.46 | 89.50 | +0% || 10.58 | 10.58 | -0% | 0.9149 |
| TPC-H 18 || 2550.33 | 2538.36 | -0% || 0.38 | 0.38 | +0% | (run time too short) |
| TPC-H 19 || 133.26 | 135.81 | +2% || 7.20 | 7.08 | -2% | 0.0614 |
| TPC-H 20 || 251.69 | 250.10 | -1% || 3.88 | 3.92 | +1% | 0.3939 |
| TPC-H 21 || 1656.86 | 1664.59 | +0% || 0.60 | 0.58 | -3% | (run time too short) |
| TPC-H 22 || 160.29 | 160.91 | +0% || 6.05 | 6.02 | -1% | 0.4659 |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| Sum || 25378.99 | 25446.56 | +0% || | | | |
| Geomean || | | || | | +0% | |
+----------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCH - multi-threaded, shuffled, 64 clients, 64 cores, SF 10.0 Sum of avg. item runtimes: -0% || Geometric mean of throughput changes: +0%Configuration Overview - click to expand +Configuration Overview---------+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd_nolto/benchmark_all_results/hyriseBenchmarkTPCH_b685721debab96b308d134e8a0c00607b4421490_mt.json | /hyrise/rel_amd_nolto/benchmark_all_results/hyriseBenchmarkTPCH_efc593082b36f449a1c657b3320e08ab0d74be7c_mt.json |
+-------------------------------+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | b685721debab96b308d134e8a0c00607b4421490-dirty | efc593082b36f449a1c657b3320e08ab0d74be7c-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| clustering | None | None |
| compiler | clang 14.0.0 | clang 14.0.0 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2023-08-08 00:18:03 | 2023-08-08 04:25:01 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+ +----------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+----------++----------+----------+--------++----------+----------+--------+---------+
| TPC-H 01 || 6143.46 | 6175.24 | +1% || 0.87 | 0.87 | -0% | 0.7926 |
+| TPC-H 02 || 709.96 | 611.85 | -14% || 0.88 | 0.88 | +0% | 0.3212 |
| TPC-H 03 || 3674.50 | 3749.46 | +2% || 0.87 | 0.87 | +0% | 0.6910 |
| TPC-H 04 || 2963.75 | 3063.94 | +3% || 0.87 | 0.87 | -0% | 0.5841 |
| TPC-H 05 || 5032.30 | 5185.45 | +3% || 0.87 | 0.87 | +0% | 0.5389 |
| TPC-H 06 || 843.62 | 863.68 | +2% || 0.88 | 0.88 | +0% | 0.8205 |
| TPC-H 07 || 3898.90 | 3860.33 | -1% || 0.87 | 0.87 | -0% | 0.8668 |
| TPC-H 08 || 2929.34 | 2847.93 | -3% || 0.87 | 0.87 | -0% | 0.6572 |
| TPC-H 09 || 7639.28 | 7530.83 | -1% || 0.87 | 0.87 | +0% | 0.6940 |
| TPC-H 10 || 5256.09 | 5253.39 | -0% || 0.87 | 0.87 | +0% | 0.9905 |
-| TPC-H 11 || 580.70 | 649.07 | +12% || 0.88 | 0.88 | +0% | 0.3994 |
| TPC-H 12 || 3512.40 | 3389.69 | -3% || 0.87 | 0.87 | +0% | 0.5343 |
| TPC-H 13 || 6533.16 | 6552.05 | +0% || 0.87 | 0.87 | -0% | 0.9019 |
+| TPC-H 14 || 1454.51 | 1382.22 | -5% || 0.88 | 0.88 | +0% | 0.5963 |
| TPC-H 15 || 787.26 | 787.19 | -0% || 0.88 | 0.88 | +0% | 0.9993 |
-| TPC-H 16 || 2942.11 | 3116.50 | +6% || 0.87 | 0.87 | +1% | 0.3348 |
-| TPC-H 17 || 938.42 | 1050.88 | +12% || 0.88 | 0.88 | +0% | 0.3218 |
| TPC-H 18 || 3863.61 | 3849.65 | -0% || 0.87 | 0.87 | +0% | 0.9041 |
-| TPC-H 19 || 1180.64 | 1304.13 | +10% || 0.88 | 0.88 | +0% | 0.3644 |
+| TPC-H 20 || 2398.32 | 2275.48 | -5% || 0.87 | 0.87 | +0% | 0.4606 |
| TPC-H 21 || 7757.51 | 7612.39 | -2% || 0.87 | 0.87 | -0% | 0.6178 |
+| TPC-H 22 || 1499.03 | 1379.20 | -8% || 0.88 | 0.88 | +0% | 0.4150 |
+----------++----------+----------+--------++----------+----------+--------+---------+
| Sum || 72538.85 | 72490.54 | -0% || | | | |
| Geomean || | | || | | +0% | |
+----------++----------+----------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCDS - single-threaded Sum of avg. item runtimes: +2% || Geometric mean of throughput changes: -2%Configuration Overview - click to expand +Configuration Overview---+-------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd_nolto/benchmark_all_results/hyriseBenchmarkTPCDS_b685721debab96b308d134e8a0c00607b4421490_st.json | /hyrise/rel_amd_nolto/benchmark_all_results/hyriseBenchmarkTPCDS_efc593082b36f449a1c657b3320e08ab0d74be7c_st.json |
+-------------------------+-------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | b685721debab96b308d134e8a0c00607b4421490-dirty | efc593082b36f449a1c657b3320e08ab0d74be7c-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 14.0.0 | clang 14.0.0 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2023-08-08 00:40:16 | 2023-08-08 04:47:10 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 100 | 100 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+-------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| 01 || 293.89 | 297.23 | +1%˄ || 3.40 | 3.36 | -1%˄ | 0.0625 |
| 03 || 97.59 | 98.61 | +1%˄ || 10.25 | 10.14 | -1%˄ | 0.1871 |
| 06 || 137.68 | 142.43 | +3%˄ || 7.26 | 7.02 | -3%˄ | 0.0000 |
-| 07 || 361.38 | 380.45 | +5%˄ || 2.77 | 2.63 | -5%˄ | 0.0000 |
-| 09 || 1036.98 | 1091.10 | +5% || 0.96 | 0.92 | -5% | 0.0000 |
-| 10 || 156.96 | 166.39 | +6%˄ || 6.37 | 6.01 | -6%˄ | 0.0000 |
| 13 || 562.64 | 587.51 | +4%˄ || 1.78 | 1.70 | -4%˄ | 0.0000 |
| 15 || 130.87 | 132.50 | +1%˄ || 7.64 | 7.55 | -1%˄ | 0.0000 |
| 16 || 184.65 | 184.91 | +0%˄ || 5.42 | 5.41 | -0%˄ | 0.5249 |
| 17 || 405.39 | 417.16 | +3%˄ || 2.47 | 2.40 | -3%˄ | 0.0000 |
-| 19 || 130.21 | 137.42 | +6%˄ || 7.68 | 7.28 | -5%˄ | 0.0000 |
| 25 || 199.86 | 208.41 | +4%˄ || 5.00 | 4.80 | -4%˄ | 0.0000 |
| 26 || 160.31 | 157.45 | -2%˄ || 6.24 | 6.35 | +2%˄ | 0.2790 |
| 28 || 771.12 | 794.58 | +3% || 1.30 | 1.26 | -3% | 0.0000 |
-| 29 || 583.91 | 616.72 | +6%˄ || 1.71 | 1.62 | -5%˄ | (run time too short) |
| 31 || 1534.88 | 1564.45 | +2% || 0.65 | 0.64 | -2% | 0.0000 |
| 32 || 49.37 | 48.15 | -2%˄ || 20.25 | 20.77 | +3%˄ | 0.0000 |
-| 34 || 212.96 | 223.37 | +5%˄ || 4.70 | 4.48 | -5%˄ | 0.0000 |
| 35 || 795.24 | 805.20 | +1% || 1.26 | 1.24 | -1% | 0.0001 |
| 37 || 284.09 | 282.45 | -1%˄ || 3.52 | 3.54 | +1%˄ | 0.2087 |
| 39a || 2082.39 | 2125.01 | +2% || 0.48 | 0.47 | -2% | 0.0001 |
| 39b || 2068.72 | 2103.74 | +2% || 0.48 | 0.48 | -2% | 0.1936 |
-| 41 || 300.91 | 340.40 | +13%˄ || 3.32 | 2.94 | -12%˄ | 0.0000 |
| 42 || 106.06 | 109.57 | +3%˄ || 9.43 | 9.13 | -3%˄ | 0.0000 |
| 43 || 1113.82 | 1122.60 | +1% || 0.90 | 0.89 | -1% | 0.0004 |
| 45 || 171.93 | 174.81 | +2%˄ || 5.82 | 5.72 | -2%˄ | 0.0000 |
| 48 || 1083.26 | 1131.49 | +4% || 0.92 | 0.88 | -4% | 0.0000 |
| 50 || 149.05 | 152.71 | +2%˄ || 6.71 | 6.55 | -2%˄ | 0.0000 |
| 52 || 106.11 | 109.81 | +3%˄ || 9.42 | 9.11 | -3%˄ | 0.0000 |
| 55 || 99.48 | 102.91 | +3%˄ || 10.05 | 9.72 | -3%˄ | 0.0000 |
| 62 || 621.67 | 629.31 | +1% || 1.61 | 1.59 | -1% | 0.0000 |
| 65 || 2254.50 | 2294.55 | +2% || 0.44 | 0.44 | -2% | 0.0006 |
| 69 || 149.63 | 153.28 | +2%˄ || 6.68 | 6.52 | -2%˄ | 0.0000 |
| 73 || 101.20 | 105.22 | +4%˄ || 9.88 | 9.50 | -4%˄ | 0.0000 |
| 79 || 603.91 | 625.46 | +4%˄ || 1.66 | 1.60 | -3%˄ | 0.0000 |
| 81 || 239.48 | 239.27 | -0%˄ || 4.18 | 4.18 | +0%˄ | 0.6716 |
| 82 || 382.25 | 385.90 | +1%˄ || 2.62 | 2.59 | -1%˄ | 0.0206 |
| 83 || 58.62 | 59.74 | +2%˄ || 17.06 | 16.74 | -2%˄ | 0.1106 |
| 85 || 177.17 | 178.71 | +1%˄ || 5.64 | 5.60 | -1%˄ | 0.0671 |
| 88 || 915.37 | 944.98 | +3% || 1.09 | 1.06 | -3% | 0.0000 |
| 91 || 24.96 | 25.59 | +3%˄ || 40.05 | 39.06 | -2%˄ | 0.0000 |
| 92 || 80.42 | 80.87 | +1%˄ || 12.43 | 12.36 | -1%˄ | 0.2291 |
| 93 || 5185.32 | 5250.63 | +1% || 0.19 | 0.19 | -1% | 0.0003 |
| 94 || 153.44 | 153.90 | +0%˄ || 6.52 | 6.50 | -0%˄ | 0.5632 |
| 95 || 9179.74 | 9397.36 | +2% || 0.11 | 0.11 | -2% | ˅ |
-| 96 || 79.12 | 82.87 | +5%˄ || 12.64 | 12.07 | -5%˄ | 0.0000 |
| 97 || 3595.51 | 3549.90 | -1% || 0.28 | 0.28 | +1% | 0.0020 |
| 99 || 1170.94 | 1180.58 | +1% || 0.85 | 0.85 | -1% | 0.0000 |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Sum || 40344.99 | 41147.64 | +2% || | | | |
| Geomean || | | || | | -2% | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
| || ˅ Insufficient number of runs for p-value calculation |
+---------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCDS - multi-threaded, shuffled, 64 clients, 64 cores Sum of avg. item runtimes: -0% || Geometric mean of throughput changes: +0%Configuration Overview - click to expand +Configuration Overview---------+-------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd_nolto/benchmark_all_results/hyriseBenchmarkTPCDS_b685721debab96b308d134e8a0c00607b4421490_mt.json | /hyrise/rel_amd_nolto/benchmark_all_results/hyriseBenchmarkTPCDS_efc593082b36f449a1c657b3320e08ab0d74be7c_mt.json |
+-------------------------------+-------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | b685721debab96b308d134e8a0c00607b4421490-dirty | efc593082b36f449a1c657b3320e08ab0d74be7c-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| compiler | clang 14.0.0 | clang 14.0.0 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2023-08-08 01:08:42 | 2023-08-08 05:15:58 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+-------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+---------+
| 01 || 832.47 | 831.59 | -0% || 0.82 | 0.83 | +0% | 0.9902 |
-| 03 || 332.35 | 434.56 | +31% || 0.82 | 0.83 | +0% | 0.0657 |
-| 06 || 887.28 | 961.89 | +8% || 0.82 | 0.82 | -0% | 0.4711 |
| 07 || 1108.78 | 1132.41 | +2% || 0.82 | 0.82 | -0% | 0.8102 |
-| 09 || 999.07 | 1080.46 | +8% || 0.83 | 0.83 | +0% | 0.4413 |
-| 10 || 823.35 | 904.50 | +10% || 0.83 | 0.82 | -0% | 0.3720 |
| 13 || 1803.94 | 1742.44 | -3% || 0.82 | 0.83 | +0% | 0.6042 |
| 15 || 584.82 | 569.71 | -3% || 0.83 | 0.83 | +0% | 0.8150 |
| 16 || 971.86 | 938.24 | -3% || 0.82 | 0.82 | -0% | 0.7308 |
| 17 || 1717.23 | 1650.31 | -4% || 0.82 | 0.83 | +0% | 0.6513 |
| 19 || 792.93 | 797.66 | +1% || 0.83 | 0.83 | -0% | 0.9546 |
+| 25 || 1350.81 | 1155.08 | -14% || 0.83 | 0.83 | -0% | 0.0933 |
| 26 || 680.06 | 677.27 | -0% || 0.83 | 0.83 | -0% | 0.9733 |
+| 28 || 1941.20 | 1766.97 | -9% || 0.82 | 0.82 | -0% | 0.2507 |
| 29 || 2158.82 | 2126.26 | -2% || 0.82 | 0.82 | +0% | 0.8240 |
| 31 || 3143.03 | 3068.32 | -2% || 0.82 | 0.82 | -0% | 0.6816 |
-| 32 || 287.38 | 337.41 | +17% || 0.82 | 0.83 | +0% | 0.3412 |
| 34 || 859.71 | 857.60 | -0% || 0.82 | 0.83 | +0% | 0.9810 |
-| 35 || 2463.88 | 2607.38 | +6% || 0.82 | 0.82 | -0% | 0.3498 |
-| 37 || 738.92 | 787.62 | +7% || 0.82 | 0.83 | +0% | 0.5753 |
| 39a || 3069.79 | 3012.18 | -2% || 0.82 | 0.82 | -0% | 0.6457 |
| 39b || 3025.99 | 2945.51 | -3% || 0.82 | 0.82 | -0% | 0.5451 |
-| 41 || 4788.48 | 5014.75 | +5% || 0.82 | 0.82 | -0% | 0.2591 |
| 42 || 558.82 | 581.86 | +4% || 0.83 | 0.83 | -0% | 0.7635 |
| 43 || 1701.03 | 1696.85 | -0% || 0.82 | 0.82 | +0% | 0.9676 |
-| 45 || 815.20 | 868.70 | +7% || 0.83 | 0.82 | -0% | 0.5265 |
| 48 || 2929.01 | 2959.68 | +1% || 0.82 | 0.82 | -0% | 0.8470 |
| 50 || 1039.58 | 1021.02 | -2% || 0.82 | 0.82 | +0% | 0.8424 |
| 52 || 534.41 | 540.01 | +1% || 0.82 | 0.83 | +0% | 0.9353 |
+| 55 || 524.34 | 482.04 | -8% || 0.82 | 0.83 | +0% | 0.5350 |
| 62 || 1169.11 | 1195.45 | +2% || 0.82 | 0.83 | +0% | 0.7706 |
| 65 || 4950.99 | 4929.58 | -0% || 0.82 | 0.82 | +0% | 0.8022 |
| 69 || 936.99 | 933.21 | -0% || 0.83 | 0.83 | +0% | 0.9678 |
-| 73 || 590.96 | 674.07 | +14% || 0.83 | 0.82 | -0% | 0.2703 |
-| 79 || 1733.02 | 1825.23 | +5% || 0.82 | 0.82 | -0% | 0.4165 |
-| 81 || 780.01 | 828.02 | +6% || 0.82 | 0.83 | +0% | 0.4530 |
| 82 || 987.92 | 944.94 | -4% || 0.82 | 0.82 | -0% | 0.6100 |
+| 83 || 496.66 | 402.60 | -19% || 0.83 | 0.83 | -0% | 0.2035 |
+| 85 || 1068.00 | 972.32 | -9% || 0.82 | 0.83 | +0% | 0.3111 |
| 88 || 3135.27 | 3058.99 | -2% || 0.82 | 0.82 | +0% | 0.6896 |
-| 91 || 247.59 | 317.48 | +28% || 0.83 | 0.83 | +0% | 0.1738 |
-| 92 || 353.28 | 427.96 | +21% || 0.82 | 0.83 | +0% | 0.1706 |
+| 93 || 2648.13 | 2527.75 | -5% || 0.82 | 0.82 | +0% | 0.3794 |
+| 94 || 1047.43 | 869.95 | -17% || 0.82 | 0.83 | +0% | 0.1060 |
| 95 || 5732.20 | 5763.94 | +1% || 0.82 | 0.82 | +0% | 0.8721 |
-| 96 || 488.65 | 541.37 | +11% || 0.82 | 0.82 | -0% | 0.4222 |
| 97 || 5720.99 | 5635.41 | -1% || 0.82 | 0.82 | +0% | 0.5785 |
| 99 || 1539.81 | 1585.21 | +3% || 0.82 | 0.82 | +0% | 0.6218 |
+---------++----------+----------+--------++----------+----------+--------+---------+
| Sum || 77091.57 | 76983.76 | -0% || | | | |
| Geomean || | | || | | +0% | |
+---------++----------+----------+--------++----------+----------+--------+---------+hyriseBenchmarkTPCC - single-threaded Sum of avg. item runtimes: +146% || Geometric mean of throughput changes: -62%Configuration Overview - click to expand +Configuration Overview---+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd_nolto/benchmark_all_results/hyriseBenchmarkTPCC_b685721debab96b308d134e8a0c00607b4421490_st.json | /hyrise/rel_amd_nolto/benchmark_all_results/hyriseBenchmarkTPCC_efc593082b36f449a1c657b3320e08ab0d74be7c_st.json |
+-------------------------+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | b685721debab96b308d134e8a0c00607b4421490-dirty | efc593082b36f449a1c657b3320e08ab0d74be7c-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 14.0.0 | clang 14.0.0 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2023-08-08 01:29:10 | 2023-08-08 05:36:28 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | -1 | -1 |
-| ≠scale_factor | 1 | 10 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+ +--------------++----------+---------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+--------------++----------+---------+--------++----------+----------+--------+----------------------+
-| Delivery || 25.40 | 61.08 | +140% || 3.82 | 1.47 | -62% | (run time too short) |
-| New-Order || 18.13 | 49.73 | +174% || 43.26 | 16.46 | -62% | 0.0000 |
-| Order-Status || 1.26 | 2.75 | +117% || 3.85 | 1.45 | -62% | (run time too short) |
-| Payment || 2.33 | 4.82 | +107% || 41.36 | 15.73 | -62% | 0.0000 |
-| Stock-Level || 3.99 | 7.47 | +87% || 3.87 | 1.47 | -62% | (run time too short) |
+--------------++----------+---------+--------++----------+----------+--------+----------------------+
-| Sum || 51.13 | 125.84 | +146% || | | | |
-| Geomean || | | || | | -62% | |
+--------------++----------+---------+--------++----------+----------+--------+----------------------+hyriseBenchmarkTPCC - multi-threaded, shuffled, 64 clients, 64 cores Sum of avg. item runtimes: +164% || Geometric mean of throughput changes: +0%Configuration Overview - click to expand +Configuration Overview---------+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd_nolto/benchmark_all_results/hyriseBenchmarkTPCC_b685721debab96b308d134e8a0c00607b4421490_mt.json | /hyrise/rel_amd_nolto/benchmark_all_results/hyriseBenchmarkTPCC_efc593082b36f449a1c657b3320e08ab0d74be7c_mt.json |
+-------------------------------+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | b685721debab96b308d134e8a0c00607b4421490-dirty | efc593082b36f449a1c657b3320e08ab0d74be7c-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| compiler | clang 14.0.0 | clang 14.0.0 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2023-08-08 01:30:11 | 2023-08-08 05:37:35 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
-| ≠scale_factor | 1 | 10 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+ +--------------++----------+---------+--------++----------+----------+---------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+--------------++----------+---------+--------++----------+----------+---------+---------+
+| Delivery || 225.37 | 466.35 | +107% || 4.35 | 11.84 | +172% | 0.0000 |
| unsucc.: || 4.76 | 12.17 | +156% || 177.56 | 12.88 | -93% | |
+| New-Order || 70.43 | 333.60 | +374% || 125.42 | 135.66 | +8% | 0.0000 |
| unsucc.: || 5.06 | 27.17 | +437% || 1921.07 | 142.50 | -93% | |
-| Order-Status || 7.70 | 20.71 | +169% || 181.91 | 24.73 | -86% | 0.0000 |
+| Payment || 12.54 | 19.58 | +56% || 5.41 | 101.29 | +1773% | 0.0000 |
| unsucc.: || 5.20 | 13.60 | +162% || 1950.14 | 164.55 | -92% | |
-| Stock-Level || 16.98 | 37.26 | +119% || 181.91 | 24.73 | -86% | 0.0000 |
+--------------++----------+---------+--------++----------+----------+---------+---------+
-| Sum || 333.01 | 877.50 | +164% || | | | |
| Geomean || | | || | | +0% | |
+--------------++----------+---------+--------++----------+----------+---------+---------+hyriseBenchmarkJoinOrder - single-threaded Sum of avg. item runtimes: +0% || Geometric mean of throughput changes: -0%Configuration Overview - click to expand +Configuration Overview---+-----------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd_nolto/benchmark_all_results/hyriseBenchmarkJoinOrder_b685721debab96b308d134e8a0c00607b4421490_st.json | /hyrise/rel_amd_nolto/benchmark_all_results/hyriseBenchmarkJoinOrder_efc593082b36f449a1c657b3320e08ab0d74be7c_st.json |
+-------------------------+-----------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | b685721debab96b308d134e8a0c00607b4421490-dirty | efc593082b36f449a1c657b3320e08ab0d74be7c-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 14.0.0 | clang 14.0.0 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2023-08-08 01:50:28 | 2023-08-08 05:57:49 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 100 | 100 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+-----------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
-| 10a || 225.32 | 245.25 | +9%˄ || 4.44 | 4.08 | -8%˄ | 0.0000 |
| 10b || 185.12 | 186.56 | +1%˄ || 5.40 | 5.36 | -1%˄ | 0.2690 |
+| 10c || 460.84 | 405.84 | -12%˄ || 2.17 | 2.46 | +14%˄ | 0.0000 |
| 11a || 23.91 | 24.36 | +2%˄ || 41.82 | 41.04 | -2%˄ | 0.0000 |
| 11b || 23.65 | 23.84 | +1%˄ || 42.27 | 41.94 | -1%˄ | 0.0245 |
| 11c || 29.02 | 30.02 | +3%˄ || 34.45 | 33.30 | -3%˄ | 0.0000 |
| 11d || 32.84 | 33.53 | +2%˄ || 30.44 | 29.81 | -2%˄ | 0.0000 |
| 12a || 66.15 | 66.54 | +1%˄ || 15.11 | 15.03 | -1%˄ | 0.1713 |
| 12b || 32.80 | 33.55 | +2%˄ || 30.48 | 29.80 | -2%˄ | 0.0000 |
| 12c || 118.56 | 120.12 | +1%˄ || 8.43 | 8.32 | -1%˄ | 0.0053 |
| 13a || 336.45 | 346.00 | +3%˄ || 2.97 | 2.89 | -3%˄ | 0.0000 |
| 13b || 211.79 | 212.26 | +0%˄ || 4.72 | 4.71 | -0%˄ | 0.3448 |
| 13c || 150.27 | 150.90 | +0%˄ || 6.65 | 6.63 | -0%˄ | 0.0276 |
| 13d || 727.49 | 724.50 | -0% || 1.37 | 1.38 | +0% | 0.0791 |
| 14a || 508.09 | 511.36 | +1%˄ || 1.97 | 1.96 | -1%˄ | 0.0294 |
| 14b || 290.72 | 293.69 | +1%˄ || 3.44 | 3.40 | -1%˄ | 0.0000 |
| 14c || 588.95 | 606.62 | +3%˄ || 1.70 | 1.65 | -3%˄ | (run time too short) |
| 15a || 99.00 | 95.21 | -4%˄ || 10.10 | 10.50 | +4%˄ | 0.0000 |
| 15b || 98.70 | 95.00 | -4%˄ || 10.13 | 10.53 | +4%˄ | 0.0000 |
| 15c || 104.29 | 100.89 | -3%˄ || 9.59 | 9.91 | +3%˄ | 0.0000 |
+| 15d || 103.31 | 98.61 | -5%˄ || 9.68 | 10.14 | +5%˄ | 0.0000 |
| 16a || 2719.56 | 2739.96 | +1% || 0.37 | 0.36 | -1% | 0.1079 |
| 16b || 3879.30 | 3929.95 | +1% || 0.26 | 0.25 | -1% | 0.0040 |
| 16c || 2843.39 | 2855.83 | +0% || 0.35 | 0.35 | -0% | 0.3279 |
| 16d || 2817.28 | 2836.03 | +1% || 0.35 | 0.35 | -1% | 0.0737 |
| 17a || 925.53 | 926.93 | +0% || 1.08 | 1.08 | -0% | 0.6268 |
| 17b || 766.36 | 767.48 | +0% || 1.30 | 1.30 | -0% | 0.7208 |
| 17c || 737.92 | 737.38 | -0% || 1.36 | 1.36 | +0% | 0.8490 |
| 17d || 881.72 | 880.99 | -0% || 1.13 | 1.14 | +0% | 0.8424 |
| 17e || 2228.23 | 2253.39 | +1% || 0.45 | 0.44 | -1% | 0.0004 |
| 17f || 1399.67 | 1406.00 | +0% || 0.71 | 0.71 | -0% | 0.1221 |
| 18a || 827.60 | 812.95 | -2% || 1.21 | 1.23 | +2% | 0.0000 |
| 18b || 179.19 | 180.49 | +1%˄ || 5.58 | 5.54 | -1%˄ | 0.1720 |
| 18c || 805.81 | 812.56 | +1% || 1.24 | 1.23 | -1% | 0.0093 |
-| 19a || 244.08 | 262.67 | +8%˄ || 4.10 | 3.81 | -7%˄ | 0.0000 |
| 19b || 184.79 | 192.02 | +4%˄ || 5.41 | 5.21 | -4%˄ | 0.0000 |
-| 19c || 257.89 | 277.46 | +8%˄ || 3.88 | 3.60 | -7%˄ | 0.0000 |
| 19d || 903.94 | 924.75 | +2% || 1.11 | 1.08 | -2% | 0.0000 |
| 1a || 13.56 | 14.00 | +3%˄ || 73.72 | 71.40 | -3%˄ | 0.0000 |
| 1b || 12.72 | 13.15 | +3%˄ || 78.60 | 76.03 | -3%˄ | 0.0000 |
| 1c || 15.78 | 16.01 | +1%˄ || 63.36 | 62.46 | -1%˄ | 0.0000 |
| 1d || 12.76 | 12.82 | +0%˄ || 78.32 | 77.97 | -0%˄ | 0.5885 |
| 20a || 638.43 | 626.85 | -2% || 1.57 | 1.60 | +2% | 0.0278 |
| 20b || 369.77 | 372.47 | +1%˄ || 2.70 | 2.68 | -1%˄ | 0.0706 |
| 20c || 361.46 | 365.63 | +1%˄ || 2.77 | 2.73 | -1%˄ | 0.0008 |
| 21a || 42.97 | 42.72 | -1%˄ || 23.27 | 23.41 | +1%˄ | 0.0830 |
| 21b || 25.28 | 26.31 | +4%˄ || 39.54 | 38.00 | -4%˄ | 0.0000 |
| 21c || 43.43 | 42.97 | -1%˄ || 23.02 | 23.27 | +1%˄ | 0.0011 |
| 22a || 246.41 | 239.84 | -3%˄ || 4.06 | 4.17 | +3%˄ | 0.0000 |
| 22b || 182.41 | 177.76 | -3%˄ || 5.48 | 5.63 | +3%˄ | 0.0000 |
| 22c || 582.47 | 574.02 | -1%˄ || 1.72 | 1.74 | +1%˄ | 0.0000 |
| 22d || 1011.76 | 1030.23 | +2% || 0.99 | 0.97 | -2% | 0.0000 |
| 23a || 52.15 | 51.82 | -1%˄ || 19.17 | 19.30 | +1%˄ | 0.0339 |
-| 23b || 62.50 | 65.31 | +5%˄ || 16.00 | 15.31 | -4%˄ | 0.0000 |
| 23c || 101.51 | 101.59 | +0%˄ || 9.85 | 9.84 | -0%˄ | 0.7448 |
| 24a || 217.81 | 215.92 | -1%˄ || 4.59 | 4.63 | +1%˄ | 0.0297 |
| 24b || 184.21 | 180.68 | -2%˄ || 5.43 | 5.53 | +2%˄ | 0.0002 |
| 25a || 431.45 | 425.28 | -1%˄ || 2.32 | 2.35 | +1%˄ | 0.0000 |
| 25b || 171.49 | 168.57 | -2%˄ || 5.83 | 5.93 | +2%˄ | 0.0077 |
| 25c || 1444.91 | 1428.60 | -1% || 0.69 | 0.70 | +1% | 0.0005 |
| 26a || 260.91 | 262.91 | +1%˄ || 3.83 | 3.80 | -1%˄ | 0.1697 |
| 26b || 210.74 | 212.12 | +1%˄ || 4.75 | 4.71 | -1%˄ | 0.2511 |
| 26c || 380.84 | 385.89 | +1%˄ || 2.63 | 2.59 | -1%˄ | 0.0014 |
-| 27a || 30.28 | 31.69 | +5%˄ || 33.01 | 31.54 | -4%˄ | 0.0000 |
-| 27b || 29.50 | 31.26 | +6%˄ || 33.89 | 31.99 | -6%˄ | 0.0000 |
| 27c || 43.43 | 42.48 | -2%˄ || 23.02 | 23.54 | +2%˄ | 0.0000 |
| 28a || 343.47 | 343.37 | -0%˄ || 2.91 | 2.91 | +0%˄ | 0.8882 |
| 28b || 50.59 | 51.60 | +2%˄ || 19.76 | 19.38 | -2%˄ | 0.0000 |
| 28c || 385.78 | 383.56 | -1%˄ || 2.59 | 2.61 | +1%˄ | 0.0003 |
| 29a || 114.61 | 114.36 | -0%˄ || 8.72 | 8.74 | +0%˄ | 0.2285 |
| 29b || 87.96 | 88.10 | +0%˄ || 11.37 | 11.35 | -0%˄ | 0.5317 |
| 29c || 217.00 | 214.84 | -1%˄ || 4.61 | 4.65 | +1%˄ | 0.0281 |
| 2a || 78.84 | 77.51 | -2%˄ || 12.68 | 12.90 | +2%˄ | 0.0064 |
| 2b || 61.89 | 62.46 | +1%˄ || 16.16 | 16.01 | -1%˄ | 0.0245 |
| 2c || 34.94 | 34.14 | -2%˄ || 28.62 | 29.29 | +2%˄ | 0.0048 |
| 2d || 107.33 | 107.32 | -0%˄ || 9.32 | 9.32 | +0%˄ | 0.9898 |
| 30a || 230.18 | 228.87 | -1%˄ || 4.34 | 4.37 | +1%˄ | 0.2076 |
| 30b || 199.53 | 199.07 | -0%˄ || 5.01 | 5.02 | +0%˄ | 0.6404 |
| 30c || 536.77 | 535.52 | -0%˄ || 1.86 | 1.87 | +0%˄ | 0.3676 |
| 31a || 217.53 | 216.07 | -1%˄ || 4.60 | 4.63 | +1%˄ | 0.1444 |
| 31b || 185.35 | 185.05 | -0%˄ || 5.40 | 5.40 | +0%˄ | 0.7397 |
| 31c || 249.54 | 251.46 | +1%˄ || 4.01 | 3.98 | -1%˄ | 0.0277 |
| 32a || 22.45 | 22.74 | +1%˄ || 44.53 | 43.97 | -1%˄ | 0.1165 |
| 32b || 54.42 | 53.94 | -1%˄ || 18.37 | 18.54 | +1%˄ | 0.0272 |
| 33a || 26.66 | 26.74 | +0%˄ || 37.51 | 37.39 | -0%˄ | 0.6713 |
| 33b || 26.33 | 26.19 | -1%˄ || 37.98 | 38.17 | +1%˄ | 0.0000 |
| 33c || 30.39 | 30.12 | -1%˄ || 32.90 | 33.19 | +1%˄ | 0.0000 |
-| 3a || 181.87 | 190.14 | +5%˄ || 5.50 | 5.26 | -4%˄ | 0.0020 |
| 3b || 19.11 | 19.37 | +1%˄ || 52.31 | 51.62 | -1%˄ | 0.0213 |
| 3c || 634.61 | 623.07 | -2% || 1.58 | 1.60 | +2% | 0.0000 |
| 4a || 160.99 | 156.52 | -3%˄ || 6.21 | 6.39 | +3%˄ | 0.0000 |
| 4b || 17.09 | 17.21 | +1%˄ || 58.49 | 58.10 | -1%˄ | 0.0233 |
| 4c || 180.58 | 176.21 | -2%˄ || 5.54 | 5.67 | +2%˄ | 0.0000 |
| 5a || 80.86 | 80.16 | -1%˄ || 12.37 | 12.47 | +1%˄ | 0.0685 |
+| 5b || 200.49 | 170.36 | -15%˄ || 4.99 | 5.87 | +18%˄ | 0.0000 |
| 5c || 257.67 | 250.03 | -3%˄ || 3.88 | 4.00 | +3%˄ | 0.0057 |
| 6a || 166.57 | 166.64 | +0%˄ || 6.00 | 6.00 | -0%˄ | 0.9494 |
+| 6b || 187.59 | 170.42 | -9%˄ || 5.33 | 5.87 | +10%˄ | 0.0000 |
| 6c || 159.63 | 159.88 | +0%˄ || 6.26 | 6.25 | -0%˄ | 0.8410 |
| 6d || 825.36 | 833.18 | +1% || 1.21 | 1.20 | -1% | 0.0056 |
| 6e || 167.02 | 165.95 | -1%˄ || 5.99 | 6.03 | +1%˄ | 0.3411 |
| 6f || 1073.58 | 1067.47 | -1% || 0.93 | 0.94 | +1% | 0.0905 |
| 7a || 58.00 | 58.39 | +1%˄ || 17.24 | 17.12 | -1%˄ | 0.0206 |
| 7b || 53.43 | 53.83 | +1%˄ || 18.71 | 18.58 | -1%˄ | 0.0007 |
| 7c || 760.86 | 759.77 | -0% || 1.31 | 1.32 | +0% | 0.6062 |
-| 8a || 56.44 | 60.24 | +7%˄ || 17.72 | 16.60 | -6%˄ | 0.0000 |
-| 8b || 51.17 | 54.30 | +6%˄ || 19.54 | 18.41 | -6%˄ | 0.0000 |
| 8c || 2213.76 | 2223
10000
.05 | +0% || 0.45 | 0.45 | -0% | 0.0965 |
| 8d || 367.50 | 367.63 | +0%˄ || 2.72 | 2.72 | -0%˄ | 0.8398 |
-| 9a || 255.02 | 267.65 | +5%˄ || 3.92 | 3.74 | -5%˄ | 0.0000 |
| 9b || 157.99 | 161.49 | +2%˄ || 6.33 | 6.19 | -2%˄ | 0.0000 |
| 9c || 375.22 | 390.31 | +4%˄ || 2.67 | 2.56 | -4%˄ | 0.0000 |
| 9d || 639.24 | 654.32 | +2% || 1.56 | 1.53 | -2% | 0.0000 |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Sum || 46763.70 | 46910.96 | +0% || | | | |
| Geomean || | | || | | -0% | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+----------+--------++----------+----------+--------+----------------------+hyriseBenchmarkJoinOrder - multi-threaded, shuffled, 64 clients, 64 cores Sum of avg. item runtimes: +0% || Geometric mean of throughput changes: +0%Configuration Overview - click to expand +Configuration Overview---------+-----------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd_nolto/benchmark_all_results/hyriseBenchmarkJoinOrder_b685721debab96b308d134e8a0c00607b4421490_mt.json | /hyrise/rel_amd_nolto/benchmark_all_results/hyriseBenchmarkJoinOrder_efc593082b36f449a1c657b3320e08ab0d74be7c_mt.json |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | b685721debab96b308d134e8a0c00607b4421490-dirty | efc593082b36f449a1c657b3320e08ab0d74be7c-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| compiler | clang 14.0.0 | clang 14.0.0 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2023-08-08 02:42:12 | 2023-08-08 06:48:55 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+---------+
| 10a || 258.67 | 265.56 | +3% || 0.90 | 0.90 | +0% | 0.7822 |
+| 10b || 212.14 | 199.86 | -6% || 0.90 | 0.90 | +0% | 0.5555 |
-| 10c || 540.39 | 594.17 | +10% || 0.90 | 0.90 | +0% | 0.2139 |
-| 11a || 63.49 | 66.55 | +5% || 0.90 | 0.90 | +0% | 0.8031 |
| 11b || 74.08 | 72.21 | -3% || 0.90 | 0.90 | +0% | 0.8730 |
-| 11c || 108.11 | 126.35 | +17% || 0.90 | 0.90 | +0% | 0.3099 |
-| 11d || 105.28 | 122.43 | +16% || 0.90 | 0.90 | +0% | 0.3286 |
+| 12a || 279.65 | 260.08 | -7% || 0.90 | 0.90 | +0% | 0.5804 |
-| 12b || 86.34 | 104.38 | +21% || 0.90 | 0.90 | +0% | 0.3586 |
+| 12c || 549.10 | 493.88 | -10% || 0.90 | 0.90 | +0% | 0.1698 |
+| 13a || 801.64 | 703.87 | -12% || 0.89 | 0.90 | +0% | 0.0280 |
| 13b || 329.30 | 315.97 | -4% || 0.90 | 0.90 | +0% | 0.6835 |
+| 13c || 325.24 | 302.66 | -7% || 0.90 | 0.90 | +0% | 0.5575 |
-| 13d || 1160.11 | 1228.70 | +6% || 0.89 | 0.90 | +0% | 0.1642 |
| 14a || 1068.18 | 1059.02 | -1% || 0.90 | 0.90 | +0% | 0.8772 |
-| 14b || 641.10 | 715.96 | +12% || 0.90 | 0.90 | +0% | 0.1282 |
| 14c || 1235.28 | 1188.79 | -4% || 0.89 | 0.90 | +0% | 0.4473 |
+| 15a || 202.09 | 155.74 | -23% || 0.90 | 0.90 | +0% | 0.0345 |
+| 15b || 173.29 | 157.34 | -9% || 0.90 | 0.90 | +0% | 0.4657 |
+| 15c || 247.03 | 187.43 | -24% || 0.90 | 0.90 | +0% | 0.0348 |
-| 15d || 228.01 | 249.01 | +9% || 0.90 | 0.90 | -0% | 0.4656 |
| 16a || 2904.93 | 2953.89 | +2% || 0.89 | 0.90 | +0% | 0.5158 |
| 16b || 4390.68 | 4410.79 | +0% || 0.89 | 0.89 | +0% | 0.7921 |
| 16c || 3246.30 | 3121.62 | -4% || 0.89 | 0.90 | +0% | 0.1269 |
| 16d || 3090.91 | 2999.80 | -3% || 0.89 | 0.89 | +0% | 0.2155 |
+| 17a || 1210.40 | 1149.44 | -5% || 0.90 | 0.90 | +0% | 0.3479 |
| 17b || 898.72 | 909.01 | +1% || 0.90 | 0.90 | +0% | 0.8515 |
| 17c || 844.57 | 828.89 | -2% || 0.89 | 0.90 | +0% | 0.7842 |
| 17d || 935.45 | 902.25 | -4% || 0.90 | 0.90 | +0% | 0.5849 |
| 17e || 1966.35 | 1985.29 | +1% || 0.90 | 0.90 | +0% | 0.7895 |
| 17f || 1599.02 | 1563.86 | -2% || 0.90 | 0.90 | +0% | 0.6172 |
-| 18a || 1055.98 | 1115.18 | +6% || 0.90 | 0.90 | +0% | 0.3301 |
| 18b || 264.94 | 273.53 | +3% || 0.90 | 0.90 | +0% | 0.7653 |
+| 18c || 1131.71 | 1067.35 | -6% || 0.90 | 0.90 | +0% | 0.3027 |
-| 19a || 669.20 | 784.16 | +17% || 0.90 | 0.90 | +0% | 0.0421 |
+| 19b || 507.78 | 471.86 | -7% || 0.90 | 0.90 | -0% | 0.3346 |
| 19c || 840.08 | 854.59 | +2% || 0.90 | 0.90 | +0% | 0.8054 |
-| 19d || 1703.15 | 1881.26 | +10% || 0.90 | 0.89 | -0% | 0.0165 |
-| 1a || 48.53 | 68.41 | +41% || 0.90 | 0.90 | +0% | 0.2312 |
-| 1b || 55.88 | 59.18 | +6% || 0.90 | 0.90 | +0% | 0.8015 |
-| 1c || 47.86 | 54.82 | +15% || 0.90 | 0.90 | +0% | 0.4800 |
-| 1d || 43.68 | 55.55 | +27% || 0.90 | 0.90 | +0% | 0.4238 |
| 20a || 840.97 | 873.51 | +4% || 0.90 | 0.90 | +0% | 0.5128 |
-| 20b || 595.52 | 643.80 | +8% || 0.89 | 0.90 | +0% | 0.3232 |
| 20c || 604.59 | 606.72 | +0% || 0.90 | 0.90 | +0% | 0.9582 |
-| 21a || 96.33 | 126.77 | +32% || 0.90 | 0.90 | +0% | 0.0518 |
-| 21b || 102.47 | 134.66 | +31% || 0.90 | 0.90 | +0% | 0.1291 |
| 21c || 117.43 | 116.82 | -1% || 0.90 | 0.90 | +0% | 0.9731 |
| 22a || 742.62 | 715.48 | -4% || 0.90 | 0.90 | +0% | 0.5735 |
+| 22b || 531.94 | 438.87 | -17% || 0.90 | 0.90 | +0% | 0.0233 |
+| 22c || 1121.02 | 1028.53 | -8% || 0.90 | 0.90 | -0% | 0.1133 |
| 22d || 1457.02 | 1436.77 | -1% || 0.90 | 0.90 | +0% | 0.7853 |
-| 23a || 215.06 | 245.43 | +14% || 0.90 | 0.90 | +0% | 0.2407 |
+| 23b || 211.86 | 179.13 | -15% || 0.90 | 0.90 | +0% | 0.2008 |
-| 23c || 248.49 | 278.58 | +12% || 0.90 | 0.90 | +0% | 0.3217 |
| 24a || 374.00 | 382.70 | +2% || 0.90 | 0.90 | +0% | 0.8199 |
+| 24b || 249.03 | 206.92 | -17% || 0.90 | 0.90 | +0% | 0.2052 |
| 25a || 767.51 | 745.90 | -3% || 0.90 | 0.90 | +0% | 0.6877 |
-| 25b || 186.32 | 235.32 | +26% || 0.90 | 0.90 | +0% | 0.0937 |
+| 25c || 1544.69 | 1465.37 | -5% || 0.89 | 0.90 | +0% | 0.3053 |
| 26a || 519.42 | 502.95 | -3% || 0.90 | 0.90 | +0% | 0.6779 |
+| 26b || 296.84 | 283.10 | -5% || 0.90 | 0.90 | +0% | 0.6595 |
| 26c || 643.34 | 642.23 | -0% || 0.90 | 0.90 | +0% | 0.9806 |
+| 27a || 195.76 | 178.49 | -9% || 0.90 | 0.90 | +0% | 0.5512 |
| 27b || 164.28 | 161.37 | -2% || 0.90 | 0.90 | +0% | 0.9091 |
+| 27c || 118.63 | 113.24 | -5% || 0.90 | 0.90 | +0% | 0.7612 |
+| 28a || 992.37 | 936.69 | -6% || 0.90 | 0.90 | +0% | 0.3145 |
-| 28b || 246.69 | 338.00 | +37% || 0.90 | 0.90 | +0% | 0.0127 |
| 28c || 1022.95 | 1052.15 | +3% || 0.90 | 0.90 | +0% | 0.6653 |
+| 29a || 305.64 | 286.60 | -6% || 0.90 | 0.90 | +0% | 0.5737 |
+| 29b || 205.16 | 192.57 | -6% || 0.90 | 0.90 | +0% | 0.5873 |
-| 29c || 305.34 | 344.03 | +13% || 0.90 | 0.90 | +0% | 0.3037 |
+| 2a || 282.48 | 250.16 | -11% || 0.90 | 0.90 | +0% | 0.3279 |
+| 2b || 241.09 | 210.90 | -13% || 0.90 | 0.90 | +0% | 0.3034 |
+| 2c || 125.44 | 110.09 | -12% || 0.90 | 0.90 | +0% | 0.3595 |
-| 2d || 275.23 | 329.39 | +20% || 0.90 | 0.90 | +0% | 0.0605 |
+| 30a || 547.02 | 493.44 | -10% || 0.90 | 0.90 | +0% | 0.2258 |
| 30b || 342.54 | 336.79 | -2% || 0.90 | 0.90 | +0% | 0.8683 |
| 30c || 1030.00 | 1014.29 | -2% || 0.90 | 0.89 | -0% | 0.7965 |
-| 31a || 414.05 | 458.62 | +11% || 0.90 | 0.90 | +0% | 0.2823 |
-| 31b || 214.24 | 239.46 | +12% || 0.90 | 0.90 | +0% | 0.3556 |
| 31c || 462.65 | 456.03 | -1% || 0.90 | 0.90 | +0% | 0.8666 |
+| 32a || 83.44 | 70.49 | -16% || 0.90 | 0.90 | +0% | 0.5113 |
+| 32b || 233.80 | 199.19 | -15% || 0.90 | 0.90 | +0% | 0.2962 |
-| 33a || 79.42 | 97.69 | +23% || 0.90 | 0.90 | +0% | 0.1714 |
| 33b || 72.77 | 75.71 | +4% || 0.90 | 0.90 | +0% | 0.8069 |
+| 33c || 110.35 | 104.89 | -5% || 0.90 | 0.90 | +0% | 0.7609 |
| 3a || 483.39 | 476.04 | -2% || 0.90 | 0.90 | +0% | 0.8429 |
-| 3b || 91.30 | 102.41 | +12% || 0.90 | 0.90 | +0% | 0.5390 |
-| 3c || 694.81 | 801.79 | +15% || 0.90 | 0.90 | +0% | 0.0391 |
+| 4a || 289.90 | 265.13 | -9% || 0.90 | 0.90 | +0% | 0.4251 |
+| 4b || 98.88 | 92.09 | -7% || 0.90 | 0.90 | +0% | 0.7718 |
+| 4c || 335.80 | 268.26 | -20% || 0.90 | 0.90 | -0% | 0.0214 |
-| 5a || 256.08 | 286.86 | +12% || 0.90 | 0.90 | +0% | 0.3944 |
+| 5b || 311.09 | 273.49 | -12% || 0.90 | 0.90 | +0% | 0.3378 |
-| 5c || 339.87 | 390.07 | +15% || 0.90 | 0.90 | +0% | 0.1804 |
+| 6a || 169.20 | 142.26 | -16% || 0.90 | 0.90 | +0% | 0.1471 |
+| 6b || 225.62 | 213.53 | -5% || 0.90 | 0.90 | +0% | 0.5665 |
-| 6c || 137.25 | 164.29 | +20% || 0.90 | 0.90 | +0% | 0.2232 |
-| 6d || 835.71 | 881.09 | +5% || 0.90 | 0.90 | +0% | 0.4045 |
-| 6e || 154.08 | 193.56 | +26% || 0.90 | 0.90 | +0% | 0.1221 |
| 6f || 1277.46 | 1333.55 | +4% || 0.90 | 0.90 | +0% | 0.2395 |
| 7a || 193.41 | 188.25 | -3% || 0.90 | 0.90 | +0% | 0.8616 |
-| 7b || 157.80 | 166.80 | +6% || 0.90 | 0.90 | +0% | 0.7213 |
-| 7c || 1257.81 | 1334.43 | +6% || 0.89 | 0.90 | +0% | 0.2607 |
| 8a || 239.77 | 245.33 | +2% || 0.90 | 0.90 | +0% | 0.8784 |
+| 8b || 236.22 | 172.90 | -27% || 0.90 | 0.90 | +0% | 0.0423 |
-| 8c || 2484.11 | 2616.02 | +5% || 0.89 | 0.90 | +0% | 0.0400 |
| 8d || 786.44 | 796.24 | +1% || 0.90 | 0.90 | +0% | 0.8333 |
-| 9a || 806.04 | 855.26 | +6% || 0.90 | 0.90 | +0% | 0.3618 |
| 9b || 446.05 | 465.40 | +4% || 0.90 | 0.90 | +0% | 0.6082 |
+| 9c || 1092.83 | 1037.04 | -5% || 0.90 | 0.90 | +0% | 0.3822 |
| 9d || 1462.64 | 1419.33 | -3% || 0.90 | 0.89 | -0% | 0.5202 |
+---------++----------+----------+--------++----------+----------+--------+---------+
| Sum || 70546.00 | 70601.95 | +0% || | | | |
| Geomean || | | || | | +0% | |
+---------++----------+----------+--------++----------+----------+--------+---------+hyriseBenchmarkStarSchema - single-threaded Sum of avg. item runtimes: +3% || Geometric mean of throughput changes: -2%Configuration Overview - click to expand +Configuration Overview---+------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd_nolto/benchmark_all_results/hyriseBenchmarkStarSchema_b685721debab96b308d134e8a0c00607b4421490_st.json | /hyrise/rel_amd_nolto/benchmark_all_results/hyriseBenchmarkStarSchema_efc593082b36f449a1c657b3320e08ab0d74be7c_st.json |
+-------------------------+------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | b685721debab96b308d134e8a0c00607b4421490-dirty | efc593082b36f449a1c657b3320e08ab0d74be7c-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 14.0.0 | clang 14.0.0 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2023-08-08 03:02:39 | 2023-08-08 07:09:21 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 100 | 100 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+---------+
-| 1.1 || 403.92 | 422.62 | +5%˄ || 2.48 | 2.37 | -4%˄ | 0.0000 |
| 1.2 || 113.82 | 117.78 | +3%˄ || 8.79 | 8.49 | -3%˄ | 0.0000 |
| 1.3 || 109.63 | 111.02 | +1%˄ || 9.12 | 9.01 | -1%˄ | 0.0629 |
| 2.1 || 844.88 | 851.15 | +1% || 1.18 | 1.17 | -1% | 0.0652 |
| 2.2 || 437.60 | 444.21 | +2%˄ || 2.29 | 2.25 | -1%˄ | 0.0002 |
| 2.3 || 256.34 | 258.44 | +1%˄ || 3.90 | 3.87 | -1%˄ | 0.0235 |
| 3.1 || 3317.75 | 3419.67 | +3% || 0.30 | 0.29 | -3% | 0.0657 |
| 3.2 || 427.06 | 431.66 | +1%˄ || 2.34 | 2.32 | -1%˄ | 0.0160 |
| 3.3 || 168.04 | 169.49 | +1%˄ || 5.95 | 5.90 | -1%˄ | 0.0388 |
| 3.4 || 156.03 | 158.49 | +2%˄ || 6.41 | 6.31 | -2%˄ | 0.0019 |
| 4.1 || 5010.38 | 5152.70 | +3% || 0.20 | 0.19 | -3% | 0.0545 |
| 4.2 || 1064.14 | 1104.84 | +4% || 0.94 | 0.91 | -4% | 0.0001 |
| 4.3 || 362.43 | 367.64 | +1%˄ || 2.76 | 2.72 | -1%˄ | 0.0000 |
+---------++----------+----------+--------++----------+----------+--------+---------+
| Sum || 12672.02 | 13009.69 | +3% || | | | |
| Geomean || | | || | | -2% | |
+---------++----------+----------+--------++----------+----------+--------+---------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+----------+--------++----------+----------+--------+---------+hyriseBenchmarkStarSchema - multi-threaded, shuffled, 64 clients, 64 cores Sum of avg. item runtimes: +0% || Geometric mean of throughput changes: -0%Configuration Overview - click to expand +Configuration Overview---------+------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd_nolto/benchmark_all_results/hyriseBenchmarkStarSchema_b685721debab96b308d134e8a0c00607b4421490_mt.json | /hyrise/rel_amd_nolto/benchmark_all_results/hyriseBenchmarkStarSchema_efc593082b36f449a1c657b3320e08ab0d74be7c_mt.json |
+-------------------------------+------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | b685721debab96b308d134e8a0c00607b4421490-dirty | efc593082b36f449a1c657b3320e08ab0d74be7c-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| compiler | clang 14.0.0 | clang 14.0.0 |
| cores | 64
10000
| 64 |
| data_preparation_cores | 0 | 0 |
| date | 2023-08-08 03:11:29 | 2023-08-08 07:18:16 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------+ +---------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+---------+
| 1.1 || 912.40 | 926.06 | +1% || 3.21 | 3.20 | -0% | 0.6727 |
| 1.2 || 563.78 | 562.28 | -0% || 3.22 | 3.20 | -0% | 0.9550 |
+| 1.3 || 361.42 | 342.95 | -5% || 3.22 | 3.20 | -0% | 0.3566 |
| 2.1 || 2454.94 | 2458.72 | +0% || 3.21 | 3.20 | -0% | 0.9442 |
| 2.2 || 1391.98 | 1367.43 | -2% || 3.21 | 3.20 | -0% | 0.5351 |
| 2.3 || 466.74 | 457.48 | -2% || 3.22 | 3.20 | -0% | 0.6503 |
| 3.1 || 3325.30 | 3381.49 | +2% || 3.21 | 3.20 | -0% | 0.2836 |
-| 3.2 || 1213.16 | 1293.03 | +7% || 3.22 | 3.20 | -0% | 0.0339 |
| 3.3 || 648.69 | 636.41 | -2% || 3.22 | 3.20 | -0% | 0.6492 |
| 3.4 || 634.80 | 631.80 | -0% || 3.22 | 3.20 | -0% | 0.9181 |
| 4.1 || 3855.10 | 3888.15 | +1% || 3.21 | 3.20 | -0% | 0.5426 |
| 4.2 || 2886.10 | 2879.89 | -0% || 3.21 | 3.19 | -1% | 0.9136 |
| 4.3 || 1070.13 | 1029.37 | -4% || 3.22 | 3.20 | -0% | 0.2320 |
+---------++----------+----------+--------++----------+----------+--------+---------+
| Sum || 19784.54 | 19855.04 | +0% || | | | |
| Geomean || | | || | | -0% | |
+---------++----------+----------+--------++----------+----------+--------+---------+ |
dey4ss
reviewed
Aug 9, 2023
nikriek
pushed a commit
that referenced
this pull request
Oct 28, 2023
This PR adjusts the `IndexScan` to use the new `TableIndexes` introduced in PR #2448 . Co-authored-by: martin.boissier <martin.boissier@hpi.de> Co-authored-by: Bouncner <martin+github@boissier.de>
nikriek
pushed a commit
that referenced
this pull request
Nov 6, 2023
This PR adjusts the `IndexScan` to use the new `TableIndexes` introduced in PR #2448 . Co-authored-by: martin.boissier <martin.boissier@hpi.de> Co-authored-by: Bouncner <martin+github@boissier.de>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Adapt IndexScan to use TableIndexes
This PR adjusts the
IndexScanto use the newTableIndexesintroduced in PR #2448 .This is needed because the
ChunkIndexescurrently used by the IndexScan are planned to be removed.Also, the TableIndex is not used by any operators currently, and this PR will change this.
Unfortunately, these changes are bringing a drawback:
Because hash-based indexes are only supporting range lookups, it is only possible to scan columns for
equalornon-equalvalues. Scans forgreater,greater-than,less, andless-thanvalues are not supported anymore.The only benchmark impacted by this PR is TPC-C, which defaults to use indexes for the defined primary key columns (no multi-column indexes, simply an index on every column of each PK). For now, the performance does not chance as we don't update indexes for growing tables.
Note: The IndexScan is never used in the TPC-H using the predefined indexes and only one time when everything is indexed.
Since we are using table indexes, Chunks that have been pruned may still be indexed and can be returned by the IndexScan. Furthermore, the indexed Chunk- (and Column)-IDs are still the original IDs pre-pruning. To counter this, we used methods of the
PruningUtilsand added a new method to generate a mapping to the original ChunkIDs (which can also be used to filter out prunedChunkIDs). Because of that, theColumnPruningUtilshave been renamed toPruningUtils.ToDos
Add test case for double-scanned chunks(already catched by other test case)TableIndexStatisticsto be used In an adaptedIndexScanRuleFix dynamic pruning (currently too many chunks are scanned)Stats How Often the IndexScan is Used
Benchmarks were run with default parameters.