Tags: Smithol/PerfKitBenchmarker
Tags
v1.10.0 External contributions: - Re-write flag_util_test.py so it's easier to read (thanks @yilei GoogleCloudPlatformGH-1244) - Fix bug that prevents running bonnie++ on Azure (thanks @rgodha GoogleCloudPlatformGH-1218) - Add kernel compile benchmark (thanks @maggiejiao GoogleCloudPlatformGH-1215, GoogleCloudPlatformGH-1255) - Change the documentation to reflect that work should be on master (thanks @besanradwan GoogleCloudPlatformGH-1209) - Add flags to capture latency, bandwidth and IOPS logs in Fio benchmark (thanks @meteorfox GoogleCloudPlatformGH-1205) - Re-add 'vm_util' object to fix broken master branch (thanks @vhe182 GoogleCloudPlatformGH-1196) - Add EPEL Repo to Silo Installation (thanks @akrzos GoogleCloudPlatformGH-1153) New features: - Add GPU PCIe bandwidth test (GoogleCloudPlatformGH-1234, GoogleCloudPlatformGH-1250, GoogleCloudPlatformGH-1252, GoogleCloudPlatformGH-1254) - Add blazemark (GoogleCloudPlatformGH-1145) - Add simple memcached ycsb benchmark based on aerospike ycsb benchmark (GoogleCloudPlatformGH-1199) - Add scimark2 installation package (GoogleCloudPlatformGH-1185) Enhancements: - Use FLAGS.aws_user_name if set for Rhel (GoogleCloudPlatformGH-1249) - Fio enhancements (GoogleCloudPlatformGH-1246) - Use aes128-ctr if aes128-cbc isn't available (GoogleCloudPlatformGH-1242) - Make aeropsike able to run with raw devices on static vms (GoogleCloudPlatformGH-1243) - Add some metadata to netperf samples (GoogleCloudPlatformGH-1236) - Remove unneeded Azure code and add availability sets (GoogleCloudPlatformGH-1232) - Add cassandra read concurrency flag (GoogleCloudPlatformGH-1233) - Add a metadata attribute 'ssd_count' to spark_service (GoogleCloudPlatformGH-1229) - Add a metadata attribute 'spark_svc_cloud' to spark_service (GoogleCloudPlatformGH-1226) - Add ability to specify boot_disk_size in AWS vm spec (GoogleCloudPlatformGH-1231) - Add a metadata attribute 'spark_svc_cloud' (GoogleCloudPlatformGH-1236) - Set a default zone for the spark test to allow for subnet creation (GoogleCloudPlatformGH-1222) - Update the location of the spark examples jar on the emr cluster (GoogleCloudPlatformGH-1222) - Persist package installation across reboots (GoogleCloudPlatformGH-1185) - Allow mongodb_ycsb to specify readahead settings (GoogleCloudPlatformGH-1256) Bug fixes and maintenance updates: - Close Aersospike connection in 1 second (GoogleCloudPlatformGH-1241) - Fix bug with having multiple Azure data disks (GoogleCloudPlatformGH-1223) - Fix aws spark service (GoogleCloudPlatformGH-1222) - Add some git ignore entries (GoogleCloudPlatformGH-1222) - Fix gcs credential conflict (GoogleCloudPlatformGH-1221) - Fix bug with run_processes (GoogleCloudPlatformGH-1212) - Remove collector from RunBenchmarkTask args (GoogleCloudPlatformGH-1210) - Add the minimum tox version to the "tox is not installed" message (GoogleCloudPlatformGH-1201) - Move sysbench05plus path prefix logic into package (GoogleCloudPlatformGH-1185) - Fix bug with specifying Azure image (GoogleCloudPlatformGH-1204) - Fix two files that were failing boilerplate check (GoogleCloudPlatformGH-1203) - Update README.md (GoogleCloudPlatformGH-1200)
Release 1.9.0 Changes in this release. New features: - Add config file imports and allow for circular imports and add documentation (GoogleCloudPlatformGH-1163) - Add a way to run benchmarks in parallel (GoogleCloudPlatformGH-1192) Enhancements: - ContainerizedDebianMixin: Ping to a fixed docker image and remove the sudo hack (GoogleCloudPlatformGH-1171) - Auto detect openjdk, libsnappy package versions (GoogleCloudPlatformGH-1181) - Add flags to govern subnet creation and Optionally create only 1 subnet (GoogleCloudPlatformGH-1182) - Install docker images as packages (GoogleCloudPlatformGH-1184) - Call FLAGS.get_help if it's available (GoogleCloudPlatformGH-1187) - Publish boot time samples for all tests (GoogleCloudPlatformGH-1156) Bugfixes and maintenance updates: - Update requirements.txt to set version of contextlib2 (GoogleCloudPlatformGH-1164) - Fix bug with config flags (GoogleCloudPlatformGH-1165) - Updated the cloudsuite web-serving benchmark (thanks @nooshin-mirzadeh, GoogleCloudPlatformGH-1166) - Fix load command parsing (GoogleCloudPlatformGH-1168) - openstack: Open all TCP and UDP ports for the internal network (GoogleCloudPlatformGH-1169) - Fix aerospike metadata (GoogleCloudPlatformGH-1170) - Adjust aerospike default replication factor (GoogleCloudPlatformGH-1172) - Try replacing FlagValues._flags instead of FlagValues.FlagDict first (GoogleCloudPlatformGH-1175) - Fix ycsb aggregator (GoogleCloudPlatformGH-1176) - Fix bug during cleanup phase of object_storage_service benchmark (GoogleCloudPlatformGH-1178) - Netperf thinktime fixes and support think time in nanoseconds instead of microseconds (GoogleCloudPlatformGH-1179, GoogleCloudPlatformGH-1186, GoogleCloudPlatformGH-1188) - Fix sysbench05plus installation on ubuntu16.04 (GoogleCloudPlatformGH-1183) - Fix race condition in Aerospike benchmark (GoogleCloudPlatformGH-1190) - Clean up some pickling, unpickling issues (GoogleCloudPlatformGH-1191) - Calculate free ram with more robust /proc/meminfo instead of `free`(GoogleCloudPlatformGH-1194) - Fix multithread netperf (GoogleCloudPlatformGH-1149) - Multiple fixes and refactoring of the linux package management on vms (GoogleCloudPlatformGH-1152) - Fix dstat metadata in Analyze (GoogleCloudPlatformGH-1154) - Obey flag overrides for static vm specs (GoogleCloudPlatformGH-1155) - Fix links in README file for OpenStack and Cloudstack setup steps (thanks @shakhat, GoogleCloudPlatformGH-1157) - Fix issue with GetConfig using flags (GoogleCloudPlatformGH-1160) - Remove scratch disk from netperf and object_storage_service benchmark (GoogleCloudPlatformGH-1147, GoogleCloudPlatformGH-1148) - Netperf changes to add num_streams metadata to samples (GoogleCloudPlatformGH-1177) - Remove collector from RunBenchmarkTask args (GoogleCloudPlatformGH-1210)
Bugfixes and maintanence updates: - Fixed default machine type for Azure (GoogleCloudPlatformGH-1161)
Release v1.8.0 New features: - Multithreaded netperf benchmark (GoogleCloudPlatformGH-1141, GoogleCloudPlatformGH-1144) - Terasort benchmark using spark service infrastructure (GoogleCloudPlatformGH-1104) - Support 10 or more disks on Azure (GoogleCloudPlatformGH-1102) - Add sysctl and set_files flags (GoogleCloudPlatformGH-1096) - Support DigitalOcean block storage (GoogleCloudPlatformGH-1092) - Add cloudsuite_data_serving_rec_count and cloudsuite_data_serving_op_count parameters to cloudsuite_data_serving benchmark (GoogleCloudPlatformGH-1091) - Add support for setting GCE boot disk size and type (GoogleCloudPlatformGH-1106) - Add flag to skip reload on ycsb benchmark (GoogleCloudPlatformGH-1108) - Support for AWS dedicated hosts (GoogleCloudPlatformGH-1109) - Object storage multistream write-only scenario (GoogleCloudPlatformGH-1123) - Allow multiple configs for the same benchmark in the same file (GoogleCloudPlatformGH-1126) - Add flat that allows run retries (GoogleCloudPlatformGH-1129) - Add fio_parameters flag (GoogleCloudPlatformGH-1131) - Add config matrices (GoogleCloudPlatformGH-1134) - Add events at the beginning and end of benchmarks (GoogleCloudPlatformGH-1135) - Add extra_zones flag to pkb (GoogleCloudPlatformGH-1137) - Add flag matrix filters (GoogleCloudPlatformGH-1138) - Support allowing port ranges on Firewall.AllowPort (GoogleCloudPlatformGH-1139) - Add static vm tags (GoogleCloudPlatformGH-1142) Breaking changes: - Because of GoogleCloudPlatformGH-1112, region names have changed. Enhancements: - Allow speccpu to run individual test (GoogleCloudPlatformGH-1113) - Use Azure resource management mode (GoogleCloudPlatformGH-1112) - GCP networks use subnets (GoogleCloudPlatformGH-1087) - Add top level flags key to configs (GoogleCloudPlatformGH-1125) - Precise resource usage for YCSB benchmarks (GoogleCloudPlatformGH-1127) Bugfixes and maintanence updates: - Fix bugs with Terasort (GoogleCloudPlatformGH-1136) - Don't run container commands as sudo with ContainerizedDebianMixin (GoogleCloudPlatformGH-1130) - Automatically use amazon linux if os_type is rhel (GoogleCloudPlatformGH-1124) - Removed Panda as a dependency (GoogleCloudPlatformGH-1118, GoogleCloudPlatformGH-1119) - Allow flag_util.ParseKeyValuePairs values to have colons in them (GoogleCloudPlatformGH-1117) - Add ycsb to data directory (GoogleCloudPlatformGH-1116) - Fix bug in mongodb_ycsb_benchmark cleanup (GoogleCloudPlatformGH-1115) - Fix bug where static VM disk specs were overriden (GoogleCloudPlatformGH-1105) - Use string formatting instead of addition to concatenate (GoogleCloudPlatformGH-1103) - Fixed regression with fio flag (GoogleCloudPlatformGH-1097) - Fix flags in static vm files (GoogleCloudPlatformGH-1093) - Fix wait_for_command.py: wait for status file to avoid race condition (GoogleCloudPlatformGH-1090)
New features: * Add ProfitBricks provider (thanks @tjb1019, GoogleCloudPlatformGH-1005) * Add YCSB JDBC benchmark (thanks @k1xme, GoogleCloudPlatformGH-1049) * Add support for st1 and sc1 disks on EBS (GoogleCloudPlatformGH-1067) Breaking changes: * Change default gce_migrate_on_maintenance to True (GoogleCloudPlatformGH-1069) Enhancements: * Update OpenStack provider to use OpenStacks CLI instead of python library (thanks @meteorfox, GoogleCloudPlatformGH-942) * Improve side-by-side tool (GoogleCloudPlatformGH-1034) * Specify flags to metadata (GoogleCloudPlatformGH-1047) * Allow Java version for Java benchmarks to be selected via command line (GoogleCloudPlatformGH-1051) * Add numjobs runtime option to fio_benchmark (GoogleCloudPlatformGH-1066) * Add netperf histogram support (GoogleCloudPlatformGH-1072) * Add multi-vm support for object_storage_service_benchmark (GoogleCloudPlatformGH-1074) * Add support for custom s3 endpoints for object_storage_service_benchmark (GoogleCloudPlatformGH-1078) * Add user-defined metadata for vms (GoogleCloudPlatformGH-1080) Bugfixes and maintenance updates: * Refactor object_storage_service_benchmark (GoogleCloudPlatformGH-1023) * Support overriding ycsb_client_vms in benchmark spec (thanks @k1xme, GoogleCloudPlatformGH-1042) * Update YCSB to 0.9.0 and support latest logging format (thanks @k1xme, GoogleCloudPlatformGH-1043) * Fix zones flag (GoogleCloudPlatformGH-1044) * Update Bigtable to v2 API (thanks @tswast, GoogleCloudPlatformGH-1045) * Update maven version to 3.3.9 (GoogleCloudPlatformGH-1046) * Start background workload in prepare stage and stop in cleanup stage (GoogleCloudPlatformGH-1048) * Minor fixes in flag description (GoogleCloudPlatformGH-1052) * Only upload files needed for API testing script for object_storage_service_benchmark (GoogleCloudPlatformGH-1053) * Fix redis_ycsb benchmark to use multiple processes (GoogleCloudPlatformGH-1062, GoogleCloudPlatformGH-1068, GoogleCloudPlatformGH-1070) * Fix bug with custom machine types configs (GoogleCloudPlatformGH-1077) * Fix in documentation of ParseTimeCommandResult (thanks @skorgu, GoogleCloudPlatformGH-1079) * Replace Pandas dependency with Numpy (GoogleCloudPlatformGH-1081) * Turn off OpenBlas threading, improving HPCC on large vms (GoogleCloudPlatformGH-1084) * Cleanup object_storage_serivce benchmark (GoogleCloudPlatformGH-1085) * Cleanup aerospike_ycsb benchmarks (GoogleCloudPlatformGH-1086)
New features: * Apache Spark benchmark (GoogleCloudPlatformGH-1014,GoogleCloudPlatformGH-1011) * Cloudsuite dataserving benchmark (thanks @ustiugov, GoogleCloudPlatformGH-930) Enhancements: * Optionally publish VM hostnames in metadata (GoogleCloudPlatformGH-1020) * Control which netperf benchmarks are run via flag (GoogleCloudPlatformGH-1029) * Netperf benchmark reports min and max latency (GoogleCloudPlatformGH-1013) * Add multichase to the google benchmark set (GoogleCloudPlatformGH-1018) * Update Cloudsuite web serving benchmark (thanks @ivonindza, @GH-998) * Object storage updates (GoogleCloudPlatformGH-987) * Repeat Run stage (GoogleCloudPlatformGH-1032) Bugfixes and maintenance updates: * Fix path to cassandra-cli (thanks @AdamIsrael, GoogleCloudPlatformGH-1006) * Update ycsb version; affects cloud_bigtable_ycsb_benchmark, hbase_ycsb (GoogleCloudPlatformGH-1021, GoogleCloudPlatformGH-1025, GoogleCloudPlatformGH-1031) * Use latest gsutil version (GoogleCloudPlatformGH-1012) * Remove duplicate requirements files (GoogleCloudPlatformGH-975) * Update openblas version (GoogleCloudPlatformGH-1003) * Background workload refactor (GoogleCloudPlatformGH-1033)
Release 1.4.0 New features: * openstack: Add support for optional floating ip pool (thanks @meteorfox, GoogleCloudPlatformGH-861) * openstack: Use Keystone session for handling authentication (thanks @meteorfox, GoogleCloudPlatformGH-870) * Support object storage classes in object storage service benchmarks (GoogleCloudPlatformGH-895) * Add Object Size Distributions in object storage service benchmarks (GoogleCloudPlatformGH-888) * Add MultiStreamThroughput benchmark to object storage benchmarks (GoogleCloudPlatformGH-840) * Adds a SPEC SFS 2014 benchmark which runs against GlusterFS (GoogleCloudPlatformGH-876) * gce_virtual_machine: Support user provided instance metadata (GoogleCloudPlatformGH-859) Improvements and fixes: * openstack: Wait until VM deletion has been completed (thanks @meteorfox, GoogleCloudPlatformGH-904) * openstack: Fix floating IP allocation and deallocation (thanks @meteorfox, GoogleCloudPlatformGH-862) * rackspace: Fix missing flags bug (thanks @meteorfox, GoogleCloudPlatformGH-903) * Allow user to specify a flag when they run object storage benchmark on GCP, and default that flag to the latest known working version. (GoogleCloudPlatformGH-925) * Update mechanism used to get iperf server process id. (GoogleCloudPlatformGH-921) * Rename variables and improve documentation of BaseOsMixin.PullFile. (GoogleCloudPlatformGH-923) * Fix WindowsMixin._GetNumCpus when more than one Win32_processor exists. (GoogleCloudPlatformGH-920) * Add exception types to except clauses. (GoogleCloudPlatformGH-893) * Add Flag for List Consistency Iterations (GoogleCloudPlatformGH-889) * Add unit tests for scripts (GoogleCloudPlatformGH-882) * Add disk type examples to README.md (GoogleCloudPlatformGH-871) * Copy-edit the README (GoogleCloudPlatformGH-877) * Turn off selinux for mongodb. (thanks @akrzos, GoogleCloudPlatformGH-867) * Use temp files for Popen stdout and stderr in IssueCommand. (GoogleCloudPlatformGH-878)
External contributions: * Add RHEL based virtual machines to OpenStack provider. (thanks @akrzos; GoogleCloudPlatformGH-858) * Change rackspace provider information to use official CLI (thanks @meteorfox; GoogleCloudPlatformGH-844) * Add rackspace requirements (thanks @meteorfox; GoogleCloudPlatformGH-805) New features: * Support flags in YAML format. (GoogleCloudPlatformGH-857) * Check version of required packages at runtime (GoogleCloudPlatformGH-834) * User-specified multiregion for GCS benchmarking (GoogleCloudPlatformGH-845) * Support metadata for gcp instances (GoogleCloudPlatformGH-859) Bugfixes and maintences updates: * Change rackspace's AllowPort to enable UDP (thanks @meteorfox; GoogleCloudPlatformGH-805) * Allow most recent verison gcs-oauth2-boto-plugin (GoogleCloudPlatformGH-849) * Require Pint >= 0.7 (GoogleCloudPlatformGH-850) * Update PIP (GoogleCloudPlatformGH-842) * Fix windows log message (GoogleCloudPlatformGH-832) * Properly Pickle Pint Quantities (GoogleCloudPlatformGH-830) * os_type added to boot benchmark metadata (GoogleCloudPlatformGH-826) * Better handle Azure timeouts (GoogleCloudPlatformGH-825) * Better handling of AWS integration tests. (GoogleCloudPlatformGH-869, GoogleCloudPlatformGH-868)
Release 1.2.0 New features: * Introduce Object Sizes (GoogleCloudPlatformGH-808). * Add ListDecoder for verifying a config option that expects list values (GoogleCloudPlatformGH-807). Enhancements: * Bump HBase to 1.0.3 (GoogleCloudPlatformGH-822). * Change MockFlags to be more like the real FlagValues (GoogleCloudPlatformGH-812). * Rename test_flag_util.py and add FlagDictSubstitution tests (GoogleCloudPlatformGH-811). * Create BenchmarkConfigSpec to aggregate benchmark input checking (GoogleCloudPlatformGH-810). * Remove flag proxy objects (GoogleCloudPlatformGH-802). Bugfixes and maintenance updates: * Fix sample iperf sample (GoogleCloudPlatformGH-801). * FixIntDecoder and FloatDecoder behavior when min=0 or max=0 (GoogleCloudPlatformGH-800).
PreviousNext