Tags: maggiejiao/PerfKitBenchmarker
Tags
New features: * Add ProfitBricks provider (thanks @tjb1019, GoogleCloudPlatformGH-1005) * Add YCSB JDBC benchmark (thanks @k1xme, GoogleCloudPlatformGH-1049) * Add support for st1 and sc1 disks on EBS (GoogleCloudPlatformGH-1067) Breaking changes: * Change default gce_migrate_on_maintenance to True (GoogleCloudPlatformGH-1069) Enhancements: * Update OpenStack provider to use OpenStacks CLI instead of python library (thanks @meteorfox, GoogleCloudPlatformGH-942) * Improve side-by-side tool (GoogleCloudPlatformGH-1034) * Specify flags to metadata (GoogleCloudPlatformGH-1047) * Allow Java version for Java benchmarks to be selected via command line (GoogleCloudPlatformGH-1051) * Add numjobs runtime option to fio_benchmark (GoogleCloudPlatformGH-1066) * Add netperf histogram support (GoogleCloudPlatformGH-1072) * Add multi-vm support for object_storage_service_benchmark (GoogleCloudPlatformGH-1074) * Add support for custom s3 endpoints for object_storage_service_benchmark (GoogleCloudPlatformGH-1078) * Add user-defined metadata for vms (GoogleCloudPlatformGH-1080) Bugfixes and maintenance updates: * Refactor object_storage_service_benchmark (GoogleCloudPlatformGH-1023) * Support overriding ycsb_client_vms in benchmark spec (thanks @k1xme, GoogleCloudPlatformGH-1042) * Update YCSB to 0.9.0 and support latest logging format (thanks @k1xme, GoogleCloudPlatformGH-1043) * Fix zones flag (GoogleCloudPlatformGH-1044) * Update Bigtable to v2 API (thanks @tswast, GoogleCloudPlatformGH-1045) * Update maven version to 3.3.9 (GoogleCloudPlatformGH-1046) * Start background workload in prepare stage and stop in cleanup stage (GoogleCloudPlatformGH-1048) * Minor fixes in flag description (GoogleCloudPlatformGH-1052) * Only upload files needed for API testing script for object_storage_service_benchmark (GoogleCloudPlatformGH-1053) * Fix redis_ycsb benchmark to use multiple processes (GoogleCloudPlatformGH-1062, GoogleCloudPlatformGH-1068, GoogleCloudPlatformGH-1070) * Fix bug with custom machine types configs (GoogleCloudPlatformGH-1077) * Fix in documentation of ParseTimeCommandResult (thanks @skorgu, GoogleCloudPlatformGH-1079) * Replace Pandas dependency with Numpy (GoogleCloudPlatformGH-1081) * Turn off OpenBlas threading, improving HPCC on large vms (GoogleCloudPlatformGH-1084) * Cleanup object_storage_serivce benchmark (GoogleCloudPlatformGH-1085) * Cleanup aerospike_ycsb benchmarks (GoogleCloudPlatformGH-1086)
New features: * Apache Spark benchmark (GoogleCloudPlatformGH-1014,GoogleCloudPlatformGH-1011) * Cloudsuite dataserving benchmark (thanks @ustiugov, GoogleCloudPlatformGH-930) Enhancements: * Optionally publish VM hostnames in metadata (GoogleCloudPlatformGH-1020) * Control which netperf benchmarks are run via flag (GoogleCloudPlatformGH-1029) * Netperf benchmark reports min and max latency (GoogleCloudPlatformGH-1013) * Add multichase to the google benchmark set (GoogleCloudPlatformGH-1018) * Update Cloudsuite web serving benchmark (thanks @ivonindza, @GH-998) * Object storage updates (GoogleCloudPlatformGH-987) * Repeat Run stage (GoogleCloudPlatformGH-1032) Bugfixes and maintenance updates: * Fix path to cassandra-cli (thanks @AdamIsrael, GoogleCloudPlatformGH-1006) * Update ycsb version; affects cloud_bigtable_ycsb_benchmark, hbase_ycsb (GoogleCloudPlatformGH-1021, GoogleCloudPlatformGH-1025, GoogleCloudPlatformGH-1031) * Use latest gsutil version (GoogleCloudPlatformGH-1012) * Remove duplicate requirements files (GoogleCloudPlatformGH-975) * Update openblas version (GoogleCloudPlatformGH-1003) * Background workload refactor (GoogleCloudPlatformGH-1033)
Release 1.4.0 New features: * openstack: Add support for optional floating ip pool (thanks @meteorfox, GoogleCloudPlatformGH-861) * openstack: Use Keystone session for handling authentication (thanks @meteorfox, GoogleCloudPlatformGH-870) * Support object storage classes in object storage service benchmarks (GoogleCloudPlatformGH-895) * Add Object Size Distributions in object storage service benchmarks (GoogleCloudPlatformGH-888) * Add MultiStreamThroughput benchmark to object storage benchmarks (GoogleCloudPlatformGH-840) * Adds a SPEC SFS 2014 benchmark which runs against GlusterFS (GoogleCloudPlatformGH-876) * gce_virtual_machine: Support user provided instance metadata (GoogleCloudPlatformGH-859) Improvements and fixes: * openstack: Wait until VM deletion has been completed (thanks @meteorfox, GoogleCloudPlatformGH-904) * openstack: Fix floating IP allocation and deallocation (thanks @meteorfox, GoogleCloudPlatformGH-862) * rackspace: Fix missing flags bug (thanks @meteorfox, GoogleCloudPlatformGH-903) * Allow user to specify a flag when they run object storage benchmark on GCP, and default that flag to the latest known working version. (GoogleCloudPlatformGH-925) * Update mechanism used to get iperf server process id. (GoogleCloudPlatformGH-921) * Rename variables and improve documentation of BaseOsMixin.PullFile. (GoogleCloudPlatformGH-923) * Fix WindowsMixin._GetNumCpus when more than one Win32_processor exists. (GoogleCloudPlatformGH-920) * Add exception types to except clauses. (GoogleCloudPlatformGH-893) * Add Flag for List Consistency Iterations (GoogleCloudPlatformGH-889) * Add unit tests for scripts (GoogleCloudPlatformGH-882) * Add disk type examples to README.md (GoogleCloudPlatformGH-871) * Copy-edit the README (GoogleCloudPlatformGH-877) * Turn off selinux for mongodb. (thanks @akrzos, GoogleCloudPlatformGH-867) * Use temp files for Popen stdout and stderr in IssueCommand. (GoogleCloudPlatformGH-878)
External contributions: * Add RHEL based virtual machines to OpenStack provider. (thanks @akrzos; GoogleCloudPlatformGH-858) * Change rackspace provider information to use official CLI (thanks @meteorfox; GoogleCloudPlatformGH-844) * Add rackspace requirements (thanks @meteorfox; GoogleCloudPlatformGH-805) New features: * Support flags in YAML format. (GoogleCloudPlatformGH-857) * Check version of required packages at runtime (GoogleCloudPlatformGH-834) * User-specified multiregion for GCS benchmarking (GoogleCloudPlatformGH-845) * Support metadata for gcp instances (GoogleCloudPlatformGH-859) Bugfixes and maintences updates: * Change rackspace's AllowPort to enable UDP (thanks @meteorfox; GoogleCloudPlatformGH-805) * Allow most recent verison gcs-oauth2-boto-plugin (GoogleCloudPlatformGH-849) * Require Pint >= 0.7 (GoogleCloudPlatformGH-850) * Update PIP (GoogleCloudPlatformGH-842) * Fix windows log message (GoogleCloudPlatformGH-832) * Properly Pickle Pint Quantities (GoogleCloudPlatformGH-830) * os_type added to boot benchmark metadata (GoogleCloudPlatformGH-826) * Better handle Azure timeouts (GoogleCloudPlatformGH-825) * Better handling of AWS integration tests. (GoogleCloudPlatformGH-869, GoogleCloudPlatformGH-868)
Release 1.2.0 New features: * Introduce Object Sizes (GoogleCloudPlatformGH-808). * Add ListDecoder for verifying a config option that expects list values (GoogleCloudPlatformGH-807). Enhancements: * Bump HBase to 1.0.3 (GoogleCloudPlatformGH-822). * Change MockFlags to be more like the real FlagValues (GoogleCloudPlatformGH-812). * Rename test_flag_util.py and add FlagDictSubstitution tests (GoogleCloudPlatformGH-811). * Create BenchmarkConfigSpec to aggregate benchmark input checking (GoogleCloudPlatformGH-810). * Remove flag proxy objects (GoogleCloudPlatformGH-802). Bugfixes and maintenance updates: * Fix sample iperf sample (GoogleCloudPlatformGH-801). * FixIntDecoder and FloatDecoder behavior when min=0 or max=0 (GoogleCloudPlatformGH-800).
Release 1.1.0 External contributions: * Add additional percentile samples to mysql_service benchmark and others (thanks @zbjornson; GoogleCloudPlatformGH-729). * Add Mesos-Marathon as a provider (thanks @mateusz-blaszkowski; GoogleCloudPlatformGH-679, GoogleCloudPlatformGH-731). * Use only available floating-ips for OpenStack (thanks @meteorfox; GoogleCloudPlatformGH-733). * Add OpenStack CLI-based support for object_storage_service benchmark (thanks @meteorfox; GoogleCloudPlatformGH-738). * Make printed benchmark results more readable (thanks @wonderfly; GoogleCloudPlatformGH-747). * Clean up formatting, grammar, and markdown in README.md (thanks @mbrukman; GoogleCloudPlatformGH-748). * Add links to projects and licenses in README.md (thanks @mbrukman; GoogleCloudPlatformGH-763). * Fix a bug that caused --helpxml to not work (thanks @jldiaz; GoogleCloudPlatformGH-782). * Make OpenStack VM username configurable with a new --openstack_image_username flag (thanks @lwatta; GoogleCloudPlatformGH-788). New features: * Allow users to specify a storage region for the object_storage_service benchmark with a new --object_storage_region flag (GoogleCloudPlatformGH-609). * Add support for running a background CPU workload while executing a benchmark (GoogleCloudPlatformGH-715, GoogleCloudPlatformGH-762). * Allow creating GCE custom VMs easily from command-line flags (GoogleCloudPlatformGH-727). * Add the --gce_network_name to allow GCE users to use pre-existing networks (GoogleCloudPlatformGH-746). * Publish a PTRANS sample from the hpcc benchmark (GoogleCloudPlatformGH-785). * Add support for running a background network workload while executing a benchmark (GoogleCloudPlatformGH-786). * Add a CSV sample output format (GoogleCloudPlatformGH-791). Enhancements: * Trim blocks while formatting and mounting disks (GoogleCloudPlatformGH-692). * Raise an error when no requests succeed in redis_benchmark (GoogleCloudPlatformGH-702). * Update the Google benchmark set (GoogleCloudPlatformGH-705). * Add input-checking to disk specs (GoogleCloudPlatformGH-675, GoogleCloudPlatformGH-779). * Let disks on Windows machines return Windows DeviceIds (GoogleCloudPlatformGH-743). * Speed up Cassandra cluster boot by setting "auto_bootstrap" to false (GoogleCloudPlatformGH-751). * Defer package update for Ubuntu (GoogleCloudPlatformGH-752). * Add provider-specific requirements.txt files (GoogleCloudPlatformGH-753). * Increase preload thread count for YCSB benchmarks (GoogleCloudPlatformGH-760). This change affects some of the samples generated by the aerospike_ycsb, cassandra_ycsb, and mongodb_ycsb benchmarks, including the overall Runtime and overall Throughput. * Guarantee order of VM and disk spec config option decoding (GoogleCloudPlatformGH-792). Bugfixes and maintenance updates: * Create one AWS VPC/IGW/PlacementGroup per region (GoogleCloudPlatformGH-687, GoogleCloudPlatformGH-798). * Update README.md instructions for setting up PKB for GCE (GoogleCloudPlatformGH-689). * Update comments in pkb.py to reflect new provision and teardown stages (GoogleCloudPlatformGH-691). * Fix bug that prevented object_storage_service benchmark from running in stages (GoogleCloudPlatformGH-694). * Add test helpers that make it easier to mock command-line flags (GoogleCloudPlatformGH-695, GoogleCloudPlatformGH-730). * Delete set-interrupts.sh (GoogleCloudPlatformGH-703). * Make process exit status non-zero upon benchmark failure (GoogleCloudPlatformGH-713). * Move "To run again" message from teardown to cleanup stage (GoogleCloudPlatformGH-714). * Fix creation of AWS VMs using Placement Groups (GoogleCloudPlatformGH-721). * Create AWS/GCE default access rules before creating VMs (GoogleCloudPlatformGH-726, GoogleCloudPlatformGH-756). This change affects the Boot Time measured by the cluster_boot benchmark. * Fix a GCE boot disk creation bug (GoogleCloudPlatformGH-736). * ntttcp benchmark fixes (GoogleCloudPlatformGH-737). * Force mongodb_ycsb benchmark to use only one VM (GoogleCloudPlatformGH-755). * Unmount /mnt if it exists prior to creating a scratch filesystem (GoogleCloudPlatformGH-757). * Move provider constants to a separate module (GoogleCloudPlatformGH-758). * Fix a bug when creating an AWS VPC outside the user's default region (GoogleCloudPlatformGH-774). * Add tests for generating help strings (GoogleCloudPlatformGH-782). * Kill servers started by the iperf benchmark as part of its cleanup (GoogleCloudPlatformGH-784). * Fix some style inconsistencies (GoogleCloudPlatformGH-789). * Move operating system constants to a separate module (GoogleCloudPlatformGH-790). * Fix some broken tests (GoogleCloudPlatformGH-795, GoogleCloudPlatformGH-796).
* Fix for benchmark_compatibility_checking flag. (thanks @mateusz-bla… …szkowski; GoogleCloudPlatformGH-707)
PreviousNext