Tags: hitstergtd/PerfKitBenchmarker
Tags
Release 1.2.0 New features: * Introduce Object Sizes (GoogleCloudPlatformGH-808). * Add ListDecoder for verifying a config option that expects list values (GoogleCloudPlatformGH-807). Enhancements: * Bump HBase to 1.0.3 (GoogleCloudPlatformGH-822). * Change MockFlags to be more like the real FlagValues (GoogleCloudPlatformGH-812). * Rename test_flag_util.py and add FlagDictSubstitution tests (GoogleCloudPlatformGH-811). * Create BenchmarkConfigSpec to aggregate benchmark input checking (GoogleCloudPlatformGH-810). * Remove flag proxy objects (GoogleCloudPlatformGH-802). Bugfixes and maintenance updates: * Fix sample iperf sample (GoogleCloudPlatformGH-801). * FixIntDecoder and FloatDecoder behavior when min=0 or max=0 (GoogleCloudPlatformGH-800).
Release 1.1.0 External contributions: * Add additional percentile samples to mysql_service benchmark and others (thanks @zbjornson; GoogleCloudPlatformGH-729). * Add Mesos-Marathon as a provider (thanks @mateusz-blaszkowski; GoogleCloudPlatformGH-679, GoogleCloudPlatformGH-731). * Use only available floating-ips for OpenStack (thanks @meteorfox; GoogleCloudPlatformGH-733). * Add OpenStack CLI-based support for object_storage_service benchmark (thanks @meteorfox; GoogleCloudPlatformGH-738). * Make printed benchmark results more readable (thanks @wonderfly; GoogleCloudPlatformGH-747). * Clean up formatting, grammar, and markdown in README.md (thanks @mbrukman; GoogleCloudPlatformGH-748). * Add links to projects and licenses in README.md (thanks @mbrukman; GoogleCloudPlatformGH-763). * Fix a bug that caused --helpxml to not work (thanks @jldiaz; GoogleCloudPlatformGH-782). * Make OpenStack VM username configurable with a new --openstack_image_username flag (thanks @lwatta; GoogleCloudPlatformGH-788). New features: * Allow users to specify a storage region for the object_storage_service benchmark with a new --object_storage_region flag (GoogleCloudPlatformGH-609). * Add support for running a background CPU workload while executing a benchmark (GoogleCloudPlatformGH-715, GoogleCloudPlatformGH-762). * Allow creating GCE custom VMs easily from command-line flags (GoogleCloudPlatformGH-727). * Add the --gce_network_name to allow GCE users to use pre-existing networks (GoogleCloudPlatformGH-746). * Publish a PTRANS sample from the hpcc benchmark (GoogleCloudPlatformGH-785). * Add support for running a background network workload while executing a benchmark (GoogleCloudPlatformGH-786). * Add a CSV sample output format (GoogleCloudPlatformGH-791). Enhancements: * Trim blocks while formatting and mounting disks (GoogleCloudPlatformGH-692). * Raise an error when no requests succeed in redis_benchmark (GoogleCloudPlatformGH-702). * Update the Google benchmark set (GoogleCloudPlatformGH-705). * Add input-checking to disk specs (GoogleCloudPlatformGH-675, GoogleCloudPlatformGH-779). * Let disks on Windows machines return Windows DeviceIds (GoogleCloudPlatformGH-743). * Speed up Cassandra cluster boot by setting "auto_bootstrap" to false (GoogleCloudPlatformGH-751). * Defer package update for Ubuntu (GoogleCloudPlatformGH-752). * Add provider-specific requirements.txt files (GoogleCloudPlatformGH-753). * Increase preload thread count for YCSB benchmarks (GoogleCloudPlatformGH-760). This change affects some of the samples generated by the aerospike_ycsb, cassandra_ycsb, and mongodb_ycsb benchmarks, including the overall Runtime and overall Throughput. * Guarantee order of VM and disk spec config option decoding (GoogleCloudPlatformGH-792). Bugfixes and maintenance updates: * Create one AWS VPC/IGW/PlacementGroup per region (GoogleCloudPlatformGH-687, GoogleCloudPlatformGH-798). * Update README.md instructions for setting up PKB for GCE (GoogleCloudPlatformGH-689). * Update comments in pkb.py to reflect new provision and teardown stages (GoogleCloudPlatformGH-691). * Fix bug that prevented object_storage_service benchmark from running in stages (GoogleCloudPlatformGH-694). * Add test helpers that make it easier to mock command-line flags (GoogleCloudPlatformGH-695, GoogleCloudPlatformGH-730). * Delete set-interrupts.sh (GoogleCloudPlatformGH-703). * Make process exit status non-zero upon benchmark failure (GoogleCloudPlatformGH-713). * Move "To run again" message from teardown to cleanup stage (GoogleCloudPlatformGH-714). * Fix creation of AWS VMs using Placement Groups (GoogleCloudPlatformGH-721). * Create AWS/GCE default access rules before creating VMs (GoogleCloudPlatformGH-726, GoogleCloudPlatformGH-756). This change affects the Boot Time measured by the cluster_boot benchmark. * Fix a GCE boot disk creation bug (GoogleCloudPlatformGH-736). * ntttcp benchmark fixes (GoogleCloudPlatformGH-737). * Force mongodb_ycsb benchmark to use only one VM (GoogleCloudPlatformGH-755). * Unmount /mnt if it exists prior to creating a scratch filesystem (GoogleCloudPlatformGH-757). * Move provider constants to a separate module (GoogleCloudPlatformGH-758). * Fix a bug when creating an AWS VPC outside the user's default region (GoogleCloudPlatformGH-774). * Add tests for generating help strings (GoogleCloudPlatformGH-782). * Kill servers started by the iperf benchmark as part of its cleanup (GoogleCloudPlatformGH-784). * Fix some style inconsistencies (GoogleCloudPlatformGH-789). * Move operating system constants to a separate module (GoogleCloudPlatformGH-790). * Fix some broken tests (GoogleCloudPlatformGH-795, GoogleCloudPlatformGH-796).
* Fix for benchmark_compatibility_checking flag. (thanks @mateusz-bla… …szkowski; GoogleCloudPlatformGH-707)
0.23.0 Known Issues: * Resources fail to be cleaned up when PerfKitBenchmarker receives SIGINT while running with `--parallel` (GoogleCloudPlatformGH-529). New Features: * Added [CloudStack](http://cloudstack.apache.org) provider support (thanks @syed; GoogleCloudPlatformGH-558). * **❢ BREAKING CHANGE:** Added a more flexible benchmark configuration system (GoogleCloudPlatformGH-510, GoogleCloudPlatformGH-546). This supports running the same benchmark multiple times, and running a benchmark using heterogeneous machine types and clouds. See [the wiki](https://github.com/GoogleCloudPlatform/PerfKitBenchmarker/wiki/PerfkitBenchmarker-Configurations) for more information. This replaces the configuration system under `perfkitbenchmarker/deployment`. * New benchmark: `redis_ycsb`, which runs YCSB against a single YCSB node (GoogleCloudPlatformGH-511). Enhancements: * Added flag: `--archive_bucket`, to archive the results of a run to Google Cloud Storage or S3 (GoogleCloudPlatformGH-489). * Added `--prefill_device` option to fio benchmark. Note that the `fio` benchmark now defaults to *not* pre-filling the device when testing against a filesystem (GoogleCloudPlatformGH-515, FH-516). * Updated `cloud_bigtable_ycsb` benchmark to pre-split table, following HBase recommendions (GoogleCloudPlatformGH-524). * Added additional logging to `LinuxVirtualMachine.RobustRemoteCommand` (GoogleCloudPlatformGH-534). * Added support for local disks with EC2 `d2` types. * Kubernetes: Support `emptyDisk` disk types (thanks @mateusz-blaszkowski GoogleCloudPlatformGH-565). * `cluster_boot`: Add `num_vms` metadata (GoogleCloudPlatformGH-575). * Add published `run_uri` to VM metadata (GoogleCloudPlatformGH-579). * Add a flag to specify the Azure Python library version in object storage benchmark, default to the latest version (GoogleCloudPlatformGH-585, GoogleCloudPlatformGH-587). Bugfixes and maintenance updates: * Kubernetes: Adapt provider to work with different versions of `kubectl` (Thanks @mateusz-blaszkowski; GoogleCloudPlatformGH-574). * Eliminated a spurious resource warning (GoogleCloudPlatformGH-522). * Fixed a string comparison bug in Object storage benchmark (GoogleCloudPlatformGH-526). * Rackspace; Removed an extra parameter from firewall implementation (thanks @meteorfox, GoogleCloudPlatformGH-531). * Rackspace: Fixed an SSH key upload bug (thanks @meteorfox, GoogleCloudPlatformGH-539). * Fix an issue with loggin errors in `vm_util.RunThreaded` (GoogleCloudPlatformGH-542; thanks @mateusz-blaszkowski for reporting). * `mongodb_ycsb`: Update default write concern to "Acknowledged" (equivalent to the previous deprecated option, safe) (GoogleCloudPlatformGH-543). * Specify SSH port when using SCP (thanks @mateusz-blaszkowski GoogleCloudPlatformGH-548). * Fix string conversion (thanks @mateusz-blaszkowski GoogleCloudPlatformGH-556). * `hbase_ycsb`: Make load records use a BufferedMutator (GoogleCloudPlatformGH-566).
Release v0.22.1 Changes: * Update the default image used in Azure tests to Ubuntu 14.04.3 (runs failed with the current image). (cherry-pick of GoogleCloudPlatform#520)
* New Features: * Add Kubernetes as a provider where benchmarks can be run (thanks * @mateusz-blaszkowski) (GoogleCloudPlatformGH-475) * Add EPFL CloudSuite WebSearch Workload (thanks @vukasin92) (GoogleCloudPlatformGH-422, * GoogleCloudPlatformGH-479) * Aerospike_yscb_benchmark (GoogleCloudPlatformGH-486) * Enhancements: * OpenStack checks/changes for attaching volumes, default volume size, * config improvements, … (thanks @kivio) (GoogleCloudPlatformGH-454, GoogleCloudPlatformGH-459, GoogleCloudPlatformGH-464) * Fio test improvements and clean-up - template files, logging, * ... (GoogleCloudPlatformGH-421, GoogleCloudPlatformGH-501, GoogleCloudPlatformGH-502) * Add improvement to use compiled crcmod when benchmarking Google * Cloud Storage (GoogleCloudPlatformGH-461) * Collect Fio data over time via “--run_for_minutes” flag (GoogleCloudPlatformGH-477) * Execute command improvements to add better logging and * parallelism (GoogleCloudPlatformGH-488, GoogleCloudPlatformGH-470) * Bugfixes and maintenance updates: * Update to allow PKB to work with the latest Azure CLI 0.9.9 (GoogleCloudPlatformGH-485) * Updated fio version to 2.2.10 (GoogleCloudPlatformGH-509) * fio iodepth flag fix “--io_depths” (GoogleCloudPlatformGH-495) * Fixes a race condition on AWS/Azure where networks in use were * deleted (GoogleCloudPlatformGH-506) * Added a note on how to fix dependencies when tox tests fail (GoogleCloudPlatformGH-505) * Fixed broken Apache project links (GoogleCloudPlatformGH-492, GoogleCloudPlatformGH-467) * Netperf timeout to work around occasional hangs (GoogleCloudPlatformGH-483) * Fixed lock pickling issues (GoogleCloudPlatformGH-471) * Added a “-v” flag (GoogleCloudPlatformGH-463)
Release 0.21.0. Changes in this release: * New features: * Add support for OpenStack affinity and anti-affinity groups. (GoogleCloudPlatformGH-440, thanks to @kivio) * Add large object scenario for CLI tests in object_storage_service. (GoogleCloudPlatformGH-445) * Add support for pre-emptible GCE VMs. (GoogleCloudPlatformGH-415) * Enhancements: * Parallelize cassandra_ycsb and hbase_ycsb benchmark setups. (GoogleCloudPlatformGH-435) * Add more config options for aerospike benchmark. (GoogleCloudPlatformGH-450) * Bugfixes and maintenance updates: * Refactor OpenStack network IP management. (GoogleCloudPlatformGH-438, thanks to @kivio) * Fix thread lock pickling bug. (GoogleCloudPlatformGH-425, thanks to @kivio) * Update jars used in cloud_bigtable_ycsb benchmark. (GoogleCloudPlatformGH-444) * Update YCSB to v0.3.0. (GoogleCloudPlatformGH-428) * Fix object_storage_service bug introduced by Azure breaking change. (GoogleCloudPlatformGH-446) * Fix object storage CLI output format. (GoogleCloudPlatformGH-449)
Release v0.20.0 * Enhancements: * Specify project to gcloud alpha bigtable clusters list (GoogleCloudPlatformGH-433) * More Samples in FIO (GoogleCloudPlatformGH-416) * Bugfixes and maintenance updates: * pkb label problem in OpenStack driver fixes (GoogleCloudPlatformGH-410) * On exception, only cleanup if run stage is all/cleanup (GoogleCloudPlatformGH-412) * Fix issue with using a flag before flags are parsed (GoogleCloudPlatformGH-413) * Umount disk when running fio against raw device. (GoogleCloudPlatformGH-417) * Clarify warnings from ycsb._CombineResults. (GoogleCloudPlatformGH-432)
PreviousNext