Tags: queniao/PerfKitBenchmarker
Tags
Release 1.4.0 New features: * openstack: Add support for optional floating ip pool (thanks @meteorfox, GoogleCloudPlatformGH-861) * openstack: Use Keystone session for handling authentication (thanks @meteorfox, GoogleCloudPlatformGH-870) * Support object storage classes in object storage service benchmarks (GoogleCloudPlatformGH-895) * Add Object Size Distributions in object storage service benchmarks (GoogleCloudPlatformGH-888) * Add MultiStreamThroughput benchmark to object storage benchmarks (GoogleCloudPlatformGH-840) * Adds a SPEC SFS 2014 benchmark which runs against GlusterFS (GoogleCloudPlatformGH-876) * gce_virtual_machine: Support user provided instance metadata (GoogleCloudPlatformGH-859) Improvements and fixes: * openstack: Wait until VM deletion has been completed (thanks @meteorfox, GoogleCloudPlatformGH-904) * openstack: Fix floating IP allocation and deallocation (thanks @meteorfox, GoogleCloudPlatformGH-862) * rackspace: Fix missing flags bug (thanks @meteorfox, GoogleCloudPlatformGH-903) * Allow user to specify a flag when they run object storage benchmark on GCP, and default that flag to the latest known working version. (GoogleCloudPlatformGH-925) * Update mechanism used to get iperf server process id. (GoogleCloudPlatformGH-921) * Rename variables and improve documentation of BaseOsMixin.PullFile. (GoogleCloudPlatformGH-923) * Fix WindowsMixin._GetNumCpus when more than one Win32_processor exists. (GoogleCloudPlatformGH-920) * Add exception types to except clauses. (GoogleCloudPlatformGH-893) * Add Flag for List Consistency Iterations (GoogleCloudPlatformGH-889) * Add unit tests for scripts (GoogleCloudPlatformGH-882) * Add disk type examples to README.md (GoogleCloudPlatformGH-871) * Copy-edit the README (GoogleCloudPlatformGH-877) * Turn off selinux for mongodb. (thanks @akrzos, GoogleCloudPlatformGH-867) * Use temp files for Popen stdout and stderr in IssueCommand. (GoogleCloudPlatformGH-878)
External contributions: * Add RHEL based virtual machines to OpenStack provider. (thanks @akrzos; GoogleCloudPlatformGH-858) * Change rackspace provider information to use official CLI (thanks @meteorfox; GoogleCloudPlatformGH-844) * Add rackspace requirements (thanks @meteorfox; GoogleCloudPlatformGH-805) New features: * Support flags in YAML format. (GoogleCloudPlatformGH-857) * Check version of required packages at runtime (GoogleCloudPlatformGH-834) * User-specified multiregion for GCS benchmarking (GoogleCloudPlatformGH-845) * Support metadata for gcp instances (GoogleCloudPlatformGH-859) Bugfixes and maintences updates: * Change rackspace's AllowPort to enable UDP (thanks @meteorfox; GoogleCloudPlatformGH-805) * Allow most recent verison gcs-oauth2-boto-plugin (GoogleCloudPlatformGH-849) * Require Pint >= 0.7 (GoogleCloudPlatformGH-850) * Update PIP (GoogleCloudPlatformGH-842) * Fix windows log message (GoogleCloudPlatformGH-832) * Properly Pickle Pint Quantities (GoogleCloudPlatformGH-830) * os_type added to boot benchmark metadata (GoogleCloudPlatformGH-826) * Better handle Azure timeouts (GoogleCloudPlatformGH-825) * Better handling of AWS integration tests. (GoogleCloudPlatformGH-869, G 8000 oogleCloudPlatformGH-868)
Release 1.2.0 New features: * Introduce Object Sizes (GoogleCloudPlatformGH-808). * Add ListDecoder for verifying a config option that expects list values (GoogleCloudPlatformGH-807). Enhancements: * Bump HBase to 1.0.3 (GoogleCloudPlatformGH-822). * Change MockFlags to be more like the real FlagValues (GoogleCloudPlatformGH-812). * Rename test_flag_util.py and add FlagDictSubstitution tests (GoogleCloudPlatformGH-811). * Create BenchmarkConfigSpec to aggregate benchmark input checking (GoogleCloudPlatformGH-810). * Remove flag proxy objects (GoogleCloudPlatformGH-802). Bugfixes and maintenance updates: * Fix sample iperf sample (GoogleCloudPlatformGH-801). * FixIntDecoder and FloatDecoder behavior when min=0 or max=0 (GoogleCloudPlatformGH-800).
Release 1.1.0 External contributions: * Add additional percentile samples to mysql_service benchmark and others (thanks @zbjornson; GoogleCloudPlatformGH-729). * Add Mesos-Marathon as a provider (thanks @mateusz-blaszkowski; GoogleCloudPlatformGH-679, GoogleCloudPlatformGH-731). * Use only available floating-ips for OpenStack (thanks @meteorfox; GoogleCloudPlatformGH-733). * Add OpenStack CLI-based support for object_storage_service benchmark (thanks @meteorfox; GoogleCloudPlatformGH-738). * Make printed benchmark results more readable (thanks @wonderfly; GoogleCloudPlatformGH-747). * Clean up formatting, grammar, and markdown in README.md (thanks @mbrukman; GoogleCloudPlatformGH-748). * Add links to projects and licenses in README.md (thanks @mbrukman; GoogleCloudPlatformGH-763). * Fix a bug that caused --helpxml to not work (thanks @jldiaz; GoogleCloudPlatformGH-782). * Make OpenStack VM username configurable with a new --openstack_image_username flag (thanks @lwatta; GoogleCloudPlatformGH-788). New features: * Allow users to specify a storage region for the object_storage_service benchmark with a new --object_storage_region flag (GoogleCloudPlatformGH-609). * Add support for running a background CPU workload while executing a benchmark (GoogleCloudPlatformGH-715, GoogleCloudPlatformGH-762). * Allow creating GCE custom VMs easily from command-line flags (GoogleCloudPlatformGH-727). * Add the --gce_network_name to allow GCE users to use pre-existing networks (GoogleCloudPlatformGH-746). * Publish a PTRANS sample from the hpcc benchmark (GoogleCloudPlatformGH-785). * Add support for running a background network workload while executing a benchmark (GoogleCloudPlatformGH-786). * Add a CSV sample output format (GoogleCloudPlatformGH-791). Enhancements: * Trim blocks while formatting and mounting disks (GoogleCloudPlatformGH-692). * Raise an error when no requests succeed in redis_benchmark (GoogleCloudPlatformGH-702). * Update the Google benchmark set (GoogleCloudPlatformGH-705). * Add input-checking to disk specs (GoogleCloudPlatformGH-675, GoogleCloudPlatformGH-779). * Let disks on Windows machines return Windows DeviceIds (GoogleCloudPlatformGH-743). * Speed up Cassandra cluster boot by setting "auto_bootstrap" to false (GoogleCloudPlatformGH-751). * Defer package update for Ubuntu (GoogleCloudPlatformGH-752). * Add provider-specific requirements.txt files (GoogleCloudPlatformGH-753). * Increase preload thread count for YCSB benchmarks (GoogleCloudPlatformGH-760). This change affects some of the samples generated by the aerospike_ycsb, cassandra_ycsb, and mongodb_ycsb benchmarks, including the overall Runtime and overall Throughput. * Guarantee order of VM and disk spec config option decoding (GoogleCloudPlatformGH-792). Bugfixes and maintenance updates: * Create one AWS VPC/IGW/PlacementGroup per region (GoogleCloudPlatformGH-687, GoogleCloudPlatformGH-798). * Update README.md instructions for setting up PKB for GCE (GoogleCloudPlatformGH-689). * Update comments in pkb.py to reflect new provision and teardown stages (GoogleCloudPlatformGH-691). * Fix bug that prevented object_storage_service benchmark from running in stages (GoogleCloudPlatformGH-694). * Add test helpers that make it easier to mock command-line flags (GoogleCloudPlatformGH-695, GoogleCloudPlatformGH-730). * Delete set-interrupts.sh (GoogleCloudPlatformGH-703). * Make process exit status non-zero upon benchmark failure (GoogleCloudPlatformGH-713). * Move "To run again" message from teardown to cleanup stage (GoogleCloudPlatformGH-714). * Fix creation of AWS VMs using Placement Groups (GoogleCloudPlatformGH-721). * Create AWS/GCE default access rules before creating VMs (GoogleCloudPlatformGH-726, GoogleCloudPlatformGH-756). This change affects the Boot Time measured by the cluster_boot benchmark. * Fix a GCE boot disk creation bug (GoogleCloudPlatformGH-736). * ntttcp benchmark fixes (GoogleCloudPlatformGH-737). * Force mongodb_ycsb benchmark to use only one VM (GoogleCloudPlatformGH-755). * Unmount /mnt if it exists prior to creating a scratch filesystem (GoogleCloudPlatformGH-757). * Move provider constants to a separate module (GoogleCloudPlatformGH-758). * Fix a bug when creating an AWS VPC outside the user's default region (GoogleCloudPlatformGH-774). * Add tests for generating help strings (GoogleCloudPlatformGH-782). * Kill servers started by the iperf benchmark as part of its cleanup (GoogleCloudPlatformGH-784). * Fix some style inconsistencies (GoogleCloudPlatformGH-789). * Move operating system constants to a separate module (GoogleCloudPlatformGH-790). * Fix some broken tests (GoogleCloudPlatformGH-795, GoogleCloudPlatformGH-796).
* Fix for benchmark_compatibility_checking flag. (thanks @mateusz-bla… …szkowski; GoogleCloudPlatformGH-707)
0.23.0 Known Issues: * Resources fail to be cleaned up when PerfKitBenchmarker receives SIGINT while running with `--parallel` (GoogleCloudPlatformGH-529). New Features: * Added [CloudStack](http://cloudstack.apache.org) provider support (thanks @syed; GoogleCloudPlatformGH-558). * **❢ BREAKING CHANGE:** Added a more flexible benchmark configuration system (GoogleCloudPlatformGH-510, GoogleCloudPlatformGH-546). This supports running the same benchmark multiple times, and running a benchmark using heterogeneous machine types and clouds. See [the wiki](https://github.com/GoogleCloudPlatform/PerfKitBenchmarker/wiki/PerfkitBenchmarker-Configurations) for more information. This replaces the configuration system under `perfkitbenchmarker/deployment`. * New benchmark: `redis_ycsb`, which runs YCSB against a single YCSB node (GoogleCloudPlatformGH-511). Enhancements: * Added flag: `--archive_bucket`, to archive the results of a run to Google Cloud Storage or S3 (GoogleCloudPlatformGH-489). * Added `--prefill_device` option to fio benchmark. Note that the `fio` benchmark now defaults to *not* pre-filling the device when testing against a filesystem (GoogleCloudPlatformGH-515, FH-516). * Updated `cloud_bigtable_ycsb` benchmark to pre-split table, following HBase recommendions (GoogleCloudPlatformGH-524). * Added additional logging to `LinuxVirtualMachine.RobustRemoteCommand` (GoogleCloudPlatformGH-534). * Added support for local disks with EC2 `d2` types. * Kubernetes: Support `emptyDisk` disk types (thanks @mateusz-blaszkowski GoogleCloudPlatformGH-565). * `cluster_boot`: Add `num_vms` metadata (GoogleCloudPlatformGH-575). * Add published `run_uri` to VM metadata (GoogleCloudPlatformGH-579). * Add a flag to specify the Azure Python library version in object storage benchmark, default to the latest version (GoogleCloudPlatformGH-585, GoogleCloudPlatformGH-587). Bugfixes and maintenance updates: * Kubernetes: Adapt provider to work with different versions of `kubectl` (Thanks @mateusz-blaszkowski; GoogleCloudPlatformGH-574). * Eliminated a spurious resource warning (GoogleCloudPlatformGH-522). * Fixed a string comparison bug in Object storage benchmark (GoogleCloudPlatformGH-526). * Rackspace; Removed an extra parameter from firewall implementation (thanks @meteorfox, GoogleCloudPlatformGH-531). * Rackspace: Fixed an SSH key upload bug (thanks @meteorfox, GoogleCloudPlatformGH-539). * Fix an issue with loggin errors in `vm_util.RunThreaded` (GoogleCloudPlatformGH-542; thanks @mateusz-blaszkowski for reporting). * `mongodb_ycsb`: Update default write concern to "Acknowledged" (equivalent to the previous deprecated option, safe) (GoogleCloudPlatformGH-543). * Specify SSH port when using SCP (thanks @mateusz-blaszkowski GoogleCloudPlatformGH-548). * Fix string conversion (thanks @mateusz-blaszkowski GoogleCloudPlatformGH-556). * `hbase_ycsb`: Make load records use a BufferedMutator (GoogleCloudPlatformGH-566).
Release v0.22.1 Changes: * Update the default image used in Azure tests to Ubuntu 14.04.3 (runs failed with the current image). (cherry-pick of GoogleCloudPlatform#520)
PreviousNext