8000 Releases · tensorflow/model-analysis · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

Releases: tensorflow/model-analysis

TensorFlow Model Analysis 0.39.0

16 May 03:23
@rtg0795 rtg0795
v0.39.0
32a2392
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Verified
Learn about vigilant mode.
Compare
Choose a tag to compare
TensorFlow Model Analysis 0.39.0

Major Features and Improvements

  • SqlSliceKeyExtractor now supports slicing on transformed features.

Bug fixes and other Changes

  • Depends on tfx-bsl>=1.8.0,<1.9.0.
  • Depends on tensorflow-metadata>=1.8.0,<1.9.0.
  • Depends on apache-beam[gcp]>=2.38,<3.

Breaking Changes

  • N/A

Deprecations

  • N/A
Loading

TensorFlow Model Analysis 0.38.0

04 Mar 23:47
@rtg0795 rtg0795
v0.38.0
9c7234d
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Verified
Learn about vigilant mode.
Compare
Choose a tag to compare
TensorFlow Model Analysis 0.38.0

Major Features and Improvements

  • N/A

Bug fixes and other Changes

  • Fixes issue attempting to parse metrics, plots, and attributions without a
    format suffix.
  • Fixes the non-deterministic key ordering caused by proto string
    serialization in metrics validator.
  • Update variable name to respectful terminology, rebuild JS
  • Fixes issues preventing standard preprocessors from being applied.
  • Allow merging extracts including sparse tensors with different dense shapes.

Breaking Changes

  • MetricsPlotsAndValidationsWriter will now write files with an explicit
    output format suffix (".tfrecord" by default). This should only affect
    pipelines which directly construct MetricsPlotsAndValidationWriter
    instances and do not set output_file_format. Those which use
    default_writers() should be unchanged.
  • Batched based extractors previously worked off of either lists of dicts of
    single tensor values or arrow record batches. These have been updated to be
    based on dicts with batched tensor values at the leaves.
  • Depends on
    tensorflow>=1.15.5,!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.*,!=2.4.*,!=2.5.*,!=2.6.*,!=2.7.*,<3.
  • Depends on tfx-bsl>=1.7.0,<1.8.0.
  • Depends on tensorflow-metadata>=1.7.0,<1.8.0.
  • Depends on apache-beam[gcp]>=2.36,<3.

Deprecations

  • N/A
Loading

TensorFlow Model Analysis 0.37.0

24 Jan 17:50
@rtg0795 rtg0795
v0.37.0
cd4d87e
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Verified
Learn about vigilant mode.
Compare
Choose a tag to compare
TensorFlow Model Analysis 0.37.0

Major Features and Improvements

  • N/A

Bug fixes and other Changes

  • Fixed issue with aggregation type not being set properly in keys associated
    with confusion matrix metrics.
  • Enabled the sql_slice_key extractor when evaluating a model.
  • Depends on numpy>=1.16,<2.
  • Depends on absl-py>=0.9,<2.0.0.
  • Depends on
    tensorflow>=1.15.5,!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.*,!=2.4.*,!=2.5.*,!=2.6.*,<3.
  • Depends on tfx-bsl>=1.6.0,<1.7.0.
  • Depends on tensorflow-metadata>=1.6.0,<1.7.0.
  • Depends on apache-beam[gcp]>=2.35,<3.

Breaking Changes

  • N/A

Deprecations

  • N/A
Loading

TensorFlow Model Analysis 0.36.0

02 Dec 04:29
@jay90099 jay90099
v0.36.0
20f9634
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Verified
Learn about vigilant mode.
Compare
Choose a tag to compare
TensorFlow Model Analysis 0.36.0

Major Features and Improvements

  • Replaced keras metrics with TFMA implementations. To use a keras metric in a
    tfma.MetricConfig you must now specify a module (i.e. tf.keras.metrics).
  • Added FixedSizeSample metric which can be used to extract a random,
    per-slice, fixed-sized sample of values for a user-configured feature key.

Bug fixes and other Changes

  • Updated QueryStatistics to support weighted examples.
  • Depends on apache-beam[gcp]>=2.34,<3.
  • Depends on
    tensorflow>=1.15.2,!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.*,!=2.4.*,!=2.5.*,!=2.6.*,<3.
  • Depends on tfx-bsl>=1.5.0,<1.6.0.
  • Depends on tensorflow-metadata>=1.5.0,<1.6.0.

Breaking Changes

  • Removes register_metric from public API, as it is not intended to be public
    facing. To use a custom metric, provide the module name in which the
    metric is defined in the MetricConfig message, instead.

Deprecations

  • N/A
Loading

TensorFlow Model Analysis 0.35.0

02 Nov 18:54
@jay90099 jay90099
v0.35.0
5aede1b
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Verified
Learn about vigilant mode.
Compare
Choose a tag to compare
TensorFlow Model Analysis 0.35.0

Major Features and Improvements

  • Added support for specifying weighted vs unweighted metrics. The setting is
    available in the tfma.MetricsSpec( example_weights=tfma.ExampleWeightOptions(weighted=True, unweighted=True)).
    If no options are provided then TFMA will default to weighted provided the
    associated tfma.ModelSpec has an example weight key configured, otherwise
    unweighted will be used.

Bug fixes and other Changes

  • Added support for example_weights that are arrays.

  • Reads baseUrl in JupyterLab to support TFMA rendering:
    #112

  • Fixing couple of issues with CIDerivedMetricComputation:

    • no CI derived metric, deriving from private metrics such as
      binary_confusion_matrices, was being computed
    • convert_slice_metrics_to_proto method didn't have support for bounded
      values metrics.

  • Depends on tfx-bsl>=1.4.0,<1.5.0.

  • Depends on tensorflow-metadata>=1.4.0,<1.5.0.

  • Depends on apache-beam[gcp]>=2.33,<3.

Breaking Changes

  • Confidence intervals for scalar metrics are no longer stored in the
    MetricValue.bounded_value. Instead, the confidence interval for a metric
    can be found under MetricKeysAndValues.confidence_interval.
  • MetricKeys now require specifying whether they are weighted (
    tfma.metrics.MetricKey(..., example_weighted=True)) or unweighted (the
    default). If the weighting is unknown then example_weighted will be None.
    Any metric computed outside of a tfma.metrics.MetricConfig setting (i.e.
    metrics loaded from a saved model) will have the weighting set to None.
  • ExampleCount is now weighted based on tfma.MetricsSpec.example_weights
    settings. WeightedExampleCount has been deprecated (use ExampleCount
    instead). To get unweighted example counts (i.e. the previous implementation
    of ExampleCount), ExampleCount must now be added to a MetricsSpec
    where example_weights.unweighted is true. To get a weighted example count
    (i.e. what was previously WeightedExampleCount), ExampleCount must now
    be added to a MetricsSpec where example_weights.weighted is true.

Deprecations

  • Deprecated python3.6 support.
Loading

TensorFlow Model Analysis 0.34.1

20 Sep 17:03
@dhruvesh09 dhruvesh09
v0.34.1
901c3c7
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Verified
Learn about vigilant mode.
Compare
Choose a tag to compare
TensorFlow Model Analysis 0.34.1

Major Features and Improvements

  • N/A

Bug fixes and other Changes

  • Correctly skips non-numeric numpy array type metrics for confidence interval
    computations.
  • Depends on apache-beam[gcp]>=2.32,<3.
  • Depends on tfx-bsl>=1.3.0,<1.4.0.

Breaking Changes

  • In preparation for TFMA 1.0, the following imports have been moved (note
    that other modules were also moved, but TFMA only supports types that are
    explicitly declared inside of __init__.py files):
    • tfma.CombineFnWithModels -> tfma.utils.CombineFnWithModels
    • tfma.DoFnWithModels -> tfma.utils.DoFnWithModels
    • tfma.get_baseline_model_spec -> tfma.utils.get_baseline_model_spec
    • tfma.get_model_type -> tfma.utils.get_model_type
    • tfma.get_model_spec -> tfma.utils.get_model_spec
    • tfma.get_non_baseline_model_specs ->
      tfma.utils.get_non_baseline_model_specs
    • tfma.verify_eval_config -> tfma.utils.verify_eval_config
    • tfma.update_eval_config_with_defaults ->
      tfma.utils.update_eval_config_with_defaults
    • tfma.verify_and_update_eval_shared_models ->
      tfma.utils.verify_and_update_eval_shared_models
    • tfma.create_keys_key -> tfma.utils.create_keys_key
    • tfma.create_values_key -> tfma.utils.create_values_key
    • tfma.compound_key -> tfma.utils.compound_key
    • tfma.unique_key -> tfma.utils.unique_key

Deprecations

  • N/A
Loading

TensorFlow Model Analysis 0.34.0

30 Aug 20:40
@dhruvesh09 dhruvesh09
v0.34.0
970ac95
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Verified
Learn about vigilant mode.
Compare
Choose a tag to compare
TensorFlow Model Analysis 0.34.0

Major Features and Improvements

  • Added SparseTensorValue and RaggedTensorValue types for storing
    in-memory versions of sparse and ragged tensor values used in extracts.
    Tensor values used for features, etc should now be based on either
    np.ndarray, SparseTensorValue, or RaggedTensorValue and not
    tf.compat.v1 value types.
  • Add CIDerivedMetricComputation metric type.

Bug fixes and other Changes

  • Fixes bug when computing confidence intervals for
    binary_confusion_metrics.ConfusionMatrixAtThresholds (or any other
    structured metric).
  • Fixed bug where example_count post_export_metric is added even if
    include_default_metrics is False.
  • Depends on apache-beam[gcp]>=2.31,<2.32.
  • Depends on
    tensorflow>=1.15.2,!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.*,!=2.4.*,!=2.5.*,<3.
  • Depends on tfx-bsl>=1.3.1,<1.4.0.

Breaking Changes

  • N/A

Deprecations

  • N/A
Loading

TensorFlow Model Analysis 0.33.0

28 Jul 20:55
@dhruvesh09 dhruvesh09
v0.33.0
22b5a09
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Verified
Learn about vigilant mode.
Compare
Choose a tag to compare
TensorFlow Model Analysis 0.33.0

Major Features and Improvements

  • Provided functionality for slice_keys_sql config. It's not available under
    Windows.

Bug fixes and other Changes

  • Improve rendering of HTML stubs for TFMA and Fairness Indicators UI.
  • Update README for JupyterLab 3
  • Provide implementation of ExactMatch metric.
  • Jackknife CI method now works with cross-slice metrics.
  • Depends on apache-beam[gcp]>=2.31,<3.
  • Depends on tensorflow-metadata>=1.2.0,<1.3.0.
  • Depends on tfx-bsl>=1.2.0,<1.3.0.

Breaking Changes

  • The binary_confusion_matrices metric formerly returned confusion matrix
    counts (i.e number of {true,false} {positives,negatives}) and optionally a
    set of representative examples in a single object. Now, this metric class
    generates two separate metrics values when examples are configured: one
    containing just the counts, and the other just examples. This should only
    affect users who created a custom derived metric that used
    binary_confusion_matrices metric as an input.

Deprecations

  • N/A
Loading

TensorFlow Model Analysis 0.32.1

16 Jul 22:14
@dhruvesh09 dhruvesh09
v0.32.1
6b7e5e6
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Verified
Learn about vigilant mode.
Compare
Choose a tag to compare
TensorFlow Model Analysis 0.32.1

Major Features and Improvements

  • N/A

Bug fixes and other Changes

  • Depends on google-cloud-bigquery>=1.28.0,<2.21.
  • Depends on tfx-bsl>=1.1.1,<1.2.0.

Breaking Changes

  • N/A

Deprecations

  • N/A
Loading

TensorFlow Model Analysis 0.32.0

24 Jun 00:08
@dhruvesh09 dhruvesh09
v0.32.0
4ea7d16
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Verified
Learn about vigilant mode.
Compare
Choose a tag to compare
TensorFlow Model Analysis 0.32.0

Major Features and Improvements

  • N/A

Bug fixes and other Changes

  • Depends on protobuf>=3.13,<4.
  • Depends on tensorflow-metadata>=1.1.0,<1.2.0.
  • Depends on tfx-bsl>=1.1.0,<1.2.0.

Breaking Changes

  • N/A

Deprecations

  • N/A
Loading
0