- Add fairness indicator metrics in the third_party library.
- Update example model to use Keras models instead of estimators.
- N/A
- N/A
- Deprecated python 3.8 support
- N/A
- Depends on
tensorflow>=2.12.0,<2.13
. - Depends on
tensorflow-data-validation>=1.13.0,<1.14.0
. - Depends on
tensorflow-model-analysis>=0.44,<0.45
. - Depends on
protobuf>=3.20.3,<5
.
- N/A
- Deprecating python3.7 support.
- N/A
- Depends on
tensorflow>=2.11,<2.12
- Depends on
tensorflow-data-validation>=1.11.0,<1.12.0
. - Depends on
tensorflow-model-analysis>=0.42,<0.43
.
- N/A
- N/A
- This is the last version that supports TensorFlow 1.15.x. TF 1.15.x support will be removed in the next version. Please check the TF2 migration guide to migrate to TF2.
- N/A
- N/A
- N/A
- N/A
- Depends on
tensorflow-data-validation>=1.10.0,<1.11.0
. - Depends on
tensorflow-model-analysis>=0.41,<0.42
. - Depends on
tensorflow>=1.15.5,!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.*,!=2.4.*,!=2.5.*,!=2.6.*,!=2.7.*,!=2.8.*,!=2.9.*,<3
.
- N/A
- N/A
- Allow counterfactual metrics to be calculated from predictions instead of only features.
- Add precision and recall to the set of fairness indicators metrics.
- Depends on
tensorflow-data-validation>=1.9.0,<1.10.0
. - Depends on
tensorflow-model-analysis>=0.40,<0.41
. - Depends on
tensorflow>=1.15.5,!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.*,!=2.4.*,!=2.5.*,!=2.6.*,!=2.7.*,!=2.8.*,<3
.
- N/A
- N/A
- Allow counterfactual metrics to be calculated from predictions instead of only features.
- Add precision and recall to the set of fairness indicators metrics.
- Depends on
tensorflow-data-validation>=1.8.0,<1.9.0
. - Depends on
tensorflow-model-analysis>=0.39,<0.40
. - Depends on
tensorflow>=1.15.5,!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.*,!=2.4.*,!=2.5.*,!=2.6.*,!=2.7.*,<3
.
- N/A
- N/A
- N/A
- Depends on
tensorflow-data-validation>=1.7.0,<1.8.0
. - Depends on
tensorflow-model-analysis>=0.38,<0.39
. - Depends on
tensorflow>=1.15.5,!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.*,!=2.4.*,!=2.5.*,!=2.6.*,!=2.7.*,<3
.
- N/A
- N/A
- N/A
- Fix Fairness Indicators UI bug with overlapping charts when comparing EvalResults
- Depends on
tensorflow-data-validation>=1.6.0,<1.7.0
. - Depends on
tensorflow-model-analysis>=0.37,<0.38
. - Depends on
tensorflow>=1.15.5,!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.*,!=2.4.*,!=2.5.*,!=2.6.*,<3
.
- N/A
- N/A
- N/A
- Depends on
tensorflow-data-validation>=1.5.0,<1.6.0
. - Depends on
tensorflow-model-analysis>=0.36,<0.37
. - Depends on
tensorflow>=1.15.2,!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.*,!=2.4.*,!=2.5.*,!=2.6.*,<3
.
- N/A
- N/A
- N/A
- Depends on
tensorflow-data-validation>=1.4.0,<1.5.0
. - Depends on
tensorflow-model-analysis>=0.35,<0.36
.
- N/A
- Deprecating python 3.6 support.
- N/A
- Depends on
tensorflow>=1.15.2,!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.*,!=2.4.*,!=2.5.*,<3
. - Depends on
tensorflow-data-validation>=1.3.0,<1.4.0
. - Depends on
tensorflow-model-analysis>=0.34,<0.35
.
- Drop Py2 support.
- N/A
- Porting Counterfactual Fairness metrics into FI UI.
- Improve rendering of HTML stubs for Fairness Indicators UI
- Depends on
tensorflow>=1.15.2,!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.*,!=2.4.*,<3
. - Depends on
protobuf>=3.13,<4
. - Depends on
tensorflow-data-validation>=1.2.0,<1.3.0
. - Depends on
tensorflow-model-analysis>=0.33,<0.34
.
- N/A
- N/A
- N/A
- Depends on
tensorflow>=1.15.2,!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.*,!=2.5.*,<3
. - Depends on
tensorflow-data-validation>=0.30,<0.31
. - Depends on
tensorflow-model-analysis>=0.30,<0.31
.
- N/A
- N/A
- N/A
- Depends on
tensorflow-data-validation>=0.29,<0.30
. - Depends on
tensorflow-model-analysis>=0.29,<0.30
.
- N/A
- N/A
- In Fairness Indicators UI, sort metrics list to show common metrics first
- For lift, support negative values in bar chart.
- Adding two new metrics - Flip Count and Flip Rate to evaluate Counterfactual Fairness.
- Add Lift metrics under addons/fairness.
- Porting Lift metrics into FI UI.
- Depends on
tensorflow-data-validation>=0.28,<0.29
. - Depends on
tensorflow-model-analysis>=0.28,<0.29
.
- N/A
- N/A
- N/A
- Added test cases for DLVM testing.
- Move the util files to a seperate folder.
- Add
tensorflow-hub
as a dependency because it's used inside the example_model.py. - Depends on
tensorflow>=1.15.2,!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.*,<3
. - Depends on
tensorflow-data-validation>=0.27,<0.28
. - Depends on
tensorflow-model-analysis>=0.27,<0.28
.
- N/A
- N/A
- Sorting fairness metrics table rows to keep slices in order with slice drop down in the UI.
- Update fairness_indicators.documentation.examples.util to TensorFlow 2.0.
- Table now displays 3 decimal places instead of 2.
- Fix the bug that metric list won't refresh if the input eval result changed.
- Remove d3-tip dependency.
- Depends on
tensorflow>=1.15.2,!=2.0.*,!=2.1.*,!=2.2.*,!=2.4.*,<3
. - Depends on
tensorflow-data-validation>=0.26,<0.27
. - Depends on
tensorflow-model-analysis>=0.26,<0.27
.
- N/A
- N/A
-
Add workflow buttons to Fairness Indicators UI, providing tutorial on how to configure metrics and parameters, and how to interpret the results.
-
Add metric definitions as tooltips in the metric selector UI
-
Removing prefix from metric names in graph titles in UI.
-
From this release Fairness Indicators will also be hosting nightly packages on https://pypi-nightly.tensorflow.org. To install the nightly package use the following command:
pip install --extra-index-url https://pypi-nightly.tensorflow.org/simple fairness-indicators
Note: These nightly packages are unstable and breakages are likely to happen. The fix could often take a week or more depending on the complexity involved for the wheels to be available on the PyPI cloud service. You can always use the stable version of Fairness Indicators available on PyPI by running the command
pip install fairness-indicators
.
- Update table colors.
- Modify privacy note in Fairness Indicators UI.
- Depends on
tensorflow-data-validation>=0.25,<0.26
. - Depends on
tensorflow-model-analysis>=0.25,<0.26
.
- N/A
- N/A
- Made the Fairness Indicators UI thresholds drop down list sorted.
- Fix in the issue where the Sort menu is not hidden when there is no model comparison.
- Depends on
tensorflow-data-validation>=0.24,<0.25
. - Depends on
tensorflow-model-analysis>=0.24,<0.25
.
- N/A
- Deprecated Py3.5 support.
- N/A
- Fix broken import path in Fairness_Indicators_Example_Colab and Fairness_Indicators_on_TF_Hub_Text_Embeddings.
- N/A
- N/A
- N/A
- Depends on
tensorflow>=1.15.2,!=2.0.*,!=2.1.*,!=2.2.*,<3
. - Depends on
tensorflow-data-validation>=0.23,<0.24
. - Depends on
tensorflow-model-analysis>=0.23,<0.24
.
- N/A
- Deprecating Py2 support.
- Note: We plan to drop py3.5 support in the next release.