Differential Validity Testing

From The Foundation for Best Practices in Machine Learning

Differential Validity Testing


If applicable, test Model(s) for differential validity. Evaluate whether Model performance varies meaningfully by (Sub)population, with a special focus on any groups that are underrepresented in modelling data.


To (a) ensure that the Model's predictive abilities aren't isolated in or concentrated to (Sub)population members; and (b) highlight associated risks that might occur in the Product Lifecycle.

Additional Information