Catastrophic Failures

From The Foundation for Best Practices in Machine Learning

Catastrophic Failures

Control

Document and assess the prevalence of predictions with High Confidence Values, but large Evaluation Errors. If apparent, improve Model to avoid these, and/or implement processes to mitigate these as much as is reasonably practical.


Aim

To (a) assess the propensity of the Model for catastrophic failures; and (b) highlight associated risks that might occur in the Product Lifecycle.


Additional Information