Continuous Delivery of Metrics: Model Performance

From The Foundation for Best Practices in Machine Learning
Technical Best Practices > Monitoring & Maintenance > Continuous Delivery of Metrics: Model Performance

Continuous Delivery of Metrics: Model Performance

Control

Continuously report on and record metrics about Model performance, predictions, errors, Features, and associated performance metrics to relevant Stakeholders (as decided upon in Section 13.2. - Representativeness & Specification Exploration and Section 13.3. - Representativeness & Specification Development).


Aim

To (a) enable rapid identification of Model decay, and/or red flags and bugs in Model and/or data pipelines; and (b) highlight associated risks that might occur in the Product Lifecycle.


Additional Information