Feature Attribution

Feature Attribution

Control

Ensure that Product Subjects can understand why the Model made the decision it did, or how the Model output contributed to the decision. Ideally, an understanding would include which features were most important in the decision and give some guidance as to how the subject could improve in the eyes of the Model. (See Section 13 - Representativeness & Specification for further information.)

Aim

To (a) ensure that Product Subjects (i) have some level of trust/understanding in the Model that affect them and (ii) feel that they have agency over the process and that Model Outcomes are not arbitrary.