Axiomatic Characterisations of Sample-based Explainers

Overview

• This paper presents a formal framework for characterizing sample-based explainers, which are a type of interpretable machine learning approach.
• The authors define a set of axioms that capture desirable properties of sample-based explainers and use these to analyze and compare different explainer methods.
• They identify sub-families of explainers that satisfy different combinations of the axioms, providing a taxonomy for understanding the landscape of sample-based explainer approaches.

Plain English Explanation

Sample-based explainers are a type of machine learning interpretability technique that try to explain a model's predictions by showing examples of similar data points and how they were classified. This paper develops a formal mathematical framework to analyze and compare different sample-based explainer methods.

The authors define a set of desirable properties, or "axioms," that a good sample-based explainer should satisfy. These include things like the explainer should focus on the most relevant features of the data, should be consistent in how it explains similar predictions, and should be sensitive to changes in the underlying model.

Using these axioms, the researchers identify different sub-families of sample-based explainers that satisfy different combinations of the axioms. This provides a taxonomy to understand the landscape of sample-based explainer approaches and helps highlight their relative strengths and limitations.

For example, one sub-family of explainers might focus on finding the most representative examples, while another sub-family might prioritize finding the most contrastive examples that highlight how a prediction is different from other possible outputs. The axioms help clarify these distinctions.

By formalizing these concepts, the paper aims to provide a rigorous foundation for analyzing and developing better sample-based explainers, which can help make complex machine learning models more interpretable and trustworthy.

Technical Explanation

The paper introduces a formal framework for characterizing sample-based explainers, which are a class of interpretable machine learning methods that try to explain a model's predictions by showing examples of similar data points and how they were classified.

The authors define a set of axioms that capture desirable properties of sample-based explainers, including:

• Relevance: The explainer should focus on the most relevant features of the data
• Consistency: The explainer should explain similar predictions in a consistent way
• Sensitivity: The explainer should be sensitive to changes in the underlying model

Using these axioms, the researchers identify different sub-families of sample-based explainers, such as:

• Representative Explainers: Focus on finding the most representative examples
• Contrastive Explainers: Focus on finding the most contrastive examples that highlight differences from other possible outputs

The paper analyzes the relationships between these sub-families and the different axioms they satisfy. This provides a taxonomy for understanding the landscape of sample-based explainer approaches and their relative strengths and limitations.

Critical Analysis

The paper provides a valuable formal framework for analyzing and comparing sample-based explainers. The axioms proposed are generally well-motivated and capture important desirable properties for interpretable machine learning methods.

However, the authors acknowledge that the axioms do not form a complete characterization, and there may be other important properties that are not captured. Additionally, satisfying all the axioms simultaneously may not always be possible, and trade-offs between them may be necessary in practice.

The taxonomy of sub-families is useful, but it is not exhaustive, and other types of sample-based explainers may exist that don't fit neatly into the categories identified. There may also be ways to combine or hybridize different approaches to create new types of explainers that satisfy different subsets of the axioms.

Furthermore, the paper focuses solely on the theoretical properties of sample-based explainers, without empirical evaluation of how well different methods perform in practice. Ultimately, the usefulness of these explainers will depend on their ability to provide meaningful and actionable insights to users, which may require additional considerations beyond the formal axioms.

Conclusion

This paper lays the groundwork for a more rigorous and systematic understanding of sample-based explainers, a important class of interpretable machine learning methods. By defining a set of desirable axioms and using them to characterize different sub-families of explainers, the authors provide a valuable theoretical framework for analyzing and developing better sample-based explainers.

While not a complete characterization, this work represents an important step towards more principled and transparent interpretable machine learning. By formalizing the properties we want from these explainers, the paper helps establish a foundation for further research and practical applications that can make complex models more understandable and trustworthy.