What is the difference between SHAP and LIME?

SHAP (SHapley Additive exPlanations) is based on game theory and gives consistent, additive feature-importance values for both global model behaviour and individual predictions. LIME (Local Interpretable Model-agnostic Explanations) approximates the model locally around one prediction with a simpler, interpretable model. SHAP is generally more theoretically grounded and better for global explanations; LIME is faster and works with any model type for local explanations.

How do I install SHAP and LIME in Python?

Run pip install shap lime , then install the supporting libraries with pip install numpy pandas scikit-learn matplotlib seaborn 'xgboost<3' . Verify the install by importing both packages and printing shap.__version__ and importlib.metadata.version('lime') (lime does not expose a top-level __version__ ). Note that shap 0.49 is not yet compatible with xgboost 3.x, hence the version pin.

Which SHAP explainer should I use for my model?

Use shap.TreeExplainer for tree-based models (Random Forest, XGBoost), shap.LinearExplainer for linear models such as Logistic Regression, and shap.KernelExplainer as a model-agnostic fallback for anything else (e.g. neural networks) — it is by far the slowest of the three. In modern SHAP (0.42+), calling the explainer directly, e.g. explainer(X) , returns an Explanation object; for scikit-learn binary classifiers the values have shape (n_samples, n_features, n_classes) , so select the positive class with explanation[..., 1] .

Can I use LIME with any machine learning model?

Yes. LIME is model-agnostic — it only needs access to the model’s predict_proba (or predict ) method, so it works the same way whether the underlying model is a Random Forest, an SVM, or a neural network.

Introduction: Explainable AI with SHAP and LIME in Python

Q: Which SHAP explainer should I use for my model?

Use shap.TreeExplainer for tree-based models (Random Forest, XGBoost), shap.LinearExplainer for linear models such as Logistic Regression, and shap.KernelExplainer as a model-agnostic fallback for anything else (e.g. neural networks) — it is by far the slowest of the three. In modern SHAP (0.42+), calling the explainer directly, e.g. explainer(X) , returns an Explanation object; for scikit-learn binary classifiers the values have shape (n_samples, n_features, n_classes) , so select the positive class with explanation[..., 1] .

Q: Can I use LIME with any machine learning model?

Yes. LIME is model-agnostic — it only needs access to the model’s predict_proba (or predict ) method, so it works the same way whether the underlying model is a Random Forest, an SVM, or a neural network.

Black-box machine learning models can be difficult to trust and debug, especially in domains where decisions have significant consequences such as healthcare, finance, and criminal justice. A model that quietly denies someone a loan without anyone being able to say why is not just a technical problem — it is a governance problem.

Explainable AI (XAI) addresses this challenge by providing methods and tools to understand how AI models make decisions. Two of the most powerful and widely used libraries for model interpretability are SHAP (SHapley Additive exPlanations) and LIME (Local Interpretable Model-agnostic Explanations).

In this tutorial, I explore how to use SHAP and LIME in Python to make machine learning models transparent and interpretable. We will cover both global and local explanations, understand feature importance, and learn how to communicate model decisions effectively. Every code block below was executed and verified against shap 0.49.1, lime 0.2, scikit-learn 1.7.2, and xgboost 2.1.4 — worth mentioning because the SHAP API changed substantially around version 0.42, and a lot of older tutorials (including an earlier draft of this one) silently produce wrong results on current versions. I will point out those pitfalls as we go.

If you are new to the broader question of whether explainability is achievable at all, see my earlier post Explainable AI is possible for the conceptual groundwork this tutorial builds on.

Understanding Explainable AI

Why Explainability Matters

Explainable AI is crucial for several reasons:

Trust and Adoption: Users are more likely to trust and adopt AI systems they can understand
Regulatory Compliance: Many industries require explanations for AI decisions (the EU AI Act and GDPR’s provisions on automated decision-making being prominent examples)
Debugging and Improvement: Understanding model behaviour helps identify and fix issues, such as a model latching onto a leaky feature
Bias Detection: Explanations can reveal unfair biases in models before they reach production
Stakeholder Communication: Clear explanations help communicate with non-technical stakeholders

Types of Model Explanations

Global Explanations

Explain the overall behaviour of the model
Show which features are most important across all predictions
Help understand model behaviour at a high level

Local Explanations

Explain individual predictions
Show why a specific prediction was made
Help understand model behaviour for specific cases

SHAP covers both: aggregate its per-prediction values and you get a global view. LIME is local by design, though we will later see SubmodularPick, its attempt at a global summary.

Setting Up the Environment

Understanding SHAP (SHapley Additive exPlanations)

🔒 Subscribe to keep reading.

Understanding LIME (Local Interpretable Model-agnostic Explanations)

🔒 Subscribe to keep reading.

Advanced SHAP Analysis

🔒 Subscribe to keep reading.

Advanced LIME Analysis

🔒 Subscribe to keep reading.

Real-World Applications

🔒 Subscribe to keep reading.

Best Practices for Explainable AI

🔒 Subscribe to keep reading.

An Explainability Workflow

🔒 Subscribe to keep reading.

Are These Methods Actually Used in Production?

🔒 Subscribe to keep reading.

Conclusion: SHAP and LIME for Trustworthy Machine Learning

🔒 Subscribe to keep reading.

References

🔒 Subscribe to keep reading.

You've hit a Deep Dive tutorial.

I spend dozens of hours researching, coding, and breaking things to write these guides. This content is free, but reserved for my subscriber community. Drop your email below to unlock this guide (and all past/future deep dives):

Already a subscriber? Use the magic link from your last newsletter, or reset your password.

New subscribers get an inbox mail: Set a password to unlock articles. The form does not log you in — use the same email afterwards.

Explainable AI with Python: SHAP and LIME for Model Transparency

📚 This post is part of the "Applied ML & Model Engineering" series

Introduction: Explainable AI with SHAP and LIME in Python

Understanding Explainable AI

Why Explainability Matters

Types of Model Explanations

Global Explanations

Local Explanations

Setting Up the Environment

Understanding SHAP (SHapley Additive exPlanations)

Understanding LIME (Local Interpretable Model-agnostic Explanations)

Advanced SHAP Analysis

Advanced LIME Analysis

Real-World Applications

Best Practices for Explainable AI

An Explainability Workflow

Are These Methods Actually Used in Production?

Conclusion: SHAP and LIME for Trustworthy Machine Learning

References

References

Citation

Explainable AI with Python: SHAP and LIME for Model Transparency

📚 This post is part of the "Applied ML & Model Engineering" series

Introduction: Explainable AI with SHAP and LIME in Python

Understanding Explainable AI

Why Explainability Matters

Types of Model Explanations

Global Explanations

Local Explanations

Setting Up the Environment

Understanding SHAP (SHapley Additive exPlanations)

Understanding LIME (Local Interpretable Model-agnostic Explanations)

Advanced SHAP Analysis

Advanced LIME Analysis

Real-World Applications

Best Practices for Explainable AI

An Explainability Workflow

Are These Methods Actually Used in Production?

Conclusion: SHAP and LIME for Trustworthy Machine Learning

References

You're in

References

Citation