Unit 10: Bias Detection, Testing & Mitigation for Devs
Bias testing = checking whether the model treats groups differently.
π Top Metrics:
Demographic Parity β Are outcomes evenly distributed?
Equal Opportunity β Are success rates consistent?
Predictive Parity β Are precision/recall balanced?Disparate Impact β Legal red flag if ratio < 0.8
π§ͺ Tools of the Trade:
IBM AI Fairness 360
Fairlearn (Python)
What-If Tool (Google)
Amazon SageMaker Clarify