What is AI Bias
Susama Agarwala
JHU APL
Why a seminar on data science?
What is data science?
What is AI?
In this course:
Algorithms that makes predictions/classifications based off a given data set.
Many algorithms not considered:
E.g.
Reinforcement learning algorithms
Human machine teaming algorithms
What is AI good for?
Protein Folding
Chess, Go and other games
Atari, Starcraft and other video games
Use cases
What is it bad for?
What is going on?
Simple example: Linear Regresssions
What is going on?
Good application
Bad application
Protein Folding
Atari, Starcraft and other video games
Chess, Go and other games
What happens if the training data is not i.i.d. distributed from the real world data?
What happens if key groups are under represented in the data?
What happens if there are differential error rates?
What happens if one fails to identify all the relevant subgroups?
What happens if a subpopulation has different characteristics?
Demo: CelebA dataset
15
24 January 2022
What makes a celebrity attractive?
16
24 January 2022
What ELSE makes a celebrity attractive?
17
24 January 2022
Is it really picking up annotator’s racial bias?
18
24 January 2022
This is a good example of what can happen when using this dataset to train a classifier: