1 of 18

Race & the “New Jim Code”

Fall 2024

2 of 18

Quiz: Race, Technology, and AI

  • Why is it important to pay attention to race when studying the direction and impact of technological development?
  • Name 1-2 examples / arguments that Ruha Benjamin uses to demonstrate how technologies can perpetuate racial bias?

3 of 18

Why study race and technology?

Your thoughts here…

4 of 18

Critical Race Theory

  • Came out of legal studies
  • Centrality of race and racism in society – people from a dominant group ascribe a racial identity to others the purpose of continued domination and social exclusion (race as a technology).
  • Racism at multiple levels – not only individual, but also institutional and structural
  • Cumulative impact + permanence

5 of 18

Derrick Bell (1930 - 2011)

Harvard Law, NYU Law, U of Oregon Law

  • First tenured African American professors of Law (at Harvard) in 1971
  • One of the originators of critical race theory
  • Fought for tenure for women faculty and faculty of color at Harvard and elsewhere

“Beyond the ebb and flow of racial progress lies the still viable and widely accepted (though seldom expressed) belief that America is a white country in which blacks, particularly as a group, are not entitled to the concern, resources, or even empathy that would be extended to similarly situated whites.”

Derrick Bell

6 of 18

Kimberlé Crenshaw: Columbia Law School

“Crenshaw’s work has been foundational in critical race theory and in intersectionality, a term she coined to describe the double bind of simultaneous racial and gender prejudice.”

  • Very active public intellectual
  • Recent OpEd in the NYTimes about the systems that enabled R. Kelly to get away with abusing Black women and girls for decades

https://www.law.columbia.edu/faculty/kimberle-w-crenshaw

7 of 18

Nikole Hannah-Jones & the 1619 Project

“The 1619 Project is an ongoing initiative from The New York Times Magazine that began in August 2019, the 400th anniversary of the beginning of American slavery. It aims to reframe the country’s history by placing the consequences of slavery and the contributions of black Americans at the very center of our national narrative.”

https://pulitzercenter.org/lesson-plan-grouping/1619-project-curriculum

8 of 18

The New Jim Code (Benjamin)

Big idea: race and racialization are perpetuated in technological infrastructures in ways that are potentially more hidden (making them potentially more dangerous).

“the employment of new technologies that reflect and reproduce existing inequities but are promoted and perceived as more objective or progressive than the discriminatory systems of a previous era” (p. 5)

9 of 18

Race After Technology: Other Big Ideas

  • Unlike other systems (e.g., banking, real estate, etc.) which are subject to strict government oversight, tech seems to get a pass.
  • Increasingly, “private industry choices are in fact public policy decisions.” (p. 12)

10 of 18

Safiya Noble

Associate Professor in Information Studies at UCLA, with appointments in African American Studies and Gender Studies.

Researches the design of digital media platforms on the internet and their impact on society.

Interrogates the biases and value judgements that are baked into platforms, and how they function.

11 of 18

12 of 18

Black COVID patients were three times as likely to have a significant discrepancy between pulse oximeter and ABG readings. Twelve percent of the time, when Black patients had a pulse oximeter reading in the “safe range”—92% to 96%—their actual saturation on an ABG test was below 88%. In white patients, this discrepancy occurred 4% of the time. Further research bolstered their findings, showing that inaccurate pulse oximeters were linked to delayed or lack of treatment for Black patients with severe COVID.

13 of 18

“Facial Recognition Led to Wrongful Arrests. So Detroit Is Making Changes.”

“Robert Williams sued the city of Detroit after being wrongly identified by facial recognition technology and arrested for a crime he didn’t commit. His suit has led the police to change their practices.”

14 of 18

1-2. Benjamin: Diversifying Tech

Consider the following:

  • Does a racist technology require racists?
  • Will increasing the number of BIPOC (black, indigenous, people of color) engineers and computer scientists solve the problem of racist technology?

How would Ruha Benjamin answer this question? How would YOU answer this question?

15 of 18

3-4. Benjamin: The Idea of Intent

A couple of weeks ago, we learned that Kant would judge an action by the intent, while a utilitarian like Bentham or Mill would judge it on its outcome.

How does Ruja Benjamin talk about intent in the context of computing systems that perpetuate a racist system (e.g. pp. 61-63)?

If a racist outcome is an unintended consequence of an action, then what should happen, according to Benjamin?

16 of 18

5-6. Benjamin: Race & Markets

Ruja Benjamin examines many different ways in which ideas around race, diversity, and social categories show up in markets.

What are some examples of this?

What does Benjamin mean when she says that companies both value and devalue blackness at the same time?

17 of 18

7-8. Benjamin: Can AI be anti-racist?

Benjamin cites many examples of systems – powered by machine learning algorithms (ML) – that perpetuate racism.

What about ML systems perpetuates racism?

Can you think of any current or potential ways that ML applications might ameliorate the issues raised?

Do ML systems have the power to instantiate a more �principled, more just society?

18 of 18

Homework 1

  • Due before class on Thursday
  • You will be presenting your topic on Thursday during class
  • Any questions about it?