1 of 10

Taking control:

Policies to address extinction risks from advanced AI

Akash Wasil

akash@controlai.com

​

2 of 10

Motivation

3 of 10

Policy ideas

  1. MAGIC: Multinational AGI Consortium

​

  • Global compute caps

​

  • Emergency response capacity

4 of 10

MAGIC

5 of 10

Compute caps

6 of 10

Emergency response

7 of 10

Emergency Preparedness Unit

What should it do?

  • Risk monitoring (evals, communication with labs)
  • Emergency response plans (if X then Y)
  • Emergency powers (ability to implement Y)
  • Drills (if X happened, could we do Y)
  • Coordination with frontier labs
  • Protecting model weights
  • Recommendations to Congress + President

8 of 10

Emergency Preparedness Unit

Where should it be?

  • DHS?
  • Interagency?
    • DHS, DoC, USAISI, DoD, DoE intelligence agencies, …

9 of 10

Emergency Preparedness Unit

How can we make it happen?

  • Legislation
  • Executive order?
  • Existing powers?

10 of 10

Get involved

akash@controlai.com