Go to Data > Create Filter View to filter by confidence or funding level locally. No one else will see your changes

Funding_Needed

Zvi Mowshowitz writes a lot of words, really quite a lot.

Summits to discuss AI respecting civil liberties and not using psychological manipulation or eroding autonomy.

Model Evaluation and Threat Research (METR)

Beth Barnes, Emma Abele, Chris Painter, Kit Harris

Groundwork starting with studies to allow repeal of the Jones Act

Making YouTube videos about AI safety, starring Rob Miles

Facilitation of the AI scenario planning game Intelligence Rising.

Caroline Jeanmaire

Cybersecurity Lab at University of Louisville

Allow Roman Yampolskiy to continue his research and pursue a PhD

Roman Yampolskiy

Learning by doing, participants work on a concrete project in the field

Remmelt Ellen and Linda Linsefors

Paying academics small stipends to move into AI safety work

Peter Salib (psalib @ central.uh.edu), Yonathan Arbel (yarbel @ law.ua.edu) and Kevin Frazier (kfrazier2 @ stu.edu).

Get the word out and also organize conferences

Mathematical Metaphysics Institute

Searching for a mathematical basis for metaethics.

AI enabled biorisks, among other things.

AI safety community building and research in South Africa

Leo Hyams and Benjamin Sturgeon

Incubation of AI safety organizations

AI forecasting research projects, governance research projects, and policy engagement, in that order.

Daniel Kokotajlo, with Eli Lifland

Effective Institutions Project (EIP)

AI governance, advisory and research, finding how to change decision points

Artificial Intelligence Policy Institute (AIPI)

AI capabilities demonstrations to inform decision makers

Foundation for American Innovation (FAI)

Tech policy research, thought leadership, educational outreach to government

Lobbying Congress to adapt mandatory AI safety standards

Jason Green-Lowe

AI governance standards and policy.

Caroline Jeanmaire

Specifications for good AI safety, also directly impacting EU AI policy

Mechanistic interpretability of how inference breaks down

Paul Riechers and Adam Shai

Brendan Fong and David Spivak.

Two people doing research at MIRI, in particular Sam Eisenstat

ALTER (Affiliate Learning-Theoretic Employment and Resources) Project

This research agenda, with this status update, examining intelligence

MSEP Project at Science and Technology Futures (Their Website)

Eric Drexler, of course

Small grants to individuals to help them develop their talent

A series of sociotechnical reports on key AI scenarios, governance recommendations and conducting AI awareness efforts.

David Kristoffersson

Accelerating the writing of AI safety standards

Ariel Gil and Jonathan Happel

Fynn Heide and Conor McGurk

Get the word out and also organize conferences

Simons Institute for Longterm Governance

Foundations and demand for international cooperation on AI governance and differential tech development

Konrad Seifert and Maxime Stauffer

Alignment in Complex Systems Research Group

AI alignment research on hierarchical agents and multi-system interactions

Scanning DNA synthesis for potential hazards

Kevin Esvelt, Andrew Yao and Raphael Egger

Increasing capability to respond to future pandemics, Next-gen PPE, Far-UVC.

Regranters to AI safety, existential risk, EA meta projects, creative mechanisms

Austin Chen (austin at manifund.org).

Spinoff of LTFF, grants for AI safety projects

Fellowships for Drexlerian functional nanomachines, 3 - High-throughput tools and discovering new superconductors

Benjamin Reinhardt

Fellowships to other organizations, such as Future Society, Safer AI and FLI.

Cillian Crosson (same as Tarbell for now but she plans to focus on Tarbell)

X-risk residencies, workshops, coworking in Prague, fiscal sponsorships

Conferences and advice on x-risk for those giving >$1 million per year

Legal Advocacy for Safe Science and Technology

Legal team for lawsuits on catastrophic risk and to defend whistleblowers.

Esben Kran, Jason Schreiber

Game theory for cooperation by autonomous AI agents

Carbon Copies for Independent Minds

Allison Duettmann

Centre for Enabling Effective Altruism Learning & Research (CEELAR)

The Athena Hotel aka The EA Hotel as catered host for EAs in UK

Incubation, fellowship and training in India for technical AI safety

Sebastian Schmidt

Journalism fellowships for oversight of AI companies.

Cillian Crosson (same as Talos Network for now but she plans to focus here)

Various field building activities in AI safety

New AI safety org in Paris, discourse, R&D collaborations, talent pipeline

Charbel-Raphael Segerie, Florent Berthet

Stanford Existential Risk Initiative (SERI)

Recruitment for existential risk causes

Steve Luby and Paul Edwards

Rationality community infrastructure, LessWrong, AF and Lighthaven.

Oliver Habryka, Raymond Arnold, Ben Pace

Center for AI Safety and the CAIS Action Fund

AI research, field building and advocacy

At this point, primarily AI policy advocacy, plus some research

Malo Bourgon, Eliezer Yudkowsky

Alignment Research Center (ARC)

Theoretically motivated alignment work

Evaluations, especially versus deception, some interpretability and governance.

Marius Hobbhahn

Collaborations for tools to increase civilizational robustness to catastrophes

Colby Thompson

Give out grants based on recommenders, primarily to 501c(3) organizations

Andrew Critch and Jaan Tallinn

Institute for AI Policy and Strategy (IAPS)

Papers and projects for ‘serious’ government circles, meetings with same.

UK Policy Think Tank focusing on ‘extreme AI risk and biorisk policy.’

Interpretability and other alignment research, incubator, hits based approach

Feeding people with resilient foods after a potential nuclear war

David Denkenberger

Researcher mentorship for those new to AI safety.

Ryan Kidd and Christian Smith.

Interpretability, tools for AI control, and so forth. New org.

Jacob Steinhardt, Sarah Schwettmann

German Primate Center (DPZ) – Leibniz Institute for Primate Research

Creating primates from cultured edited stem cells

Sergiy Velychko and Rudiger Behr

Grants of 4-6 figures mostly to individuals, mostly for AI existential risk

Caleb Parikh (among other fund managers)

Principles of Intelligent Behavior in Biological and Social Systems (PIBBSS)

Fellowships and affiliate programs for new alignment researchers

Nora Ammann, Lucas Teixeira and Dusan D. Nesic