Overview of Generative AI and LLMs
AI Safety & Catastrophic Risks
Debate over Open vs Closed Models| Concentration of (Tech) Power
The Applications| Benefits of Generative AI
Disinformation, Misinformation, Deepfakes and Adversarial Attacks
Bias, Discrimination and Inclusion
Generative Agents | Chat Bots
Governance, Oversight and Regulatory Debate
Authenticity, Watermarking and Detection
Politics, Election and AI
AI and the Law
Trends to Watch in 2024 & 2023 Recap
Overview of Generative AI and LLMs
- From Einstein to AI: how 100 years have shaped science by Nature’s editorial, December 2023.
- Generative AI exists because of the transformer via FT by Madhumita Murgia, September 2023.
- Intro to Large Language Models video lecture by Andrej Karpathy, November 2023.
- What is generative AI and how does it work? – The Turing Lectures with Mirella Lapata, October 2023.
- Explainer: What is a foundation model? | Ada Lovelace Institute by Elliot Jones, July 2023.
- Year in a word: LLM via FT by Madhumita Murgia, December 2023.
- Oxford Internet Institute, University of Oxford—written evidence (LLM0074) prepared in response to the UK Parliament’s Call for Evidence on Large Language Models, October 2023.
AI Safety & Catastrophic Risks
- AI and Catastrophic Risk | Journal of Democracy by Yoshua Bengio, September 2023.
- Fears about AI’s existential risk are overdone, says a group of experts, July 2023.
- Hendrycks, Dan, Mantas Mazeika, and Thomas Woodside. "An Overview of Catastrophic AI Risks," June 2023.
- AI Death or Dud? by Nina Schick, September 2023.
- AI risk must be treated as seriously as climate crisis, says Google DeepMind chief | Technology | The Guardian, October, 2023.
- Can We Manage the Risks of General-Purpose AI Systems? | TechPolicy.Press, December 2023.
- The techno-optimists and doomsdayers inside Silicon Valley's most dangerous AI debate, CNBC, December 2023.
- The Turing Lectures: Addressing the risks of generative AI by Lydia France, November 2023.
- AI safety on whose terms? | Science by Seth Lazar and Alondra Nelson, July 2023.
- Introduction to Generative AI — Integrity Institute. Alice Hunsberger talks with Numa Dhamani and Maggie Engler, who recently co-authored a book about the power and limitations of AI tools and their impact on society, the economy, and the law, December 2023.
- Taxonomy of Risks posed by Language Models by Weidinger, Laura, et al, proceedings of the 2022 ACM conference on Fairness, Accountability, and Transparency, 2022.
Debate over Open vs Closed Models| Concentration of (Tech) Power
- Issue Brief Considerations for Governing Open Foundation Models | Stanford HAI by Rishi Bommasani, Sayash Kapoor, Kevin Klyman, Shayne Longpre, Ashwin Ramaswami, Daniel Zhang, Marietje Schaake, Daniel E. Ho, Arvind Narayanan, Percy Liang, December 2023.
- How to Promote Responsible Open Foundation Models. Experts from industry, academia, and government share lessons learned and outline a path forward at a Princeton-Stanford workshop, October 2023.
- Workshop on Responsible and Open Foundation Models organized by Stanford and Princeton Universities, September 2023.
- Developing LLMs: Open, closed, or democratic? The Retort podcast, October 2023.
- Why open-source LLMs matter by Vikram Sreekanti and Joseph E. Gonzalez, October 2023.
- Open (For Business): Big Tech, Concentrated Power, and the Political Economy of Open AI by Widder, David Gray, Sarah West, and Meredith Whittaker, August 2023.
- Twitter thread
- What does a leaked Google memo reveal about the future of AI? via the Economist, May 2023.
- Are Open AI Models Safe? by Dr. Irving Wladawsky-Berger via the Linux Foundation, June 2023.
- ChatGPT And More: Large Scale AI Models Entrench Big Tech Power - AI Now Institute by AI Now Institute, August 2023.
- How to Regulate Unsecured “Open-Source” AI: No Exemptions via TechPress by David Evan Harris, December 2023.
- The real story of the OpenAI debacle is the tyranny of big tech | The Guardian by Courtney Radsch, November 2023.
- Introducing the AI Alliance, December 2023.
- The LLM Battle: Open Source vs. Big Tech - Who Will Triumph? by Soonwook Hwang, July 2023.
- Open source large language models: Benefits, risks and types - IBM Blog, September 2023.
- Open Source Liability is Coming | Developers Alliance, December 2023.
- The Myth of ‘Open Source’ AI | WIRED, August 2023.
- It’s Time to Fight for Open Source Again by Daniel Jeffries, October 2023.
The Applications| Benefits of Generative AI
- Overview
- Generative AI: What is it good for? The strengths and weaknesses behind the hype via the Economist, May 2023.
- AI and Everything Else. Benedict Evans’s annual big presentation exploring macro and strategic trends in the tech industry, focusing on AI.
- Unbundling AI--ChatGPT and LLMs can do anything (or look like they can), so what can you do with them? by Benedict Evans, October 2023.
- Online Nation 2023 Report - Ofcom, page 31 for the use of Generative artificial intelligence, November, 2023.
- Trust and Safety & Content Moderation
- Unleashing the Potential of Generative AI in Integrity, Trust & Safety Work: Opportunities, Challenges, and Solutions by Alex Rosenblatt, Swapneel Mehta, Laila Wahedi, Talha Baig, and Sandeep Abraham, June 2023.
- OpenAI says AI tools can be effective in content moderation | Reuters, August 2023.
- “Social Media's New Referees?: Public Attitudes Toward AI Content Moderation Bots Across Three Countries” by John Wihbey, December 2023.
- How Generative AI Makes Content Moderation Both Harder and Easier by Integrity Institute, November, 2023.
- Economics
- How genAI is revolutionizing the field of economics by Bryan Mena and Samantha Delouya, CNN, October, 2023.
- Higher Education
- Five Ways Higher Education Can Leverage Generative AI by Boston Consulting Group, July 2023.
- Education in the Era of Generative Artificial Intelligence (AI): Understanding the Potential Benefits of ChatGPT in Promoting Teaching and Learning by David Baidoo-Anu and Leticia Owusa Ansah, 2023.
- Health Care
- GenAI Could Transform How Health Care Works, Harvard Business Review by Ron Adner and Dr. James N. Weinstein, November 2023.
- Can GenAI Help Make Health Care Affordable? Consumers Think So | Deloitte US by Asif Dhar, M.D., US Life Sciences & Health Care leader, Deloitte Consulting LLP, Bill Fera, M.D., principal, Deloitte Consulting LLP, and Leslie Korenda, MPH, research manager, November 2023.
- Questioning the hype
- One Year In, ChatGPT’s Legacy Is Clear via the Atlantic by Charlie Warzel, November 2023.
Disinformation, Misinformation, Deepfakes and Adversarial Attacks
- Generative Language Models and Automated Influence Operations: Emerging Threats and Potential Mitigations by Josh A. Goldstein, Girish Sastry, Micah Musser, Renee DiResta, Matthew Gentzel, Katerina Sedova, January 2023.
- The Coming Age of AI-Powered Propaganda | Foreign Affairs by Josh A. Goldstein and Girish Sastry, April 2023.
- How AI-generated content could both fuel disinformation and improve fact-checking - Poynter by Borja Lozano and Irene Larraz, April 2023.
- ChatGPT 'hallucinates.' Some researchers worry it isn't fixable by Gerrit De Vynck, May 2023.
- This Disinformation Is Just for You by Thor Benson via Wired, August 2023.
- Adversarial Attacks on LLMs | Lil'Log by Lilian Weng, October 2023.
- Misinformation reloaded? Fears about the impact of generative AI on misinformation are overblown via Misinformation Review by Felix Simon (Oxford), Sacha Altay (University of Zurich), and Hugo Mercier (CNRS), October 2023.
- Research can help to tackle AI-generated disinformation by Stefan Feuerriegel, Renée DiResta, Josh A. Goldstein, Srijan Kumar, Philipp Lorenz-Spreen, Michael Tomz & Nicolas Pröllochs, Nat Hum Behav 7, November 2023.
- How AI will turbocharge misinformation — and what we can do about it by Ina Fried, July 2023.
- The LLaMA is out of the bag. Should we expect a tidal wave of disinformation? | Knight First Amendment Institute by Arvind Narayanan & Sayash Kapoor, March 2023.
- ChatGPT and other generative AI could foster science denial and misunderstanding – here’s how you can be on alert by the Conversation, May 2023.
- Deepfakes, Synthetic Media and Generative AI--WITNESS’s rich work on the topic of synthetic media.
- How Online Mobs Act Like Flocks of Birds by Renée DiResta via Noema, November 2022.
- How generative AI is boosting the spread of disinformation and propaganda | MIT Technology Review by Tate Ryan-Mosleyarchive, October 2023.
- The making of an AI news anchor—and its implications | PNAS by Matyas Bohacek and Hany Farid, December 2023.
- What can psychology teach us about AI’s bias and misinformation problem? | Berkeley, Jason Pohl, June 2023.
- AI Images Detectors Are Being Used to Discredit the Real Horrors of War by Emanuel Maiberg, October 2023.
- People Are Disinformation’s Biggest Problem, Not AI, Experts Say via Bloomberg by Nate Lanxon and Jackie Davalos, October 2023.
- Slovakia’s Election Deepfakes Show AI Is a Danger to Democracy | WIRED, October 2023.
- Will AI-generated images create a new crisis for fact-checkers? Experts are not so sure | Reuters Institute for the Study of Journalism, April 2023.
- Artificial Intelligence in Automated Detection of Disinformation: A Thematic Analysis by Fátima C. and Carrilho Santos, May 2023.
- Attacking ChatGPT with Standard Program Attacks | by Daniel Kang | Medium, February 2023.
- AI porn is easy to make now. For women, that’s a nightmare via Washington Post by Tatum Hunter, February 2023.
- AI’s Content Moderation Moment is Here via TechPolicy Press by Maximilian Gahntz, October 2023.
Bias, Discrimination and Inclusion
- What Do We Do About the Biases in AI? by James Manyika, Jake Silberg, and Brittany Presten, October 2019.
- Why AI’s diversity crisis matters, and how to tackle it by Rachel Crowell, May 2023.
- These Women Tried to Warn Us About AI by Lorena O'Neil, August 2023.
- More human than human: measuring ChatGPT political bias | Public Choice, by Fabio Motoki, Valdemar Pinho Neto and Victor Rodrigues, August 2023.
- Does ChatGPT have a liberal bias?, by Arvind Narayanan and Sayash Kapoor pushing back against Fabio Motoki, Valdemar Pinho Neto and Victor Rodrigues earlier findings on ChatGPT’s political bias, August 2023.
- AI language models are rife with different political biases by Melissa Heikkilä,
August 2023.
- Analyzing Gender Diversity in ChatGPT-3 Training Data by Jessica Kuntz and Dr. Elise Silva, October 2023.
- How AI reduces the world to stereotypes by Victoria Turk via Rest of the World, October 2023.
Generative Agents | Chat Bots
- Ethics for Generative Agents — Normative Philosophy of Computing by Seth Lazar, February 2023.
- It’s Not a Computer, It’s a Companion! | Andreessen Horowitz by Justine Moore, Bryan Kim, Yoko Li, and Martin Casado, June 2023.
- Human-Computer Interaction in Customer Service: The Experience with AI Chatbots—A Systematic Literature Review by Nicolescu, Luminița, and Monica Teodora Tudorache, 2022.
- The return of the chatbots | Natural Language Engineering | Cambridge Core
- A Complete Guide To Chatbots, 2016.
- Why people use chatbots by Petter Bae Brandtzaeg and Asbjørn Følstad, 2017.
- Weizenbaum’s nightmares: how the inventor of the first chatbot turned against AI | Artificial intelligence (AI) | The Guardian by Ben Tarnoff, July 2023.
- Why Chayn took down its chatbot in 2020 and what we’ve learned about building culturally-aware chatbots since | by Hera Hussain, June 2023.
- Chatbots will change how we use the internet via the Economist, March 2023.
- What do AI chatbots really mean for students and cheating? | Stanford Graduate School of Education, October 2023.
- The Perils of Artificial Romance by Pritam Bordoloi, July 2023.
- Generative Agents: Interactive Simulacra of Human Behavior by Joon Sung Park, Joseph C. O'Brien, Carrie J. Cai, Meredith Ringel Morris, Percy Liang, Michael S. Bernstein, August 2023.
- Effectiveness of a chatbot for eating disorders prevention: A randomized clinical trial, Fitzsimmons‐Craft, Ellen E., et al, 2022.
- A Survey of Conversational Agents and Their Applications for Self-Management of Chronic Conditions - PMC by Park, Min Sook, et al, June 2023.
- The Implications of ChatGPT for Legal Services and Society by Andrew Perlman, Harvard Law School, Center on the Legal Profession, March 2023.
- Chatbots for embarrassing and stigmatizing conditions: could chatbots encourage users to seek medical advice? by Branley-Bell, Dawn, et al, September 2023.
- AI Chatbots and Our Loneliness Epidemic - by Rex Woodbury, May 2023.
- Could AI-powered Robot “Companions” Combat Human Loneliness? | Duke Today by Murali Doraiswamy, July 2023.
- Enhancing social connectedness with companion robots using AI by Broadbent, Elizabeth, et al, July 2023.
- A New Kind of AI Copy Can Fully Replicate Famous People. The Law Is Powerless. - POLITICO by Mohar Chatterjee, December 2023.
- Agents, Agents, Everywhere, All At Once by Daniel Jeffries, October 2023.
Governance, Oversight and Regulatory Debate
- International Institutions
- ChatGPT - the impact of Large Language Models on Law Enforcement | Europol, March 2023.
- Artificial Intelligence: UNESCO calls on all Governments to implement Global Ethical Framework without delay, March 2023.
- Expert Forum on AI Foresight and Generative AI - OECD.AI, April 2023.
- High-Level Advisory Body on Artificial Intelligence | Office of the Secretary-General's Envoy on Technology, 2023.
- EU & AI Act
- Artificial Intelligence Act: deal on comprehensive rules for trustworthy AI | News | European Parliament, December 2023.
- Draft with all three versions of the EU AI Act in parallel columns, June 2023.
- European Parliament Version, June 14, 2023, June 2023.
- Artificial intelligence act, Council’s General Approach, November 2022.
- Artificial intelligence act, Commission proposal, April 2023.
- EU AI Act: Everything in One Place--David E Harris’s living resource for researchers and journalists trying to find all the info about the EU Act.
- Civil society urges the European Parliament to protect people's rights in the AI Act, April 2023.
- AI Act: a step closer to the first rules on Artificial Intelligence | News | European Parliament, May 2023.
- E.U. Agrees on AI Act, Landmark Regulation for Artificial Intelligence - The New York Times, December 2023.
- US Government & President Biden’s Executive Order
- AI in Gov't Memo: Human-Readable Edition (view-only)by David E Harris.
- Sam Altman's Testimony Chief Before the U.S. Senate Committee on the Judiciary Subcommittee on Privacy, Technology, & the Law, May 2023.
- Blueprint for an AI Bill of Rights | OSTP | The White House.
- G7 Hiroshima Leaders’ Communiqué | The White House, May 2023.
- AI EO: Human-Readable Edition (view only)by David E Harris.
- UK
- A pro-innovation approach to AI regulation - GOV.UK, August 2023.
- Oversight & Governance Tools from Non-Profits
- PAI's Responsible Practices for Synthetic Media A Framework for Collective Action, February 2023.
- Deepfakes and Synthetic Media: Updated Survey of Solutions against Malicious Usages - WITNESS Blog, 2019.
- Commentary from Academics, Scientists and Civil Society
- Policy makers: Please don’t fall for the distractions of #AIhype | by Emily M. Bender | Medium, March 2023.
- ChatGPT and the AI Act | Internet Policy Review by Natali Helberger and Nicholas Diakopoulos, February 2023.
- AI Desperately Needs Global Oversight | WIRED by Rumman Chowdhury, April 2023.
- Joint statement: EU legislators must close dangerous loophole in AI Act - Access Now, September 2023.
- Regulating Transparency in Audiovisual Generative AI: How Legislators Can Center Human Rights by Raquel Vazquez Llorente via Tech Policy Press, October 2023.
- A Letter to the EU’s Future AI Office by Hadrien Pouget and Johann Laux, Carnegie Endowment for International Peace, October 2023.
- The AI Act and General Purpose AI - AlgorithmWatch, October 2023.
- White House AI Executive Order Takes On Complexity of Content Integrity Issues | TechPolicy.Press by Renée DiResta and Dave Willner, November 2023.
- Analysis form Think-Tanks
- The EU and U.S. diverge on AI regulation: A transatlantic comparison and steps to alignment, April 2023.
- The Biden Administration’s Executive Order on Artificial Intelligence, October 2023.
- The UK AI Safety Summit Opened a New Chapter in AI Diplomacy - Carnegie Endowment for International Peace by Tino Cuellar, November 2023.
- Schumer Insight Forum: What the U.S. Can Learn From China About Regulating AI by Carnegie fellow Matt Sheehan, September 2023.
- Evaluating Europe's push to enact AI regulations: how will this influence global norms? by Steven Feldstein, 2022.
- On the Role of the Global South
- The Global South’s missing voice in AI – POLITICO by Marc Scott, August 2023.
Authenticity, Watermarking and Detection
- Watermarking ChatGPT, DALL-E and other generative AIs could help protect against fraud and misinformation by Hany Farid, March 2023.
- ‘Authentic’ Is 2023’s Word of the Year. You Read That Right | WIRED by Angela Watercutter, December 2023.
- Why watermarking AI-generated content won’t guarantee trust online | MIT Technology Review by Claire Leibowicz, August 2023.
- Why detecting AI-generated text is so difficult (and what to do about it) | MIT Technology Review by Melissa Heikkilä.
- How Easy Is It to Fool A.I.-Detection Tools? - The New York Times, 2023.
- Watermarks aren’t the silver bullet for AI misinformation - The Verge by Makena Kelly, October 2023.
- Watermarking & generative AI: what, how, why (and why not), Access Now by Gustaf Björksten and Daniel Leufer, September 2023.
- Content Authenticity Initiative.
Politics, Election and AI
- AI’s Powers of Political Persuasion, Stanford, February 2023.
- How AI is Rewriting Political Advertising | American Enterprise Institute - AEI by Shane Tews, November 2023.
- A policy framework to govern the use of generative AI in political ads | Brookings by Matt Perault and J. Scott Babwah Brennen, December 2023.
- The new political ad machine: Policy frameworks for political ads in an age of AI by Matt Perault and J. Scott Babwah Brennen, December 2023.
- What You Need to Know About Generative AI's Emerging Role in Political Campaigns by Tom Di Fonzo, October 2023.
- 6 ways AI can make political campaigns more deceptive than ever via the Conversation by David E. Clementson, July 2023.
- Is Argentina the First A.I. Election? - The New York Times, November 2023.
- PolitiFact | How generative AI could help foreign adversaries influence U.S. elections, December 2023.
- AI can strengthen U.S. democracy—and weaken it | Brookings by Norman Eisen, Nicol Turner Lee, Colby Galliher, and Jonathan Katz, November 2023.
- ACLU warns of free-speech risks in FEC oversight of AI-generated election ads - Nextgov/FCW by Alexandra Kelley and Jessie Bur, November 2023.
- The Repressive Power of Artificial Intelligence | Freedom House by Allie Funk, Adrian Shahbaz, and Kian Vesteinsson.
AI and the Law
- Artificial Intelligence and the Law - Cover Story - Stanford Lawyer Magazine, December 2023.
- The lawsuit against Microsoft, GitHub and OpenAI that could change the rules of AI copyright - The Verge by James Vincent, November 2022.
- Artificial intelligence, free speech, and the First Amendment | The Foundation for Individual Rights and Expression, 2023.
- Meet the Lawyer Leading the Human Resistance Against AI | WIRED, November 2023.
- ChatGPT Has a Big Privacy Problem | WIRED by Matt Burgess, April 2023.
- Speech in the Machine: Generative AI's Implications for Free Expression by Summer Lopez, Nadine Farid Johnson, and Liz Woolery, July 2023.
- The NY Times Lawsuit Against OpenAI Would Open Up The NY Times To All Sorts Of Lawsuits Should It Win | Techdirt by Mike Masnick, December 2023.
- Ten Legal and Business Risks of Chatbots and Generative AI | TechPolicy.Press by Matthew F. Ferraro, Natalie Li, Haixia Lin, and Louis W. Tompros.
Trends to Watch in 2024 & 2023 Recap
- What to Expect in AI in 2024 from Stanford HAI.
- 13 Biggest AI Stories of 2023- Stanford HAI.
- AI News in 2023: a look back - Last Week in AI, December 2023.
This living document is a curated list of academic writings and commentaries that explore key integrity and policy topics in Generative Artificial Intelligence (GenAI) prepared by Sarah Shirazyan. For questions, reach out to shirazy@stanford.edu.