Open Call for Advisees and Collaborators, September 2024

UPDATE: The open call for advisees and collaborators is now closed. Thank you to everyone who applied. However, anyone interested in seeking our advice and/or collaborating with us is still welcome to contact us as per the instructions below and we will include them in our next advisees and collaborators program.

————————————————————————————————

GCRI is currently welcoming inquiries from people who are interested in seeking our advice and/or collaborating with us as part of our sixth annual Advising and Collaboration Program. Inquiries may cover any aspect of global …

Read More »

Climate Change, Uncertainty, and Global Catastrophic Risk

View the paper “Climate Change, Uncertainty, and Global Catastrophic Risk”

Is climate change a global catastrophic risk? Warming temperatures are already causing a variety harms around the world, some quite severe, and they project to worsen as temperatures increase. However, despite the massive body of research on climate change, the potential for extreme global harms remains highly uncertain and controversial. This paper addresses the question by examining the theoretical definition of global catastrophic risk and by comparing climate change to another severe global risk, nuclear winter. …

Read More »

Assessing the Risk of Takeover Catastrophe from Large Language Models

View the paper “Assessing the Risk of Takeover Catastrophe from Large Language Models”

Recent large language models (LLMs) have shown some impressive capabilities, but this has raised concerns about their potential to cause harm. Once concern is that LLMs could take over the world and cause catastrophic harm, potentially even killing everyone on the planet. However, this concern has been questioned and hotly debated. Therefore, this paper presents a careful analysis of LLM takeover catastrophe risk.

Concern about LLM takeover is noteworthy across the entire history of …

Read More »

On the Intrinsic Value of Diversity

View the paper “On the Intrinsic Value of Diversity”

Diversity is an important ethical concept. It’s also relevant to global catastrophic risk in at least two ways: the risk of catastrophic biodiversity loss and the need for diversity among people working on global catastrophic risk. It’s additionally relevant to scenarios involving extreme good, such as in well-designed advanced AI. However, the ethics of diversity has been remarkably understudied. To help address the full range of issues involving diversity, this paper presents a foundational study of the …

Read More »

Manipulating Aggregate Societal Values to Bias AI Social Choice Ethics

View the paper “Manipulating Aggregate Societal Values to Bias AI Social Choice Ethics”

Vote suppression, disinformation, sham elections that give authoritarians the veneer of democracy, and even genocide: all of these are means of manipulating the outcomes of elections. (Shown above: a ballot from the sham 1938 referendum for the annexation of Austria by Nazi Germany; notice the larger circle for Ja/Yes.) Countering these manipulations is an ongoing challenge. Meanwhile, work on AI ethics often proposes that AI systems use something similar to democracy. Therefore, this …

Read More »

The Origin and Implications of the COVID-19 Pandemic: An Expert Survey

View the Main Report “The Origin and Implications of the COVID-19 Pandemic: An Expert Survey”

View the Methodological and Analytical Annex

Exactly how the COVID-19 pandemic began remains a topic of considerable scientific and political debate. However, the opinions expressed in the debate have thus far come from an ad hoc mix of experts and commentators who have spoken up. Therefore, a research team led by the Global Catastrophic Risk Institute (GCRI) and Nemesys Insights conducted a rigorous survey of global expert opinion. The anonymous survey included …

Read More »

2023 Annual Report

2023 was a year of learning and transition for GCRI, and likewise a relatively quiet year for us. A year ago, we lost two team members, McKenna Fitzgerald and Andrea Owe, leaving the GCRI team with just its two co-founders, Seth Baum and Tony Barrett. We certainly miss the excellent contributions of our former team members. Nonetheless, in our newly streamlined situation, we have taken the opportunity to reinvest in ourselves and recalibrate the direction of our activities.

In our 2022 Annual Report, we described our …

Read More »

2023 GCRI Fellowship Program

GCRI is pleased to announce the 2023 Fellowship Program. The Fellowship Program aims to highlight exceptional collaborators GCRI had the opportunity to partner with over the course of the year.

This year, we have three 2023 Fellows. One of them is collaborating with GCRI on an innovative research project on psychological and behavioral dimensions of AI governance. The other two are collaborating from their positions in new global catastrophic risk organizations in Africa and the Spanish-speaking world. These organizations are part of a broader initiative to …

Read More »

Summary of the 2023 Advising and Collaboration Program

In August, GCRI put out an open call for people interested in seeking our advice or collaborating on projects with us. This was a continuation of our successful 2019, 2020, 2021, and 2022 Advising and Collaboration Programs. The 2023 Program was made possible by continued support from Gordon Irlam.

The GCRI Advising and Collaboration Program is an opportunity for anyone interested in global catastrophic risk to get more involved in the field. There is practically no barrier to entry in the program: the only thing people …

Read More »

All-Hazards Policy for Global Catastrophic Risk

View the paper “All-Hazards Policy for Global Catastrophic Risk”

There are many similarities and linkages between the global catastrophic risks, as well as synergies in measures to address them. For these and other reasons, GCRI has an active program on cross-risk evaluation & prioritization. Unfortunately, policy for global catastrophic risk often focuses on one risk at a time, failing to take advantage of the ways to address multiple global catastrophic risks concurrently. Therefore, this report develops a cross-risk, “all-hazards” approach to policy for global catastrophic risk.

The …

Read More »