February Newsletter: Military AI – The View From DC

Dear friends,

This past month, GCRI has participated in two exclusive, invitation-only events in Washington, DC, discussing military and international security applications of artificial intelligence. First, GCRI Director of Research Tony Barrett attended a workshop hosted by the AI group at the think tank Center for a New American Security. Then I gave a talk on AI at a workshop on strategic stability hosted by the Federation of American Scientists.

These two events show that the DC international security community is quite interested in AI and its …

Read More »

January Newsletter: Superintelligence & Hawaii False Alarm

Dear friends,

This month marks the release of Superintelligence, a special issue of the journal Informatica co-edited by GCRI’s Matthijs Maas and Roman Yampolskiy along with Ryan Carey and Nell Watson. It contains an interesting mix of papers on AI risk. One of the papers is “Modeling and Interpreting Expert Disagreement About Artificial Superintelligence”, co-authored by Yampolskiy, Tony Barrett, and myself. This paper applies our ASI-PATH risk model to an ongoing debate between two leading AI risk experts, Nick Bostrom and Ben Goertzel. It shows how risk analysis can capture …

Read More »

December Newsletter: Year in Review

Dear friends,

It has been another productive year for GCRI. Though we have a limited budget, we’ve made major contributions to global catastrophic risk research. Here are some highlights:

* GCRI hosted its largest-ever series of symposia on global catastrophic risk at the 2017 Society for Risk Analysis (SRA) conference, prompting SRA to encourage us to lead the formation of an official global catastrophic risk group within SRA.

* GCRI affiliates presented at numerous other events throughout the year, including dedicated catastrophic risk events at UCLA and Gothenburg.

* …

Read More »

November Newsletter: Survey of AI Projects

Dear friends,

This month we are announcing a new paper, A Survey of Artificial General Intelligence Projects for Ethics, Risk, and Policy. This is more than the usual research paper: it’s 99 pages pulling together several months of careful work. It documents and analyzes what’s going on right now in artificial general intelligence (AGI) R&D in terms that are useful for risk management, policy, and related purposes. Essentially, this is what we need to know about AGI R&D to make a difference on the issue.

AGI is AI …

Read More »

October Newsletter: How To Reduce Risk

Dear friends,

As we speak, a group of researchers is meeting in Gothenburg, Sweden on the theme of existential risk. I joined it earlier in September. My commendations to Olle Häggström and Anders Sandberg for hosting an excellent event.

My talk in Gothenburg focused on how to find the best opportunities to reduce risk. The best opportunities are often a few steps removed from academic risk and policy analysis. For example, there is a large research literature on climate change policy, much of which factors in catastrophic risk. However, the …

Read More »

Towards an Integrated Assessment of Global Catastrophic Risk

View the paper “Towards an Integrated Assessment of Global Catastrophic Risk” 

Integrated assessment is an analysis of a topic that integrates multiple lines of research. Integrated assessments are thus inherently interdisciplinary. They are generally oriented toward practical problems, often in the context of public policy, and frequently concern topics in science and technology. This paper presents a concept for and some initial work towards an integrated assessment of global catastrophic risk (GCR). Generally speaking, GCR is the risk of significant harm to global human civilization. More …

Read More »

September Newsletter: 2017 Society for Risk Analysis Meeting

Dear friends,

Each year, GCRI hosts sessions on global catastrophic risk at the annual meeting of the Society for Risk Analysis, which is the leading academic and professional society for all things risk. This year, we have gotten three full sessions accepted for the meeting, our most ever. SRA is competitive and we are honored to have three sessions.

Likewise, for those of you who are interested in SRA but haven’t come to the meeting before, this would be a good year to come. SRA has a …

Read More »

July Newsletter: Summer Talks and Presentations

Integrated Assessment

GCRI Executive Director Seth Baum gave a talk on “Integrated Assessment of Global Catastrophic Risk and Artificial Intelligence” at the Cambridge University Centre for the Study of Existential Risk (CSER) on June 28. Dr. Baum will also participate in a Tech2025 workshop on future AI risk on July 11 in New York City.

GCRI Director of Research Tony Barrett gave a talk on integrated assessment, nuclear war, AI, and risk reduction opportunities at an Effective Altruism DC event on global catastrophic risks on June 17.

Artificial Intelligence

GCRI Associate …

Read More »

June Newsletter: Nuclear Weapons Ban Treaty

Dear friends,

This past May, a draft treaty to ban nuclear weapons was released at the United Nations. Nuclear weapons are a major global catastrophic risk, one that GCRI has done extensive work on. At first glance, the nuclear ban treaty would seem like something to wholeheartedly support. However, upon closer inspection, its merits are ambiguous.

The treaty is not expected to eliminate nuclear weapons because the nuclear-armed countries won’t sign it. Instead, it seeks to strengthen the norm against nuclear weapons and increase pressure for disarmament. …

Read More »

May Newsletter: The Value of GCR Research

Dear friends,

People often ask me why we set GCRI up as a think tank instead of something for more direct action at reducing the risk. The reason is that when it comes to the global catastrophic risks, a little bit of well-designed research goes a long way. It helps us make better decisions about how to reduce the risks.

For example, last week I attended a political science workshop at Yale University on how to cost-effectively spend $10 billion to reduce the probability of war between …

Read More »