This book reflects on work done through the Managing Extreme Technological Risk (METR) project, a pioneering research programme within the Centre for the Study of Existential Risk, University of Cambridge. METR has been both an exercise in 'academic engineering' to address major global challenges, and a research programme that extends beyond traditional academic outputs into methodological development and innovative forms of expert engagement and outreach.
Managing Extreme Technological Risk explores how the METR programme developed a model that is needed to effectively understand risks to the survival of humanity, as well as their management and mitigation. It reflects on the challenges faced and lessons learned in the process of building a research community focused on this aim. This book brings together findings and future considerations from a key formative phase, not just for the Centre, but for the field of existential risk and aligned areas of research as a whole. It relates the story of this journey and outlines some of the programme's specific findings. There is an overall focus on what has been learnt for approaching the study of existential risk and how this can, and must, be taken forward by others, urgently and at scale.
Sample Chapter(s)
Chapter 2: Extreme Risk and the Culture of Science: Two Challenges
Contents:
- About the Editor
- About the Contributors
- List of Figures
- List of Tables
- List of Abbreviations and Acronyms
- Introduction to Managing Extreme Technological Risk (Catherine Rhodes)
- Extreme Risk and the Culture of Science: Two Challenges (Lalitha S Sundaram and Adrian Currie)
- Risk and Scientific Reputation: Lessons from Cold Fusion (Huw Price)
- Foreseeing Extreme Technological Risk (Luke Kemp)
- Evaluating Extreme Technological Risk: A Social Contract Based Approach (S J Beard and Patrick Kaczmarek)
- Responsibility and the Management of Extreme Technological Risk: Bio(techno)logical Risk (Catherine Rhodes)
- A Decade of Responsible Innovation by the AI Community 2012–2022: Analysing Recent Achievements and Future Prospects (Haydn Belfield)
- From Evaluation to Action: Ethics, Epistemology, and Extreme Technological Risk (Lalitha S Sundaram, Matthijs M Maas, and S J Beard)
- Index
Readership: Researchers, policy makers, technologists, and regulators interested in risk management/governance and management of specific areas of risk (e.g. artificial intelligence, biological risks, climate change) and what can be learnt across different sectors. General public with an interest in major risks facing humanity. The 'Effective Altruism' community, for which addressing existential risks is considered a major cause area.
Catherine Rhodes was Executive Director of the Centre for the Study of Existential Risk (CSER) from 2019–2021, and Academic Project Manager for the Managing Extreme Technological Risk programme from 2016–2020. She retains research affiliations with CSER and the Biosecurity Research Initiative at St Catharine's College, Cambridge. In the context of addressing global risks, her work broadly focuses on understanding the intersection and combination of risk stemming from technologies and risk stemming from governance (or lack of it). Catherine has particular expertise in international governance of biotechnology, biosecurity and broader biological risk management. She has a background in international relations, but has engaged in extensive interdisciplinary work. Her PhD was funded as part of a Project on Strengthening the Biological and Toxin Weapons Convention at the Bradford Disarmament Research Centre, and Catherine retains a strong interest in international actions to prevent misuse of bioscience.