Artificial Intelligence Safety and Security Chapman & Hall/CRC Artificial Intelligence and Robotics Series

The history of robotics and artificial intelligence in many ways is also the history of humanity?s attempts to control such technologies. From the Golem of Prague to the military robots of modernity, the debate continues as to what degree of independence such entities should have and how to make sure that they do not turn on us, its inventors. Numerous recent advancements in all aspects of research, development and deployment of intelligent systems are well publicized but safety and security issues related to AI are rarely addressed. This book is proposed to mitigate this fundamental problem. It is comprised of chapters from leading AI Safety researchers addressing different aspects of the AI control problem as it relates to the development of safe and secure artificial intelligence. The book is the first edited volume dedicated to addressing challenges of constructing safe and secure advanced machine intelligence.

The chapters vary in length and technical content from broad interest opinion essays to highly formalized algorithmic approaches to specific problems. All chapters are self-contained and could be read in any order or skipped without a loss of comprehension.

Preface: Introduction to AI Safety and Security

Acknowledgments

Editor

Contributors

Part I Concerns of Luminaries

Chapter 1 Why the Future Doesn’t Need Us

Bill Joy

Chapter 2 The Deeply Intertwined Promise and Peril of GNR

Ray Kurzweil

Chapter 3 The Basic AI Drives

Stephen M. Omohundro

Chapter 4 The Ethics of Artificial Intelligence

Nick Bostrom and Eliezer Yudkowsky

Chapter 5 Friendly Artificial Intelligence: The Physics Challenge

Max Tegmark

Chapter 6 MDL Intelligence Distillation: Exploring Strategies for Safe Access to Superintelligent Problem-Solving Capabilities

K. Eric Drexler

Chapter 7 The Value Learning Problem

Nate Soares

Chapter 8 Adversarial Examples in the Physical World

Alexey Kurakin, Ian J. Goodfellow, and Samy Bengio

Chapter 9 How Might AI Come About?: Different Approaches and Their Implications for Life in the Universe

David Brin

Chapter 10 The MADCOM Future: How Artificial Intelligence Will Enhance Computational Propaganda, Reprogram Human Culture, and Threaten Democracy … and What can be Done About It

Matt Chessen

Chapter 11 Strategic Implications of Openness in AI Development

Nick Bostrom

Part II Responses of Scholars

Chapter 12 Using Human History, Psychology, and Biology to Make AI Safe for Humans

Gus Bekdash

Chapter 13 AI Safety: A First-Person Perspective

Edward Frenkel

Chapter 14 Strategies for an Unfriendly Oracle AI with Reset Button

Olle Häggström

Chapter 15 Goal Changes in Intelligent Agents

Seth Herd, Stephen J. Read, Randall O’Reilly, and David J. Jilk

Chapter 16 Limits to Verification and Validation of Agentic Behavior

David J. Jilk

Chapter 17 Adversarial Machine Learning

Phillip Kuznetsov, Riley Edmunds, Ted Xiao, Humza Iqbal, Raul Puri, Noah Golmant, and Shannon Shih

Chapter 18 Value Alignment via Tractable Preference Distance

Andrea Loreggia, Nicholas Mattei, Francesca Rossi, and K. Brent Venable

Chapter 19 A Rationally Addicted Artificial Superintelligence

James D. Miller

Chapter 20 On the Security of Robotic Applications Using ROS

David Portugal, Miguel A. Santos, Samuel Pereira, and Micael S. Couceiro

Chapter 21 Social Choice and the Value Alignment Problem

Mahendra Prasad

Chapter 22 Disjunctive Scenarios of Catastrophic AI Risk

Kaj Sotala

Chapter 23 Offensive Realism and the Insecure Structure of the International System: Artificial Intelligence and Global Hegemony

Maurizio Tinnirello

Chapter 24 Superintelligence and the Future of Governance: On Prioritizing the Control Problem at the End of History

Phil Torres

Chapter 25 Military AI as a Convergent Goal of Self-Improving AI

Alexey Turchin and David Denkenberger

Chapter 26 A Value-Sensitive Design Approach to Intelligent Agents

Steven Umbrello and Angelo F. De Bellis

Chapter 27 Consequentialism, Deontology, and Artificial Intelligence Safety

Mark Walker

Chapter 28 Smart Machines ARE a Threat to Humanity

Kevin Warwick

Index

Dr. Roman V. Yampolskiy is a Tenured Associate Professor in the department of Computer Engineering and Computer Science at the Speed School of Engineering, University of Louisville. He is the founding and current director of the Cyber Security Lab and an author of many books including Artificial Superintelligence: a Futuristic Approach. During his tenure at UofL, Dr. Yampolskiy has been recognized as: Distinguished Teaching Professor, Professor of the Year, Faculty Favorite, Top 4 Faculty, Leader in Engineering Education, Top 10 of Online College Professor of the Year, and Outstanding Early Career in Education award winner among many other honors and distinctions. Yampolskiy is a Senior member of IEEE and AGI; Member of Kentucky Academy of Science, former Research Advisor for MIRI and Associate of GCRI.

Dr. Yampolskiy’s main areas of interest are AI Safety, Artificial Intelligence, Behavioral Biometrics, Cybersecurity, Genetic Algorithms, and Pattern Recognition. Dr. Yampolskiy is an author of over 150 publications including multiple journal articles and books. His research has been cited by 1000+ scientists and profiled in popular magazines both American and foreign (New Scientist, Poker Magazine, Science World Magazine), dozens of websites (BBC, MSNBC, Yahoo! News), on radio (German National Radio, Swedish National Radio) and TV. Dr. Yampolskiy’s research has been featured 1000+ times in numerous media reports in 30 languages.