“To Yudkowsky and Soares’s credit, their book mostly eschews such niche ideas, but they don’t entirely disavow the quasi-mystical dimensions of the community Yudkowsky has cultivated online. Each chapter in the book begins with a parable, warning of the dangers to come. These parables sometimes read like gibberish, talking both down and up to the reader. Their characters range from alien birds discussing the optimal amount of stones in nests to Aztec warriors unaware of guns to bumbling, chess-playing professors. Of course, writing critically about AI without sounding alarmist is difficult. Yudkowsky and Soares don’t particularly care. They believe it’s more important to save the world than to understate their case. If Anyone Builds It, Everyone Dies frequently reiterates the title’s refrain and draws parallels between AI superintelligence and the possibility of nuclear war. Yudkowsky even believes nuclear war might be preferable to the singularity.
…
“The authors devote chapter after chapter and parable after parable to demonstrating why they believe AI is so dangerously unpredictable and violent. Sometimes they lapse into repetition, and they are so insistent on driving their points home that they put certain thesis statements in boldface type. Nevertheless, they sometimes lose the conversational thread amid all the apocalyptic pomp. There are plenty of reasons to oppose AI development that they ignore, among them job loss, economic decline, environmental degradation and racism.
…
“If Anyone Builds It, Everyone Dies is less a manual than a polemic. Its instructions are vague, its arguments belabored and its absurdist fables too plentiful. Yudkowsky and Soares are certainly experts in their field, but this book often reads like a disgruntled missive from two aggrieved patriarchs tired of being ignored. It’s true that AI is here, and there’s no undoing that. Maintaining our humanity in the face of automated machinery is a tiresome test, one that will require a variety of tactics. Perhaps too few of them are to be found in this book’s pages.”
–Grace Byron on Eliezer Yudkowsky and Nate Soares’ If Anyone Builds It, Everyone Dies: Why Superhuman AI Would Kill Us All (The Washington Post)