In June 2015, Sam Altman told a tech conference, “I think that AI will probably, most likely, sort of lead to the end of the world. But in the meantime, there will be great companies created with serious machine learning.”
His comments echoed a certain postapocalyptic New Yorker cartoonopen in new window, but Altman, then the president of the startup accelerator Y Combinator, did not appear to be joking. In the next breath, he announced that he’d just funded a new venture focused on “AI safety research.” That company was OpenAI, now best known as the creator of ChatGPT.
The simultaneous cheerleading and doomsaying about AI has only gotten louder in the years since. Charles Jones, a professor of economics at Stanford Graduate School of Business, has been watching with interest as developers and investors like Altman grapple with the dilemma at the heart of this rapidly advancing technology. “They acknowledge this double-edged sword aspect of AI: It could be more important than electricity or the internet, but it does seem like it could potentially be more dangerous than nuclear weapons,” he says.
Out of curiosity, Jones, an expert on modeling economic growth, did some back-of-the-envelope math on the relationship between AI-fueled productivity and existential risk. What he found surprised him. It formed the basis of a new paper in which he presents some models for assessing AI’s tradeoffs. While these models can’t predict when or if advanced artificial intelligence will slip its leash, they demonstrate how variables such as economic growth, existential risk, and risk tolerance will shape the future of AI — and humanity.
There are still a lot of unknowns here, as Jones is quick to emphasize. We can’t put a number on the likelihood that AI will birth a new age of prosperity or kill us all. Jones acknowledges that both of those outcomes may prove unlikely, but also notes that they may be correlated. “It does seem that the same world where this fantastic intelligence helps us innovate and raise growth rates a lot also may be the world where these existential risks are real as well,” he says. “Maybe those two things go together.”
Healthy, Wealthy… and Wise?
Jones also built a more complex model that considers the possibility that AI will help us live healthier, longer lives. “In addition to inventing safer nuclear power, faster computer chips, and better solar panels, AI might also cure cancer and heart disease,” he says. Those kinds of breakthroughs would further complicate our relationship with this double-edged tech. If the average life expectancy doubled, even the most risk-averse people would be much more willing to take their chances with AI risk. “The surprise here is that cutting mortality in half suddenly turns your willingness to accept existential risk from 4% to 25% or even more,” Jones explains. In other words, people would be much more willing to gamble if the prize was a chance to live to 200.
The models also suggest that AI could mitigate the economic effects of falling birth rates, another subject Jones has recently written about. “If machines can create ideas, then the slowing of population growth may not be such a problem,” he says.
Jones’ models provide insights into the wildest visions of AI, such as the singularity — the fabled moment when technological growth becomes infinite. He found that, in practical terms, accelerated growth might be hard to distinguish from the singularity. “If growth rates were to go to 10% a year, that would be just as good as a singularity,” he says. “We’re all going to be as rich as Bill Gates.”
Overall, Jones cautions that none of his results are predictive or prescriptive. Instead, they’re meant to help refine our thinking about the double-edged sword of AI. As we rush toward a future where AI can’t be turned off, efforts to quantify and limit the potential for disaster will become even more essential. “Any investments in reducing that risk are really valuable,” Jones says.
Read the full article by Dave Gilson
