Brief IA
›

Bankman-Fried Estimates 25% Risk of AI Extinction

Models & LLM·Tom Levy·

Bankman-Fried Estimates 25% Risk of AI Extinction

Bankman-Fried Estimates 25% Risk of AI Extinction
Key Takeaways
1Sam Bankman-Fried estimates the risk of human extinction caused by AI at around 25%.
2He also indicates a range between 20% and 60% depending on the definition of a catastrophe.
3His Anthropic shares were sold in 2024 for $1.3 billion, used to repay FTX creditors.
Why it matters : this personal estimate comes with caveats regarding the definition of the risk considered.

Interviewed by podcaster Eli Goldfine, Sam Bankman-Fried estimates the probability that artificial intelligence will annihilate humanity at around 25%. He places this estimate above 10% and below 50%, while making his answer dependent on the definition of a catastrophe.

Bankman-Fried Qualifies His Risk Estimate

The question was about "P(doom)," a term referring to the probability that an AI-related catastrophe could lead to human extinction. For Bankman-Fried, assigning a single value is difficult, as not everyone necessarily defines a catastrophe in the same way. Following these ambiguities, he indicates that his answer could range between 20% and 60%.

He particularly ties this risk to the possibility of a peaceful agreement between humans and AI, as opposed to an AI that ultimately becomes indifferent to humanity and eliminates it. He also envisions cooperation under primarily artificial leadership, but pursuing human objectives. In his view, this scenario could lead to massive technological development.

La lettre du soirGratuit · 19 h

Le brief IA que les pros lisent chaque soir

Les 7 actus IA du jour, décryptées en 5 min. Gratuit.

Inclus dès l'inscription : notre sélection des meilleurs guides & comparatifs IA.

Choisissez votre rythme

Gratuit · Pas de spam · Désabonnement en 1 clic

Anthropic Shares Sold for $1.3 Billion

An early investor in Anthropic, Bankman-Fried contributed $500 million during its Series B funding round in April 2022. He was the main investor, with a stake corresponding to about 13.6% of the capital at that time.

These shares were resold in 2024 for $1.3 billion. The funds were used to repay FTX creditors, including those who were victims of the fraud.

Eli Goldfine Interviews Bankman-Fried by Phone

Bankman-Fried, who is serving a 25-year prison sentence for fraud, spoke with Eli Goldfine over several recorded phone conversations for his podcast. At 14 years old and in ninth grade, Goldfine also runs a Substack publication dedicated to prediction markets. The discussions covered the collapse of FTX, Bankman-Fried's cryptocurrency platform, as well as his commitment to effective altruism and his views on AI.

Goldfine also asked him if he could consider uploading his brain to the Internet. Bankman-Fried did not rule out this possibility, stating that he has no principled opposition to it.

Brief IA — L'actualité IA en français

L'essentiel de l'actualité de l'intelligence artificielle, décrypté et expliqué chaque jour.