Brief IA
›

Anthropic: 26.8% on average, but 0 out of 90 for a target

Research·Tom Levy·

Anthropic: 26.8% on average, but 0 out of 90 for a target

Anthropic: 26.8% on average, but 0 out of 90 for a target
Key Takeaways
1Anthropic's campaign achieved 354 links out of 1,320 designs, or 26.8%
2Success rates vary significantly depending on the targets, ranging from 72/90 to 0/90
3Estimates indicate that a new target has a 20.1% risk of obtaining no links out of 30 attempts
Why it matters : The reported average rate does not reflect the probability of success for a given target, which has practical implications for the use of these tools.

Claude's autonomous protein design campaign boasts a validated binding rate of 26.8%, surpassing the industry standard of 10 to 15%. However, performance varies significantly across targets, with one objective where none of the 90 designs achieved binding. Estimates from published accounts suggest that a new target could often fall well below 26.8%.

Performance Varies Widely by Target

The results published by target range from 72 bindings out of 90 for TREM2 to 0 out of 90 for the maltose-binding protein. For the latter, 90 designs were synthesized, expressed, and measured without achieving a single binding. These discrepancies indicate that the overall rate of 26.8% is an average of very different performances across targets and cannot be applied to each specific case. According to a report from Anthropic, in silico confidence scores did not predict these failures, as MBP and BBF-14 received scores similar to those of the successful targets. Taken together, these elements suggest that a new target may experience much more variable and often less favorable outcomes than the average rate implies.

What the Campaign Actually Achieved and Validated

On August 25, 2026, Anthropic published the results of an autonomous protein design campaign. The campaign, which had a summary released on August 18, 2026, reports 354 bindings out of 1,320 designs, or 26.8%, compared to an industry standard of 10 to 15%. Two distinct contracted laboratories conducted independent validation of these results. The key figures, including the 0 out of 90 and the 26.8% rate, come from the same campaign, using the same prompt and model. A dozen open-source tools dedicated to protein design were coordinated by the autonomous agent, which achieved better success rates than human experts on the majority of targets. Nevertheless, the 26.8% rate corresponds to an overall measure, while practical applications generally focus on a single target.

Le brief IA que lisent les pros

Le brief IA que les pros lisent chaque soir

Les 7 actus IA du jour, décryptées en 5 min. Gratuit.

Inclus dès l'inscription : notre sélection des meilleurs guides & comparatifs IA.

Choisissez votre rythme

Gratuit · Pas de spam · Désabonnement en 1 clic

What Estimates from Published Accounts Show

The 26.8% rate represents an average across sixteen targets, not the probability of success for a given target. A binomial test applied to the results by target rejects the idea of a shared unique rate with a p-value of approximately 1.8 × 10⁻⁶³. Taking into account the differences between targets, the estimate indicates that a new target has about a 38% chance of falling below the 10% threshold observed in the industry. Assuming a unique rate of 26.8%, achieving 0 successes out of 90 for the maltose-binding protein would have a probability of 6.3 × 10⁻¹³, or about one chance in 1.6 trillion. A beta-binomial adjustment to the eight available accounts places the 90% predictive interval between 0.1% and 84.7%, with a median of 18.6%. Based on this, a batch of 30 designs facing an unseen target has a 20.1% chance of producing no bindings, compared to 0.0086% if a shared rate were assumed, representing a factor of about 2,300.

Brief IA — L'actualité IA en français

L'essentiel de l'actualité de l'intelligence artificielle, décrypté et expliqué chaque jour.