Brief IA
›

MathArena: Gemini 4 Carbon Leads, 15 Times More Expensive than Sol

Models & LLM·Tom Levy·

MathArena: Gemini 4 Carbon Leads, 15 Times More Expensive than Sol

MathArena: Gemini 4 Carbon Leads, 15 Times More Expensive than Sol
Key Takeaways
1Gemini 4 Carbon leads the MathArena benchmark ahead of GPT-6.1 Sol and Claude Fable 5.2
2Under the tested reasoning parameters, its cost is about 15 times higher than that of Sol, with frequent time overruns
3The OpenAI models mentioned for complex equations are not yet available to the public
Why it matters : This ranking marks a breakthrough for non-OpenAI models, but highlights the cost and usage constraints for users.

Google's model has taken the top spot in the MathArena benchmark, ahead of GPT-6.1 Sol and Claude Fable 5.2. This lead comes with frequent time overruns and a significantly higher cost with the reasoning parameters tested, while some of the OpenAI models mentioned are not yet publicly available.

Time Overruns and Rising Costs Under Tested Settings

The most common failure mode of Gemini 4 Carbon is exceeding the time limit. The model rarely abandons a task, which can be seen as either an advantage or a disadvantage. In one instance, a script ran for over eleven hours without any progress check. With the reasoning parameters used during testing, Gemini 4 Carbon costs about 15 times more than GPT-6.1 Sol, and approximately 40 times more than Claude Fable 5.2.

Le brief IA que lisent les pros

Le brief IA que les pros lisent chaque soir

Les 7 actus IA du jour, décryptées en 5 min. Gratuit.

Inclus dès l'inscription : notre sélection des meilleurs guides & comparatifs IA.

Choisissez votre rythme

Gratuit · Pas de spam · Désabonnement en 1 clic

Limited Public Access for Some OpenAI Models

According to some reports, models developed by OpenAI have recently been able to solve complex equations such as the Navier-Stokes equations; however, these models are not yet available to the public. In this context, MathArena serves as a benchmark to measure the mathematical capabilities of accessible models.

Current Ranking and Announced Milestones of the Leaderboard

Gemini 4 Carbon, developed by Google, has become the first non-OpenAI model to top the MathArena benchmark in some time, pushing GPT-6.1 Sol out of first place. Claude Fable 5.2 holds the second position, and Gemini 4 Carbon is among the highest-performing public models for mathematical tasks. Expected performance milestones are set for November 10, 2026, for Gemini 4 Carbon (high), November 9, 2026, for Claude-Fable-5.2 (max), September 29, 2026, for GPT-6.1 Sol (max), and October 23, 2026, for Kimi K3.1 Pro (max).

Brief IA — L'actualité IA en français

L'essentiel de l'actualité de l'intelligence artificielle, décrypté et expliqué chaque jour.