Tokenmaxxing: The New Battle Among Engineers to Dominate AI
Le brief IA que les pros lisent chaque soir
Les 7 actus IA du jour, décryptées en 5 min. Gratuit.
Inclus dès l'inscription : notre sélection des meilleurs guides & comparatifs IA.
Choisis ton rythme
Gratuit · Pas de spam · Désabonnement en 1 clic
A Heated Debate on Tokenmaxxing
The phenomenon of tokenmaxxing has recently captured the attention of software engineers, sparking an intense debate on social media. This concept, which involves maximizing the use of AI tokens, is seen by some as a new way to measure productivity in the tech sector. Garry Tan, CEO of Y Combinator, embraced the term by stating, "We have been tokenmaxxing longer than most people." However, other voices are rising to criticize this approach, labeling it an ineffective measure that could encourage the misuse of tokens.
In the tech industry, engineers are no longer content with just counting lines of code. With the advent of tokenmaxxing, they now have new AI coding tools and a portfolio of tokens to spend. These tokens, which represent a unit of computation, are used to assess the cost of AI work. Companies like OpenAI and Anthropic even incorporate this notion into their AI grant offerings.
The debate surrounding tokenmaxxing was reignited by a report from The Information about engineers at Meta who are seeking to maximize their token usage to rank on an internal leaderboard called "Claudeonomics." This board allows employees to compete for prestigious titles such as "Token Legend." However, this practice has been criticized for encouraging inefficient use of AI, with some engineers even going so far as to create bots to burn tokens unnecessarily. Jon Chu, a partner at Khosla Ventures, wrote on X that people are building bots to burn tokens as quickly as possible.
Some argue that it is a useful indicator of employee adoption of new tools; others say it could lead to inefficient use of AI within companies, resulting in performative manipulation of the metric. Cristina Cordova, COO of Linear, wrote on X: "Don't confuse a high consumption rate with a high success rate."
To understand tokenmaxxing, one must first know what a token is. Large language models break down words into numerical inputs, considering each token to be about ¾ of a word. AI models charge based on the number of tokens used. Tokenmaxxing, therefore, is the desire to spend as many tokens as possible. Meta and OpenAI are just a few of the tech companies with token rankings, as previously reported by The New York Times.
While it is difficult to measure the extent of tokenmaxxing, corporate spending on AI is clearly on the rise. Fintech company Ramp referred to this as a "$1 trillion blind spot" on X, citing data from Gartner showing that monthly AI spending among companies has quadrupled over the past year.
It is also a way to boast. Founders and forward-thinking engineers post their token spending on X to signal how invested they are in AI.
Although Nvidia CEO Jensen Huang has not directly commented on tokenmaxxing, he emphasized the importance for engineers to consume a significant number of tokens. He stated that if an engineer costing $500,000 did not consume at least $250,000 worth of tokens, he would be "deeply alarmed." This trend could transform how productivity is measured in the tech industry, potentially influencing hiring and management practices. Gergely Orosz, author of The Pragmatic Engineer, called this practice wasteful, while Ben Pouladian of BEP Research pointed out that computation has become the bottleneck of innovation.
Finally, Edwin Wee Arbus, an employee at Cursor, compared the tokenmaxxing metric to the Body Mass Index (BMI), describing it as a "useful and quick proxy, but slightly flawed." Arush Shankar, a software engineer at Persona, reminded that token spending is just one signal among others and should not be considered in isolation.
Brief IA — L'actualité IA en français
L'essentiel de l'actualité de l'intelligence artificielle, décrypté et expliqué chaque jour.