Satya Nadella curbs excessive AI use at Microsoft

Satya Nadella, the CEO of Microsoft, recently expressed his concerns regarding the phenomenon of tokenmaxxing within the company. During a live recording of the New York Times podcast "Hard Fork," he stated that there is "a lot" of tokenmaxxing at Microsoft. Nadella emphasized that employees should use the right AI model for each task, rather than being lured by the most powerful models unnecessarily.

Nadella acknowledged that tokenmaxxing, which involves maximizing the use of data units processed by AI systems, has become a common practice at Microsoft. He admitted to being drawn to this approach himself, while stressing the need to step back and assess the true added value of projects. "I am also a tokenmaxxer; it's addictive," he added. "But you need to take a step back when the novelty fades to ask yourself: 'What am I trying to create?'"

Silicon Valley companies, including Microsoft, have encouraged their employees to integrate AI into their processes, sometimes following internal rankings based on token usage. However, with rising costs, a regulation of this usage is necessary. Nadella did not indicate that Microsoft was limiting AI usage by its employees, but he specified that they should use the appropriate model for each task. "Don't use cutting-edge models for non-cutting-edge problems," he stated, referring to Microsoft Copilot's automatic mode, which is designed to match tasks with the most suitable model.

Furthermore, Nadella developed a tool capable of keeping a software project updated based on professional discussions. This system allows AI to create plans and update code without requiring Nadella's presence during meetings. If employees discuss a change related to the project, the AI can create a plan, perform the update, and keep the code functional without Nadella needing to be present in the meeting or discussion.

In his effort to transform Microsoft for the AI era, Nadella recently appointed a new CEO for the business operations and an AI advisor to rethink the company's business model. These changes aim to make Microsoft more competitive against smaller, agile companies. In October, he appointed a new CEO for Microsoft's business operations, a decision that allowed him to dedicate more time to technical work. In November, he designated a new AI advisor to rethink the company's business model in the AI era.

During the event, Kevin Roose, co-host of the podcast, presented Nadella with a "Microsoft Advanced AI Research" T-shirt, a memento from a time when Microsoft considered creating an AI lab for OpenAI employees. Although this project never came to fruition, the gesture amused Nadella. Roose explained that he acquired it from an OpenAI employee who had it made in 2023, when Sam Altman was briefly ousted and Microsoft was preparing to create a new AI lab for OpenAI employees. Altman was reinstated a few days later, and the lab was never created. Nadella, laughing, accepted the T-shirt.