Amazon Challenges Nvidia with Expanding AI Chips Trainium

Amazon Bets on Its AI Chips to Compete with Nvidia

In his annual letter to shareholders, Andy Jassy, the CEO of Amazon, highlighted the company's notable advancements in the field of artificial intelligence (AI) chips. He emphasized that this sector is "booming" and took the opportunity to critique Nvidia, the current market leader in AI chips.

Although Amazon is a customer of Nvidia, the e-commerce giant is also developing its own AI chips, known as Trainium. Jassy stated that the demand for these chips aligns with a trend where companies are seeking to diversify their supply sources. He remarked, "Practically all AI to date has been done on NVIDIA chips, but a new shift has begun." Despite this competition, Jassy clarified that Amazon maintains a strong partnership with Nvidia and will continue to make AWS the best place to run Nvidia chips.

Strategic Partnerships and Enhanced Performance

Amazon has already established partnerships with major players like OpenAI, Anthropic, and Apple, providing access to its Trainium chips via the cloud. Jassy also mentioned the possibility of selling these chips to third parties in the future, responding to a growing demand for better value. "It is quite possible that we will sell racks of these to third parties in the future," he indicated.

The comparison with Intel is striking: Amazon had already shaken Intel's dominance in the CPU space with its Graviton chip launched in 2018. Today, Amazon's Trainium3 chip is touted as being 30 to 40% more cost-effective than its predecessors. However, Business Insider reported that some startups found that Trainium 1 and 2 performed less effectively compared to Nvidia chips.

Challenges for Nvidia and Market Diversification

Despite previous criticisms regarding the performance of the early versions of Trainium, Jassy revealed that a "significant portion" of Trainium 4 is already reserved even before its general availability in 18 months. This situation underscores the increasing competitive threats to Nvidia, which is striving to maintain its dominant position in the global advanced chip market. Nvidia recently achieved a record status in the $1 trillion club.

Tech giants like Google and Meta are also diversifying their chip suppliers, collaborating respectively with Broadcom and AMD. Arm, for its part, is partnering with OpenAI and Meta to develop the Arm AGI CPU.

A Promising Future for Amazon

Jassy announced that Amazon's annual revenue from its chip business now exceeds $20 billion, with internal use in its data centers. This strategy could allow Amazon to significantly reduce its capital expenditures, estimated at $200 billion. "At scale, we expect Trainium to save us tens of billions of dollars per year in capital expenditures, and to provide several hundred basis points of operational margin advantage compared to reliance on other chips for inference," he wrote.

In conclusion, Amazon's ambitions in the AI chip sector illustrate its desire to reduce dependence on other companies while strengthening its position in the global market. Amazon's stock has dropped by 1.2% this year but has risen by over 25% over the past year. Nvidia did not immediately respond to a request for comment from Business Insider.