Chinese Models Reveal Training on Blackwell

Model weights published by several AI laboratories in China reportedly exhibit initialization patterns specific to Nvidia Blackwell GPUs, according to Will DePue. Technical indicators cite DeepSeek, Moonshot AI, MiniMax, and Ant Group, while B300 units have been spotted in China by a security firm. In Washington, several texts aim to further restrict these accesses, despite acknowledged limitations in geographic attribution.
The Location of GPUs Remains Undetermined and Verifications Are Published
Linking a model to Blackwell GPUs does not determine where these chips are physically installed, as some Chinese laboratories may access them through American suppliers. The Cloud Security Act aims to address this indirect access gap. Initialization seeds associating DeepSeek-V3 with Hopper and DeepSeek-V4-Flash with Blackwell allow for the reproduction of results. Will DePue notes that several senior researchers, both independent and from laboratories like OpenAI and Anthropic, have confirmed his findings. Furthermore, OpenAI and Anthropic have expressed concerns about the copying of their models through distillation, a practice also reported by the U.S. agency CISA.
DeepSeek, Moonshot AI, MiniMax, and Ant Group Among Suspected Users
Will DePue claims that DeepSeek, Moonshot AI, MiniMax, and Ant Group have used Nvidia Blackwell GPUs to train their models. He reports having identified six Chinese models initialized on Blackwell systems, including DeepSeek-V4-Pro, Kimi K3, and MiniMax-M3. Four of these models correspond to Grace Blackwell components, GB200 and GB300, in Nvidia's flagship liquid-cooled systems. According to DePue, this is the first time MiniMax and Ant Group have been publicly associated with the use of Blackwell. More broadly, he asserts that Chinese laboratories are using these GPUs despite export restrictions.
Le brief IA que les pros lisent chaque soir
Les 7 actus IA du jour, décryptées en 5 min. Gratuit.
Inclus dès l'inscription : notre sélection des meilleurs guides & comparatifs IA.
Choisissez votre rythme
Gratuit · Pas de spam · Désabonnement en 1 clic
B300 Units from the Blackwell Ultra Generation Identified via Chinese IPs
Israeli security firm Lava has stated that it identified 32 Nvidia B300 GPUs through publicly exposed monitoring points. These units belong to the Blackwell Ultra generation, and the associated IP addresses were geolocated in China. According to Lava, these GPUs are subject to U.S. export controls.
The Method: An Initialization Fingerprint Exploited on a Large Scale
Will DePue explains that a GPU signature persists in the weights after training, as the initialization imposes a pattern dependent on the chip and seed used. His analysis, published by Unemployment Labs, examines the weights made public by Chinese laboratories. The weights are initialized using pseudo-random algorithms like Philox, which generates the same values from a given seed. Using PyTorch and Nvidia's cuRAND library, parallel GPU threads create these values, making it possible to compare a simulated pattern with published weights. DePue claims to have tested over six trillion combinations of chip layout and seed to make this correlation. He founded Unemployment Labs after leaving OpenAI earlier this year.
Political Pressure in the United States and the Megaspeed Affair
In the United States, House Speaker Mike Johnson supports strengthening export controls as at least four bills await review: the AI Overwatch Act, Chip Security Act, Match Act, and Cloud Security Act. On Monday, Senators Jim Banks and Elizabeth Warren invoked the alleged relationship between Jensen Huang and a suspected spy to support the AI Overwatch Act, aimed at codifying existing controls. Elizabeth Warren specified that she was uncertain about Alice Huang's status, an accusation contested by Beijing and under investigation by the FBI. Meanwhile, Jensen Huang resigned following revelations about an affair with Alice Huang, who founded Megaspeed International in Singapore in 2023, a company under U.S. investigation for suspected illicit exports of Nvidia chips to China.
Brief IA — L'actualité IA en français
L'essentiel de l'actualité de l'intelligence artificielle, décrypté et expliqué chaque jour.