Image: Tesla
Tesla has just announced it has completed work on its own Dojo supercomputer and will be putting it into production soon. Elon Musk said that “it has been online & running useful tasks for a few months.”
Tesla has announced that its long-awaited supercomputer, Dojo, should go into production next month. This means the company is just one step away from having powerful equipment that will provide full autonomy for Tesla vehicles.
In addition, CEO Elon Musk also stated that the company is already using the equipment. “It has been online & running useful tasks for a few months,” he tweeted late Wednesday. Perhaps it is because of the power of Dojo that the latest versions of FSD Beta are so good.
It has been online & running useful tasks for a few months
— Elon Musk (@elonmusk) June 22, 2023
At Tesla AI Day, which took place on August 19, 2021, in Fremont, the company unveiled its Dojo supercomputing technology. Dojo's goal is to increase the speed and accuracy of training. Dojo is a Neural Network (NN) chip being developed by Tesla's hardware team to increase the learning speed of neural networks on the server-side.
Tesla's new development was presented by Ganesh Venkataramanan, Senior Director of Autopilot Hardware at Tesla and Dojo Project Manager. He unveiled the Dojo D1 chip, which uses 7nm technology and delivers breakthrough bandwidth and computing performance.
The D1 chip was completely developed by the Tesla team internally. “This was entirely designed by the Tesla team internally. All the way from the architecture to the package. This chip is like GPU-level compute with a CPU level flexibility and twice the network chip-level IO bandwidth,” Venkataramanan said.
Each of the D1's 354 chip nodes reportedly has one teraflop (1,024 gflops) of compute. Venkataramanan said the entire chip was capable of up to 363 teraflops of compute as well as 10tbps of on-chip bandwidth/4tbps of off-chip bandwidth.
The company has developed what it calls ‘training tiles’ with which it builds its computing systems. Each tile consists of 25 D1 chips in an integrated multi-chip module, with each tile providing nine petaflops of computing and 36tbps of off-tile bandwidth.
To create Dojo, the company plans to install two trays of six tiles in a single cabinet, for 100 petaflops of compute per cabinet. Once complete, the company will have a single ‘Exapod’ capable of 1.1 exaflops of AI compute via 10 connected cabinets; the entire system will house 120 tiles, 3,000 D1 chips, and more than one million nodes.
© 2023, Eva Fox | Tesmanian. All rights reserved.
_____________________________
We appreciate your readership! Please share your thoughts in the comment section below.
Article edited by @SmokeyShorts; follow him on Twitter