Google says its AI supercomputer is faster, greener than Nvidia A100 chip

Alphabet Inc’s (GOOGL.O) Google released on Tuesday new details about the supercomputers it uses to train its artificial intelligence models, saying the systems are both faster and more power-efficient than comparable systems from Nvidia Corp (NVDA.O).

Google has designed its own custom chip called the Tensor Processing Unit, or TPU. It uses those chips for more than 90% of the company’s work on artificial intelligence training, the process of feeding data through models to make them useful at tasks such as responding to queries with human-like text or generating images.

The Google TPU is now in its fourth generation. Google on Tuesday published a scientific paper detailing how it has strung more than 4,000 of the chips together into a supercomputer using its own custom-developed optical switches to help connect individual machines.

Improving these connections has become a key point of competition among companies that build AI supercomputers because so-called large language models that power technologies like Google’s Bard or OpenAI’s ChatGPT have exploded in size, meaning they are far too large to store on a single chip.

The models must instead be split across thousands of chips, which must then work together for weeks or more to train the model. Google’s PaLM model – its largest publicly disclosed language model to date – was trained by splitting it across two of the 4,000-chip supercomputers over 50 days.

Google said its supercomputers make it easy to reconfigure connections between chips on the fly, helping avoid problems and tweak for performance gains.

“Circuit switching makes it easy to route around failed components,” Google Fellow Norm Jouppi and Google Distinguished Engineer David Patterson wrote in a blog post about the system. “This flexibility even allows us to change the topology of the supercomputer interconnect to accelerate the performance of an ML (machine learning) model.”

While Google is only now releasing details about its supercomputer, it has been online inside the company since 2020 in a data center in Mayes County, Oklahoma. Google said that startup Midjourney used the system to train its model, which generates fresh images after being fed a few words of text.

In the paper, Google said that for comparably sized systems, its chips are up to 1.7 times faster and 1.9 times more power-efficient than a system based on Nvidia’s A100 chip that was on the market at the same time as the fourth-generation TPU.

A Nvidia spokesperson declined to comment.

Google said it did not compare its fourth-generation to Nvidia’s current flagship H100 chip because the H100 came to the market after Google’s chip and is made with newer technology.

Google hinted that it might be working on a new TPU that would compete with the Nvidia H100 but provided no details, with Jouppi telling Reuters that Google has “a healthy pipeline of future chips.”

55 COMMENTS

  1. Pics available on your blog whether or not doing interest easily a modest amount of total submits. Fully gratifying technique for extended foreseeable future, We will be book-marking during the time come to be ones exterior finish off appears inch in place inch.

  2. Kibris’in Dijital alandaki en profesyonel firmasi olan ” Kibris Dijital Ajans” Kibris seo , kibris mobil uygulama , kibris web tasarimi , kibris sosyal medya yonetimi gibi alanlarda hizmet vermektedir.

  3. güvenilir ve profesyonel çözümler sunan bir elektrikçi firmasıdır. Deneyimli ve uzman ekibimiz, elektrik tesisatından bakım ve onarıma kadar geniş bir hizmet yelpazesiyle müşterilerimize kaliteli ve hızlı çözümler sunmaktadır.

  4. An impressive share, I just now with all this onto a colleague who had been doing a little analysis with this. And he the fact is bought me breakfast simply because I discovered it for him.. smile. So let me reword that: Thnx for the treat! But yeah Thnkx for spending some time to discuss this, I’m strongly regarding it and really like reading regarding this topic. When possible, as you become expertise, does one mind updating your website with more details? It can be highly great for me. Massive thumb up for this short article!

  5. After I initially commented I clicked the -Notify me when new feedback are added- checkbox and now every time a remark is added I get four emails with the same comment. Is there any manner you may remove me from that service? Thanks!

  6. What a fantabulous publish this has been. never visible this kind of beneficial publish. i’m grateful to you and anticipate more number of posts like those. thanks very plenty.

  7. An impressive share, I merely given this onto a colleague who has been performing a little analysis about this. And he in truth bought me breakfast simply because I stumbled upon it for him.. smile. So permit me to reword that: Thnx with the treat! But yeah Thnkx for spending some time to go over this, I find myself strongly about this and really like reading more on this topic. If it is possible, as you become expertise, could you mind updating your blog site with an increase of details? It is extremely useful for me. Massive thumb up due to this article!

  8. Hey! This is my first visit to your blog! We are a team of volunteers and starting a new initiative in a community in the same niche. Your blog provided us valuable information to work on. You have done a outstanding job!

  9. Whenever i became on your site while having particular attention easily a bit of tiny bit submits. Pleasing technique for long run, I’ll be book-marking at the moment have models accomplish springs right up.

  10. I spend time people’s writing. It has the excellent to consider you demonstrate around thoughts together with the intellect and also res while doing this very important topic is sometimes successfully deemed.

  11. THE DMV’S #1 DUCT & DRYER VENT CLEANING SERVICES REMOVE ALLERGENS, MOLD, AND DUST FROM WITHIN YOUR HOME AND BUSINESS DUCTWORK WITH AIR DUCT & DRYER VENT CLEANING. BREATHE THE DIFFERENCE AND SEE WHAT CLEAN DUCTWORK AND DRYER VENTS CAN DO FOR YOU.

  12. When i purchased on your site nonetheless placement concentrate solely a bit small submits. Fulfilling technique for near future, I’ll be book-marking every time obtain individuals complete occurs in position.

  13. Pete’s Cycle Co. is a leading motorcycle dealer in Baltimore, Severna Park and Bel Air, offering new and used motorcycles, ATVs, 3-wheel Vehicles, and more. Contact Us: +1 (410) 647-5880

  14. Excitement is in the air as Peshawar Zalmi clashes with Multan Sultans in the Pakistan Super League! 🏏💥 Get ready for a thrilling encounter between these two powerhouse teams. Who do you think will come out on top? Share your predictions and let the cricket

  15. For this reason it’s prudent that you can acceptable homework leading up to publishing. You may establish better print in this manner.

  16. For this reason it’s prudent that you can acceptable homework leading up to publishing. You may establish better print in this manner.

  17. Considerably, the post is really the greatest on this worthy topic. I agree with your conclusions and can eagerly look forward to your future updates. Simply just saying thanks can not simply be sufficient, for the fantasti c clarity in your writing. I will perfect away grab your rss feed to stay abreast of any updates. Genuine work and also much success in your business dealings!

  18. We still cannot quite believe that It was not respectable often be those checking important points located on yuor web blog. Our kids and that i are sincerely thankful for your personal generosity also giving me possibility pursue our chosen profession path. Published information Manged to get with your web-site.

  19. I enjoy each one of the posts, We appreciated, I would enjoy a lot more info with this particular, due to the fact it’s very enjoyable., Be thankful meant for providing.

  20. His or her received on your web site even though eliminating identification simply just a number of tid touch submits. Pleasing technique for approaching, We are book-marking before commencing pick-up solutions finish spgs all the way up way up.

  21. Nestled in the heart of the Mediterranean, amidst the vibrant atmosphere of urban life, lies a glittering gem that beckons to nocturnal adventurers: Kıbrıs Night Club. Embracing the spirit of the island of Cyprus, this establishment promises an unforgettable journey through the pulsating rhythms and vibrant energy of its nightlife. Let’s delve into the allure of Kıbrıs Night Club and discover the experiences it offers to those who seek excitement under the stars.

  22. To observe picked up against your site even now setting up procedure in plain english only one minimal little bit of submits. Pleasurable way of possibilities long run, We’re also book-marking at a time safe and sound forms prevent rises along.

Comments are closed.

Must Read