Nvidia assembled the world's 7th fastest supercomputer in one month

Nvidia assembled the world's 7th fastest supercomputer in one month 1
In a nutshell: Nvidia has detailed the assembly process of the Selene supercomputer, which became the world’s seventh fastest supercomputer in June. The entire thing was assembled amid the pandemic in just three and a half weeks with a socially-distanced team of six, plus a handy robot named Trip.

Selene is a rather unique supercomputer. It uses Nvidia’s commercially-available GPU-accelerated DGX SuperPOD architecture, instead of the custom CPU-heavy designs that dominate most of the Top500 list. It ranks second on the Green500 most power-efficient supercomputer list.

In numbers, Selene uses 560 AMD Epyc 7742 CPUs (64 cores each) and 2240 Nvidia A100 GPUs. Its peak theoretical performance is just under 35 thousand teraflops.

Nvidia’s previous supercomputers took months to construct and were extremely difficult to maintain and upgrade. When it came to designing Selene they tried to make it as simple and modular as possible. Each of Selene’s 280 nodes is a standardized DGX pod containing eight Nvidia A100 GPUs and two AMD Epyc CPUs. A handful of pods are stacked in a glorified filing cabinet (just being honest) which are strung together in groups of sixteen to form a SuperPOD.

Selene’s homogeneity is what enabled it to be assembled so quickly. It was mostly a matter of moving each DGX pod into the right spot and wiring it up and checking that it worked. Wiring a supercomputer is always a tricky job (particularly six feet apart) but Nvidia used Mellanox’s InfiniBand switches to reduce the number of cables required while simultaneously increasing bandwidth.

<iframe allowfullscreen="allowfullscreen" frameborder="0" height="390" src="https://www.youtube.com/embed/vY61ExKhnfA?rel=0&showinfo=0&modestbranding=1&vq=hd720&autohide=1&autoplay=1" width="560" loading="lazy" srcdoc="*{padding:0;margin:0;overflow:hidden}html,body{height:100%}img,span{position:absolute;width:100%;top:0;bottom:0;margin:auto}span{height:auto;padding-top:24%;text-align:center;font:48px/1.5 sans-serif;color:white;text-shadow:0 0 0.5em black;background:#05408f85;background:linear-gradient(90deg, rgba(44,52,61,0.5) 0%, rgba(36,91,172,0.49763655462184875) 35%, rgba(81,132,202,0.5) 100%)}Nvidia assembled the world's 7th fastest supercomputer in one month 2“>[embedded content]

Selene is cooled on a per-SuperPOD basis. All of the SuperPODs reside in one giant air-conditioned warehouse. They’re raised off the ground with fans underneath to push the cool air up into the DGX pods. Nvidia’s tiny assembly team only needed to install the flooring and seal up the SuperPODs to control the flow of air.

Nvidia got creative with the monitoring equipment for Selene. They purchased a little robot called Trip, who can be controlled remotely and wheeled around to observe the goings-on inside Selene. They also built a bot for Slack that sends them notifications when the hardware is misbehaving or when a cable has come loose.

Selene is currently working on about a thousand tasks mostly oriented around AI development and neural network training. Its spare cycles are dedicated to coronavirus research.

About the author

E-Crypto News was developed to assist all cryptocurrency investors in developing profitable cryptocurrency portfolios through the provision of timely and much-needed information. Investments in cryptocurrency require a level of detail, sensitivity, and accuracy that isn’t required in any other market and as such, we’ve developed our databases to help fill in information gaps.

Related Posts

E-Crypto News Executive Interviews

Automated trading with HaasBot Crypto Trading Bots

Crypto Scams

Millions in Cryptocurrency Stolen by Scammers in the Last Month According to Tenable Research
November 24, 2021
Behind The Scenes: How this Crypto Community Responded to + $50m Hack
October 18, 2021
Crypto Scams
Crypto Scams Still Persistent In 2021, SEC Warns About Red Flags To Watch
September 9, 2021
Poly Network
Here’s How Hackers Stole Over $600 million in the Poly Network Attack
August 12, 2021
The World’s Most Infamous Crypto Hacks and Scams
July 31, 2021

Blockchain/Cryptocurrency Questions and Answers

GamStop
How Does Bitcoin Casino Work + 2021 Beginner’s Guide
November 8, 2021
Cryptocurrency
How to Buy and Sell Cryptocurrency
November 8, 2021
What Are Bitcoin Futures And How Will They Work In 2022?
November 4, 2021
Ethereum
The Unconventional Guide to Ethereum
October 28, 2021
ICo Presale
The Science Behind ICO Presales…
October 14, 2021


CryptoCurrencyUSDChange 1hChange 24hChange 7d
Bitcoin37,223 0.23 % 4.63 % 12.00 %
Ethereum2,470.8 0.62 % 4.79 % 23.19 %
Tether1.000 0.42 % 1.00 % 0.02 %
Binance Coin379.27 1.34 % 5.31 % 20.39 %
USD Coin1.000 0.06 % 0.49 % 0.23 %
Cardano1.050 0.77 % 1.34 % 33.78 %
Solana96.50 2.44 % 8.90 % 31.10 %
XRP0.6112 0.52 % 3.12 % 20.08 %
Terra65.63 1.61 % 1.95 % 15.11 %
Polkadot18.85 1.19 % 7.70 % 26.78 %

bitcoin
Bitcoin (BTC) $ 37,181.00
ethereum
Ethereum (ETH) $ 2,451.19
tether
Tether (USDT) $ 1.00
binance-coin
Binance Coin (BNB) $ 375.14
usd-coin
USD Coin (USDC) $ 1.00
cardano
Cardano (ADA) $ 1.05
solana
Solana (SOL) $ 94.36
xrp
XRP (XRP) $ 0.60966
terra-luna
Terra (LUNA) $ 64.93
polkadot
Polkadot (DOT) $ 18.73