Supermicro Shows Off Intel Nervana NNP-T Servers: 8-Way PCIe and OAM

One of the key elements to deep learning and training is lots of very dense compute, as well as the dense servers to go through the computation. Intel’s Nervana NNP-T Spring Crest silicon, which we saw at Hot Chips earlier this year, is the ‘big training silicon’ that came out of the acquisition with Nervana: a 680 mm2 built on TSMC 16nm with CoWoS with four stacks of HBM2. The servers using this silicon are now starting to appear, and we caught sight of two at the Supermicro booth at Supercomputing.

Supermicro Shows Off Intel Nervana NNP-T Servers: 8-Way PCIe and OAM 1

Supermicro Shows Off Intel Nervana NNP-T Servers: 8-Way PCIe and OAM 2

To start the week, Supermicro showed off its first server using the NNP-T hardware, all based on PCIe cards. As one might imagine, these fit into any server that was previously designed to accommodate GPUs, and so Supermicro’s system is a very typical 2P unit with 8 cards in a 4U design. The cards talk to each other, with 3.58 Tbps total bi-directional bandwidth per chip, and off-chip connections supporting scalability up to 1024 nodes. As noted by the single 8-pin PCIe power per card, it means that each card has a peak power of 225W as per PCIe standards.

Supermicro Shows Off Intel Nervana NNP-T Servers: 8-Way PCIe and OAM 3

Supermicro Shows Off Intel Nervana NNP-T Servers: 8-Way PCIe and OAM 4

Later in the week, we were told by Supermicro that they had been given permission to show off the 8-way OAM (OCP Accelerator Module) version of the server, which keeps the chip-to-chip communications through the PCB of the baseboard, rather than using PCIe card-to-card like connectors. This also allows for substantial air cooling implementations, and compatibility with the OCP standards, as well as modularization.

Supermicro Shows Off Intel Nervana NNP-T Servers: 8-Way PCIe and OAM 5

The chip is Intel’s first to support bfloat16 numerics for training in deep learning. Each chip supports up to 119 TOPs, with 60 MB of on-chip memory and 24 dedicated ‘tensor’ processing clusters which have dual 32×32 matrix multiply arrays. The chip has a total of 27 billion transistors, and the cores run at 1.1 GHz. This is supported by 32 GB of HBM2-2400 memory, and technically the PCIe connection is a PCIe 4.0 x16 connection, however Intel does not have CPUs to support this yet.

Supermicro Shows Off Intel Nervana NNP-T Servers: 8-Way PCIe and OAM 6

We were told that for this sort of compute, in order to drive it all, some training customers are moving up from 2P per head node up to 4P, and bigger installations such as Facebook are already using 8P systems to drive their deep learning and training hardware.

Supermicro states that their NNP-T systems are ready for deployment.

Related Reading

About the author

E-Crypto News was developed to assist all cryptocurrency investors in developing profitable cryptocurrency portfolios through the provision of timely and much-needed information. Investments in cryptocurrency require a level of detail, sensitivity, and accuracy that isn’t required in any other market and as such, we’ve developed our databases to help fill in information gaps.

Related Posts

E-Crypto News Executive Interviews

Crypto Scams

Beanstalk Farms Loses $80M In A Massive DeFi Governance Flash-Loan Hack
Beanstalk Farms Loses $80M In A Massive DeFi Governance Flash-Loan Hack
April 23, 2022
Prove
Joon Pak Head of Crypto at Prove talks to Us about Crypto Fraud And More
April 11, 2022
Mintable
Mintable CEO Zach Burks Talks to Us about the Opensea Stolen NFTs and Their Recovery
March 21, 2022
Crypto Crime
Crypto Crime Surges To Record Highs As Thieves Follow Market Buzz – Chainalysis 2022 Report
February 24, 2022
Bots Circumvent 2FA Login At Coinbase And Other Crypto Exchanges In 2022
Bots Have Circumvented 2FA Logins At Coinbase And Other Crypto Exchanges In 2022
February 17, 2022

Automated trading with HaasBot Crypto Trading Bots

Blockchain/Cryptocurrency Questions and Answers

Russia
Roundtable Interview-What is the Effect of The Russia-Ukraine War on Cryptocurrency Prices?
March 4, 2022
GamStop
How Does Bitcoin Casino Work + 2021 Beginner’s Guide
November 8, 2021
Cryptocurrency
How to Buy and Sell Cryptocurrency
November 8, 2021
What Are Bitcoin Futures And How Will They Work In 2022?
November 4, 2021
Ethereum
The Unconventional Guide to Ethereum
October 28, 2021


CryptoCurrencyUSDChange 1hChange 24hChange 7d
Bitcoin28,922 0.40 % 2.01 % 4.81 %
Ethereum1,768.7 0.17 % 5.71 % 12.61 %
Tether1.001 0.28 % 0.09 % 0.01 %
USD Coin0.9989 0.16 % 0.08 % 0.04 %
BNB302.82 0.09 % 3.54 % 1.57 %
XRP0.3897 0.00 % 2.19 % 7.57 %
Binance USD1.004 0.14 % 0.07 % 0.03 %
Cardano0.9566 0.22 % 0.68 % 6.96 %
Solana41.91 0.90 % 8.41 % 19.92 %
Dogecoin0.08368 6.88 % 4.90 % 3.90 %

bitcoin
Bitcoin (BTC) $ 28,881.00
ethereum
Ethereum (ETH) $ 1,770.43
tether
Tether (USDT) $ 1.00
usd-coin
USD Coin (USDC) $ 1.00
bnb
BNB (BNB) $ 302.95
xrp
XRP (XRP) $ 0.390019
binance-usd
Binance USD (BUSD) $ 1.00
cardano
Cardano (ADA) $ 0.461806
solana
Solana (SOL) $ 42.38
dogecoin
Dogecoin (DOGE) $ 0.084133