Investigating NVIDIA's Jetson AGX: A Look at Xavier and Its Carmel Cores

Today’s piece is a bit of an unusual review; NVIDIA’s new Jetson AGX embedded system kit isn’t really a device platform we’re expecting the average reader to think about, much less buy. NVIDIA’s shift over the last few years from offering consumer grade Tegra chipsets to more specialised silicon applications isn’t any more evident than in the new Tegra Xavier which powers the Jetson AGX. While the board’s capabilities certainly fall outside of the use-cases of most consumers, it still represents a very interesting platform with a lot of functionality and silicon IP that we don’t find in any other device to this day. So when NVIDIA reached out to offer us a sample, we decided to have a go at assembling a high-level overview of what the board and the new Xavier chip can do.

Investigating NVIDIA's Jetson AGX: A Look at Xavier and Its Carmel Cores 1

First of all, we have to describe what this actually is. The Jetson AGX is a full-fledged small form-factor computer / embedded system, with the form of the whole unit not any bigger than 105x105mm. The AGX module itself is designed to be a complete commercial off the shelf (COTS) system for use in finished products, with NVIDIA aiming it at AI (read: neural networking) centric use cases such as robotics and industrial automation. Jetson boards typically occupy the small-to-mid volume end of the market, showing up in one-off products and items with limited production runs, where it doesn’t make sense for a manufacturer to develop and deploy their own custom hardware.

But of course the bare module is only half the story. You can’t do development against a bare module, and this is where NVIDIA’s complete Jetson AGX development kit comes in. The AGX dev kit comes with everything needed to run a single module, including a power supply, a heatsink, and more important of all, a breakout board.  The breakout board offers various I/O headers and ports, ranging from your standard double USB-C 3.1 ports, HDMI connectors and Gigabit Ethernet ports, to more specialised connectivity such as MIPI CSI-2 connectors for camera connectivity and a range of typical development board headers such as a 40 pin GPIO connector.

Investigating NVIDIA's Jetson AGX: A Look at Xavier and Its Carmel Cores 2

The more unusual connectivity options of the Jetson AGX are the PCIe Gen4 x16 slot as well as a M.2 PCIe x1 extension slot that is meant to be used for connectivity add-ons such as WiFi or cellular modules, both features that aren’t common among Arm development board as most SoCs don’t have the spare PCIe controllers.

Investigating NVIDIA's Jetson AGX: A Look at Xavier and Its Carmel Cores 3

The board comes with many other connectors, and that’s one regard in which the new Jetson AGX doesn’t lack at all in flexibility. Power is supplied by an external generic 19V power supply – the stock one supplied by NVIDIA is a 65W LiteOn unit that seems no different than most laptop charger bricks.

Investigating NVIDIA's Jetson AGX: A Look at Xavier and Its Carmel Cores 4

Underneath the quite heavy and solid aluminium heatsink we find what actually powers the Jetson AGX board: the AGX Xavier module. This is a system module that sits on top of the Jetson motherboard – the module has no I/O ports by itself and merely serves as the brains of the system, integrating the core components surrounding the Xavier chip, such as the 16GB of LPDDR4x memory, a small 32GB eMMC storage chip as well as all the power delivery circuits for powering the different power rails of the DRAM as well as IP blocks of the Xavier SoC.

Investigating NVIDIA's Jetson AGX: A Look at Xavier and Its Carmel Cores 5

The Xavier chip, as said, is the brains of the platform and represents NVIDIA’s biggest and most complex SoC to date. With 9 billion transistors on a die size of 350mm², it’s among one of the heavyweights of the Arm ecosystem, although between its initial announcements and today Apple has one-upped NVIDIA in terms of transistor count as the new A12X is a 10B chip – in a much smaller manufacturing node.

Investigating NVIDIA's Jetson AGX: A Look at Xavier and Its Carmel Cores 6

Coming from the traditional PC industry, NVIDIA doesn’t shy away from showing die shots of their products, which is something that is quite rare these days among the Arm SoC vendors. The Xavier SoC is mainly dominated by two big IP blocks which consist of the majority of the space allocated on the die: The 8-core “Carmel” CPU complex as well as a four-cluster Volta GPU.

Investigating NVIDIA's Jetson AGX: A Look at Xavier and Its Carmel Cores 7

At the high level, the CPU complex contains 8 Carmel CPU cores configured in four clusters, each with a pair of Carmel CPU cores. Each cluster has an independent clock plane and shares a 2MB cache among two CPU cores. At the higher CPU complex level we find a 4MB L3 cache serving all clusters. We don’t know too much about the microarchitecture of the new Carmel cores – seemingly this looks to be a successor to NVIDIA’s Denver µarch, a design that was characterised by its dynamic code optimisation capability. The only thing that NVIDIA does advertise is that this is a 10-wide superscalar machine (10 execution ports in this case, not 10-wide decode) and has support for the ARMv8.2+RAS instruction set. We’ll come back to the CPU core later in the article.

Investigating NVIDIA's Jetson AGX: A Look at Xavier and Its Carmel Cores 8

The GPU in Xavier has its roots in the Volta architecture. Here we find the GPU configured into four TPC (Texture processing clusters), each with two SMs (Stream multiprocessors), for a total of 8 SMs or 512 ALU lanes/CUDA cores. A most interesting aspect of the GPU is that because it is based on Volta, it also inherits the Tensor processing units from its bigger brethren. This augments the total processing power of the GPU by up to 22.6 8-bit TOPs or 11.3 FP16 TOPS on the part of the Tensor cores, on top of the respectively 2.8 and 1.4 TFLOPs for FP16 and FP32 CUDA operations provided by the SMs.

Investigating NVIDIA's Jetson AGX: A Look at Xavier and Its Carmel Cores 9

Alongside the CPU and GPU there’s many other important blocks, many of which NVIDIA had covered already at its HotChips 2018 presentation last summer. The one block that really does augment the Xavier SoC is the new DLA IP block: this is very much a new type of block that follows the trend we’ve seen in the mobile SoC space – a dedicated machine inferencing acceleration unit not unlike that which we’ve seen from the likes of HiSilicon or Apple. NVIDIA’s DLA promises performances of up to 11.4 int8 TOPS and is also capable of FP16 operation at half speed at 5.7 TOPS. On the SoC, the unit is implemented as a dual-core instance.

Investigating NVIDIA's Jetson AGX: A Look at Xavier and Its Carmel Cores 10

Alongside the DLA, the programmable vision accelerator is again a key component of the Xavier system that allows it focus on vision and in particular robotics, embedded AI and automotive use-cases. The PVA is a more traditional vision IP block that handles more rudimentary tasks such as object detections in a much more efficient way than it would be able to be handled by the GPU or machine inferencing algorithms. Here the PVA will be the first IP block after the ISP in the vision pipeline that will serve to segment parts of an image into objects that will be then forwarded to other algorithms that then would happen on the GPU or DLA.

About the author

E-Crypto News was developed to assist all cryptocurrency investors in developing profitable cryptocurrency portfolios through the provision of timely and much-needed information. Investments in cryptocurrency require a level of detail, sensitivity, and accuracy that isn’t required in any other market and as such, we’ve developed our databases to help fill in information gaps.

Related Posts

E-Crypto News Executive Interviews



bitcoin
Bitcoin (BTC) $ 61,569.00
ethereum
Ethereum (ETH) $ 3,873.83
binance-coin
Binance Coin (BNB) $ 475.59
cardano
Cardano (ADA) $ 2.23
tether
Tether (USDT) $ 1.00
xrp
XRP (XRP) $ 1.15
solana
Solana (SOL) $ 160.32
polkadot
Polkadot (DOT) $ 42.67
usd-coin
USD Coin (USDC) $ 1.00
dogecoin
Dogecoin (DOGE) $ 0.240631
USD
EUR
GBP
bitcoinBitcoin (BTC)
$ 61,569.00
ethereumEthereum (ETH)
$ 3,873.83
tetherTether (USDT)
$ 1.00
bitcoin-cashBitcoin Cash (BCH)
$ 629.27
litecoinLitecoin (LTC)
$ 190.01
bitcoinBitcoin (BTC)
53.290,74
ethereumEthereum (ETH)
3.352,97
tetherTether (USDT)
0,865545
bitcoin-cashBitcoin Cash (BCH)
544,66
litecoinLitecoin (LTC)
164,46
bitcoinBitcoin (BTC)
45,188.26
ethereumEthereum (ETH)
2,843.18
tetherTether (USDT)
0.733945
bitcoin-cashBitcoin Cash (BCH)
461.85
litecoinLitecoin (LTC)
139.46

Automated trading with HaasBot Crypto Trading Bots

Crypto Scams

Crypto Scams
Crypto Scams Still Persistent In 2021, SEC Warns About Red Flags To Watch
September 9, 2021
Poly Network
Here’s How Hackers Stole Over $600 million in the Poly Network Attack
August 12, 2021
The World’s Most Infamous Crypto Hacks and Scams
July 31, 2021
Cryptocurrency Exchanges
Cryptocurrency Exchanges and the Plague of Scams and Bans
June 29, 2021
What Role Do Cryptocurrencies Play In The Era Of Ransomware Attacks?
June 9, 2021

Blockchain/Cryptocurrency Questions and Answers

ICo Presale
The Science Behind ICO Presales…
October 14, 2021
Beginner’s Guide to Investing in Cryptocurrency
August 9, 2021
Short-Sell Cryptocurrency
How to Short-Sell Cryptocurrency: A Brief Overview
July 17, 2021
Klaytn
What Is Klaytn (KLAY) And How Does It Work?
July 16, 2021
Cryptocurrencies
Our Crypto Roundup Interview Asks- Do Cryptocurrencies Have a Future?
July 15, 2021


CryptoCurrencyUSDChange 1hChange 24hChange 7d
Bitcoin61,476 0.63 % 6.22 % 14.07 %
Ethereum3,858.4 1.01 % 1.59 % 7.33 %
Binance Coin474.49 0.14 % 0.93 % 7.86 %
Cardano2.220 0.27 % 1.67 % 2.60 %
Tether0.9986 0.03 % 0.08 % 0.23 %
XRP1.140 0.17 % 1.12 % 7.07 %
Solana160.39 1.38 % 6.82 % 3.97 %
Polkadot30.87 2.19 % 17.29 % 10.73 %
USD Coin1.000 0.14 % 0.20 % 0.17 %
Dogecoin0.2397 1.72 % 1.99 % 1.52 %

bitcoin
Bitcoin (BTC) $ 61,569.00
ethereum
Ethereum (ETH) $ 3,873.83
binance-coin
Binance Coin (BNB) $ 475.59
cardano
Cardano (ADA) $ 2.23
tether
Tether (USDT) $ 1.00
xrp
XRP (XRP) $ 1.15
solana
Solana (SOL) $ 160.32
polkadot
Polkadot (DOT) $ 42.67
usd-coin
USD Coin (USDC) $ 1.00
dogecoin
Dogecoin (DOGE) $ 0.240631