Hot Chips 2020 Live Blog: Silicon Photonics for AI (6:00pm PT)

08:28PM EDT – Lightmatter developers silicon photonics based AI systems

Hot Chips 2020 Live Blog: Silicon Photonics for AI (6:00pm PT) 1

08:29PM EDT – A new type of computer

08:29PM EDT – Lightmatter Mars

Coinbase 30

08:29PM EDT – multi-chip solution

Hot Chips 2020 Live Blog: Silicon Photonics for AI (6:00pm PT) 2

Hot Chips 2020 Live Blog: Silicon Photonics for AI (6:00pm PT) 3

Hot Chips 2020 Live Blog: Silicon Photonics for AI (6:00pm PT) 4

08:31PM EDT – Workloads grow out to datacenter scales

08:31PM EDT – a new hw approach is needed

Hot Chips 2020 Live Blog: Silicon Photonics for AI (6:00pm PT) 5

08:31PM EDT – Using standard CMOS

Hot Chips 2020 Live Blog: Silicon Photonics for AI (6:00pm PT) 6

08:31PM EDT – Optical transport

08:32PM EDT – Perform computation in the optical domain, even in parallel

08:32PM EDT – 1000x faster than electronics at 10x speed with 1000x les pwoer for the same die area

08:32PM EDT – Single MAC at microwatt in photonics vs a milliwatt in electronics

08:32PM EDT – Takes about the same area

Hot Chips 2020 Live Blog: Silicon Photonics for AI (6:00pm PT) 7

08:33PM EDT – 10s watts for data transport – free with optics

08:33PM EDT – Free from RC time constants

08:33PM EDT – 10s of watts to single digit microwatts

Hot Chips 2020 Live Blog: Silicon Photonics for AI (6:00pm PT) 8

08:34PM EDT – MZI phase shift interference detection

08:34PM EDT – Mach Zehnder Interferometer

08:34PM EDT – Interference creates a multiplier

08:34PM EDT – No fundamental energy required

08:34PM EDT – near-zero

08:35PM EDT – independent of process, voltage

Hot Chips 2020 Live Blog: Silicon Photonics for AI (6:00pm PT) 9

08:35PM EDT – Many ways to build phase shifters

08:35PM EDT – Mars uses Nano Optical Electro Mechanical System NOEMS

08:35PM EDT – Run at 100s of MHz vs 10s of kHz

08:36PM EDT – Mars uses a mechanical solution

08:36PM EDT – effect the refractive index

08:36PM EDT – suspend in air during manufacture and etch under it

08:36PM EDT – Cdyn is super low

Hot Chips 2020 Live Blog: Silicon Photonics for AI (6:00pm PT) 10

08:37PM EDT – Optical Vector MAC

08:37PM EDT – Directional couplers

08:38PM EDT – 2×2 matrix multiplied by a 1×2 vector

08:38PM EDT – At speed of light, almost zero power

08:38PM EDT – Array of MZIs

Hot Chips 2020 Live Blog: Silicon Photonics for AI (6:00pm PT) 11

08:38PM EDT – Build large matrix vector structures

08:38PM EDT – 1000×1000 or larger

08:39PM EDT – 1000s MACs per 100ps

08:39PM EDT – limitation is surrounding electronics

Hot Chips 2020 Live Blog: Silicon Photonics for AI (6:00pm PT) 12

08:39PM EDT – High speed data photonics at the edge

08:39PM EDT – Performance scales with area

08:39PM EDT – power scales with sqrt(area)

08:40PM EDT – 64 DAC and 64 ADC = 4096 MACs

08:40PM EDT – Limit is pushing the weights into the array

08:40PM EDT – 3 orders of magnitudes of order faster than electronics

Hot Chips 2020 Live Blog: Silicon Photonics for AI (6:00pm PT) 13

08:41PM EDT – Each element can take multiple data points – parallel processing

08:42PM EDT – optics in different colors etc

08:42PM EDT – like fiber optics

Hot Chips 2020 Live Blog: Silicon Photonics for AI (6:00pm PT) 14

08:42PM EDT – 1 GHz vector rate – set my data conversions

08:42PM EDT – 50mW laser

08:42PM EDT – 90nm GloFo standard photonics process

08:42PM EDT – 150mm2

08:42PM EDT – yield very well

Hot Chips 2020 Live Blog: Silicon Photonics for AI (6:00pm PT) 15

Hot Chips 2020 Live Blog: Silicon Photonics for AI (6:00pm PT) 16

08:43PM EDT – Mars SoC 14nm custom ASIC

08:43PM EDT – mm2

08:43PM EDT – Analog interfaces to Photoics

08:43PM EDT – SRAM for weights and activations

Hot Chips 2020 Live Blog: Silicon Photonics for AI (6:00pm PT) 17

08:44PM EDT – single fully synchronous pipeline scehduler

Hot Chips 2020 Live Blog: Silicon Photonics for AI (6:00pm PT) 18

Hot Chips 2020 Live Blog: Silicon Photonics for AI (6:00pm PT) 19

08:47PM EDT – 3W TDP…

Hot Chips 2020 Live Blog: Silicon Photonics for AI (6:00pm PT) 20

08:48PM EDT – Most power is data movement

Hot Chips 2020 Live Blog: Silicon Photonics for AI (6:00pm PT) 21

08:48PM EDT – 3D integration

08:49PM EDT – optical core and ASIC are stacked

08:49PM EDT – Laser power coming in from external to chip

Hot Chips 2020 Live Blog: Silicon Photonics for AI (6:00pm PT) 22

08:49PM EDT – Support for ML Frameworks – Pytorch, TensorFlow, ONNX

Hot Chips 2020 Live Blog: Silicon Photonics for AI (6:00pm PT) 23

Hot Chips 2020 Live Blog: Silicon Photonics for AI (6:00pm PT) 24

08:51PM EDT – Q&A Time

08:51PM EDT – Q: 3W TDP? A: That’s for SiPh, Laser, SoC, everything

08:52PM EDT – Q: Perf on Resnet? A: Not publishing yet, but we have simulator results and demo chips in the lab

08:52PM EDT – Q: MLPerf? A: We’re working on it!

08:53PM EDT – Q: Models bigger than on-system memory? A: We know it’s an important problem to solve! We think we can solve it through photonics. Looking at scale out solutions for training and inference

08:54PM EDT – HBM roadmap is good, but it doesn’t scale with the BW that we need, so we need solutions that scale at factors of 10, that’s what we’re look at

08:56PM EDT – Q: How robust are the inteferometers? A: MEMS have a yield – you can enhance based on scales on feature sizes. Reliability – these things have to live in a datacenter for 10 years, so we’re looking at robust devices. High reliability MEMs devices technology has been around a while. These devices are really small, so these are tiny – we’re not pushing to a limit. These are tiny movements to affect the effective refractive index

08:56PM EDT – Q: DAC precision? A: Not as critical as you think. Generally 8-bit DAC. We can scale to 12-bit and still build high perf system. We’re building something that matches the rest of the industry. DAC/ADC are the rate limits of the design

08:57PM EDT – Q: 200ps, does that include digital? A: No, just the photonics and analog

08:58PM EDT – Q: Other neural networks? A: We’re looking at them, but our goal is a general purpose accelerator. We have space on the 14nm ASIC of course

08:58PM EDT – Q: Limitations on weight matrices? A: No, we can represent any matrix

08:59PM EDT – That’s the end of Hot Chips! I hope you’ve enjoyed the Live Blogs. There’s so much to piece through after the fact. The slack channel for attendees was going crazy. There’s a small wrap up talk for a few minutes

Hot Chips 2020 Live Blog: Silicon Photonics for AI (6:00pm PT) 25

09:00PM EDT – 2294 total participants this year!

09:00PM EDT – 2302! this slide was made too early

09:00PM EDT – Last year was a record 1250

09:01PM EDT – ~3.5% press in previous years

Hot Chips 2020 Live Blog: Silicon Photonics for AI (6:00pm PT) 26

09:02PM EDT – Public slide decks and videos will be available later this year

Hot Chips 2020 Live Blog: Silicon Photonics for AI (6:00pm PT) 27

Hot Chips 2020 Live Blog: Silicon Photonics for AI (6:00pm PT) 28

09:07PM EDT – Thanks to everyone for tuning in. If you loved our content, sign up next year to watch it live 🙂

Hot Chips 2020 Live Blog: Silicon Photonics for AI (6:00pm PT) 29
blank
About the author

E-Crypto News was developed to assist all cryptocurrency investors in developing profitable cryptocurrency portfolios through the provision of timely and much-needed information. Investments in cryptocurrency require a level of detail, sensitivity, and accuracy that isn’t required in any other market and as such, we’ve developed our databases to help fill in information gaps.

Related Posts

blank

E-Crypto News Executive Interviews


blank

bitcoin
Bitcoin (BTC) $ 39,798.00
ethereum
Ethereum (ETH) $ 2,644.37
tether
Tether (USDT) $ 1.00
binance-coin
Binance Coin (BNB) $ 335.60
cardano
Cardano (ADA) $ 1.33
xrp
XRP (XRP) $ 0.753292
usd-coin
USD Coin (USDC) $ 1.00
dogecoin
Dogecoin (DOGE) $ 0.206342
polkadot
Polkadot (DOT) $ 18.34
binance-usd
Binance USD (BUSD) $ 1.00
USD
EUR
GBP
bitcoinBitcoin (BTC)
$ 39,798.00
ethereumEthereum (ETH)
$ 2,644.37
tetherTether (USDT)
$ 1.00
bitcoin-cashBitcoin Cash (BCH)
$ 558.09
litecoinLitecoin (LTC)
$ 144.34
bitcoinBitcoin (BTC)
33.536,70
ethereumEthereum (ETH)
2.228,34
tetherTether (USDT)
0,842673
bitcoin-cashBitcoin Cash (BCH)
470,29
litecoinLitecoin (LTC)
121,63
bitcoinBitcoin (BTC)
28,621.37
ethereumEthereum (ETH)
1,901.74
tetherTether (USDT)
0.719166
bitcoin-cashBitcoin Cash (BCH)
401.36
litecoinLitecoin (LTC)
103.80

Automated trading with HaasBot Crypto Trading Bots

Crypto Scams

blank
The World’s Most Infamous Crypto Hacks and Scams
July 31, 2021
Cryptocurrency Exchanges
Cryptocurrency Exchanges and the Plague of Scams and Bans
June 29, 2021
blank
What Role Do Cryptocurrencies Play In The Era Of Ransomware Attacks?
June 9, 2021
Crypto Scams On The Rise As Market Enters Bull Cycle
Crypto Scams On The Rise As Market Enters Bull Cycle
December 22, 2020
Harpreet Singh Sahni perpetrated the Plus Gold Union Coin (PGUC) scam
Sydney Concert Promoter Harpreet Sahni Involved In $50M Crypto PGUC Scam
November 2, 2020

Blockchain/Cryptocurrency Questions and Answers

Short-Sell Cryptocurrency
How to Short-Sell Cryptocurrency: A Brief Overview
July 17, 2021
Klaytn
What Is Klaytn (KLAY) And How Does It Work?
July 16, 2021
Cryptocurrencies
Our Crypto Roundup Interview Asks- Do Cryptocurrencies Have a Future?
July 15, 2021
Solana
What Is Solana (SOL) And How Does It Work?
June 26, 2021
blank
What Is Plethori Platform And How Does It Work?
June 12, 2021


CryptoCurrencyUSDChange 1hChange 24hChange 7d

bitcoin
Bitcoin (BTC) $ 39,296.00
ethereum
Ethereum (ETH) $ 2,618.66
tether
Tether (USDT) $ 1.00
binance-coin
Binance Coin (BNB) $ 331.60
cardano
Cardano (ADA) $ 1.31
xrp
XRP (XRP) $ 0.739584
usd-coin
USD Coin (USDC) $ 1.00
dogecoin
Dogecoin (DOGE) $ 0.204238
polkadot
Polkadot (DOT) $ 18.23
binance-usd
Binance USD (BUSD) $ 1.01