Gaming AIs: NVIDIA Teaches A Neural Network to Recreate Pac-Man

Gaming AIs: NVIDIA Teaches A Neural Network to Recreate Pac-Man 1

Following last week’s virtual GTC keynote and the announcement of their Ampere architecture, this week NVIDIA has been holding the back-half of their conference schedule. As with the real event, the company has been posting numerous sessions on everything NVIDIA, from Ampere to CUDA to remote desktop. But perhaps the most interesting talk – and certainly the most amusing – is coming from NVIDIA’s research group.

Tasked with developing future technologies and finding new uses for current technologies, today the group is announcing that they have taught a neural network Pac-Man.

And no, I don’t mean how to play Pac-Man. I mean how to be the game of Pac-Man.

The reveal, timed to coincide with the 40th anniversary of the ghost-munching game, is coming out of NVIDIA’s research into Generative Adversarial Networks (GANs). At a very high level, GANs are a type of neural network where two neural networks are trained against each other – typically one learning how to do a task and the other learning how to spot the first doing that task – with the end goal being that the competition between the networks can help make the two networks better by forcing them to improve to win. In terms of practical applications, GANs have most famously been used in research projects to create programs that can create realistic-looking images of real-world items, upscale existing images, and other image synthesis/manipulation tasks.

For Pac-Man, however, the researchers behind the fittingly named GameGAN project took things one step further, focusing on creating a GAN that can be taught how to emulate/generate a video game. This includes not only recreating the look of a game, but perhaps most importantly, the rules of a game as well. In essence, GameGAN is intended to learn how a game works by watching it, not unlike a human would.

For their first project, the GameGAN researchers settled on Pac-Man, which is as good a starting point as any. The 1980 game has relatively simple rules and graphics, and crucially for the training process, a complete game can be played in a short amount of time. As a result, over 50K “episodes” of training, the researchers taught a GAN how to be Pac-Man solely by having the neural network watch the game being played.

And most impressive of all, the crazy thing actually works.

In a video released by NVIDIA, the company is briefly showing off the Pac-Man-trained GameGAN in action. While the resulting game isn’t a pixel-perfect recreation of Pac-Man – notably, GameGAN’s simulated resolution is lower – the game none the less looks and functions like the arcade version of Pac-Man. And it’s not just for looks, either: the GameGAN version of Pac-Man accepts player input, just like the real game. In fact, while it’s not ready for public consumption quite yet, NVIDIA has already said that they want to release a publicly playable version this summer, so that everyone can see it in action.

Fittingly for a gaming-related research project, the training and development for the GameGAN was equally as silly at times. Because the network needed to consume thousands upon thousand of gameplay sessions – and NVIDIA presumably doesn’t want to pay its staff to play Pac-Man all day – the researchers relied on a Pac-Man-playing bot to automatically play the game. As a result, the AI that is GameGAN has essentially been trained in Pac-Man by another AI. And this is not without repercussions – in their presentation, the researchers have noted that because the Pac-Man bot was so good at the game, GameGAN has developed a tendency to avoid killing Pac-Man, as if it were part of the rules. Which, if nothing else, is a lot more comforting than finding out that our soon-to-be AI overlords are playing favorites.

All told, training the GameGAN for Pac-Man took a quad GV100 setup four days, over which time it monitored 50,000 gameplay sessions. Which, to put things in perspective of the amount of hardware used, 4 GV100 GPUs is 84.4 billion transistors, almost 10 million times as many transistors as are found in the original arcade game’s Z80 CPU. So while teaching a GAN how to be a Pac-Man is incredibly impressive, it is, perhaps, not an especially efficient way to execute the game.

Meanwhile, figuring out how to teach a neural network to be Pac-Man does have some practical goals to it as well. According to the research group, one big focus right now is in using this concept to more quickly train simulators, which traditionally have to be carefully constructed by humans in order to capture all of the possible interactions. If a neural network can instead learn how something behaves by watching what’s happening and what inputs are being made, this could conceivably make creating simulators far faster and easier. Interestingly, the entire concept leads to something of a self-feedback loop, as the idea is to then use those simulators to then train other neural networks how to perform a task, such as NVIDIA’s favorite goal of self-driving cars.

Ultimately, whether it leads to real-world payoffs or not, there’s something amusingly human about a neural network learning a game by observing – even (and especially) if it doesn’t always learn the desired lesson.

About the author

E-Crypto News was developed to assist all cryptocurrency investors in developing profitable cryptocurrency portfolios through the provision of timely and much-needed information. Investments in cryptocurrency require a level of detail, sensitivity, and accuracy that isn’t required in any other market and as such, we’ve developed our databases to help fill in information gaps.

Related Posts

E-Crypto News Executive Interviews



bitcoin
Bitcoin (BTC) $ 65,265.00
ethereum
Ethereum (ETH) $ 4,289.67
binance-coin
Binance Coin (BNB) $ 492.92
cardano
Cardano (ADA) $ 2.26
tether
Tether (USDT) $ 1.00
solana
Solana (SOL) $ 190.34
xrp
XRP (XRP) $ 1.15
polkadot
Polkadot (DOT) $ 44.34
dogecoin
Dogecoin (DOGE) $ 0.253434
usd-coin
USD Coin (USDC) $ 0.996287
USD
EUR
GBP
bitcoinBitcoin (BTC)
$ 65,265.00
ethereumEthereum (ETH)
$ 4,289.67
tetherTether (USDT)
$ 1.00
bitcoin-cashBitcoin Cash (BCH)
$ 648.33
litecoinLitecoin (LTC)
$ 208.69
bitcoinBitcoin (BTC)
56.015,32
ethereumEthereum (ETH)
3.681,72
tetherTether (USDT)
0,858275
bitcoin-cashBitcoin Cash (BCH)
556,45
litecoinLitecoin (LTC)
179,11
bitcoinBitcoin (BTC)
47,361.18
ethereumEthereum (ETH)
3,112.91
tetherTether (USDT)
0.725675
bitcoin-cashBitcoin Cash (BCH)
470.48
litecoinLitecoin (LTC)
151.44

Automated trading with HaasBot Crypto Trading Bots

Crypto Scams

Behind The Scenes: How this Crypto Community Responded to + $50m Hack
October 18, 2021
Crypto Scams
Crypto Scams Still Persistent In 2021, SEC Warns About Red Flags To Watch
September 9, 2021
Poly Network
Here’s How Hackers Stole Over $600 million in the Poly Network Attack
August 12, 2021
The World’s Most Infamous Crypto Hacks and Scams
July 31, 2021
Cryptocurrency Exchanges
Cryptocurrency Exchanges and the Plague of Scams and Bans
June 29, 2021

Blockchain/Cryptocurrency Questions and Answers

ICo Presale
The Science Behind ICO Presales…
October 14, 2021
Beginner’s Guide to Investing in Cryptocurrency
August 9, 2021
Short-Sell Cryptocurrency
How to Short-Sell Cryptocurrency: A Brief Overview
July 17, 2021
Klaytn
What Is Klaytn (KLAY) And How Does It Work?
July 16, 2021
Cryptocurrencies
Our Crypto Roundup Interview Asks- Do Cryptocurrencies Have a Future?
July 15, 2021


CryptoCurrencyUSDChange 1hChange 24hChange 7d
Bitcoin64,868 1.43 % 1.26 % 12.84 %
Ethereum4,220.8 2.35 % 8.85 % 17.06 %
Binance Coin489.67 0.73 % 0.44 % 4.28 %
Cardano2.230 2.45 % 3.54 % 1.83 %
Tether0.9986 0.03 % 0.08 % 0.23 %
Solana185.86 3.49 % 16.20 % 25.25 %
XRP1.130 1.97 % 1.88 % 0.40 %
Polkadot30.87 2.19 % 17.29 % 10.73 %
Dogecoin0.2504 2.36 % 2.16 % 7.58 %
USD Coin1.000 0.14 % 0.20 % 0.17 %

bitcoin
Bitcoin (BTC) $ 65,265.00
ethereum
Ethereum (ETH) $ 4,289.67
binance-coin
Binance Coin (BNB) $ 492.92
cardano
Cardano (ADA) $ 2.26
tether
Tether (USDT) $ 1.00
solana
Solana (SOL) $ 190.34
xrp
XRP (XRP) $ 1.15
polkadot
Polkadot (DOT) $ 44.34
dogecoin
Dogecoin (DOGE) $ 0.253434
usd-coin
USD Coin (USDC) $ 0.996287