Facebook Research is developing touchy-feely curious robots

“Much of our work in robotics is focused on self-supervised learning, in which systems learn directly from raw data so they can adapt to new tasks and new circumstances,” a team of researchers from FAIR (Facebook AI Research) wrote in a blog post. “In robotics, we’re advancing techniques such as model-based reinforcement learning (RL) to enable robots to teach themselves through trial and error using direct input from sensors.”

asdf

Specifically, the team has been trying to get a six-legged robot to teach itself to walk without any outside assistance. “Generally speaking, locomotion is a very difficult task in robotics and this is what it makes it very exciting from our perspective,” Roberto Calandra, a FAIR researcher, told Engadget. “We have been able to design algorithms for AI and actually test them on a really challenging problem that we otherwise don’t know how to solve.”

The hexapod begins its existence as a pile of legs with no understanding of its surroundings. Using a reinforcement-learning algorithm, the robot slowly figures out a controller that will help it meet its goal of forward locomotion. And since the algorithm utilizes a recursive self-improvement function, the robot can monitor the information it gathers and further optimize its behavior over time. That is, the more experience the robot gains, the better it performs.

This is easier said than done, given that the robot is expected to figure out not only its location and orientation in space but its balance and momentum as well — all from a series of sensors located in the machine’s knees. By optimizing the robot’s behavior and focusing on getting it walking in as few steps as possible, Facebook taught the robot how to “walk” in a matter of hours, rather than days.

But what’s a hexapod to do once it figures out how to move? Go exploring, obviously. But it’s not so easy to induce wanderlust in robots that are typically trained to achieve a narrowly defined goal. Yet this is exactly what Facebook is trying to do, with some help from its colleagues at NYU and a robotic arm.

asdf

Previous research into imparting a sense of curiosity onto AI has focused on reducing uncertainty. Facebook’s latest efforts strive for the same goal but do so in a more structured manner.

“We actually started with a model that doesn’t know much about itself,” FAIR researcher Franziska Meier told Engadget. “At this point, the robot knows how to hold its arm, but it doesn’t actually know what actions to apply to reach a certain target.” But as the robot learns which torques need to be applied to move the arm into the next target configuration, it can eventually begin to optimize its planning.

“We use this model that tells us this, to plan ahead for a number of time steps,” Meier continued. “And we try to use this planning procedure to optimize the action sequence to achieve the task.” To prevent the robot from optimizing its routines too highly and getting caught in a loop, the research team rewarded the robot for actions that resolved uncertainty.

“We do this exploration, we actually learn a better model faster, achieve the task faster, and we learn a model that generalizes better to new tasks,” Meier concluded.

Finally, Facebook has been hard at work teaching robots how to feel. Not emotionally, but physically. And it’s leveraging a predictive deep-learning model originally designed for video. “It’s essentially a technique that can predict videos from the current state, from the current image and an action,” Calandra explained.

The team trained the AI to operate directly using raw data, in this case a high-resolution tactile sensor, rather than through a model. “Our work shows that such policies may be learned entirely without rewards, through diverse unsupervised exploratory interactions with the environment,” the researchers concluded. During the experiment, the robot was able to successfully manipulate a joystick, roll a ball and identify the correct face of a 20-sided die.

“We show that we can essentially have a robot manipulating small objects in an unsupervised manner,” Calandra said. “And what it means in practice is… we can actually predict accurately what’s going to be the output of [a given] action. This allows us to start planning into the future. We can optimize for the sequence of actions that will actually yield the desired outcome.”

Combining visual and tactile inputs could greatly improve the functionality of future robotic platforms and improve learning techniques. “To build machines that can learn by interacting with the world independently, we need robots that can leverage data from multiple senses,” the team concluded. We can only imagine what Facebook has in store for this. However the company declined to comment on potential practical applications for this research in the future.

About the author

E-Crypto News was developed to assist all cryptocurrency investors in developing profitable cryptocurrency portfolios through the provision of timely and much-needed information. Investments in cryptocurrency require a level of detail, sensitivity, and accuracy that isn’t required in any other market and as such, we’ve developed our databases to help fill in information gaps.

Related Posts

E-Crypto News Executive Interviews



Automated trading with HaasBot Crypto Trading Bots

Crypto Scams

Millions in Cryptocurrency Stolen by Scammers in the Last Month According to Tenable Research
November 24, 2021
Behind The Scenes: How this Crypto Community Responded to + $50m Hack
October 18, 2021
Crypto Scams
Crypto Scams Still Persistent In 2021, SEC Warns About Red Flags To Watch
September 9, 2021
Poly Network
Here’s How Hackers Stole Over $600 million in the Poly Network Attack
August 12, 2021
The World’s Most Infamous Crypto Hacks and Scams
July 31, 2021

Blockchain/Cryptocurrency Questions and Answers

Crypto casinos
How Does Bitcoin Casino Work + 2021 Beginner’s Guide
November 8, 2021
Cryptocurrency
How to Buy and Sell Cryptocurrency
November 8, 2021
What Are Bitcoin Futures And How Will They Work In 2022?
November 4, 2021
Ethereum
The Unconventional Guide to Ethereum
October 28, 2021
ICo Presale
The Science Behind ICO Presales…
October 14, 2021


CryptoCurrencyUSDChange 1hChange 24hChange 7d
Bitcoin51,314 0.64 % 4.09 % 11.30 %
Ethereum4,336.4 1.03 % 3.30 % 2.43 %
Binance Coin581.68 0.60 % 1.54 % 6.75 %
Tether0.9986 0.03 % 0.08 % 0.23 %
Solana195.31 0.54 % 2.36 % 4.42 %
Cardano1.410 0.70 % 5.17 % 11.87 %
USD Coin1.000 0.14 % 0.20 % 0.17 %
XRP0.8303 0.38 % 4.28 % 16.25 %
Polkadot30.87 2.19 % 17.29 % 10.73 %
Terra70.88 0.25 % 8.15 % 37.42 %

bitcoin
Bitcoin (BTC) $ 51,293.00
ethereum
Ethereum (ETH) $ 4,355.35
binance-coin
Binance Coin (BNB) $ 582.78
tether
Tether (USDT) $ 1.00
solana
Solana (SOL) $ 196.56
cardano
Cardano (ADA) $ 1.41
usd-coin
USD Coin (USDC) $ 0.996239
xrp
XRP (XRP) $ 0.829671
polkadot
Polkadot (DOT) $ 30.74
terra-luna
Terra (LUNA) $ 72.26