How do you get from Moorgate to Piccadilly Circus?

Here, let me help you.

Here, let me help you.

It may look easy to you (or does it?), but it’s borderline impossible for artificial intelligence. Or it was, until Google DeepMind (that employs several physicists) unleashed its Differentiable Neural Computer (DNC). According to the DeepMind scientists, neural networks are very good at recognizing patterns, or finding the best move for a given situation (as their own AlphaGo did). However, they cannot stack up a complex sequence of actions, because they cannot remember.

dnc-cover-image-002-width-1500

A representation of DNC: the “controller” neural network at the center takes in the data coming from the left, stores it on the right, or links it to information already there. Then combines them all to produce the answer at the bottom. Credit: DeepMind

tumblr_nklw7hj3o51t55xupo1_400In a way, you could think of data as ingredients, and of the neural network as a somewhat limited cook, that can only work sequentially on them. So it can’t set aside the dough for a pie while it prepares the filling. Chef DNC can: it makes the dough, puts it in the memory, works on the filling and then finishes our data pie.

Whether we realize it or not, when we plan a subway journey we store and link information all the time. At each stop we make a decision: stay on, get down, or change. Then we remember where we are, where we started and where we’re headed. That’s how DNC do.

Big whoop—you may say—public transportation apps and satnavs have been doing this for years. Indeed they have, and are probably better at it. But they were specifically programmed for that, and that’s all they can do.

DNC wasn’t: it learned to compute paths, starting from sets of randomly connected dots (graphs, if you want to be fancy). It would memorize the different connections (what points are connected, with what line), then try to find the shortest path between two points. Time after time, it would be told whether the answer was correct.

graph

An example of randomly connected dots, like those DNC was trained on—only those were a lot more complicated!

Once it learned, DNC was able to navigate the London Tube—quite the random graph after all—, but it could just as easily guide you through the NY subway, plan out the solution to a simple puzzle, or answer complex questions about family trees.

This video shows DNC memorizing connection (who’s whose child or sibling) and answering “who is X’s maternal great uncle?” I had to take a moment to parse the question—and I’m a reasonably competent human. Try asking that to a satnav!

Often in artificial intelligence, what the machine can do is not as important as what it might learn to do. And DNC proved it can learn a lot.

Cover photo: I think we got out at the wrong station, CC-BY-NC-ND The Hamster Factor, via Flickr. Some rights reserved.

If you want more
  • The Nature paper detailing how DNC works and how it was trained.
  • A very nice post on the DeepMind blog about DNC
  • Want to see DNC solve one of many tasks on a puzzle? There’s a video of that, too.
Advertisements

Questions? Comments? Let's talk about that!

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s