The Living Thing / Notebooks :

Differentiable learning of automata

Learning stack machines, random access machines, nested hierarchical parsing machines, Turing machines and whatever other automata-with-memory that you wish, from data. In other words, teaching computers to program themselves, via a deep learning formalism. Obviously Artificial general intelligence would be good at handling these; It’s not the absolute hippest research area right now though, on account of being hard in general, just like we alwasy thought. Some progress has been made.

The border between these and recurrent neural networks is porous.

Google branded: Differentiable neural computers

Christopher Olah’s Characteristically pedagogic intro

Adrian Colyer’s introduction to neural Turing machines.

Andrej Karpathy’s memory machine list has some good starting point.