Discrete Recurrent Neural Networks as Pushdown Automata
In this paper, we describe a new discrete recurrent model with discrete external stacks for learning context-free grammars (or pushdown automata).
SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
In this paper, we describe a new discrete recurrent model with discrete external stacks for learning context-free grammars (or pushdown automata).
Recurrent neural networks have recently been shown to have the ability to learn regular and context-free grammars from examples. We show that while conventional analog recurrent networks try to form clusters in activation space to represent discrete states of the grammars during learning, and can be successful in doing so, the clusters so formed tend to become unstable as longer and longer test input strings are presented to the network.