Recurrent Neural Networks – RNNs – are a class of artificial neural network where connections between nodes form a directed graph along a sequence. This characteristic allows RNNs to exhibit dynamic temporal behavior for a time sequence.
Unlike feedforward neural networks, RNNs can use their internal state (memory) to process sequences of inputs. This makes them applicable to tasks such as unsegmented, connected handwriting recognition or speech recognition.
Read more on Wikipedia