Recurrent Neural Network (RNN) introduction

rnn1_graph

[Update 2017.06.11] Add chainer v2 code   How can we deal with the sequential data in deep neural network? This formulation is especially important in natural language processing (NLP) field. For example, text is made of sequence of word. If we want to predict the next word from given sentence, the probability of the next word depends on whole past sequence of word. So, the neural network need an ability to “remember” the past sentence to predict next word. In this chapter, Recurrent Neural Network (RNN) and Long Short Term Memory (LSTM) are introduced to deal with sequential data. Recurrent Neural Network (RNN) Recurrent Neural Network is similar to Multi Layer […]

Continue reading →