Recursive neural network implementation in TensorFlow

Question

Is there any available recursive neural network implementation in TensorFlow TensorFlow's tutorials do not present any recursive neural networks. Most TensorFlow code I've found is CNN, LSTM, GRU, vanilla recurrent neural networks or MLP. I am most interested in implementations for natural language processing.

Example of a recursive neural network:

The tree structure may vary between different inputs. I.e., I do not want the tree structure to be fixed.

I was looking for something similar, if you're open to using theano instead of tensorflow you could have a look https://github.com/ofirnachum/tree_rnn. There are a few examples on display. — Lukasz, Nov 22 '16 at 17:42

score 1 · Accepted Answer · answered May 23 '17 at 21:47

1

Take a look at Tensorflow Fold:

https://github.com/tensorflow/fold

TensorFlow Fold is a library for creating TensorFlow models that consume structured data, where the structure of the computation graph depends on the structure of the input data.

answered May 23 '17 at 21:47

Jadiel de Armas

126
2

score 0 · Answer 2 · answered Nov 01 '16 at 22:13

These types of architectures are awkward in Tensorflow. I think someone did implement them though. http://www.kdnuggets.com/2016/06/recursive-neural-networks-tensorflow.html

You might prefer to use DyNet, which was designed to allow for dynamically changing architectures. https://github.com/clab/dynet

score 0 · Answer 3 · edited May 25 '17 at 16:05

0

I hope this is what you need: https://github.com/sapruash/RecursiveNN:

Tensorflow implementation of Recursive Neural Networks using LSTM units as described in "Improved Semantic Representations From Tree-Structured Long Short-Term Memory Networks" by Kai Sheng Tai, Richard Socher, and Christopher D. Manning.

edited May 25 '17 at 16:05

Franck Dernoncourt

42,093
30
155
271

answered May 25 '17 at 15:23

Kevin Chen

9
1

1

You need to explain your answer and not just give a link that you think may be applicable. – Michael R. Chernick May 25 '17 at 15:40
This is rather a comment. Can someone convert this answer to a comment? – Ferdi May 25 '17 at 16:00
1

I have added some information, it qualifies as an answer in my opinion. Is that okay for you Ferdi and Michael Chernick? – Franck Dernoncourt May 25 '17 at 16:05

Recursive neural network implementation in TensorFlow

3 Answers3