example of seq2seq in tfjs

[Sohrab Saran]

Hi,

Can anyone please share an example of seq2seq in tfjs? For example, language translation.

Thanks,

Sohrab

[yass...@google.com]

Have you seen https://github.com/tensorflow/tfjs-examples/tree/master/translation?

Best

Yannick

[Sohrab Saran]

Hi Yannick,

Thanks for the link. One more question: is there any example of seq2seq training using tfjs? The link you provided says that the training was done in Python and Keras.

[Shanqing Cai]

Hi Sohrab,

The AdditionRNN example (https://github.com/tensorflow/tfjs-examples/tree/master/addition-rnn) is precisely a seq2seq training example. The task is perhaps a little unconventional: given a sequence like "23+39", output a sequence like "62". But the essence of seq2seq is there.

Best,

Shanqing

[Sohrab Saran]

Hi Shanqing,

Sorry if I am asking a silly question, but actually I'm a newbie to tensorflow:

When I run https://storage.googleapis.com/tfjs-examples/addition-rnn/dist/index.html I get all these fabulous graphs and parameters.

But what do these graphs and parameters mean?

How were the parameter default values arrived at?

Please point me to the documentation that can best answer this...

Question2: Also, I looked at the code of index.js in order to figure out how to provide my own training data.

I see a function 

generateData(digits, numExamples, invert) 

How do I change the code of this function to use an array of examples where each example is an array of 2 elements, the first element being an input string and second element being an output string,e.g.

[

["My name is Sohrab. What is my name?", "Sohrab"],

["My name is Shanquing. What is my name?", "Shanquing"] 

...

]

For my second question, I am analysing and experimenting with the code but meanwhile any pointer from your side will help.

Thanks,

Sohrab

[Josiah Bryan]

Hey @Sohrab, did you ever find any solutions? I'm looking for the same thing - training seq2seq with tfjs ....

[Josiah Bryan]

Appreciate the information! I have already done tons of background reading, looking for actual implementation haha. I look forward to seeing what you come up with!

On Mon, Sep 3, 2018, 1:09 PM Sohrab Saran <sohra...@gmail.com> wrote:

Hi Josiah,

I found this useful as background reading: 

http://neuralnetworksanddeeplearning.com

Beyond that I did not yet fork and annotate https://github.com/tensorflow/tfjs-examples/tree/master/addition-rnn

Maybe I'll start doing that in a couple of days.

Best,

Sohrab

[Z Z]

Did anyone come up with an example of this ?