Groups
Groups
āĻāĻĨā§āĻĒāĻāĻĨāύāĻā§āϞāĻŋ
āϏāĻŦ āĻā§āϰā§āĻĒ āĻāĻŦāĻ āĻŽā§āϏā§āĻ
Google-āĻ āĻŽāϤāĻžāĻŽāϤ āĻĒāĻžāĻ āĻžāύ
āϏāĻšāĻžā§āϤāĻž
āĻā§āϰā§āύāĻŋāĻ
āϏāĻžāĻāύ-āĻāύ āĻāϰā§āύ
Groups
Groups
tensor2tensor
āĻāĻĨā§āĻĒāĻāĻĨāύāĻā§āϞāĻŋ
āϏāĻŽā§āĻĒāϰā§āĻā§
tensor2tensor
āĻŽāĻžāϞāĻŋāĻ āĻāĻŦāĻ āĻŽā§āϝāĻžāύā§āĻāĻžāϰā§āϰ āϏāĻžāĻĨā§ āϝā§āĻžāĻāĻžāϝā§āĻžāĻ āĻāϰā§āύ
1â30 of 184
Welcome to Tensor2Tensor.
This group is dedicated to discussing issues related to the Tensor2Tensor library:
Â
https://github.com/tensorflow/
tensor2tensor
We're discussing issues with the library, problems with training and use of the models,
other issues related to ML and TensorFlow, and recent Tensor2Tensor releases.
Feel free to post here!
T2T Team
āϏāĻŦāĻāĻāĻŋ 'āĻĒāĻĄāĻŧāĻž āĻšā§ā§āĻā§' āĻšāĻŋāϏā§āĻŦā§ āĻāĻŋāĻšā§āύāĻŋāϤ āĻāϰā§āύ
āĻāĻĒāϤā§āϤāĻŋāĻāύāĻ āĻā§āϰā§āĻĒā§āϰ āĻŦāĻŋāώā§ā§ āϰāĻŋāĻĒā§āϰā§āĻ āĻāϰā§āύ
ā§ĻāĻāĻŋ āĻŦā§āĻā§ āύā§āĻā§āĻž āĻšā§ā§āĻā§
subramaniyam cabila
,Â
Joydeep Mitra
3
⧧⧍/ā§§ā§§/ā§¨ā§Š
Clarification
I apologize for the error. On Mon, 13 Nov 2023, 09:13 Joydeep Mitra, <joyd...@gmail.com> wrote
āĻĒā§āĻž āĻšā§āύāĻŋ,
Clarification
I apologize for the error. On Mon, 13 Nov 2023, 09:13 Joydeep Mitra, <joyd...@gmail.com> wrote
⧧⧍/ā§§ā§§/ā§¨ā§Š
Betizazu Alemu
ā§Ŧ/ā§Ŧ/⧍⧍
I need Just one Command
I know it's no longer supported, but I am just starting on NLP and working on a Translation
āĻĒā§āĻž āĻšā§āύāĻŋ,
I need Just one Command
I know it's no longer supported, but I am just starting on NLP and working on a Translation
ā§Ŧ/ā§Ŧ/⧍⧍
Lohith Naj N
ā§Ģ/⧧⧍/⧍⧧
Unable to train the model
Hello, I used your code in machine learning foundations video lecture on your youtube channel and I
āĻĒā§āĻž āĻšā§āύāĻŋ,
Unable to train the model
Hello, I used your code in machine learning foundations video lecture on your youtube channel and I
ā§Ģ/⧧⧍/⧍⧧
åį¯
ā§Ž/ā§/⧍ā§Ļ
Model Apply and Application - Image Classification
Dear experts, I want to use Tensor2Tensor for image classification tasks. After model training, I got
āĻĒā§āĻž āĻšā§āύāĻŋ,
Model Apply and Application - Image Classification
Dear experts, I want to use Tensor2Tensor for image classification tasks. After model training, I got
ā§Ž/ā§/⧍ā§Ļ
Rohan
,Â
Lukasz Kaiser
2
⧍ā§Ļ/ā§Š/⧍ā§Ļ
GSOC 2020
Hi Rohan. We're not planning to convert T2T to TF2 as is. Instead, please contribute to Trax, the
āĻĒā§āĻž āĻšā§āύāĻŋ,
GSOC 2020
Hi Rohan. We're not planning to convert T2T to TF2 as is. Instead, please contribute to Trax, the
⧍ā§Ļ/ā§Š/⧍ā§Ļ
Arben Sabani
2
⧧⧝/ā§Š/⧍ā§Ļ
Tranformer model with float inputs and outputs
I know that the word sequnce in translate problem is converted to tensors of float, but i want to
āĻĒā§āĻž āĻšā§āύāĻŋ,
Tranformer model with float inputs and outputs
I know that the word sequnce in translate problem is converted to tensors of float, but i want to
⧧⧝/ā§Š/⧍ā§Ļ
Paloma Jimeno
,Â
Martin Popel
3
⧍ā§Ļ/⧍/⧍ā§Ļ
tensorflow_model_server translation from translate_enes_wmt32k t2t library. "Could not parse example input"
Thank you, Martin, It is still a bad request (see picture) Could be an option to use the t2t-query-
āĻĒā§āĻž āĻšā§āύāĻŋ,
tensorflow_model_server translation from translate_enes_wmt32k t2t library. "Could not parse example input"
Thank you, Martin, It is still a bad request (see picture) Could be an option to use the t2t-query-
⧍ā§Ļ/⧍/⧍ā§Ļ
David Liebman
,Â
Martin Popel
4
ā§§ā§Ŧ/⧍/⧍ā§Ļ
registering hparam set in user dir
from tensor2tensor.utils import usr_dir usr_dir.import_usr_dir('my-usr-dir') I tried this as
āĻĒā§āĻž āĻšā§āύāĻŋ,
registering hparam set in user dir
from tensor2tensor.utils import usr_dir usr_dir.import_usr_dir('my-usr-dir') I tried this as
ā§§ā§Ŧ/⧍/⧍ā§Ļ
Ravi Jain
⧧/⧧⧧/⧧⧝
Regarding attention
Why is ``` Q*(K).t() ``` ( t() mean transpose) done in attention, and not ``` Q*(Q+K).t() ``` for
āĻĒā§āĻž āĻšā§āύāĻŋ,
Regarding attention
Why is ``` Q*(K).t() ``` ( t() mean transpose) done in attention, and not ``` Q*(Q+K).t() ``` for
⧧/⧧⧧/⧧⧝
Sumeet Singh
⧍⧝/ā§§ā§Ļ/⧧⧝
Invalid argument: In[0] and In[1] must have compatible batch dimensions: [1,8,1288,4608,4] vs. [1,8,1250,4,256]
This error is occurring inside the function dot_product_attention. I don't even know how
āĻĒā§āĻž āĻšā§āύāĻŋ,
Invalid argument: In[0] and In[1] must have compatible batch dimensions: [1,8,1288,4608,4] vs. [1,8,1250,4,256]
This error is occurring inside the function dot_product_attention. I don't even know how
⧍⧝/ā§§ā§Ļ/⧧⧝
Sumeet Singh
ā§¨ā§Š/ā§§ā§Ļ/⧧⧝
local_attention_2d vs unmasked_local_attention_2d_tpu
Hi All, I am writing a new model for images that uses 2D Local Self Attention for the encoder as
āĻĒā§āĻž āĻšā§āύāĻŋ,
local_attention_2d vs unmasked_local_attention_2d_tpu
Hi All, I am writing a new model for images that uses 2D Local Self Attention for the encoder as
ā§¨ā§Š/ā§§ā§Ļ/⧧⧝
Sumeet Singh
⧍⧧/ā§§ā§Ļ/⧧⧝
ImageMsCocoCharacters (image_ms_coco_characters)
Hi, Does anybody know what model goes along with the ImageMsCocoCharacters (image_ms_coco_characters)
āĻĒā§āĻž āĻšā§āύāĻŋ,
ImageMsCocoCharacters (image_ms_coco_characters)
Hi, Does anybody know what model goes along with the ImageMsCocoCharacters (image_ms_coco_characters)
⧍⧧/ā§§ā§Ļ/⧧⧝
Weiguang Guan
, âĻÂ
Sumeet Singh
7
⧍⧧/ā§§ā§Ļ/⧧⧝
conflict between TF 2.0 and T2T 1.14.1
Got it to work with Python 3.6 using pipenv --skip-lock. Pasting the pipfile for what its worth. [[
āĻĒā§āĻž āĻšā§āύāĻŋ,
conflict between TF 2.0 and T2T 1.14.1
Got it to work with Python 3.6 using pipenv --skip-lock. Pasting the pipfile for what its worth. [[
⧍⧧/ā§§ā§Ļ/⧧⧝
Aleksas Pielikis
⧍⧧/ā§§ā§Ļ/⧧⧝
Defining Text Multi-label Classification Problem
Trying to define a text multi-label classification problem in t2t with kaggle jigsaw toxic comment
āĻĒā§āĻž āĻšā§āύāĻŋ,
Defining Text Multi-label Classification Problem
Trying to define a text multi-label classification problem in t2t with kaggle jigsaw toxic comment
⧍⧧/ā§§ā§Ļ/⧧⧝
Tianyu Jiang
ā§Ž/ā§§ā§Ļ/⧧⧝
how to indicate input and output node names
Hi everyone, I am trying to convert the t2t model to Apple coreML model.( Transformer model). But i
āĻĒā§āĻž āĻšā§āύāĻŋ,
how to indicate input and output node names
Hi everyone, I am trying to convert the t2t model to Apple coreML model.( Transformer model). But i
ā§Ž/ā§§ā§Ļ/⧧⧝
Simon Mc Duff
, âĻÂ
Erik Chan
8
ā§Š/ā§§ā§Ļ/⧧⧝
How to add Input Parameter in T2T using Tensorflow Serving
Hi Simon Would you mind sharing your code? I am also trying to do Input Parameter in T2T using
āĻĒā§āĻž āĻšā§āύāĻŋ,
How to add Input Parameter in T2T using Tensorflow Serving
Hi Simon Would you mind sharing your code? I am also trying to do Input Parameter in T2T using
ā§Š/ā§§ā§Ļ/⧧⧝
éŗčŖæŋ
,Â
Eugene Kuznetsov
5
ā§§/ā§§ā§Ļ/⧧⧝
with Tensor2tensor when making a transformer training.......
I think the dateset is fine. Because, the training could be continued. The following is including
āĻĒā§āĻž āĻšā§āύāĻŋ,
with Tensor2tensor when making a transformer training.......
I think the dateset is fine. Because, the training could be continued. The following is including
ā§§/ā§§ā§Ļ/⧧⧝
Jonny Saunders
⧍⧝/⧝/⧧⧝
Conditional Language Modeling?
Hello! I've been playing around with T2T for awhile now, still getting my feet around some of the
āĻĒā§āĻž āĻšā§āύāĻŋ,
Conditional Language Modeling?
Hello! I've been playing around with T2T for awhile now, still getting my feet around some of the
⧍⧝/⧝/⧧⧝
David Liebman
,Â
John Ed Alvinez
2
⧍⧝/⧝/⧧⧝
learning rate 2.0
Hi David, Good day. I think the Base learning rate text is logged here: https://github.com/tensorflow
āĻĒā§āĻž āĻšā§āύāĻŋ,
learning rate 2.0
Hi David, Good day. I think the Base learning rate text is logged here: https://github.com/tensorflow
⧍⧝/⧝/⧧⧝
siddhant sharma
,Â
Martin Popel
2
ā§§/ā§Ž/⧧⧝
Training the a new model based on previous trained model
Just use the same output_dir and continue training. Make sure the new dataset uses the same subword
āĻĒā§āĻž āĻšā§āύāĻŋ,
Training the a new model based on previous trained model
Just use the same output_dir and continue training. Make sure the new dataset uses the same subword
ā§§/ā§Ž/⧧⧝
Mrinal Roy
, âĻÂ
Praneet
3
ā§Šā§Ļ/ā§/⧧⧝
CIFAR-10, CIFAR-100 Models with Mesh TensorFlow
+1 On Thursday, 13 June 2019 14:09:11 UTC-4, Mrinal Roy wrote: Anyone tried or have pointers to
āĻĒā§āĻž āĻšā§āύāĻŋ,
CIFAR-10, CIFAR-100 Models with Mesh TensorFlow
+1 On Thursday, 13 June 2019 14:09:11 UTC-4, Mrinal Roy wrote: Anyone tried or have pointers to
ā§Šā§Ļ/ā§/⧧⧝
Suhas Shekhar
,Â
Praneet
2
ā§Šā§Ļ/ā§/⧧⧝
Model-Parallel Layout in Mesh-Tensorflow
+1, looking for answer/ Thanks you On Monday, 1 July 2019 20:39:07 UTC-4, Suhas Shekhar wrote: I am
āĻĒā§āĻž āĻšā§āύāĻŋ,
Model-Parallel Layout in Mesh-Tensorflow
+1, looking for answer/ Thanks you On Monday, 1 July 2019 20:39:07 UTC-4, Suhas Shekhar wrote: I am
ā§Šā§Ļ/ā§/⧧⧝
Youwei Liang
, âĻÂ
Lukasz Kaiser
5
⧍ā§/ā§/⧧⧝
Does anyone know some easy-to-train datasets?
Thank you. I want to train on an NLP dataset.
āĻĒā§āĻž āĻšā§āύāĻŋ,
Does anyone know some easy-to-train datasets?
Thank you. I want to train on an NLP dataset.
⧍ā§/ā§/⧧⧝
Eugene Kuznetsov
,Â
Lukasz Kaiser
7
⧍⧍/ā§/⧧⧝
bfloat16 GPU performance
Found another fairly significant optimization. It turns out that, if you add a dense layer to
āĻĒā§āĻž āĻšā§āύāĻŋ,
bfloat16 GPU performance
Found another fairly significant optimization. It turns out that, if you add a dense layer to
⧍⧍/ā§/⧧⧝
Seongjin Cho
,Â
Lukasz Kaiser
2
⧍ā§Ļ/ā§/⧧⧝
"Generic conv implementation only supports NHWC tensor format for now" error when using t2t-decode
This looks very much like a TF or CUDA problem. I'm not sure what the solution is, but please ask
āĻĒā§āĻž āĻšā§āύāĻŋ,
"Generic conv implementation only supports NHWC tensor format for now" error when using t2t-decode
This looks very much like a TF or CUDA problem. I'm not sure what the solution is, but please ask
⧍ā§Ļ/ā§/⧧⧝
Martin Popel
ā§§ā§Ž/ā§/⧧⧝
Re: Formula used to calculate BLEU
Hi Arben, t2t-bleu implementation (as well as SacreBLEU) uses the correct BLEU formula (as in the
āĻĒā§āĻž āĻšā§āύāĻŋ,
Re: Formula used to calculate BLEU
Hi Arben, t2t-bleu implementation (as well as SacreBLEU) uses the correct BLEU formula (as in the
ā§§ā§Ž/ā§/⧧⧝
Santosh Gupta
,Â
Lukasz Kaiser
2
ā§§ā§Ž/ā§/⧧⧝
Is the Text2textCopyableTokens problem for summarization? If so, what to put for 'extra_label'?
I must admit I'm not sure what problem this file is about, does anyone know? Lukasz On Tue, Jul
āĻĒā§āĻž āĻšā§āύāĻŋ,
Is the Text2textCopyableTokens problem for summarization? If so, what to put for 'extra_label'?
I must admit I'm not sure what problem this file is about, does anyone know? Lukasz On Tue, Jul
ā§§ā§Ž/ā§/⧧⧝
Arben Sabani
,Â
Martin Popel
3
ā§§ā§Š/ā§/⧧⧝
mathematical formula used for t2t-bleu
Thanks a lot, Martin. Thant helps a lot. best Arben On Saturday, 13 July 2019 18:30:47 UTC+2, Arben
āĻĒā§āĻž āĻšā§āύāĻŋ,
mathematical formula used for t2t-bleu
Thanks a lot, Martin. Thant helps a lot. best Arben On Saturday, 13 July 2019 18:30:47 UTC+2, Arben
ā§§ā§Š/ā§/⧧⧝
siddhant sharma
,Â
Martin Popel
2
ā§§ā§Š/ā§/⧧⧝
Generation of word embedding in tensor2tensor-transformer model
Hi Siddhant, by default, word embeddings are treated as all other weights in the Transformer model,
āĻĒā§āĻž āĻšā§āύāĻŋ,
Generation of word embedding in tensor2tensor-transformer model
Hi Siddhant, by default, word embeddings are treated as all other weights in the Transformer model,
ā§§ā§Š/ā§/⧧⧝
Arben Sabani
, âĻÂ
est namoc
6
ā§§ā§Š/ā§/⧧⧝
new translate problem which can deal with corrections
Thanks a lot, very interesting articles. I had a similar idea or approach how translation should work
āĻĒā§āĻž āĻšā§āύāĻŋ,
new translate problem which can deal with corrections
Thanks a lot, very interesting articles. I had a similar idea or approach how translation should work
ā§§ā§Š/ā§/⧧⧝