two questions about AdamWOptimizer

[Deqing Sun]

Hi, 

I have two questions about the AdamWOptimizer. Can you please help answer them?

1. Is there any difference between contrib_opt.AdamWOptimizer and tfa.optimizers.AdamW when you migrated the former to addons?

2. Have you compared with torch.optim.AdamW and see any differences between them? 

Thank you.

Deqing

[Sean Morgan]

Hi Deqing,

1. AdamWOptimizer was originally ported from contrib, but has since underdone improvements:

https://github.com/tensorflow/addons/commits/master/tensorflow_addons/optimizers/weight_decay_optimizers.py

2. Do you mean static code comparisons or runtime results? Both are a little tricky to compare across frameworks, but if you do benchmark on some standard models/datasets please send the results to the SIG!

Thanks,
Sean

--
You received this message because you are subscribed to the Google Groups "SIG Addons" group.
To unsubscribe from this group and stop receiving emails from it, send an email to addons+un...@tensorflow.org.
To view this discussion on the web visit https://groups.google.com/a/tensorflow.org/d/msgid/addons/f4401424-f0cd-4f21-860a-ab7df9ebe51d%40tensorflow.org.

[Deqing Sun]

Hi Sean,

Thank you for your answers.

We are more interested in comparing the runtime results and will let you know if we have some benchmark results.

Best regards,

Deqing

On Tue, May 5, 2020 at 6:14 PM Sean Morgan <seanm...@outlook.com> wrote:

Hi Deqing,

1. AdamWOptimizer was originally ported from contrib, but has since underdone improvements:

https://github.com/tensorflow/addons/commits/master/tensorflow_addons/optimizers/weight_decay_optimizers.py

2. Do you mean static code comparisons or runtime results? Both are a little tricky to compare across frameworks, but if you do benchmark on some standard models/datasets please send the results to the SIG!

Thanks,
Sean

On Tue, May 5, 2020 at 3:05 PM 'Deqing Sun' via SIG Addons <add...@tensorflow.org> wrote:

--

You received this message because you are subscribed to the Google Groups "SIG Addons" group.
To unsubscribe from this group and stop receiving emails from it, send an email to addons+un...@tensorflow.org.
To view this discussion on the web visit https://groups.google.com/a/tensorflow.org/d/msgid/addons/f4401424-f0cd-4f21-860a-ab7df9ebe51d%40tensorflow.org.

--

Thank you.

Deqing