[RFC] API to synchronize devices

[Reed Wanderman-Milne]

Hi all,

The RFC to add an API to synchronize devices is available for comment.

The feedback phase will be open until November 8, 2022. Comments are invited at the pull request linked.

Summary

The RFC proposes adding a function, tf.sync_devices(), which synchronizes all devices. Since GPUs run asynchronously, this is useful for benchmarking TensorFlow on GPUs.

Thank you,

Reed