[RFC] Generalizing tf.data batching using windowing and reducers

[Edd Wilder-James]

Hi everyone,

I'm happy to announce that the RFC for Generalizing tf.data batching using windowing and reducers is available for comment. 

The feedback phase will be open for two weeks until 2018-08-10. Comments are invited to the pull request linked. You can view the design doc here, and also leave comments inline on the document source.

(Cross posting discuss & developers, as broad API interest. Usually these notices just go to developers@, where you should definitely join if you are interested in reviewing design proposals.)

Summary

This proposal addresses the known limitations of the current tf.data batching API:

• it provides a mechanism for padded batching of sparse tensors
  
• it facilitates customization of batching logic (users can now express batching logic as a pure Python function)
  
• it enables application of different batching logic on different components
  

Thank you for your review and participation!

--

Edd Wilder-James, Open Source Strategy at Google

Github @ewilderj • @tensorflow • @kubeflow