Scio 0.4.6 released

3 views
Skip to first unread message

Neville Li

unread,
Dec 19, 2017, 1:12:30 PM12/19/17
to scio-...@googlegroups.com
Hi all,

We just released Scio 0.4.6. It's based on Beam 2.2.0 now with a lot of improvements and bug fixes.

Cheers,
Neville

https://github.com/spotify/scio/releases/tag/v0.4.6

"Galago gallarum"

Features

  • Upgrade Beam to 2.2.0 #797 #958
  • Support dynamic file IO destinations #919 #965
  • Support custom Kryo options via PipelineOptions #896 #955
  • Propagate input to TensorFlow predict output fn
  • Annotate more examples with Socco
  • Support compression in TextIO #972
  • Use Compression in TFRecordIO #977
  • Add TSV examples #974

Bug fixes

  • Use window as side input cache key #959 #960
  • Use canonical path in macro type providers #975
  • Fix deduplication in SCollection#subtract #973
  • Fix empty RHS for hashJoin and hashLeftJoin #953
  • Fix ClassNotFound issue with ClosureCleaner
  • Lift projection in ParquetAvroFile#flatMap
  • Add Dataflow runner to scio-examples #963 #968
  • Remove deprecated Pubsub ClientAuthInterceptor #957 #962
Reply all
Reply to author
Forward
0 new messages