Scio 0.8.3 released

[Neville Li]

Hi all,

We just released Scio 0.8.3. This is mainly a bug fix release with some minor improvements. 

Notes on JDK 11

JDK 11 is now supported starting with 0.8.2. To upgrade, you'll need to build your code and submit jobs to Dataflow with JDK 11.

Notes on Scala 2.11

Scio 0.8.x will be the last releases to support Scala 2.11. 0.9.x will support 2.12 & 2.13 only. Upgrading to 2.12 should be mostly transparent barring some stale external dependencies. Please reach out if you run into any issues.

Cheers,

Neville

https://github.com/spotify/scio/releases/tag/v0.8.3

"Draconifors"

Features

• Add CsvIO (#2701)
• Implement hashSubtractByKey (#2769)
• Add directory treatment and compression option to readFiles (#2756)
• Add FileNaming and prefix support to BinaryIO (#2759)
• Add Header and Footer support to TextIO (#2758)
• Add GenericJson coder (#2742)
• Add ProtobufUtil for Message<->Avro conversions (#2743)

Bug fixes & improvements

• Add schema cache support in BigQueryType (#2775)
• Optimize KeyGroupIterator (#2779)
• Make CoGbkResult Iterable slightly lazy (#2749)
• Make java Enum coder deterministic #2761 #2764
• Fix saveAsTypedBigQuery deprecation message (#2763)
• Patch SortValues doFn to avoid re-enconding bytes (#2748)
• Fix: remove redundant withExtendedErrorInfo in dynamic BigQuery (#2744)

[Neville Li]

A quick follow up, we just released Scio 0.8.4. This is mostly a minor bug fix release and the last one for 0.8.x.

We'll hopefully get an initial 0.9.0 release out in a few weeks.

https://github.com/spotify/scio/releases/tag/v0.8.4

"Expecto Patronum"

Features

• Initial flink runner support #2785
• Add support for default transform names #2760 #2803
• Add fromStorage doc #2792

Bug fixes & improvements

• Fix offset in SlidingWindows #2790
• Reduce Consumer impl leak in SortedBucketTransform (#2795)
• Revert "make CoGbkResult Iterable slightly lazy (#2749)" #2791