Scio 0.9.0 released

[Neville Li]

Hi all,

We just released Scio 0.9.0. The biggest change was dropping Scala 2.11 and adding 2.13 support. Also included are Guava/magnolia powered Bloom Filter, improved test messages and other improvements.

For those using Featran for feature engineering, the matching release is 0.6.0.

Cheers,

Neville

https://github.com/spotify/scio/releases/tag/v0.9.0

"Furnunculus"

Breaking changes

• See v0.9.0 Migration Guide for detailed instructions
• Remove deprecated elasticsearch2 (#2800)
• Remove deprecated cassandra2 (#2801)
• Remove deprecated tensorflow saveAsTfExampleFile (#2798)
• Remove toEither from ScioUtil (#2799)
• Remove ReflectiveRecordIO (#2856)
• Remove context close in favor of run (#2858)
• Remove deprecated ScioContext Future references (#2859)
• Rework implicits/syntax for scio-extra bigquery package (#2844)
• Remove implicit Coder requirement for .saveAsSortedBucket (#2839)
• Drop scala 2.11 support (#2619)
• Re-vamp Bloom filter and sparse-transforms (#2651)
• Remove deprecated bigQuery, typedBigQuery and saveAsBigQuery (#2806)

Improvements

• Add scala 2.13 support (#2619)
• Add queryAsSource to BigQueryType (#2804)
• Deprecate BigQueryType query in favor of queryRaw (#2857)
• Make OptionCoder extends from AtomicCoder (#2882)
• Make iterable and traversable coders buffered (#2881)
• Better support for alternative runners in tests (#2877)
• Use UUID in SMB temp directory (#2849)
• Reuse ApproxFilter (#2817)
• Support metadata in AvroFileOperations (fix #2832) (#2834)
• Add --help command line support for custom PipelineOptions (#2840)(#2843)
• Add covary method to lift SCollection to the specified type (#2808)
• Customize equality in unit tests and better failure message (#2733)
• Add more convinience methods that support default transform names (#2805)

Bug Fixes

• Fix create scio-spanner it clients lazy (#2889)
• Fix generate tree eagerly before checking for private constructors (#2846)
• Fix missing-bucket case when Sink collection is empty (#2869)
• Remove uneeded caffeine dep in scio-bigquery (#2861)
• Fix Sharded Sparkey string hashing behaviour for strings longer than one character. (#2826)
• Add magnolify BigtableType usage examples to scio-examples #2789 (#2816)
• Check jobReference.location for query location (#2845)
• Fix NPE in BaseAsyncLookupDoFn.Try#hashCode() (#2841)
• Fix: cancel job on waitUntilFinish timeout (#2823)
• Fix: full camelCase typed args support (#2777)

Dependency Updates

• Update magnolify to 0.1.7
• Update magnolia to 0.14.5 (#2886)
• Update beam-runners-core-construction-java, ... to 2.20.0 (#2887)
• Update scala-collection-compat to 2.1.5 (#2885)
• Update gcs-connector to hadoop2-2.1.2 (#2842)
• Update algebra to 2.0.1 (#2821)
• Update es6 transport to 6.8.8 (#2830)
• Update es7 elasticsearch-rest-client, ... to 7.6.2 (#2829)
• Update cats-kernel to 2.1.1 (#2822)
• Update PPrint to 0.5.9 (#2793)