Scio 0.11.0 Released

[Claire McGinty]

Hi all,

We just released Scio 0.11.0. This release has quite a few changes since 0.10.4 including:

🐛 Bug Fixes

• Rename Sparkey hash* methods to avoid shadowing regular methods (#3894) @devictr
• Rollback covary* resetting coder logic (#3969) @stormy-ua
• Ensure MutableScalableBloomFilter initialCapacity > 0 (#3961) @kellen
• Defer ResourceId materialization in SMB to get around Flink FileSystems init issue (#3954) @stormy-ua
• (fix #3912) fix unionAll withName issue (#3931) @clairemcginty
• Get rid of an Iterable re-iteration twice in the asMapSingletonSideInput (#3926) @stormy-ua
• Fix Elasticsearch authentication (#3888) @mrkm4ntr
• update zone in BigtableIT (#3984) @clairemcginty
• explicitly set coders.tableRowCoder in BQ write (#3942) @clairemcginty

🚀 Enhancements

• Side inputs for SMB transforms (#3915) @kellen
• (fix #3944) ToTable implements selectedFields (#3956) @clairemcginty
• Add outputParallelization for JdbcReadOptions (#3941) @LeReunionais
• (fix #3913) parquet-avro TestIO includes map function (#3924) @clairemcginty
• make SMB rename more fault-tolerant, fix #3766 (#3949) @nevillelyh
• Shade updated AvroCoder until Beam 2.33.0 is released (#3957) @clairemcginty
• Remove printstacktrace in Coders (#3982) @jto
• Add a script and methods for smb cogroup with additional sources (#3904) @bkalra23
• Replace setup-scala action and tweak .jvmopts (#3925) @regadas

🪦 Deprecations

• Disable mdoc for scio-sql code blocks in the documentation (#3983) @stormy-ua
• Deprecate pacakage com.spotify.scio.extra.bigquery #3494 (#3974) @stormy-ua
• Deprecate and remove scio-sql #3695 (#3973) @stormy-ua

📗 Documentation

• Update the REPL documentation to use vals in place of defs. (#3891) @jmcconnell
• Adds a Parquet example (#3903) @live-wire
• 0.11.0 release docs update (#3985) @stormy-ua
• Add SMB String decoding doc to Site (#3980) @clairemcginty
• Release v0.10.4 docs updates (#3886) @live-wire

+ Many dependency upgrades. You can read the full list at https://github.com/spotify/scio/releases/tag/v0.11.0.

Thanks,

Claire

[Ankur Goenka]

Thanks Claire!

Which Beam version does it use?

[Ahmet Altay]

Thank you and congratulations! 🎉

[Claire McGinty]

Thanks! It uses Beam 2.32.0 :)

- Claire