Scio 0.8.1 released

2 views
Skip to first unread message

Shameera Rathnayaka

unread,
Jan 31, 2020, 2:02:08 PM1/31/20
to scio-...@googlegroups.com, us...@beam.apache.org
Hi all,

We just released Scio 0.8.1. This release depends on beam 2.18.0 and includes a few new features, bug fixes and improvements.

The matching spotify-scio release version is 0.8.1-lib325

"Bombarda Maxima"

Features

  • Update Beam to 2.18 (#2631)
  • Add BigQuery Geography support (#2620)
  • Add simple sorter method (#2542)
  • Add Avro BigQuery logical types conversion (#2602)

Bug fixes & improvements

  • Add Map/MultiMap singleton side input, fix #2628 (#2629)
  • Fix ClassCastEx in PubSubIO (#2583)
  • Fix sharded Sparkey side input with missing values. (#2617)
  • Add specialized coders for Elasticsearch, fix #2626 (#2637)
  • Make KryoAtomicCoder.instanceId an incrementing integer, not a UUID (#2589)
  • Fix BigQuery caching, by using dry-run when extracting tables (#2613)
  • Fix recursive coders (#2605)
  • Avoid NPE when finding rt.jar under jdk11 (#2610)
  • More tests on Coders (#2639)
  • Consolidate IT mock data generation (#2624)
  • Fix sql script query generator
  • Avro Message record from scio-schemas could hide protobuf Message (#2609)
  • Rename metricsLocation option parameter (#2603)
  • Add comment on scio-extra support level
  • Add test case for avro conversion with bytes (#2594)
  • Add lisp-case arg parsing removal (#2592) (#2221)
  • Remove unused ClassTag (#2590)
  • Fix BigQuery deprecated method message (#2586)
  • Add scalafmt to scalafix rules (#2491), rename join names (#2455), rename named args: that to rhs (#2468)
  • Fix BigQuery deprecated method message (#2586)
  • Add elasticsearch example (#2388)
  • Remove mdoc annotation for macro-based Parquet.md examples (#2581)
  • Update doc and migration guides (#2585)
  • Use weakTypeOf in scio-bigquery (#2641)
  • Drop FastEval in scio-sql (#2622)

Thanks to all contributors!

Cheers,
Shameera.
Reply all
Reply to author
Forward
0 new messages