Scio v0.9.2 release

1 view
Skip to first unread message

Filipe Regadas

unread,
Jul 2, 2020, 4:10:24 PM7/2/20
to
Hi all,

We just released scio v0.9.2. If you are upgrading from 0.8.x see our Migration Guide for detailed instructions.

I’ll take this opportunity to announce that we moved from Gitter to Spotify FOSS Slack, you can find us in the #scio channel! (get an invite here)


Cheers,
Filipe Regadas


"Alohomora"

Improvements

  • Add more info to RateLimiterDoFn javadoc (#3054)
  • Add OnTimeBehaviour window option (#3063)
  • add small SMB sink optimizations (#3079)
  • Add support for PipelineOptions in ContextAndArgs (#3121)
  • Add support for read only ensureTable (#3114)
  • Add support for sharded JDBC reads from tables (#3020)
  • Add support for String/ByteString TF Bucket key types (#3098)
  • Ensures the future returned by addCallback will complete (#3099)
  • Update BigQueryType and AvroType compileTimeOnly msg (#3107)
  • Cleanup scio-repl classloader (#3118)
  • Initialize ScioContext on :reset (#3109)
  • Remove unnecessary cache of client interceptors (#3091)
  • Refactor scio-repl underlying ILoop (#3108)
  • Make SMB source a splittable BoundedSource (#3005)
  • More Coder doc (#3025)
  • Use a sampled subset of files to compute estimated SMB source size (#3037)
  • Use IndexRecord upper bound (#3028)
  • Use MonoidAggregator when available (#3051)
  • Wrap skewedJoin internals in transform (#3104)
  • Update deprecated .toIterator with .iterator (#3053)
  • Update to use testId instead of toString (#3115)

Bug Fixes

  • Fix additional exception wrappings for Flink (#3035)
  • Fix classpath issue when running from IntelliJ or Bloop (#3087)
  • Fix containValue serialization (#3128)
  • Fix doc site edit page link (#3062)
  • Fix javafmt from #3054
  • Fix repl-generated classfiles output directory (#3106)
  • Fix scio-repl scala specific repl settings (#3089)
  • fix site homepage formatting
  • fix SMB doc formatting (#3078)
  • Fix tuplecoders script
  • Fix: Add extra schema encoding step if coder already set (#3027)
  • Fix: propagate PipelineOptions in job test (#3026)
  • Fix: support mutable zeroValue in aggregate/combine/fold (#3033)
  • Add missing Dataflow runner to scio-repl (#3081)

Dependency Updates

  • Update auto-value, auto-value-annotations to 1.7.3 (#3042)
  • Update Beam to 2.22.0 (#3039)
  • Update caffeine to 2.8.5 (#3112)
  • Update case-app, case-app-annotations, ... to 2.0.3 (#3094)
  • Update elasticsearch-rest-client, ... to 7.8.0 (#3067)
  • Update magnolify-avro, magnolify-bigtable, ... to 0.2.1 (#3127)
  • Update scala to 2.13.3 (#3130)
  • Update scalactic to 3.2.0 (#3072)
  • Update scalatest to 3.2.0 (#3073)
  • Update transport to 6.8.10 (#3047)


Reply all
Reply to author
Forward
0 new messages