Scio 0.8.0-beta2 released

4 views
Skip to first unread message

Neville Li

unread,
Oct 16, 2019, 1:04:55 PM10/16/19
to Scio Users, us...@beam.apache.org
Hi all,

We've just released Scio 0.8.0-beta2 (Scala API for Apache Beam for those on the Beam mailing list). This will likely be the last beta before 0.8.0 stable release.

Cheers,
Neville


Features

  • Bump Beam to 2.16.0 (#2292)
  • Bump featran to 0.4.0
  • Add DelegatingSideInput and TypedSparkeySideInput. (#2287)
  • Add initial BigQuery methods with Beam schema (#2197)
  • Allow user to pass in Bigtable GcRule (#2256)
  • Support accessing all counters within JobTest (fix #2007) (#2247)
  • Add BigQuery Source type (#2214)
  • Add Storage API read from query (#2204)

Bug Fixes & Improvements

  • Segregate and deprecate avro reflective records support (#2300)
  • Fix lambda ser/de in SCollectionMatchers, #2294 (#2296)
  • Use PubsubIO.readMessagesWithCoderAndParseFn from Beam 2.16 (#2295)
  • Wrap PubsubWithAttributes write in composite PTransform (fix #2286) (#2288)
  • AvroType macro shouldn't generate duplicate record classes fix #2264) (#2267)
  • Add Paradise dependency back to scio-repl classpath (fix #2265) (#2266)
  • Use JavaSerializer for encoding Throwable (fix #2249) (#2261)
  • Check name uniqueness without running on Dataflow (#2252)
  • Added fix for BinaryIO output. (#2251)
  • Truncate app args if long (#2244)
  • Fix: run repl with jdk11 (#2246)
  • Reduce guava usage #2223 #2242
  • Use upstream magnolia for scala >= 2.12, fix #2192 (#2241)
  • Fix #2096: restore sbt < 1.3.0 behaviour by not closing classloader (#2224)
  • Update version check message (#2227)
  • Don't wrap exceptions in WrappedBCoder (#2266)
  • Bypass nullable coder for ObjectFileIO, fix #2187 (#2188)

Breaking Changes

  • Decouple SQL extension from scio-core (#2201)
Reply all
Reply to author
Forward
0 new messages