Embulk v0.9 and JDBC plugins

[Dai Mikurube]

Hello, Embulk users.

Please upgrade your JDBC plugins to the latest before Embulk v0.9. Only embulk-input-jdbc 0.8.6+ and embulk-output-jdbc 0.7.12+ would work with Embulk v0.9.

"JDBC plugins" include MySQL, PostgreSQL, Redshift, Oracle, SQL Server, DB2, and so on...

Some other plugins may not work with Embulk v0.9 as well. We'd suggest to start testing your usage with the latest plugins sooner.

Let me recap the previous announcement about v0.9 and its incompatibility again.

----

<< tl;dr for Users >> 

The biggest change is that Embulk v0.9 would expect Java 8. Embulk core would be tested only in Java 8 (and possibly Java 9 in addition sooner or later... *hopefully*). Plugins compiled with Java 8 features are welcome then!

Next, we stop providing embulk.gem from v0.9. If you are using embulk.gem and/or require 'embulk' from Ruby, please see and comment in: #628 and/or #766.

Then, please try Embulk v0.8.36 soon with the plugins and the usages which you actually operate. You'd see some warning messages like below on your console (stderr) if your usage expects compatibility breaks.

    ===== Example warning message =====

    [WARN] Plugin uses deprecated constructor of org.embulk.spi.time.TimestampFormatter.

    [WARN] Report plugins in your config at: https://github.com/embulk/embulk/issues/ ...

    ===== Example warning message =====

If you see such warning messages, please report in the GitHub Issues URL in your case. We'd provide how to workaround, notify the developer of the plugin, or reconsider the breakage then.

<< for Plugin Developers >>

v0.9 would introduce 6 types of plugin SPI incompatibilities as of now. They are related with JRuby which we're removing from Embulk's deeply-tightened dependencies in v0.9. Some of them are related with Timestamps which have been unnecessarily depending on JRuby.

1. Some constructors of TimestampParser and TimestampFormatter (#745)

It could be the most impactful on plugins. TimestampParser and TimestampFormatter have been constructed with JRuby instances, but the constructors will be removed in v0.9. The GitHub Issue above describes how to workaround this incompatibility.

2. AbstractDynamicColumnSetter#setRubyObject (#799)

We expect no plugins are calling this method directly. Ruby's PageBuilder had been calling it inside Embulk core, but the part is now replaced to pure-Ruby implementation. Please ping us if your plugin is calling the method directly.

3. RubyValueApi (#802)

We expect no plugins are using this class directly. It had been a static utility class to convert internal MessagePack values and JRuby values inside Embulk core, but the part is now replaced to pure-Ruby implementation. Please ping us if your plugin is using this class directly.

4. Timestamp#getRubyTime or Timestamp.fromRubyTime (#820)

We expect no plugins are using these methods directly. The methods had been used to convert Embulk Timestamps and JRuby's time objects inside Embulk core, but the part is now replaced to pure-Ruby implementation. Please ping us if your plugin is calling the methods directly.

5. Some constructors of PagePrinter (#827)

We expect no plugins are using PagePrinter. The class had been used from embedded StdoutOutputPlugin. StdoutOutputPlugin now calls PagePrinter's new constructor.

6. TimestampFormat: newFormatter and newParser (#828)

We expect no plugins are using these methods to create TimestampFormatter and/or TimestampParser. They have been @Deprecated for a long time since v0.6.14.

--

Dai MIKURUBE

  dmik...@treasure-data.com