Error importing redshift driver

[German Bortoli]

I am trying to create a new data source using redshift connector, I did the following steps.

1) Download the driver from here http://docs.aws.amazon.com/redshift/latest/mgmt/configure-jdbc-connection.html#download-jdbc-driver (Choosen driver was JDBC 4.2–compatible driver)

2) Copy the driver into /opt/nifi/mysql (with nifi:users permissions) and copy also on /opt/kylo/kylo-services/plugin

3) Restart kylo services.

When I restart somehow the plugin located into kylo services throw the following error https://gist.github.com/Germanaz0/5971ebc3494b4ecb2bb56fad20ffacc3

Then I tried another alternative:

Did all 3 steps using postgres driver and created the data source using the following steps: https://groups.google.com/d/msg/kylo-community/cZDorVliKJg/oWsuearMBgAJ

It worked properly but when I tried to create a new feed using that data source, it was not showing any table inside my schemas (neither public one)

What can be ? I would like to use the redshift driver

[Gregory Hart]

Hi German,

Could you try the Redshift driver without the AWS SDK included? Kylo includes the AWS SDK v1.9.6 so these may be conflicting.

If you still get an error could you please post your entire kylo-services.log file? The one you posted seems to be truncated.

If Kylo starts but you're not able to see your tables then also please attach your kylo-services.log file as it may indicate why.

[German Bortoli]

Yes I tried with the no-aws-sdk driver, but it still continue failing, this is the log https://gist.github.com/Germanaz0/5c35f4f5eea613b80e8f58912e9e22c5

And when I try to use the postgres driver I get no tables on data feed creation, this is the error log for it https://gist.github.com/Germanaz0/bb84019b2e0d16e00194a56d7201ff90

[Gregory Hart]

Hi German,

Unfortunately it doesn't look like Kylo supports Redshift at this time. Those errors look specific to Redshift so you might try asking in the AWS community forums or contacting Think Big Analytics for professional services and support options.

[Gregory Hart]

Also as a work-around, if you remove the jar from kylo-services/plugin/ then Kylo should allow you to enter the table name manually. It would then be up to NiFi to support Redshift which should work.

Please create a JIRA and the Kylo team can look into supporting Redshift:

https://kylo-io.atlassian.net/

[German Bortoli]

Yeah did it but still does not work, what I am having now is a new issue, I migrated the db to postgres, instead using redshift now, everything goes well until Nifi starts to process,

I am getting a strange error

2017-10-26 01:44:24,065 ERROR [Timer-Driven Process Thread-3] c.t.nifi.v2.ingest.GetTableData GetTableData[id=a3eb6450-1f53-3e1e-c01f-450d09c9d529] Unable to execute SQL select from table due to StandardFlowFileRecord[uuid=6aaceeb6-23ff-4bc7-91e3-358e8c5c9cdc,claim=,offset=0,name=114649344355806,size=0]; routing to failure: org.apache.nifi.processor.exception.ProcessException: org.apache.commons.dbcp.SQLNestedException: Cannot create PoolableConnectionFactory ([Amazon](600000) Error setting/closing connection: General SSLEngine problem.)

This is the link to the error log https://gist.github.com/Germanaz0/12516e9d65612a7dc15180085ebb8739 

[German Bortoli]

Nevermind it worked using this link https://stackoverflow.com/a/46122744/1156325

[Jagrut Sharma]

German - Thanks for posting your resolution. 

--

Jagrut