Upgrade ETL application from 3.3.0 to 3.4.0

[leeli-jen]

Hi,

I am upgrading CDAP ETL application from 3.3.0 to 3.4.0 by follwoing the instruction in CDAP document: http://docs.cask.co/cdap/current/en/cdap-apps/hydrator/upgrade.html#cdap-apps-etl-upgrade

The command is:

java -cp /opt/cdap/master/libexec/cdap-etl-tools-3.4.0.jar co.cask.cdap.etl.tool.UpgradeTool -u http://<host>:<port> -e /tmp/failedUpgrades upgrade

The document describes: The first argument is the host and port for the CDAP master.

I do not understand what does it mean "the port for CDAP master"? I can not find the corresponding setting for the port of CDAP master in cdap-site.xml.

Leon

[Ali Anwar]

Hi Leon.

The default values are defined in cdap-default.xml:
https://github.com/caskdata/cdap/blob/develop/cdap-common/src/main/resources/cdap-default.xml

The parameter is "router.bind.port", with a default value of 10000.

Let us know if there's any other questions.

Regards,

Ali Anwar

--
You received this message because you are subscribed to the Google Groups "CDAP User" group.
To unsubscribe from this group and stop receiving emails from it, send an email to cdap-user+...@googlegroups.com.
To post to this group, send email to cdap...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/cdap-user/19569e3f-ddf7-4e98-a314-56a761c136fd%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[leeli-jen]

Hi Ali,

The upgrade command returns the follwoing error:

2016-05-03 15:59:19,804 - ERROR [main:c.c.c.e.t.UpgradeTool@147] - Error upgrading pipeline application:default.kafka2es_mysql_customer_sqoop.
co.cask.cdap.common.NotFoundException: 'app or app artifact' was not found.
        at co.cask.cdap.client.ApplicationClient.update(ApplicationClient.java:352) ~[cdap-etl-tools-3.4.0.jar:na]
        at co.cask.cdap.etl.tool.UpgradeTool.upgrade(UpgradeTool.java:145) [cdap-etl-tools-3.4.0.jar:na]
        at co.cask.cdap.etl.tool.UpgradeTool.upgrade(UpgradeTool.java:132) [cdap-etl-tools-3.4.0.jar:na]
        at co.cask.cdap.etl.tool.UpgradeTool.upgrade(UpgradeTool.java:106) [cdap-etl-tools-3.4.0.jar:na]
        at co.cask.cdap.etl.tool.UpgradeTool.main(UpgradeTool.java:247) [cdap-etl-tools-3.4.0.jar:na]
2016-05-03 15:59:19,805 - ERROR [main:c.c.c.e.t.UpgradeTool@150] - Writing config for pipeline application:default.kafka2es_mysql_customer_sqoop to /tmp/failedUpgrades/default-kafka2es_mysql_customer_sqoop.json for further manual investigation.

default-kafka2es_mysql_customer_sqoop.json file is as attached.

在 2016年5月3日星期二 UTC+8下午3:34:06，ali写道：

[Albert Shau]

Hi Leon,

The error indicates that there is no etl-realtime-3.4.0 artifact.  Could you try listing the artifacts to see if it is in the list (http://docs.cdap.io/cdap/current/en/reference-manual/http-restful-api/artifact.html#list-available-artifacts)?  You could also try going to the Hydrator UI.  If there are errors the artifact is likely not in the system.

If that is the case, do you see any errors in the cdap-master log?

Thanks,

Albert

To view this discussion on the web visit https://groups.google.com/d/msgid/cdap-user/5dccfb10-7315-45a3-99d9-b83f31ffd711%40googlegroups.com.

[ali]

The resolution to this issue is the same as here:
https://groups.google.com/forum/#!topic/cdap-user/KV1XItHNWHQ