pnda install issue

[yongzoo Kim]

i'm trying to install pnda

# root

1. git clone https://github.com/pndaproject/pnda.git

2. cd  $PNDA_HOME/mirror

3. sh create_mirror.sh -r -d HDP

4. cd $PNDA_HOME/build

5. ./install-build-tools.sh

6. ./set-pnda-env.sh

# user

7. ./build-pnda.sh RELEASE release/4.0 HDP

   python error!! ImportError: No module named pyhive

   trying to install manual "pip install pyhive"

8. flink error

wget -qO- https://raw.githubusercontent.com/pndaproject/platform-salt/release/4.0/pillar/services.sls << The following url does not have flink-related settings

building flink-hdp

Java 1.8: OK

shyaml: OK

Apache Maven 3.0.5: OK

Build error

Please determine the reason for the error, correct and re-run

+ export LC_ALL=en_US.utf8

+ LC_ALL=en_US.utf8

+ echo -n 'Java 1.8: '

++ /home/hello/pnda/build/jdk1.8.0_131/bin/javac -version

+ [[ javac 1.8.0_131 != \j\a\v\a\c\ \1\.\8* ]]

+ echo OK

+ echo -n 'shyaml: '

++ which shyaml

+ [[ -z /usr/bin/shyaml ]]

+ echo OK

+ echo -n 'Apache Maven 3.0.5: '

++ mvn -version

+ [[ Apache Maven 3.0.5 (r01de14724cdef164cd33c7c8c2fe155faf9602da; 2013-02-19 22:51:28+0900)

Maven home: /usr/share/apache-maven-3.0.5

Java version: 1.8.0_131, vendor: Oracle Corporation

Java home: /home/hello/pnda/build/jdk1.8.0_131/jre

Default locale: en_US, platform encoding: UTF-8

OS name: "linux", version: "3.10.0-957.5.1.el7.x86_64", arch: "amd64", family: "unix" == *\A\p\a\c\h\e\ \M\a\v\e\n\ \3\.\0\.\5* ]]

+ echo OK

+ [[ PNDA == \P\N\D\A ]]

++ wget -qO- https://raw.githubusercontent.com/pndaproject/platform-salt/release/4.0/pillar/services.sls

++ shyaml get-value flink.release_version

Error: invalid path 'flink.release_version', missing key 'flink' in struct.

+ FLINK_VERSION=

parallel: This job failed:

./build-upstream.sh flink-hdp release/4.0 /home/hello/pnda/build/pnda-dist /home/hello/pnda/build/pnda-stage /home/hello/pnda/build/upstream-builds HDP

Build error

Please determine the reason for the error, correct and re-run

What should I do. Please help.

[Donald Hunter (donaldh)]

Hi,

It looks like you are trying to build release/4.0 but using the master branch of pnda.git. You should clone or checkout pnda.git with the same version tag as you use to build the PNDA components.

I would strongly recommend that you use release/5.0 which is the latest release. A lot of upstream components have had significant updates since release/4.0 and the older versions required by release/4.0 may be missing from distribution mirrors.

 

Hope this helps.

Donald.

--
You received this message because you are subscribed to the Google Groups "PNDA Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to pnda-users+...@googlegroups.com.
To post to this group, send email to pnda-...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/pnda-users/2715f8d3-8a51-4bb7-b7d6-ada96de60b80%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[yongzoo Kim]

Thank you Donald.

I' will try again!! 

2019년 2월 27일 수요일 오후 7시 9분 54초 UTC+9, Donald Hunter 님의 말:

Donald.

To post to this group, send email to pnda...@googlegroups.com.

[yongzoo Kim]

Hi Donald.

I did what you said, but there were other issues.

1. git clone -b release/5.0 https://github.com/pndaproject/pnda.git  << release/5.0 branch clone

2. cd $PNDA_HOME/mirror/

3. sudo su

4. sh create_mirror.sh -d HDP

http://www.apache.org/dist/knox/1.1.0/knox-1.1.0.zip

curl: (22) The requested URL returned error: 404 Not Found

curl: (22) The requested URL returned error: 404 Not Found

curl: (22) The requested URL returned error: 404 Not Found

Failed to download http://www.apache.org/dist/knox/1.1.0/knox-1.1.0.zip after 3 retries

ERROR: Problem while creating misc package mirror

"http://www.apache.org/dist/knox/" not support 1.1.0 version, only 1.2.0 version exists

What should I do?

yjkim0083

2019년 2월 27일 수요일 오후 7시 9분 54초 UTC+9, Donald Hunter 님의 말:

Hi,

Donald.

To post to this group, send email to pnda...@googlegroups.com.

[Donald Hunter (donaldh)]

Hi,

 

I ran into the same issue. There is a new version of Knox and 1.1.0 has been removed from the primary download location. Knox 1.1.0 is still available from archive.apache.org.

 

You can modify mirror/dependencies/pnda-static-file-dependencies.txt to download knox from http://archive.apache.org/dist/knox/1.1.0/knox-1.1.0.zip and the same for the .sha1 file.

 

Hope this helps,

Donald.

To post to this group, send email to pnda-...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/pnda-users/bb4c17fb-c750-42e1-80f3-7473c475e9e0%40googlegroups.com.

[Donald Hunter]

You will also need to change the knox-1.1.0.zip.sha1 URL to knox-1.1.0.zip.sha512

Cheers,
Donald.

To view this discussion on the web visit https://groups.google.com/d/msgid/pnda-users/990A33FA-899A-4DB9-B3BE-FD5BCE18FC3B%40cisco.com.