voltha 2.3.0 stuck in loop in "wait for pods" of voltha core

[Giuseppe Longo]

Hi,

I've been struggling with trying to install voltha 2.3 with kind-voltha using informtation into README:

git checkout tags/3.0.3 -b 3.0.3

source releases/voltha-2.3 

At first we noticed that in voltha script the variabile VK_RELEASE was still set to 'master', so many urls didn't work 

After setting by hand VK_RELEASE=3.0.3 we managed to carry on the installation, but now we are stuck into section:

 "✓  Waiting for VOLTHA Core to start"

Seems that the method "wait_for_pods()" is in loop when called by:

VOLTHA="voltha-ofagent-.* \

    rw-core.* \

    voltha-etcd-cluster-.* \

    voltha-kafka-.* \

    voltha-zookeeper-.*"

wait_for_pods - "voltha" $EXPECT "includes" -1 "Waiting for VOLTHA Core to start" $VOLTHA

any idea?

thank you

giuseppe 

[David Bainbridge]

please look in the install log (install-minimal.log). Is there an error in that log file at the end while the loop continues?

--
You received this message because you are subscribed to the Google Groups "VOLTHA Discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to voltha-discus...@opencord.org.
To view this discussion on the web visit https://groups.google.com/a/opencord.org/d/msgid/voltha-discuss/b35763e9-771a-4e5c-bb83-f95904d03b62o%40opencord.org.

[Giuseppe Longo]

I solved this way, but still have problem with voltctl that happened to be 'latest' despite the '2.3.0' installation, does someone know what version of voltctl is suitable for voltha 2.3.0?

By the way I noticed that the command

source releases/voltha-2.3

export some enviroment variables suitable with 2.3.0 version of voltha, but during installation voltha script ignore those values, and use default latest values, so I had to write them on the script explicitly, i.e:

VOLTHA_CHART_VERSION=2.3.1

VOLTHA_BBSIM_CHART_VERSION=3.0.18

VOLTHA_ADAPTER_OPEN_OLT_CHART_VERSION=2.3.1

VOLTHA_ADAPTER_OPEN_ONU_CHART_VERSION=2.3.0

ONOS_CHART_VERSION=3.0.1

EXTRA_HELM_FLAGS="--set defaults.image_tag=null,images.onos.tag=4.0.2 "

Beside this I had explicity define

VK_RELEASE=3.0.3

As I said before, the installation is complete but voltctl doesn't work, any command is pending, I think because the script installed the latest version, what version is to be set?

thank you

On Wednesday, June 17, 2020 at 4:09:29 PM UTC+2, David Bainbridge wrote:

please look in the install log (install-minimal.log). Is there an error in that log file at the end while the loop continues?

On Wed, Jun 17, 2020 at 3:45 AM 'Giuseppe Longo' via VOLTHA Discuss <voltha-...@opencord.org> wrote:

Hi,

I've been struggling with trying to install voltha 2.3 with kind-voltha using informtation into README:

git checkout tags/3.0.3 -b 3.0.3

source releases/voltha-2.3 

At first we noticed that in voltha script the variabile VK_RELEASE was still set to 'master', so many urls didn't work 

After setting by hand VK_RELEASE=3.0.3 we managed to carry on the installation, but now we are stuck into section:

 "✓  Waiting for VOLTHA Core to start"

Seems that the method "wait_for_pods()" is in loop when called by:

VOLTHA="voltha-ofagent-.* \

    rw-core.* \

    voltha-etcd-cluster-.* \

    voltha-kafka-.* \

    voltha-zookeeper-.*"

wait_for_pods - "voltha" $EXPECT "includes" -1 "Waiting for VOLTHA Core to start" $VOLTHA

any idea?

thank you

giuseppe 

--
You received this message because you are subscribed to the Google Groups "VOLTHA Discuss" group.

To unsubscribe from this group and stop receiving emails from it, send an email to voltha-...@opencord.org.

[David Bainbridge]

A couple of things to check.

- are the port-forwards running (ps -ef | grep port-forward). In particular is there one to the voltha-api server

- what is the config for voltctl `echo $VOLTCONIG` as well as `voltctl config`

To unsubscribe from this group and stop receiving emails from it, send an email to voltha-discus...@opencord.org.
To view this discussion on the web visit https://groups.google.com/a/opencord.org/d/msgid/voltha-discuss/24c5e608-edfb-4589-adfa-db1eb7b835b1o%40opencord.org.

[David Bainbridge]

ok. did a `DEPLOY_K8S=y ./voltha up` with the following environment settings and things seemed to have worked. The setting are a combination of my existing setting and then i sources the 2.3 values. i did not have to modify `VK_VERSION`.

export ADAPTER_NS="default"
export BBSIM_NS="default"
export BBSIM_SADIS_SERVER_CHART="bbsim-sadis/bbsim-sadis-server"
export BBSIM_SADIS_SERVER_CHART_VERSION="latest"
export CONFIG_SADIS="external"
export DEPLOY_K8S="no"
export DEV="onf"
export ENABLE_ONOS_EXTRANEOUS_RULES="no"
export ETCD_CHART="incubator/etcd"
export ETCD_CHART_VERSION="latest"
export EXTRA_HELM_FLAGS="--set defaults.image_tag=null,images.onos.tag=4.0.2"
export HELM_USE_UPGRADE="no"
export HELM_VERSION="v2.14.3"
export INFRA_NS="default"
export INSTALL_HELM="yes"
export INSTALL_KUBECTL="yes"
export INSTALL_ONOS_APPS="no"
export JUST_K8S="no"
export KAFKA_CHART="incubator/kafka"
export KAFKA_CHART_VERSION="0.15.3"
export KIND_VERSION="v0.5.1"
export KUBECONFIG="/home/ubuntu/.kube/kind-config-voltha-minimal"
export LEGACY_BBSIM_INDEX="yes"
export NAME="minimal"
export NUM_OF_ATOMIX="3"
export NUM_OF_BBSIM="1"
export NUM_OF_ONOS="2"
export NUM_OF_OPENONU="1"
export OFAGENT_PPROF_PORT="6062"
export ONOS_API_PORT="8181"
export ONOS_CHART="onf/onos"
export ONOS_CHART_VERSION="3.0.1"
export ONOS_CLASSIC_CHART="onos/onos-classic"
export ONOS_CLASSIC_CHART_VERSION="latest"
export ONOS_SSH_PORT="8101"
export OPENOLT_PPROF_PORT="6061"
export RADIUS_CHART="/home/ubuntu/src/helm-charts/freeradius"
export RADIUS_CHART_VERSION="latest"
export SADIS="bbsim-sadis"
export SADIS_BANDWIDTH_PROFILES="http://bbsim.voltha.svc:50074/v2/bandwidthprofiles/%s"
export SADIS_CFG="onos-files/onos-sadis-sample.json"
export SADIS_SUBSCRIBERS="http://bbsim.voltha.svc:50074/v2/subscribers/%s"
export SCHEDULE_ON_CONTROL_NODES="yes"
export TYPE="minimal"
export UPDATE_HELM_REPOS="yes"
export VK_RELEASE="master"
export VOLTCONFIG="/home/ubuntu/.volt/config-minimal"
export VOLTCTL_VERSION="1.0.18"
export VOLTHA_ADAPTER_OPEN_OLT_CHART="onf/voltha-adapter-openolt"
export VOLTHA_ADAPTER_OPEN_OLT_CHART_VERSION="2.3.2"
export VOLTHA_ADAPTER_OPEN_ONU_CHART="onf/voltha-adapter-openonu"
export VOLTHA_ADAPTER_OPEN_ONU_CHART_VERSION="2.3.0"
export VOLTHA_ADAPTER_SIM_CHART="onf/voltha-adapter-simulated"
export VOLTHA_ADAPTER_SIM_CHART_VERSION="latest"
export VOLTHA_API_PORT="55555"
export VOLTHA_BBSIM_CHART="onf/bbsim"
export VOLTHA_BBSIM_CHART_VERSION="3.0.18"
export VOLTHA_CHART="onf/voltha"
export VOLTHA_CHART_VERSION="2.3.2"
export VOLTHA_DOWN_ON_TIMEOUT="no"
export VOLTHA_ETCD_PORT="2379"
export VOLTHA_KAFKA_PORT="9092"
export VOLTHA_LOG_LEVEL="WARN"
export VOLTHA_NS="voltha"
export VOLTHA_PPROF_PORT="6060"
export VOLTHA_SSH_PORT="5022"
export WAIT_ON_DOWN="yes"
export WAIT_TIMEOUT="30m"
export WITH_ADAPTERS="yes"
export WITH_BBSIM="yes"
export WITH_CHAOS="no"
export WITH_DHCP="yes"
export WITH_EAPOL="yes"
export WITH_ETCD="yes"
export WITH_IGMP="no"
export WITH_INCREMENTAL_EVTO_UPDATE="no"
export WITH_KAFKA="yes"
export WITH_ONOS="legacy"
export WITH_OPEN_ADAPTERS="yes"
export WITH_PORT_FORWARDS="yes"
export WITH_PPROF="no"
export WITH_RADIUS="yes"
export WITH_SIM_ADAPTERS="no"
export WITH_TIMINGS="no"

[Giuseppe Longo]

It works now, thank for your help

I forgot to "source minimal-env.sh", and voltctl was pending

Anyway, I'm trying to share now what I had to do to have a complete successfull installation of voltha2.3.0

1.

I still need to specify VK_RELEASE=3.0.3 in voltha script (after checkout 3.0.3) otherwise these links fail:

https://raw.githubusercontent.com/ciena/kind-voltha/$VK_RELEASE/$TYPE-cluster.cfg
https://raw.githubusercontent.com/ciena/kind-voltha/$VK_RELEASE/$TYPE-values.yaml
https://raw.githubusercontent.com/ciena/kind-voltha/$VK_RELEASE/$i
https://raw.githubusercontent.com/ciena/kind-voltha/$VK_RELEASE/onos-files/$i

they wouldn't fail if I used the master "voltha script", because the links would have 'opencord' instead o 'ciena' in their url

i.e: 

try

https://raw.githubusercontent.com/ciena/kind-voltha/master/minimal-values.yaml

it fails

try

https://raw.githubusercontent.com/ciena/kind-voltha/3.0.3/minimal-values.yaml

it works

try the same links with 'opencord' instead of 'ciena', they both work in "master voltha script"

2.

Beside this, I also need to specify into voltha script (3.0.3) the following values, otherwise they are always set to latest even though I made

source releases/voltha-2.3 

these are the values explicitily set into voltha script (3.0.3)

VOLTHA_CHART_VERSION=2.3.1

VOLTHA_BBSIM_CHART_VERSION=3.0.18

VOLTHA_ADAPTER_OPEN_OLT_CHART_VERSION=2.3.1

VOLTHA_ADAPTER_OPEN_ONU_CHART_VERSION=2.3.0

ONOS_CHART_VERSION=3.0.1

EXTRA_HELM_FLAGS="--set defaults.image_tag=null,images.onos.tag=4.0.2 "

By the way, this is my personal experience about I managed to get a successfull voltha2.3.0 installation

Thank David for your support, I appreciated it

Giuseppe