Kubernetes deployment : can't start the UI pod

Charly Clairmont

unread,

Oct 17, 2019, 1:55:18 AM10/17/19

to CDAP User

Hi,

I follow the tutorial described in this article "CDAP in Kubernetes Deployment Guide" - https://medium.com/cdapio/cdap-in-kubernetes-deployment-guide-7c0777dbc3a6

Unfortunately, I faced an error for the "userinterface" pod (here cdap-test-userinterface-5b4c6d89d8-xfbwv)

kubectl get pods

NAME                                                              READY   STATUS             RESTARTS   AGE
cdap-test-appfabric-79747d7995-4n9cg                              1/1     Running            0          7h36m
cdap-test-logs-0                                                  1/1     Running            0          7h36m
cdap-test-messaging-0                                             1/1     Running            0          7h36m
cdap-test-metadata-b4fff9797-nxmd9                                1/1     Running            0          7h36m
cdap-test-metrics-0                                               1/1     Running            0          7h36m
cdap-test-preview-0                                               1/1     Running            0          7h36m
cdap-test-router-5497446b45-zw8n8                                 1/1     Running            0          7h36m
cdap-test-service-system-pipeline-studio-27b87f57-298f-40a4gpx5   1/1     Running            0          7h4m
cdap-test-userinterface-5b4c6d89d8-jw26w                          0/1     CrashLoopBackOff   7          15m
elasticsearch-master-0                                            1/1     Running            1          7h55m
hadoop                                                            1/1     Running            1          7h42m
postgres-postgresql-0                                             1/1     Running            1          8h

As you can see this pod get a CrashLoopBackOff status.

kubectl describe pod cdap-test-userinterface-5b4c6d89d8-jw26w

Name:         cdap-test-userinterface-5b4c6d89d8-jw26w
Namespace:    default
Priority:     0
Node:         minikube/10.0.2.15
Start Time:   Thu, 17 Oct 2019 07:28:27 +0200
Labels:       cdap.container=cdap-test-userinterface
              cdap.instance=test
              custom-resource=v1alpha1.CDAPMaster
              custom-resource-name=test
              custom-resource-namespace=default
              pod-template-hash=5b4c6d89d8
              using=cdapmaster.UserInterface
Annotations:  <none>
Status:       Running
IP:           172.17.0.12
IPs:
  IP:           172.17.0.12
Controlled By:  ReplicaSet/cdap-test-userinterface-5b4c6d89d8
Containers:
  cdap-test-userinterface:
    Container ID:  docker://84d55a5c548f30b2efe5618af536ecf403adfdaadb8e90094e4c3d7276e2ae95
    Image:         gcr.io/cdapio/cdap:latest
    Image ID:      docker-pullable://gcr.io/cdapio/cdap@sha256:16844ca144e280af759cd6fd0b3a89ea73ff0a9a69f0d78e8e340004c2b37eed
    Port:          <none>
    Host Port:     <none>
    Command:
      bin/node
    Args:
      index.js
      start
    State:          Waiting
      Reason:       CrashLoopBackOff
    Last State:     Terminated
      Reason:       ContainerCannotRun
      Message:      OCI runtime create failed: container_linux.go:345: starting container process caused "exec: \"bin/node\": stat bin/node: no such file or directory": unknown
      Exit Code:    127
      Started:      Thu, 17 Oct 2019 07:44:17 +0200
      Finished:     Thu, 17 Oct 2019 07:44:17 +0200
    Ready:          False
    Restart Count:  8
    Environment:
      NODE_ENV:  production
    Mounts:
      /etc/cdap/conf from cdap-conf (ro)
      /etc/hadoop/conf from hadoop-conf (ro)
      /var/run/secrets/kubernetes.io/serviceaccount from cdap-token-8m7cs (ro)
Conditions:
  Type              Status
  Initialized       True 
  Ready             False 
  ContainersReady   False 
  PodScheduled      True 
Volumes:
  cdap-conf:
    Type:      ConfigMap (a volume populated by a ConfigMap)
    Name:      cdap-test-cconf
    Optional:  false
  hadoop-conf:
    Type:      ConfigMap (a volume populated by a ConfigMap)
    Name:      cdap-test-hconf
    Optional:  false
  cdap-token-8m7cs:
    Type:        Secret (a volume populated by a Secret)
    SecretName:  cdap-token-8m7cs
    Optional:    false
QoS Class:       BestEffort
Node-Selectors:  <none>
Tolerations:     node.kubernetes.io/not-ready:NoExecute for 300s
                 node.kubernetes.io/unreachable:NoExecute for 300s
Events:
  Type     Reason     Age                   From               Message
  ----     ------     ----                  ----               -------
  Normal   Scheduled  <unknown>             default-scheduler  Successfully assigned default/cdap-test-userinterface-5b4c6d89d8-jw26w to minikube
  Normal   Pulling    16m (x5 over 18m)     kubelet, minikube  Pulling image "gcr.io/cdapio/cdap:latest"
  Normal   Pulled     16m (x5 over 18m)     kubelet, minikube  Successfully pulled image "gcr.io/cdapio/cdap:latest"
  Normal   Created    16m (x5 over 18m)     kubelet, minikube  Created container cdap-test-userinterface
  Warning  Failed     16m (x5 over 18m)     kubelet, minikube  Error: failed to start container "cdap-test-userinterface": Error response from daemon: OCI runtime create failed: container_linux.go:345: starting container process caused "exec: \"bin/node\": stat bin/node: no such file or directory": unknown
  Warning  BackOff    2m58s (x66 over 17m)  kubelet, minikube  Back-off restarting failed container

Finally it appears that the "bin/node" file could not be found in the container.

Does the image "gcr.io/cdapio/cdap:latest" is corrupted ? How could I build it ? I don't find the docker file.

Cheers

Ortiz Valmaseda, Marcos Luis

unread,

Oct 17, 2019, 10:58:03 AM10/17/19

to CDAP User

You can find all the docker images here:

https://console.cloud.google.com/gcr/images/cdapio/GLOBAL/cdap?gcrImageListsize=30

De: cdap...@googlegroups.com <cdap...@googlegroups.com> en nombre de Charly Clairmont <cclai...@synaltic.fr>
Enviado: jueves, 17 de octubre de 2019 00:55
Para: CDAP User <cdap...@googlegroups.com>
Asunto: Kubernetes deployment : can't start the UI pod

Este es un correo externo, por eso te pedimos: 1.Verifique el remitente | 2. No descargues adjuntos desconocidos | 3. No ingreses a enlaces sospechosos | 4. Si tienes dudas escribe a correos-s...@intercorp.com.pe

--
You received this message because you are subscribed to the Google Groups "CDAP User" group.
To unsubscribe from this group and stop receiving emails from it, send an email to cdap-user+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/cdap-user/04b53484-13c5-4fe4-9975-1de8a44ff68e%40googlegroups.com.

La información contenida en este correo electrónico es originada por INTERBANK o por sus subsidiarias, es de uso privilegiado, tiene carácter confidencial y sólo puede ser utilizada por la persona a quien ha sido dirigida. Su divulgación, copia y/o adulteración no autorizada está estrictamente prohibida. Si usted no es el destinatario previsto, por favor contáctese con el remitente y elimine el mensaje. Esta comunicación es sólo para propósitos de información y no genera obligación contractual alguna a cargo de INTERBANK.

Ortiz Valmaseda, Marcos Luis

unread,

Oct 17, 2019, 10:59:33 AM10/17/19

to CDAP User

You should try with the minor version:

https://console.cloud.google.com/gcr/images/cdapio/GLOBAL/cdap@sha256:14fd16125b7b46575153226de6ef8257a0591a98abc5f2c6d1ac8d93c66f6f05/details?tab=info

The tutorial is made with that version, not the last one.

De: Ortiz Valmaseda, Marcos Luis <mor...@intercorp.com.pe>
Enviado: jueves, 17 de octubre de 2019 09:57
Para: CDAP User <cdap...@googlegroups.com>
Asunto: RE: Kubernetes deployment : can't start the UI pod

Charly CLAIRMONT

unread,

Oct 17, 2019, 11:52:48 AM10/17/19

to cdap...@googlegroups.com

Hi !

Thanks for this link.

But I want to check why the \"bin/node\" file could not be found. Where could we get the Docker file ? So I could investigate.

Also, the latest image is dated 26th september 2019. Is that image valid ?

Cheers

To view this discussion on the web visit https://groups.google.com/d/msgid/cdap-user/FR1P152MB2871E8586C0FE9CB7DFBF023F36D0%40FR1P152MB2871.LAMP152.PROD.OUTLOOK.COM.

--

-- -- -- -- -- -- -- -- -- -- -- -- -- -- -- --

Charly CLAIRMONT

CTO

Tél : +33 1 55 28 89 40

www : http://synaltic.fr

Twitter : @egwada | @synaltic

Terence Yim

unread,

Oct 17, 2019, 3:54:39 PM10/17/19

to CDAP User

Hi,

Thanks for discovering the issue. Seems like the latest docker image was built with an incorrect Dockerfile (https://github.com/cdapio/cdap-build/blob/release/6.1/Dockerfile). I have fixed the Dockerfile and updated the docker image. Please try again.

Thanks,

Terence

To view this discussion on the web visit https://groups.google.com/d/msgid/cdap-user/CAOZ4%2Be1Utfy0K-aHP7BN99YKX%2B6DQMe%3DXHoLKAMVx%3DDzxcMsag%40mail.gmail.com.

--

Terence Yim | Staff Software Engineer | tere...@google.com |

Charly CLAIRMONT

unread,

Oct 17, 2019, 4:01:43 PM10/17/19

to cdap...@googlegroups.com

Hi !

Nice I try and will keep you informed.

Cheers

To view this discussion on the web visit https://groups.google.com/d/msgid/cdap-user/CAFmsUY1izSbPjOOcyVRy35W_HByd1RRnb8OYcqzev4nbjamyVA%40mail.gmail.com.

Charly Clairmont

unread,

Oct 17, 2019, 6:41:51 PM10/17/19

to CDAP User

Hi !

So now it's working with the updated image.

kubectl get pods

NAME                                                              READY   STATUS    RESTARTS   AGE

cdap-test-appfabric-79747d7995-vg7zc                              1/1     Running   0          78m
cdap-test-logs-0                                                  1/1     Running   0          78m
cdap-test-messaging-0                                             1/1     Running   0          78m
cdap-test-metadata-b4fff9797-52pdl                                1/1     Running   0          78m
cdap-test-metrics-0                                               1/1     Running   0          78m
cdap-test-preview-0                                               1/1     Running   0          78m
cdap-test-router-5497446b45-926q6                                 1/1     Running   0          78m
cdap-test-service-default-yare-service-4fc27738-db94-42cf-g6kdb   1/1     Running   0          66s
cdap-test-service-system-dataprep-service-d204a175-eb7f-42d47ht   0/1     Pending   0          28s
cdap-test-service-system-pipeline-studio-4fa44825-e244-464sczrp   1/1     Running   0          53m
cdap-test-userinterface-5b4c6d89d8-nm762                          1/1     Running   0          78m
elasticsearch-master-0                                            1/1     Running   0          109m
hadoop                                                            1/1     Running   0          101m
postgres-postgresql-0                                             1/1     Running   0          115m

Sélection_032.png

Thanks

Le jeudi 17 octobre 2019 22:01:43 UTC+2, Charly Clairmont a écrit :

Hi !

Nice I try and will keep you informed.

Cheers

Le jeu. 17 oct. 2019 à 21:54, 'Terence Yim' via CDAP User <cdap...@googlegroups.com> a écrit :

Hi,

Thanks for discovering the issue. Seems like the latest docker image was built with an incorrect Dockerfile (https://github.com/cdapio/cdap-build/blob/release/6.1/Dockerfile). I have fixed the Dockerfile and updated the docker image. Please try again.

Thanks,
Terence

On Thu, Oct 17, 2019 at 8:52 AM Charly CLAIRMONT wrote:

Hi !

Thanks for this link.

But I want to check why the \"bin/node\" file could not be found. Where could we get the Docker file ? So I could investigate.
Also, the latest image is dated 26th september 2019. Is that image valid ?

Cheers

Le jeu. 17 oct. 2019 à 16:59, 'Ortiz Valmaseda, Marcos Luis' via CDAP User <cdap...@googlegroups.com> a écrit :

You should try with the minor version:

https://console.cloud.google.com/gcr/images/cdapio/GLOBAL/cdap@sha256:14fd16125b7b46575153226de6ef8257a0591a98abc5f2c6d1ac8d93c66f6f05/details?tab=info

The tutorial is made with that version, not the last one.

De: Ortiz Valmaseda, Marcos Luis

Enviado: jueves, 17 de octubre de 2019 09:57
Para: CDAP User <cdap...@googlegroups.com>
Asunto: RE: Kubernetes deployment : can't start the UI pod

You can find all the docker images here:

https://console.cloud.google.com/gcr/images/cdapio/GLOBAL/cdap?gcrImageListsize=30

De: cdap...@googlegroups.com <cdap...@googlegroups.com> en nombre de Charly Clairmont

Enviado: jueves, 17 de octubre de 2019 00:55
Para: CDAP User <cdap...@googlegroups.com>
Asunto: Kubernetes deployment : can't start the UI pod

Este es un correo externo, por eso te pedimos: 1.Verifique el remitente | 2. No descargues adjuntos desconocidos | 3. No ingreses a enlaces sospechosos | 4. Si tienes dudas escribe a correos-sospechosos@intercorp.com.pe

To unsubscribe from this group and stop receiving emails from it, send an email to cdap-user+unsubscribe@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/cdap-user/04b53484-13c5-4fe4-9975-1de8a44ff68e%40googlegroups.com.

La información contenida en este correo electrónico es originada por INTERBANK o por sus subsidiarias, es de uso privilegiado, tiene carácter confidencial y sólo puede ser utilizada por la persona a quien ha sido dirigida. Su divulgación, copia y/o adulteración no autorizada está estrictamente prohibida. Si usted no es el destinatario previsto, por favor contáctese con el remitente y elimine el mensaje. Esta comunicación es sólo para propósitos de información y no genera obligación contractual alguna a cargo de INTERBANK.

--
You received this message because you are subscribed to the Google Groups "CDAP User" group.

To unsubscribe from this group and stop receiving emails from it, send an email to cdap-user+unsubscribe@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/cdap-user/FR1P152MB2871E8586C0FE9CB7DFBF023F36D0%40FR1P152MB2871.LAMP152.PROD.OUTLOOK.COM.

--
--
-- -- -- -- -- -- -- -- -- -- -- -- -- -- -- --
Charly CLAIRMONT
CTO

Tél : +33 1 55 28 89 40
www : http://synaltic.fr
Twitter : @egwada | @synaltic

--
You received this message because you are subscribed to the Google Groups "CDAP User" group.

To unsubscribe from this group and stop receiving emails from it, send an email to cdap-user+unsubscribe@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/cdap-user/CAOZ4%2Be1Utfy0K-aHP7BN99YKX%2B6DQMe%3DXHoLKAMVx%3DDzxcMsag%40mail.gmail.com.

--
Terence Yim | Staff Software Engineer | |

--

You received this message because you are subscribed to the Google Groups "CDAP User" group.

To unsubscribe from this group and stop receiving emails from it, send an email to cdap-user+unsubscribe@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/cdap-user/CAFmsUY1izSbPjOOcyVRy35W_HByd1RRnb8OYcqzev4nbjamyVA%40mail.gmail.com.

Terence Yim

unread,

Oct 17, 2019, 7:37:38 PM10/17/19

to cdap...@googlegroups.com

I am glad that it is working now.

Terence

Este es un correo externo, por eso te pedimos: 1.Verifique el remitente | 2. No descargues adjuntos desconocidos | 3. No ingreses a enlaces sospechosos | 4. Si tienes dudas escribe a correos-s...@intercorp.com.pe

To unsubscribe from this group and stop receiving emails from it, send an email to cdap-user+...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/cdap-user/04b53484-13c5-4fe4-9975-1de8a44ff68e%40googlegroups.com.

La información contenida en este correo electrónico es originada por INTERBANK o por sus subsidiarias, es de uso privilegiado, tiene carácter confidencial y sólo puede ser utilizada por la persona a quien ha sido dirigida. Su divulgación, copia y/o adulteración no autorizada está estrictamente prohibida. Si usted no es el destinatario previsto, por favor contáctese con el remitente y elimine el mensaje. Esta comunicación es sólo para propósitos de información y no genera obligación contractual alguna a cargo de INTERBANK.

--
You received this message because you are subscribed to the Google Groups "CDAP User" group.

To unsubscribe from this group and stop receiving emails from it, send an email to cdap-user+...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/cdap-user/FR1P152MB2871E8586C0FE9CB7DFBF023F36D0%40FR1P152MB2871.LAMP152.PROD.OUTLOOK.COM.

--
--
-- -- -- -- -- -- -- -- -- -- -- -- -- -- -- --
Charly CLAIRMONT
CTO

Tél : +33 1 55 28 89 40
www : http://synaltic.fr
Twitter : @egwada | @synaltic

--
You received this message because you are subscribed to the Google Groups "CDAP User" group.

To unsubscribe from this group and stop receiving emails from it, send an email to cdap-user+...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/cdap-user/CAOZ4%2Be1Utfy0K-aHP7BN99YKX%2B6DQMe%3DXHoLKAMVx%3DDzxcMsag%40mail.gmail.com.

--
Terence Yim | Staff Software Engineer | |

--
You received this message because you are subscribed to the Google Groups "CDAP User" group.

To unsubscribe from this group and stop receiving emails from it, send an email to cdap-user+...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/cdap-user/CAFmsUY1izSbPjOOcyVRy35W_HByd1RRnb8OYcqzev4nbjamyVA%40mail.gmail.com.

--
--
-- -- -- -- -- -- -- -- -- -- -- -- -- -- -- --
Charly CLAIRMONT
CTO

Tél : +33 1 55 28 89 40
www : http://synaltic.fr
Twitter : @egwada | @synaltic

--
You received this message because you are subscribed to the Google Groups "CDAP User" group.

To unsubscribe from this group and stop receiving emails from it, send an email to cdap-user+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/cdap-user/6fecf8fe-d7e5-48bd-8f12-4cc57e3c9271%40googlegroups.com.

--

Terence Yim | Staff Software Engineer | tere...@google.com |

Reply all

Reply to author

Forward