The data fusion stuck in provisioning state while running the pipeline and not deleting later.

728 views
Skip to first unread message

Sumati Jain

unread,
Sep 4, 2019, 4:08:02 PM9/4/19
to CDAP User
I am trying to run a simple pipeline with data fusion but its dataproc cluster stuck while provisioning and pipeline execution failed. Later I updated the networking configurations to all the internal communications and incoming request on port 22 but that didn't help. Finally I was trying to delete the data fusion instance and that is also not working, it is just showing the deleting in the action column but stuck in the same state since hours.

Please let me know how to delete the data fusion instance for this issue.

Sagar Kapare

unread,
Sep 4, 2019, 5:29:51 PM9/4/19
to sumat...@oddschecker.com, cdap...@googlegroups.com
Hi Sumati,

Can you share the pipeline logs or Dataproc cluster stack driver logs to debug the pipeline stuck issue?
Regarding the deletion issue, do you see the instance is still in running state? Are you able to access the CDF UI, view pipelines etc. after attempting deletion?

Also this user group is for open source CDAP questions. Can you please post CDF related questions on the stack overflow with the tag google-cloud-data-fusion?
Thanks and Regards,
Sagar

On Wed, Sep 4, 2019 at 1:08 PM Sumati Jain <sumat...@oddschecker.com> wrote:
I am trying to run a simple pipeline with data fusion but its dataproc cluster stuck while provisioning and pipeline execution failed. Later I updated the networking configurations to all the internal communications and incoming request on port 22 but that didn't help. Finally I was trying to delete the data fusion instance and that is also not working, it is just showing the deleting in the action column but stuck in the same state since hours.

Please let me know how to delete the data fusion instance for this issue.

--
You received this message because you are subscribed to the Google Groups "CDAP User" group.
To unsubscribe from this group and stop receiving emails from it, send an email to cdap-user+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/cdap-user/1f6dede3-7ba4-4ba7-9f5f-61558e2a08d8%40googlegroups.com.

Jay Shah

unread,
Jan 11, 2022, 8:09:00 PM1/11/22
to CDAP User

@Sumati Any update on how did you delete the cluste. Same case for me, data fusion instance stuck in deleting state

viann bono

unread,
Jul 21, 2023, 6:21:41 PM7/21/23
to CDAP User
Experiencing the same, apparently 2 pipelines have been stuck in provisioning mode since early April. Can't delete or stop them
Reply all
Reply to author
Forward
0 new messages