T2D instances not appearing in YARN

20 views
Skip to first unread message

Amir Shukayev

unread,
Dec 19, 2023, 10:41:57 PM12/19/23
to Google Cloud Dataproc Discussions
When creating a dataproc cluster, the machines are not visible in yarn for spark jobs. This is the command to repro:

```
gcloud dataproc clusters create test \
  --image-version 2.2-debian \
  --region us-central1 \
  --worker-machine-type t2d-standard-8 \
  --num-workers 100 \
  --enable-component-gateway
```

And the machines are created, i can ssh into the machines that are not in the YARN cluster, they work properly, and I can even ping the `test-m` machine, but doing `yarn nodes -list` starts timing out.
Reply all
Reply to author
Forward
0 new messages