how to increase the nodes in data proc cluster more than 4 nodes

217 views
Skip to first unread message

mohammed alhayani

unread,
Oct 14, 2020, 11:22:08 AM10/14/20
to Google App Engine
Hello every body
After creating cluster by data proc
I have not been able to add nodes in data proc cluster for more than four node
it says 4 available so if there is any ideas or ways to create cluster with multi nodes  with 10 or 20 nodes 
help me please 

  

Jun Lu

unread,
Oct 15, 2020, 3:56:47 PM10/15/20
to Google App Engine
Hi, 

From the documentation of Using Scaling at [1], there does not seem to have limitations of more than 4 in terms of number of nodes mentioned for scaling up worker nodes at Dataproc. 

Do you have more details about the behavior you're encountering such as screenshots or etc?  

mohammed alhayani

unread,
Oct 16, 2020, 12:33:36 PM10/16/20
to google-a...@googlegroups.com
I got this 

‫في الخميس، 15 أكتوبر 2020 في 10:57 م تمت كتابة ما يلي بواسطة ‪'Jun Lu' via Google App Engine‬‏ <‪google-a...@googlegroups.com‬‏>:‬
--
You received this message because you are subscribed to the Google Groups "Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-appengi...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/50548d2c-dae8-422d-b8e2-4072cdda6a05n%40googlegroups.com.
Untitled.png

holoubi

unread,
Oct 18, 2020, 3:43:00 PM10/18/20
to Google App Engine
Hi,

From the error message attached, 

- Quota limit for CPUS; is the “Compute Engine API CPUs” [1].

- Quota limit for "IN_USE_ADDRESSES";  indicates that you are reaching your “Compute Engine API In-use IP addresses” [2].

- Quota limit for "DISKS_TOTAL_GB"; means that you are reaching is the “Persistent Disk Standard (GB)” [3] which is the total size of standard persistent disk.

To increase your quota you can use the quota page by clicking on the “Edit Quotas” button [4].

Reply all
Reply to author
Forward
0 new messages